Discussion about this post

User's avatar
Taylor Arndt's avatar

Loved this! I have done some fine-tuning myself and the waiting game is so real.

Good news on your CLI wish: Google released a Colab CLI in June that agents can control directly. You can spin up a GPU, run your script, and download the results all from the terminal, and it works with Claude Code too: https://developers.googleblog.com/introducing-the-google-colab-cli/

On the Mac side, it really depends on the Mac and the model. Apple's MLX framework lets you do LoRA fine-tuning on smaller models right on Apple silicon, and the more unified memory you have, the bigger you can go. It is not the right fit for every job, but it is great for quick tests before paying for cloud time.

RunPod is another good option and you get a lot of GPU choices. A couple of ways to save money there:

Community Cloud uses GPUs hosted by individual providers instead of RunPod's own data centers. It is usually cheaper, but reliability can vary.

Spot pods are even cheaper, but your run can get interrupted if someone else needs that GPU. If you go that route, have your training save checkpoints often so you can pick up where you left off instead of starting over. With 15 minute runs that might not matter much, but for longer jobs it is a lifesaver.

If you need a run to finish no matter what, pay a little more for an on-demand pod.

Ready for more?