Persistent VMs are now available.Learn more

Fine-tune models on GPUs

Fine-tune LLMs and diffusion models on H100s and other GPUs. Decorate your training function, run the file, and Beam handles the GPUs, storage, and scaling.

Fine-tuning without wrangling GPUs

Bring your LoRA, QLoRA, or other training code, and Beam runs the compute.


Launch a training job

  1. Upload weights and data to a volume

    Create a volume and download your base model and dataset.

  2. Run training with one decorator

    Wrap your training loop in @function, declare the GPU inline, and run the file. Beam streams logs to your terminal.

  3. Serve the result

    Point an endpoint at the fine-tuned weights in the same volume and deploy it as an autoscaling API.

terminal
# 1. Create a volume and stage weights + data
$ beam volume create gemma-ft
$ python upload.py   # snapshot_download() into the volume

# 2. Kick off training on an H100
$ python finetune.py
=> Running function: <finetune:fine_tune>
{'loss': 1.617, 'epoch': 0.01}
...
=> Function complete

# 3. Inspect the artifacts
$ beam ls gemma-ft/gemma-2b-finetuned
adapter_config.json
adapter_model.safetensors

Frequently asked questions

Which fine-tuning methods work?

Anything that runs in PyTorch: LoRA and QLoRA with PEFT, Unsloth, TRL, or your own training loop. Beam provides the managed GPU runtime, and the framework is up to you.

Do I pay when I'm not training?

For serverless, compute billing is per-second and stops when the run ends. Storage is not billed yet. Planned: $0.0001 per GB-hour of data stored, with no free allowance.

Where do my checkpoints go?

To a persistent storage volume mounted into the container. Inspect files with beam ls, download them, or serve them directly from an inference endpoint.

Can I fine-tune gated models like Llama or Gemma?

Yes. Save your Hugging Face token with beam secret create HF_TOKEN, and the container can pull gated repos securely.

What GPUs can I train on?

T4s and A10Gs up through B200s and B300s. Pick the GPU in the decorator and change it any time with one line.

Pay as you go
billed by the second

Give your agents their own machines

Sign up, install the CLI, and launch a sandbox, VM, or GPU from your terminal or your coding agent.