Persistent VMs are now available.Learn more

Serve embedding models for your RAG stack

Host embedding and reranking models on your own autoscaling endpoints instead of per-token third-party APIs. Beam runs the GPUs; your RAG pipeline just calls HTTPS.

Host each part of your retrieval stack

Deploy embeddings, rerankers, and the LLM itself from Python, and scale each one independently.


Stand up retrieval in three steps

  1. Wrap your embedding model

    A few lines turn any sentence-transformers model into an endpoint definition with a GPU attached.

  2. Deploy it

    beam deploy gives you an authenticated HTTPS URL that autoscales with query volume.

  3. Point your pipeline at it

    Call it for query-time embeddings, and use .map() to backfill your corpus in parallel.

terminal
$ beam deploy app.py:embed
=> Deployed 🎉
=> https://embeddings-abc123.app.beam.cloud

# Backfill your corpus in parallel
from beam import function

@function(gpu="T4")
def embed_chunk(chunk: list):
    return model.encode(chunk).tolist()

for vectors in embed_chunk.map(chunks):
    index.upsert(vectors)

Frequently asked questions

Which embedding models work?

Any model sentence-transformers or transformers can load, including BGE, GTE, E5, and your own fine-tuned variants.

Do I need a specific vector database?

No. Beam serves the compute. Your endpoint returns vectors, and you store them anywhere: Postgres with pgvector, Pinecone, Qdrant, or your own index.

How do I keep query latency low?

Models load once per container with on_start, and keep_warm_seconds keeps containers hot so query-time embeddings skip the cold path entirely.

Can I host the LLM side of RAG too?

Yes. Run an OpenAI-compatible vLLM server on Beam next to your embedding endpoint, so the whole stack lives on one platform.

Can I serve a fine-tuned embedding model?

Yes. Load weights from a persistent volume or the Hugging Face Hub exactly like any other model. Fine-tune it on Beam too, if you like.

Pay as you go
billed by the second

Give your agents their own machines

Sign up, install the CLI, and launch a sandbox, VM, or GPU from your terminal or your coding agent.