Skip to main content

Bring your own model

Point RAGSuite at OpenAI, Anthropic, Mistral, Google Gemini, or fully local Custom LLM / Ollama. Switch per project. Your data stays on your infrastructure.

RAGSuite is model-agnostic. You choose frontier APIs with your own keys, EU-oriented providers, or keep inference on-premise with Ollama. The product does not lock you to one vendor, and your corpus does not train someone else’s model. How to choose
  • Need hosted quality quickly → curated providers with bring-your-own keys.
  • Need zero egress / air-gapped → Ollama (or another OpenAI-compatible local endpoint).
  • Mix both → switch per project as requirements change.

Use curated chat and embedding catalogs — your keys, your perimeter. Local Ollama when you need air-gapped inference.

ProvidersOllama

​
In this section

Providers

OpenAI, Anthropic, Mistral, Gemini, and custom endpoints.

Ollama & air-gapped

Local models with no outbound LLM traffic.

Bring your own keys

Store API keys on your stack — not in a shared cloud tenancy.