Skip to content

Providers Overview

ModelReins supports 7 providers out of the box. Each worker can be configured to use one or more providers, and the routing system can direct jobs to the best provider based on cost, speed, or capability.

ProviderAPI Key RequiredCost TierBest ForLocal/Cloud
ClaudeYes$$Complex reasoning, code generationCloud
OpenAIYes$$General purpose, embeddings, visionCloud
GeminiYes$Long context, multimodal, free tier availableCloud
OllamaNoFreePrivacy, offline work, zero costLocal
LM StudioNoFreeHigh-volume local, GUI model managementLocal
OpenRouterYes$–$$$Model variety, fallback routingCloud
1minAIYes$Budget batch processing, simple tasksCloud
  • Free — No API costs. Hardware electricity only. Ollama and LM Studio run entirely on your machine.
  • $ — Under $0.01 per typical job. Gemini free tier, 1minAI, and OpenRouter with budget models.
  • $$ — $0.01–$0.10 per job. Claude Haiku, GPT-4o-mini, Gemini Pro.
  • $$$ — $0.10+ per job. Claude Opus, GPT-4o, Gemini Ultra. Reserved for complex tasks.

Start local. Install Ollama, pull llama3.2, and run your first jobs at zero cost. This validates your setup without touching a credit card.

Add a cloud provider for quality. When you need better output — complex code, nuanced summaries — add Claude or OpenAI. Use routing rules to send only the jobs that need it.

Use OpenRouter as a fallback. It aggregates dozens of models and handles rate limits across providers. Good insurance for production workloads.

Mix and match. A single ModelReins deployment can use all 7 providers simultaneously. Route cheap jobs to local models, complex jobs to Claude, and everything else to the best price/performance ratio on OpenRouter.

Every provider is configured through environment variables or the modelreins.config.json file:

Terminal window
# Set the default provider
export MODELREINS_PROVIDER=ollama
# Or configure per-worker
modelreins worker start --provider claude --name cloud-worker
modelreins worker start --provider ollama --name local-worker

See each provider’s page for specific setup instructions.