· Model provider/ What thinks

Ollama

Ollama is a model provider option for building AI agents. Open-weight models on your own machine. Nothing leaves the box.

Open source · can be self-hosted · SDKs for TypeScript and Python · by Ollama · verified 2026-08-21

Official docsAdd to a stackAll model provider options
· When to reach for it/ Fit
  • You are choosing a model provider component — what thinks.
  • You need to run it on your own infrastructure, or your procurement process requires source access.
  • You want to start without a commercial conversation.
· What it takes to run/ Setup
Install
brew install ollama
· Ollama vs the alternatives/ 12 others
OptionWhat it doesLicenceSelf-host
OllamaOpen-weight models on your own machine. Nothing leaves the box.Open sourceYes
AnthropicClaude Opus, Sonnet and Haiku. Strong tool use and long-horizon agentic work.ProprietaryNo
OpenAIGPT and o-series via the Responses API.ProprietaryNo
Google GeminiGemini models with very long context and native multimodality.ProprietaryNo
Amazon BedrockFrontier models inside your AWS account, with IAM and VPC boundaries.ProprietaryNo
Google Vertex AIClaude and Gemini under GCP billing, IAM and regional controls.ProprietaryNo
DeepSeekStrong reasoning and coding at a fraction of frontier pricing, with the weights published so you can move off the API later.ProprietaryNo
OpenRouterOne API key, several hundred models, automatic failover.ProprietaryNo
Hugging FaceOne OpenAI-compatible endpoint routed across Groq, Together, Fireworks, Cerebras and Replicate — with the open-weight catalogue behind it.ProprietaryNo
Venice AIHosted open-weight inference with no prompt logging or retention, plus an anonymising proxy in front of the frontier APIs.ProprietaryNo
LiteLLMSelf-hosted proxy that speaks one API to 100+ providers, with keys and budgets.Open sourceYes
GroqOpen-weight models at very low latency.ProprietaryNo
vLLMHigh-throughput open-weight serving on your own GPUs.Open sourceYes
· For agents/ This page, machine-readable

Every page here answers to Accept: text/markdown and returns the same content at roughly a tenth the tokens. No separate site, no toggle — same URL.

curl -s -H "Accept: text/markdown" https://newagent.build/c/ollama