Skip to content
The Agents Index

LiteLLM

Self-hosted open-source gateway that puts models, agents and MCP tools behind one API.

LiteLLM is an open-source AI gateway and Python SDK for routing model, agent and MCP requests through an OpenAI-compatible interface. It is self-hosted, letting platform teams apply access controls, budgets and routing across their AI infrastructure.

Best for
Platform teams operating production AI across models, agents and MCP tools

What we checked

Pages last read
Facts checked
21 factsFrom 12 sources
AI answers
Named in 0 of 151Our October check

What we checked on LiteLLM

YesPartlyNo

How much it does unattendedYes

Agent permissions

The gateway controls MCP tool access by key and team, so an agent receives only permitted tools.

You control access to each tool by key and by team. An agent gets only the tools that you permit.

litellm.ai/aboutChecked

Which models it runs onYes

Open models

LiteLLM supports locally run and self-hosted model providers including Ollama, vLLM, LM Studio, and Llamafile.

## Self-Hosted & Local - Ollama - vLLM - LM Studio - Llamafile

docs.litellm.ai/docs/providersChecked

Which models it runs onYes

Model choice

Buyers select a provider-prefixed model name, while the same request format works from both the Python SDK and gateway.

Set the model as <prefix>/<model-name>, for example anthropic/claude-sonnet-5, and the same request works from the Python SDK and the Gateway.

docs.litellm.ai/docs/providersChecked

Whose machine it runs onYes

Self-hosted

The free gateway is intended for self-hosting, and the vendor also documents air-gapped deployment for Enterprise customers.

The open-source gateway is free to self-host, forever.

litellm.ai/pricingChecked

Whose machine it runs onYes

Open-source runtime

A buyer can run the open-source gateway indefinitely on its own infrastructure without needing a LiteLLM account or license fee.

Yes. Self-host LiteLLM OSS with no license fee, forever.

litellm.ai/pricingChecked

Whose machine it runs onYes

Runs in your cloud

The gateway supports deployment in a buyer's AWS, Google Cloud, Azure, or Kubernetes environment using Helm and Terraform paths.

Production deployment guide for LiteLLM on AWS, Google Cloud, Azure, or any Kubernetes cluster.

docs.litellm.ai/docs/proxy/deployChecked

Building with itYes

SDK languages

Python is LiteLLM's native SDK language; non-Python applications access the gateway through OpenAI-compatible client interfaces.

Python SDK: uv add litellm

docs.litellm.ai/docsChecked

Building with itYes

Tracing and evals

Each request gets a unique call identifier and can send input, output, and exception information to supported logging systems.

LiteLLM generates a unique call_id for each request. This call_id can be used to track the request across the system.

docs.litellm.ai/docs/proxy/loggingChecked

What it costs to runPartly

How it meters

The OSS gateway has no license fee, while Enterprise is an annual quote based on request capacity, deployment architecture, and support needs.

Enterprise pricing is sized to your annual gateway request capacity, deployment architecture, and support needs — never per token.

litellm.ai/pricingChecked

What it costs to runPartly

Cost of one job

LiteLLM adds no gateway fee to model spend, but it does not publish a per-job price because underlying model providers bill separately.

LiteLLM adds no fee to your model cost.

litellm.ai/aboutChecked

What it costs to runYes

Free tier

The open-source gateway is a standing free tier, self-hosted with no license fee, covering virtual keys, budgets, spend tracking, fallbacks and Prometheus metrics; a separate 30-day Enterprise trial key exists on top.

Is the open-source version really free for production? Yes. Self-host LiteLLM OSS with no license fee, forever.

litellm.ai/pricingChecked

What it costs to runYes

MCP server

The gateway acts as an MCP gateway: it fronts MCP servers over streamable HTTP, SSE and stdio, lists and calls their tools, and scopes access by key, team or organization. stdio needs a flag set at startup.

LiteLLM Proxy provides an MCP Gateway that allows you to use a fixed endpoint for all MCP tools and control MCP access by Key, Team.

docs.litellm.ai/docs/mcpChecked

What it costs to runYes

Bring your own key

Deployments retain provider keys in their own infrastructure instead of sharing a vendor-managed inference credential.

Nobody shares provider keys.

litellm.ai/aboutChecked

Buying it for a teamYes

A company can buy it

Organizations can obtain an Enterprise license directly or through cloud marketplaces and authorized resellers for production deployments.

Direct, or through AWS Marketplace and authorized resellers if that fits your procurement.

litellm.ai/pricingChecked

Buying it for a teamPartly

Seat model

The vendor publishes no per-seat price; it offers SSO free for up to five users and requires Enterprise licensing beyond that threshold.

SSO is free for up to 5 users; beyond that, an Enterprise license is required.

docs.litellm.ai/docs/enterpriseChecked

Buying it for a teamYes

Pooled budget

Team virtual keys can draw from a shared team budget, while optional member budgets set individual limits inside that pool.

Team budgets: Add team_id to virtual keys to draw on a team's shared budget

docs.litellm.ai/docs/proxy/usersChecked

Buying it for a teamYes

Admin controls

Administrators can assign scoped organization and team roles, then constrain budgets, rates, models, and member permissions.

Team admins manage keys, models, and budgets per project, tag, and model without the master key

docs.litellm.ai/docs/enterpriseChecked

Buying it for a teamPartly

Audit log

Enterprise records creation, updates, deletion, and regeneration of keys, teams, users, and models, rather than exposing this as an OSS entitlement.

LiteLLM Enterprise feature. Requires an Enterprise license (LITELLM_LICENSE).

docs.litellm.ai/docs/proxy/audit_logsChecked

Buying it for a teamPartly

Single sign-on

The Admin UI supports SSO for up to five users without charge, while larger deployments require an Enterprise license.

From v1.76.0, SSO is free for up to 5 users. Beyond that, an enterprise license is required.

docs.litellm.ai/docs/proxy/admin_ui_ssoChecked

What happens to your codeYes

Data residency

Self-hosted deployments keep processed data in the buyer's infrastructure, so the chosen deployment location determines residency.

Any data generated or processed remains entirely within your own infrastructure.

docs.litellm.ai/docs/data_securityChecked

What happens to your codeYes

Certifications

LiteLLM states that it is SOC 2 Type II audited, with the current report available through its Trust Center.

SOC 2 Type II. Our current report is available through the LiteLLM Trust Center.

docs.litellm.ai/docs/data_securityChecked

LiteLLM price and terms

Terms

Free plan
YesYesOpen-source, self-hosted gateway
The terms in full

free forever with no license fee. Underlying model-provider usage is separate.

What needs a higher plan

Enterprise
Audit log

For AI agents

MCP server
Yes
LiteLLM's pricing page

Pricing page, captured

litellm.ai/pricing, checked

LiteLLM alternatives

All 2 alternatives

Questions about LiteLLM

How much does LiteLLM cost?
LiteLLM is free to use. From litellm.ai/pricing, checked 29 October 2026.
Does LiteLLM have an API or an MCP server?
It has an MCP server.
Is LiteLLM open source, and can you host it yourself?
You can host it yourself.
What have we checked on LiteLLM?
21 facts, under these headings: How much it does unattended, which models it runs on, whose machine it runs on, building with it, what it costs to run, buying it for a team, what happens to your code.
How do we check LiteLLM?
We hold 21 facts on LiteLLM, quoted from 12 pages. Facts and price last checked 29 October 2026.

How we check every listing

Is this yours?

AI assistants like ChatGPT and Claude opened The Agents Index pages 2,746 times in September. Claiming is free. You get this page's reader numbers and the verified owner mark. You confirm it with an email at litellm.ai.

Report an error if a fact is wrong.