LiteLLM

7.6easy start · #4 of 32
in LLM Gateway Software

Free to practise onyes
Free trialyes
Well documentedyes
Runs where you worknot on record

Runs on api, self-hosted, Web.

LiteLLM is ranked #4 of 32 in LLM gateway software on The Geeks Club. It runs on API, Self-hosted, Web. There is a free plan. A free trial is offered.

LiteLLM plans and pricing

All plans

Open Source Free Free forever · self-hosted 100+ providers · virtual keys, users and teams · spend tracking · budgets and rate limits · LLM fallbacks · request/response logging · Prometheus metrics litellm.ai · 2 Oct 2026

Enterprise Not published Annual · sized to your usage Annual request capacity · priced by deployment architecture and support needs · volume discounts · 24/7 support and SLAs litellm.ai · 2 Oct 2026

Compared on LLM gateway software

Free plan: Yes
Fallback routing: Yes
Usage analytics: Yes
Self-hosted deployment: Yes
Budget controls: Yes
Virtual API keys: Yes

Best LiteLLM alternatives

See all 12

Bifrost 0 of 4 in the starter kit Lesson 17.9 Kong Gateway 0 of 4 in the starter kit Lesson 27.8 Helicone 0 of 4 in the starter kit Lesson 37.6 Requesty 0 of 4 in the starter kit Lesson 57.6 TrueFoundry AI Gateway 0 of 4 in the starter kit Lesson 67.6 Vercel 0 of 4 in the starter kit Lesson 77.6

The record

Product: LiteLLM is an open-source AI gateway and LLM proxy for platform teams.
Unified access: The gateway provides one OpenAI-compatible API to 140+ providers and 1,800+ models.
Routing: LiteLLM supports load balancing, lowest-cost routing, and automatic routing of simple prompts to cheaper models.
Spend controls: It tracks usage and spend by key, user, team, organization, tool, agent, and MCP, and supports hard budgets and rate limits.
Caching: Response and semantic caching can use Redis, S3, or GCS.
Deployment: The gateway can be self-hosted, including in air-gapped environments, and supports deployment with an official Helm chart or Terraform module.
Integrations: The integrations documentation lists observability tools including Langfuse, Datadog, Grafana Cloud, OpenTelemetry, LangSmith, Arize/Phoenix, and Helicone.
Security: The product page describes signed hardened non-root images, vulnerability scanning, SSO/JWT/RBAC controls, and secrets-manager integrations.
Data handling: LiteLLM says its self-hosted deployment has no telemetry and keeps data within the user's infrastructure.
Enterprise access: The Enterprise plan includes SSO and SCIM, OIDC/JWT authentication, audit logs, secret managers, key rotation, and organization and team administrators.
Support: Enterprise includes dedicated support and onboarding, with 24/7 support and SLAs listed on the pricing page.
Trial: The pricing FAQ offers an instant 30-day Enterprise trial key without a credit card.
Intended users: The Enterprise plan is described for teams running LiteLLM in production, including high-volume and regulated deployments.
Price from: Free

Where it ranks on The Geeks Club

Best LLM Gateway Software in 2026#4 of 32

Is LiteLLM yours?

Claim it for free: prove the domain, then correct facts, plans and screenshots. An editor reviews every change.

Claim it free Promote LiteLLM

Sources

litellm.ai· checked 2 Oct 2026
docs.litellm.ai/docs/integrations/· checked 2 Oct 2026
litellm.ai/pricing· checked 2 Oct 2026