LLM Gateway
llmgateway.io
- Free plan
- Open source
- Linux
- Web
- Browser extension
- API
- Self-hosted
What LLM Gateway is
LLM Gateway gives product and platform teams one OpenAI-compatible API for routing requests across 250+ models from 40+ providers. If a provider errors, times out or rate-limits a request, the gateway can retry up to twice through another provider for the same model. Its dashboard tracks request, token, spend, latency, error and cache metrics, with breakdowns by model and provider. Teams can bring their own provider API keys without a platform fee and pay providers directly. The core gateway is open source under AGPLv3 and can be self-hosted for free; enterprise features require a license. Published integration guides cover tools including Claude Code, Cursor, Codex CLI, Cline, n8n and VS Code. The Free plan costs nothing, includes 200+ models across 40+ providers, activity logs and export, and allows 20 requests per minute on free models; paid models are not rate limited. It also lists a 5% fee on credit usage. Enterprise adds SSO, centrally configured guardrails, unlimited data retention, a 99.9% uptime SLA and 24/7 priority support; its price is custom.
Who it suits
LLM Gateway suits product and platform teams routing requests across multiple model providers. Its enterprise identity and guardrail features target organizations deploying LLM infrastructure across teams.
Good to know, and what to watch
- Routes requests across 250+ models and 40+ providers.
- Retries failed requests with another provider for the same model.
- Self-hosted open-source core is available at no charge.
- Dashboard reports usage, spend, latency, errors and cache metrics.
- Bring-your-own-key usage has no platform fee.
- Free-plan credit usage carries a 5% fee.
- Free models are limited to 20 requests per minute.
- Enterprise features require a license.
- Enterprise pricing is custom and not listed.
Plans
Every plan and priceEnterprise
Free
Free plan · 30-day trial
Getting started
- Open https://llmgateway.io/
- Use the web API or Linux deployment
- Choose the Free plan or request Enterprise pricing
- Connect provider keys, including your own keys if preferred
- Follow an integration guide for your selected development tool
- Self-host the AGPLv3 core if you want a free private deployment
Limits to check
The Free plan is free forever, includes 200+ models, and allows 20 requests per minute on free models; paid models are not rate limited. It lists a 5% fee on credit usage. Enterprise pricing is custom and adds unlimited retention and seats.
The Club's review
LLM Gateway is a common API layer for routing requests across a broad range of model providers. It is best suited to product and platform teams that want fallback routing and usage visibility, especially when they can bring their own provider keys. The free option lowers the barrier to entry, but its credit fee and request limit deserve attention.
Overview
One OpenAI-compatible API covers more than 250 models from over 40 providers, giving teams a single integration point as they work across providers. If a provider errors, times out, or rate-limits a request, LLM Gateway can retry up to twice with another provider for the same model. That is useful for reducing disruption, though teams still need to manage their provider relationships and keys.
The dashboard breaks down requests, tokens, spend, latency, errors, and cache metrics by model and provider. This gives teams a practical view of traffic and cost patterns. Using your own provider API keys carries no platform fee, with payment going directly to providers; using credits incurs a 5% fee on the Free plan.
Key features
Routing and controls
Fallback routing and virtual API keys support a centralized approach to application access. Budget controls add a way to manage usage, while custom routing is reserved for Enterprise. These features make the gateway relevant to teams consolidating several model integrations, but they do not make provider selection or cost management automatic.
Security and enterprise administration
The company says it is SOC 2 Type II audited and GDPR-aligned, and describes TLS encryption in transit and AES-256 encryption at rest. Enterprise adds SAML 2.0 and OIDC single sign-on, SCIM provisioning, and group-based role mapping. Its centrally configured guardrails detect prompt injection, personally identifiable information, and secrets. Those controls suit organizations with centralized governance needs, but require an Enterprise license.
Metadata retention is free; full payload retention costs $0.01 per 1 million tokens. Free includes activity logs and export. Enterprise plans include unlimited data retention, unlimited seats, a 99.9% uptime SLA, volume discounts, and 24/7 priority support through a dedicated Slack or Discord channel. The Free plan instead includes Discord Community support.
Integrations and deployment
Published guides cover Claude Code, Cursor, Codex CLI, Cline, Continue CLI, GitHub Copilot, n8n, OpenCode, and VS Code, making the gateway relevant to both coding tools and workflow automation. The core is open source under AGPLv3 and can be self-hosted for free. That is appealing to teams that want deployment control, but enterprise features still require a license.
Pricing
LLM Gateway uses a freemium model, with a free plan and a 30-day trial. The Free plan is free, billed Free forever. It covers 200+ models across 40+ providers, permits 20 requests per minute on free models, and does not rate-limit paid models. It charges 5% on credit usage; BYOK has no platform fee. This is a sensible starting point for small projects and evaluation, while the free-model rate cap may constrain busier workloads.
Enterprise has custom pricing and is billed Custom; teams must contact the company. It adds volume discounts, custom routing, unlimited data retention, a 99.9% uptime SLA, and 24/7 priority support. Its unlimited seats and enterprise identity and guardrail features make it the fit for organizations operating shared infrastructure across teams. For solo developers or teams that do not need those controls, the custom-priced tier is harder to justify.
Platforms
LLM Gateway supports API, Linux, self-hosted, and web use. The API-first design suits teams integrating model access into applications; the self-hosted option suits those who want to run the open-source core themselves.
Who it's for
Product and platform teams can use LLM Gateway to consolidate provider access, retry requests through another provider, and track usage centrally. It is less suitable for teams that need enterprise SSO, provisioning, guardrails, or service commitments but cannot take on a custom-priced license. Teams satisfied with direct provider-key billing should also weigh whether the gateway's extra routing and visibility justify another layer in their stack.
Pros and cons
- Broad model coverage: One compatible API routes across 250+ models and 40+ providers, reducing the need for separate application integrations.
- Provider fallback: Up to two retries with another provider for the same model can help when an upstream provider fails, times out, or rate-limits.
- Useful usage breakdowns: Model- and provider-level analytics cover requests, tokens, spend, latency, errors, and cache activity.
- Free self-hosting and BYOK: The open-source core can be self-hosted at no charge, and using provider keys carries no platform fee.
- Free-tier trade-off: Credit usage incurs a 5% fee, and free models are limited to 20 requests per minute.
- Enterprise controls cost extra: SSO, SCIM, group-based roles, guardrails, unlimited retention, and priority support require custom-priced Enterprise.
Alternatives
Compare LLM Gateway software if you want to assess more options. Choose Bifrost if a free, self-hosted gateway under Apache 2.0 and deployment via npx, Docker, Kubernetes, or a Go binary better fits your setup. Kong Gateway is worth considering if a 30-day trial with no gateway limits and 30 days of analytics retention is the priority. Requesty may fit a lighter workload that can stay within 200 requests per day on its free plan, which includes free models, routing, caching, fallbacks, spend tracking, analytics, and EU data residency.
TrueFoundry AI Gateway may suit a small team that can work within its Developer plan limits of three users, 10,000 requests per user per month, five model accounts, and five MCP servers. Helicone is another freemium option that describes itself as open source. LiteLLM is a candidate for teams seeking a free, self-hosted open-source gateway with 100+ providers, virtual keys, spend tracking, budgets, and rate limits. Vercel may be a better fit for a broader web deployment platform, with a free Hobby plan for personal, non-commercial use. Envoy AI Gateway is a free self-managed open-source project for teams comfortable with its Linux and macOS local CLI or Kubernetes deployment requirements.
Verdict
Choose LLM Gateway if your product or platform team wants one API for many providers, useful usage breakdowns, and fallback retries, with the option to self-host or use provider keys without a platform fee. Look elsewhere if the free tier's credit charge and 20-request-per-minute cap are a poor fit, or if you need enterprise controls but cannot commit to custom pricing.
The verdict
LLM Gateway centralizes model routing and usage visibility, with both hosted and self-hosted options. Review the free-plan credit fee and rate limit, and confirm enterprise licensing needs before adopting it.
Questions people ask
Is there a free plan?
Yes. Free is listed as free forever and includes 200+ models across 40+ providers, activity logs, and export.
Can I use my own provider keys?
Yes. BYOK usage has no platform fee, and you pay the providers directly.
Is LLM Gateway open source?
Its core gateway is open source under AGPLv3 and can be self-hosted for free. Enterprise features require a license.
Which platforms are supported?
The listed platforms are API, Linux, self-hosted, and web.
What does Enterprise add?
Enterprise includes custom routing, unlimited data retention and seats, a 99.9% uptime SLA, 24/7 priority support, SSO, and centrally configured guardrails.
What the maker publishes
- Analytics
- The dashboard tracks request, token, spend, latency, error, and cache metrics, with breakdowns by model and provider. source
- API surface
- Documented endpoints include chat completions, responses, Anthropic messages, embeddings, images, speech, transcription, moderation, search, video and realtime operations. source
- Automatic routing
- The gateway selects providers using availability, latency, throughput, price and cache-related signals, with configurable routing behavior. source
- BYOK
- Using your own provider API keys has no platform fee; users pay providers directly. source
- BYOK
- Customers may store their own provider keys and use routing and analytics without a platform fee. source
- Caching
- Projects can enable response caching to reduce repeated-request latency and token expense. source
- Company size
- LinkedIn classifies llm-gateway as a self-employed information-services organization with 2–10 employees. source
- Credit pricing
- Pay-as-you-go credits use provider list token rates plus a flat 5% fee when credits are purchased; international cards add 1.5%. source
- Data retention
- Pricing lists metadata retention as free and full payload retention at $0.01 per 1 million tokens; the Free plan includes activity logs and export. source
- Documentation depth
- The documentation includes feature guides, dashboard knowledge-base articles, integration material, self-hosting sections, developer tools and an API reference. source
- Enterprise identity
- Enterprise SSO supports SAML 2.0 and OIDC with SCIM provisioning and group-based role mapping. source
- Enterprise limits
- Enterprise plans include unlimited seats and unlimited data retention, according to the enterprise page. source
- Enterprise pricing
- Enterprise pricing is contact-based and offers volume discounts, custom limits and contractual service levels. source
- Failover
- When a provider errors, times out or rate-limits, the gateway can retry on another provider for the same model, up to two times. source
- Guardrails
- Enterprise guardrails detect prompt injection, personally identifiable information, and secrets, and can be centrally configured at the gateway. source
- Guardrails
- Enterprise guardrails can detect prompt injection, jailbreak attempts, personally identifying information, payment-card data and secrets, with block, redact or warn actions. source
- Identity controls
- Enterprise supports SAML 2.0 or OIDC single sign-on, SCIM provisioning and organization/project roles. source
- Independent assessment: API caveat
- GatewayScore reports that latency-based routing applies only to streaming requests and that non-auto tool choices may be downgraded when no mapping supports them. source
- Independent assessment: compliance gap
- GatewayScore says SOC 2 is published but found no unconditional zero-retention guarantee or HIPAA business-associate agreement. source
- Independent assessment: deployment documentation
- GatewayScore found hosted and self-host deployment documented, while VPC, on-premises and air-gapped deployment were not documented on the reviewed pages. source
- Independent assessment: pricing
- Vantaige characterizes the gateway as freemium, with free BYOK and self-hosting and a 5% managed-credit fee. source
- Independent praise: unified access
- The same Reddit announcement highlights one API, provider fallback and usage/cost tracking as the core benefit for application developers. source
- Independent product description
- A Reddit post by a project builder describes hosted pay-as-you-go access, provider-key mode and AGPLv3 self-hosting, with separate commercial licensing for enterprise code. source
- Independent technical footprint
- Gridinsoft detected React, Next.js, Sonner notifications, Google Cloud hosting and a linked GitHub profile for the site. source
Checked against the maker's pages on 15 Oct 2026.