Loading the SOTA2 catalog…
LiteLLM Gateway (Proxy)
LLM Gateway (OpenAI Proxy) to manage authentication, load balancing, and spend tracking across 100+ LLMs.
What is LiteLLM Gateway (Proxy)?
LLM Gateway (OpenAI Proxy) to manage authentication, load balancing, and spend tracking across 100+ LLMs. All in the OpenAI format.
Product typeModel APIs & Gateways
Pricing$0 · Free, Enterprise Custom
Deployment
APINot available
What teams use LiteLLM Gateway (Proxy) for
LLM gateway proxy
Authentication and load balancing across LLMs
Spend tracking and budgeting across providers
Integrations and access
Platforms, integrations, and language support vary by plan and region. Confirm final requirements with the vendor.
Platforms
IntegrationsAPI and webhooks
Languages
Support
What reviewers say
Community reviewsReviews are owned and editable by their authors.
Sign in to reviewLoading community reviews…
Enterprise readiness
Compliance claims are normalized from current vendor documentation and independently reviewed by SOTA2.
SOC 2 Type I
SOC 2 Type II
ISO/IEC 27001
ISO 22301
TLS/SSL (TLS 1.2 and TLS 1.3)
NaCl SecretBox (XSalsa20-Poly1305) encryption for API keys, credentials, and config secrets
CodeQL
grype vulnerability scanning on Docker images
Self-hosted deployment with no data or telemetry stored on LiteLLM servers
No personal data collected or transmitted for self-hosted users
Minimal session cookies (JWT) for Admin UI authentication; no third-party cookies
Audit logs for auth, creation, and update events
Vulnerability disclosure policy
Cybersecurity incident management program with incident response policy
Partial data-at-rest encryption: API keys, credentials, and config secrets encrypted via NaCl SecretBox; spend/audit logs and cache data not encrypted
Data retention:
Benchmarks and comparisons
Independent benchmarksStructured task results are being verified.
Side-by-side comparisonsComparison workspaces will be available in a later release.
