LiteLLM
Open-source LLM gateway supporting 2,000+ APIs in OpenAI-compatible format
Our Take
LiteLLM is the most popular open-source LLM gateway (40K+ GitHub stars) and it earns that position. Drop it in front of any combination of providers and you get a unified OpenAI-compatible API, per-project budget controls, and SSO/SAML in the enterprise tier. The fully self-hosted model gives maximum data control. The tradeoff: you need DevOps expertise, and the UI is less polished than Portkey. But if you want open-source flexibility with enterprise governance bolted on, LiteLLM is hard to beat.
Pros
- + Open source with 40K+ GitHub stars
- + Broadest integration surface (2,000+ LLM APIs)
- + Fully self-hosted option
- + OpenAI-compatible format simplifies migration
- + Available on AWS and Azure Marketplaces
Cons
- - Requires DevOps expertise to self-host
- - UI less polished than commercial alternatives
- - Enterprise features require paid tier
Details
- Pricing Model
- open-source
- Starting Price
- $0
- Self-Hosted
- Yes
- Cloud Hosted
- Yes
- Founded
- 2023
- Repository
- GitHub →
Best For
- • OpenAI-compatible API abstraction
- • Self-hosted LLM gateway
- • Multi-provider cost management
- • Budget controls and rate limiting
Integrations
OpenAI Anthropic Google AI Azure OpenAI AWS Bedrock Hugging Face Ollama
Articles featuring LiteLLM
Last updated: