⚡
LiteLLM AI Proxy
AI open-source LLM API proxy
AI Infrastructure
Open-source LLM API proxy using AI to unify calls to 100+ LLMs with a single OpenAI-compatible interface, with load balancing, fallbacks, and cost tracking built in.
Key Features
- ✓LLM proxy AI unified
- ✓100+ AI models
- ✓Cost AI tracking LLM
- ✓Fallback AI handling
#LLM AI proxy#unified AI interface#open-source AI gateway#LLM AI cost tracking
Quick Info
- Category
- AI Infrastructure
- Pricing
- Free
More AI Infrastructure Tools
Inferless
AI InfrastructureServerless AI model deployment platform with GPU auto-scaling and cold start optimization
Colossal AI
AI InfrastructureOpen-source system for efficient large-scale AI model training and fine-tuning
Neural Magic
AI InfrastructureSoftware-defined AI inference engine that runs LLMs at GPU speed on CPUs
Weaviate Cloud
AI InfrastructureFully managed cloud service for the Weaviate open-source vector database