LiteLLM iconLiteLLM

oss Free Star12k

Unified LLM API wrapper supporting 100+ models with consistent OpenAI-format interface. Includes load balancing, rate limiting, and spending tracking across providers (OpenAI, Claude, Gemini, Mistral, etc).

Users
Rating
Founded

Overview

LLM Gateway (OpenAI Proxy) to manage authentication, loadbalancing, and spend tracking across 100+ LLMs. All in the OpenAI format.

The Verdict

Who Should Use LiteLLM?

Best For

  • [Add best use case 1]
  • [Add best use case 2]
  • [Add best use case 3]

Not Ideal For

  • [Add limitation 1]
  • [Add limitation 2]

What's Great

  • Azure Access
  • Gemini Access
  • Bedrock Access
  • OpenAI Access
  • Anthropic Access

Watch Out For

  • [Research G2/Capterra for cons]
  • [Add con 2]

Pricing

View all features & details

Key Features

  • Azure Access
  • Gemini Access
  • Bedrock Access
  • OpenAI Access
  • Anthropic Access
  • Azure Access

Platforms

  • [Add supported platforms]

How It Compares

Feature LiteLLM Competitor 1 Competitor 2
Key Feature
Pricing
Best For

User Reviews

Loading reviews...