LiteLLM iconLiteLLM

oss Free Star12k

Unified LLM API wrapper supporting 100+ models with consistent OpenAI-format interface. Includes load balancing, rate limiting, and spending tracking across providers (OpenAI, Claude, Gemini, Mistral, etc).

— Users
— Rating
— Founded

Overview

LLM Gateway (OpenAI Proxy) to manage authentication, loadbalancing, and spend tracking across 100+ LLMs. All in the OpenAI format.

The Verdict

Who Should Use LiteLLM?

Best For

  • [Add best use case 1]
  • [Add best use case 2]
  • [Add best use case 3]

Not Ideal For

  • [Add limitation 1]
  • [Add limitation 2]

What's Great

  • Azure Access
  • Gemini Access
  • Bedrock Access
  • OpenAI Access
  • Anthropic Access

Watch Out For

  • [Research G2/Capterra for cons]
  • [Add con 2]

Pricing

View all features & details

Key Features

  • Azure Access
  • Gemini Access
  • Bedrock Access
  • OpenAI Access
  • Anthropic Access
  • Azure Access

Platforms

  • [Add supported platforms]

How It Compares

Feature LiteLLM Competitor 1 Competitor 2
Key Feature — — —
Pricing — — —
Best For — — —

User Reviews

Loading reviews...