verifier.org

LiteLLM

the widest provider coverage, with the governance behind a paywall

free to self-host — enterprise is quote-only#teams-who-want-one-inter#can-live-without-the-ent

the broadest coverage of any self-hostable gateway, but the features most teams deploy it for sit under a proprietary licence with no published price.

litellm's readme promises 'a single, unified interface to call 100+ llm providers ... using the openai format', and that breadth is the reason it is everywhere. self-hosted, it adds no per-token cost — your keys, your compute, provider bills direct at list. virtual keys, per-project spend tracking, load balancing, retry and fallback routing, and the admin dashboard all work on the free mit core.

the licence is where it gets complicated, and litellm is at least honest about it. the root licence file is mit but explicitly states that everything under the 'enterprise/' directory is governed by a separate licence, and that file is a proprietary berriai enterprise licence requiring 'a valid berriai enterprise license for the correct number of user seats' for production use. development and testing are permitted unlicensed.

the description above is ours, condensed from the ranking. pricing moves — check it on the vendor's own page before you rely on it.

category
llm gateways
pricing
free to self-host — enterprise is quote-only
website
litellm.ai
our verdict

the broadest coverage of any self-hostable gateway, but the features most teams deploy it for sit under a proprietary licence with no published price.

we researched this category against vendors' own pricing pages and licence files. that is where this line comes from — not from the vendor, and not from anything they paid for.

more llm gateways

Unify

routes each prompt to whichever provider wins on your own benchmark

#routing#benchmarks

Not Diamond

learns which model to route each request to, from your feedback

#routing#learned

LangDB

gateway with tracing and cost controls in front of many providers

#tracing#cost-control

Vercel AI Gateway

we checked this$0 — usable on the free hobby plan

zero markup stated plainly, including on byok

#teams-already-deploying-