llm gateways

ranked on what they actually add to your token bill, what the licence permits, and whether the governance features ship in the open-source build.

5 listed · 5 researched by us · featured first, then most upvoted

Vercel AI Gateway

we checked this$0 — usable on the free hobby plan

zero markup stated plainly, including on byok

#teams-already-deploying-

OpenRouter

we checked this$0 — no platform fee

the default, and the only one whose catalogue is the product

#teams-who-want-one-key-a#no-gateway-bill-at-all

Portkey

we checked this$49/mo (production)

mit-licensed, and billed per log rather than per token

#teams-who-want-the-full-#the-option-to-run-it-the

Helicone

we checked this$79/mo (pro)

the gateway and the observability layer in one apache 2.0 codebase

#teams-who-want-request-l

Cloudflare AI Gateway

we checked this$0 — free on all cloudflare plans

free caching, retries and logging in front of fourteen providers

#teams-already-on-cloudfl#a-retry-layer-for-nothin

this page is deliberately short: a handful of llm gateways we looked at properly, rather than everything that exists. if you build one that belongs here, a free listing takes two minutes and $50 pins it to the top of this page.

add a tool →