Bifrost
Best for a fast self-hosted gateway$0open source; you run it
Maxim's open-source gateway in Go: one OpenAI-style API, fallbacks, exact and semantic caching, and budgets and rate limits on virtual keys, all free. Enterprise (custom price) adds clustering.
Good
- Claims 11 µs of overhead per request at 5,000 a second (on mocked calls)
- SQLite by default: no database to run on day one
Watch out
- No hosted plan: you run and scale it
- Caching needs a vector store such as Redis or Qdrant