maximhq/bifrost: Go AI Gateway Adds Only 11µs Latency at 5K req/s Across 15+ Providers — 3.3K Stars

GitHub·medium signal

Bifrost is a high-performance Go AI gateway unifying access to 15+ providers (OpenAI, Anthropic, AWS Bedrock, Google Vertex) through a single OpenAI-compatible API, adding only 11 microseconds of overhead at 5,000 requests/second. With 3,642 commits and +63 stars/day on Go trending, it offers zero-configuration deployment via NPX or Docker — the lowest-latency open-source AI gateway benchmarked to date.