Open Source Self-Hosted AI Gateway

Bifrost

The fastest enterprise AI gateway with adaptive load balancing

LLM MCP Server MCP Client AI Gateway Gateway MCP Gateway Token Management Gateway Services LLM Cost LLM Gateway LLMOPS

docker Fasthttp go golang javascript react typescript

Visit Website Repository Main Repository Official Documentation

Screenshots

A closer look at the product interface and key surfaces.

5 images

At a glance

Primary use case: The fastest enterprise AI gateway with adaptive load balancing
Best for: AI Gateway — LLM, MCP Server
Stack: docker, Fasthttp, go, golang
License: Apache-2.0
Maintenance: 1 week ago
Access: Open source · Self-hosted
Documentation path: https://docs.getbifrost.ai/

Resource map

Website

https://github.com/maximhq/bifrost

Repository

https://github.com/maximhq/bifrost

Documentation

https://docs.getbifrost.ai/

Source

https://github.com/maximhq/bifrost

About this tool

Bifrost is a high performance AI gateway that unifies access to 23+ providers through a single OpenAI compatible API. It offers automatic failover, semantic caching, and enterprise grade load balancing for scalable applications.

Repository

Stars

6,519

Forks

894

Issues

592

License

Apache-2.0

Last Push

1 week ago

Features

Unifies access to over twenty-three providers including OpenAI and Anthropic through a single compatible API.
Delivers enterprise grade performance with less than one hundred microseconds of overhead at high request rates.
Includes advanced features like adaptive load balancing, automatic failover, and semantic caching for reliability.