Getting started
Install the gateway and get a first completion through the router.
archived documentation
Self-hosted AI gateway -- operator documentation
v0.4.0
Install the gateway and get a first completion through the router.
Endpoint catalogue and the guide for adding your own endpoints.
Embed the router in your own code with llm_router_lib.
Runnable stacks: vLLM, Ollama, LangChain, LlamaIndex and client SDKs.
What changed in every released version.