archived documentation
llm-router docs
Self-hosted AI gateway -- operator documentation
v0.4.0released 2025-11-28 · 9 pages · 5 sections · built from v0.4.0 @ 7d11cb7
llm-router
Install the gateway and get a first completion through the router.
Endpoint catalogue and the guide for adding your own endpoints.
Embed the router in your own code with llm_router_lib.
Runnable stacks: vLLM, Ollama, LangChain, LlamaIndex and client SDKs.
What changed in every released version.