Getting started
Install the gateway and get a first completion through the router.
archived documentation
llm-router docs
Self-hosted AI gateway -- operator documentation
v0.3.0
llm-router
REST API
Endpoint catalogue and the guide for adding your own endpoints.
Python library
Embed the router in your own code with llm_router_lib.
Web UI (archived)
Configuration and anonymizer panels shipped before the CLI rewrite.
Masker plugins (archived)
Standalone masking plugins from the early 0.x releases.
Release notes
What changed in every released version.