Loading
Open source
Apache-2.0, a Python package with no runtime dependencies, a container image and a Helm chart. Route between models, agents and tools behind your own firewall with policy, a trace per request and learning from outcomes - or use the hosted platform on a free plan.
Free plan, no card. Open source under Apache-2.0; self-hosting is free forever.
From the benchmark
0
runtime dependencies in the Python package
The core installs nothing else; YAML, the server and OpenTelemetry are optional extras. Every release is on PyPI and npm with its checksum, and the images carry the same version.
The whole benchmark, with the cases the router lostThe problem
A hosted router sees every prompt. For regulated data, air-gapped networks or a procurement process that asks where the bytes go, the router has to run where the models run - without a second product, a second licence or a dependency tree to audit.
How the router answers it
pip install opensmartroute pulls in nothing else. The router is a class; targets and rules are two YAML files; the trace is a Python object.
osr serve exposes /route, /v1/chat/completions and an MCP server from the same catalogue; the container image and the Helm chart run it in your cluster.
The hosted platform - workspaces, keys, dashboard, savings ledger - ships as the same open-source package with a Compose bundle. Enterprise features are a setting, not a second product.
A real request
The same two files drive the library, the server, the container and the MCP server.
# rules.yaml
- id: pii-stays-home
when: { contains_pii: true }
prefer: [onprem-llama]
pin: true # not a preference - a rule the score cannot override
$ osr -t targets.yaml -r rules.yaml route "Summarise the attached patient letter"
target=onprem-llama confidence=0.91 policy: cloud targets rejected (pii)Read next
Install
docker run --rm -p 8000:8000 crosrua2c6onyidguw.azurecr.io/opensmartroute:latestOr no install at all: the hosted API answers a plain curl with the decision, and the browser extension shows the price and the router's pick under the composer of the AI chat sites you already use.
OpenSmartRoute is open source and the free plan keeps the full trace of every decision. Create a workspace, mint a key and send the request above.
Free plan, no card. Fifteen thousand decisions a month with the full trace.