Skip to content
OpenSmartRoute
TemplateFeaturedv1.0.0

Starter stack

Three models, two rules: quality first, private data stays on-prem. Apply in a minute.

by OpenSmartRoute(0) 0 installs
Free
Sign in to install

Free account. Installing gives you the manifest plus copy-paste snippets.

See reviews

About

What you get

Three models and two rules that cover most teams' first month:

Target Used for
llm-small everyday questions, summaries, drafts
llm-frontier hard reasoning, long documents, code
llm-onprem anything with personal or regulated data

pii-stays-home pins requests that contain personal data to the on-prem model; hard-goes-frontier sends complex requests to the frontier model. Everything else lands on the small model, which is where the savings come from.

Apply it

osr stack plan  registry://starter@1.0.0 --registry https://your-platform
osr stack apply registry://starter@1.0.0 --registry https://your-platform --route "Summarise this contract"

Rename the targets to your own deployments, keep the rules.

Use it

Copy one of these into your project. Installing also returns the manifest and these snippets.

bash
osr stack plan registry://starter@1.0.0 --registry https://api.opensmartroute.ai
osr stack apply registry://starter@1.0.0 --registry https://api.opensmartroute.ai

Manifest

A declarative stack: models, rules and settings in one file. `osr stack apply` turns it into a running router.

starter.stack.jsonjson
{
  "osr": "1",
  "kind": "stack",
  "name": "starter",
  "description": "Route by quality first, keep private data on-prem.",
  "targets": [
    {
      "id": "llm-small",
      "kind": "llm",
      "name": "Small fast model",
      "description": "Everyday questions, summaries and drafts",
      "cost": {
        "usd_per_1k_tokens": 0.0005
      },
      "latency_ms": 400,
      "quality_prior": 0.6
    },
    {
      "id": "llm-frontier",
      "kind": "llm",
      "name": "Frontier model",
      "description": "Hard reasoning, long documents and code",
      "cost": {
        "usd_per_1k_tokens": 0.01
      },
      "latency_ms": 1800,
      "quality_prior": 0.92,
      "capabilities": {
        "min_complexity": 0.5
      }
    },
    {
      "id": "llm-onprem",
      "kind": "llm",
      "name": "On-prem model",
      "description": "Regulated and personal data that must not leave the network",
      "cost": {
        "usd_per_1k_tokens": 0.0004
      },
      "latency_ms": 900,
      "quality_prior": 0.7,
      "constraints": {
        "data_boundary": "on_prem",
        "pii_allowed": true
      }
    }
  ],
  "rules": [
    {
      "name": "pii-stays-home",
      "when": {
        "contains_pii": true
      },
      "prefer": [
        "llm-onprem"
      ],
      "pin": true
    },
    {
      "name": "hard-goes-frontier",
      "when": {
        "min_complexity": 0.7
      },
      "prefer": [
        "llm-frontier"
      ]
    }
  ],
  "objective": {
    "quality": 1,
    "cost": 0.3,
    "latency": 0.1
  }
}

Fetch it by URL: GET /api/v1/registry/starter/manifest?version=1.0.0

Reviews

Star ratings from people who tried it. One review per account; edit yours any time.

No reviews yet. Install it, try it, and be the first to rate it.