Skip to content
OpenSmartRoute
TemplateFeaturedv1.0.0

Privacy-first routing

Anything with personal data is pinned to an on-prem model; everything else uses the cloud tiers.

by OpenSmartRoute(0) 0 installs
Free
Sign in to install

Free account. Installing gives you the manifest plus copy-paste snippets.

See reviews

About

For teams under a data-residency or PII policy: the router detects personal data and pins those requests to a self-hosted model that never leaves the boundary, while ordinary traffic still uses the faster cloud tiers. Swap llm-onprem for your own in-network deployment.

Use it

Copy one of these into your project. Installing also returns the manifest and these snippets.

bash
osr stack plan registry://privacy-first@1.0.0 --registry https://api.opensmartroute.ai
osr stack apply registry://privacy-first@1.0.0 --registry https://api.opensmartroute.ai

Manifest

A declarative stack: models, rules and settings in one file. `osr stack apply` turns it into a running router.

privacy-first.stack.jsonjson
{
  "osr": "1",
  "kind": "stack",
  "name": "privacy-first",
  "description": "Personal data stays on-prem; everything else uses the cloud tiers.",
  "targets": [
    {
      "id": "llm-cloud",
      "kind": "llm",
      "name": "Cloud model",
      "description": "Fast general model for non-sensitive requests",
      "cost": {
        "usd_per_1k_tokens": 0.003
      },
      "latency_ms": 700,
      "quality_prior": 0.8
    },
    {
      "id": "llm-onprem",
      "kind": "llm",
      "name": "On-prem model",
      "description": "Regulated and personal data that must not leave the network",
      "cost": {
        "usd_per_1k_tokens": 0.0008
      },
      "latency_ms": 1200,
      "quality_prior": 0.7,
      "constraints": {
        "data_boundary": "on_prem",
        "pii_allowed": true
      }
    }
  ],
  "rules": [
    {
      "name": "pii-stays-home",
      "when": {
        "contains_pii": true
      },
      "prefer": [
        "llm-onprem"
      ],
      "pin": true
    }
  ],
  "objective": {
    "quality": 1,
    "cost": 0.3,
    "latency": 0.2
  }
}

Fetch it by URL: GET /api/v1/registry/privacy-first/manifest?version=1.0.0

Reviews

Star ratings from people who tried it. One review per account; edit yours any time.

No reviews yet. Install it, try it, and be the first to rate it.