tool-quality-audit

Name: tool-quality-audit
Author: majiayu000

Audit tool integrations for deterministic behavior, error contracts, and logging before agents depend on them. Use when adding or updating tools or MCP servers.

by majiayu000(0) 0 installs

Free

Free account. Installing gives you the manifest plus copy-paste snippets.

See reviews

About

Imported from majiayu000/claude-skill-registry (skills/data/tool-quality-audit/SKILL.md). Install upstream with npx skills add majiayu000/claude-skill-registry --skill tool-quality-audit. Copyright stays with the author.

Tool Quality Audit

Overview

Evaluate a tool’s reliability with a checklist and small smoke tests. Emphasize deterministic outputs, clear errors, and stable schemas.

Quick start

Fill templates/tool_audit.json.
Run smoke tests manually or via your harness.
Record findings in results.json.

Core Guidance

Prefer deterministic checks before LLM-based grading.
Verify error contracts (consistent codes/messages).
Validate schemas are stable and documented.
Record latency and failure modes.

Resources

references/tool-audit-checklist.md: Reliability and contract checklist.
templates/tool_audit.json: Audit scaffold for a tool.

Validation

Ensure audit file is filled and failures are actionable.

Use it

Copy one of these into your project. Installing also returns the manifest and these snippets.

yaml

targets:
  - https://api.opensmartroute.ai/api/v1/registry/majiayu000-claude-skill-registry-tool-quality-audit/manifest   # or paste the manifest below

Manifest

An Open Capability Manifest: the router reads it to know what this does, what it costs and when to pick it.

majiayu000-claude-skill-registry-tool-quality-audit.ocm.jsonjson

{
  "ocm": "1",
  "id": "majiayu000-claude-skill-registry-tool-quality-audit",
  "kind": "skill",
  "name": "tool-quality-audit",
  "description": "Audit tool integrations for deterministic behavior, error contracts, and logging before agents depend on them. Use when adding or updating tools or MCP servers.",
  "publisher": "majiayu000",
  "version": "1.0.0",
  "capabilities": {
    "domains": [
      "general"
    ],
    "tags": [
      "skill-md",
      "tools",
      "validation",
      "mcp",
      "github"
    ],
    "languages": [
      "en"
    ]
  },
  "quality_prior": 0.6,
  "examples": [
    "Audit tool integrations for deterministic behavior, error contracts, and logging before agents depend on them. Use when adding or updating tools or MCP servers."
  ],
  "primary": false,
  "metadata": {
    "source": {
      "provider": "github",
      "repository": "https://github.com/majiayu000/claude-skill-registry",
      "path": "skills/data/tool-quality-audit/SKILL.md",
      "ref": "a16e8e7bdddc9a7406a56f51e520cef7a8646208",
      "url": "https://github.com/majiayu000/claude-skill-registry/blob/a16e8e7bdddc9a7406a56f51e520cef7a8646208/skills/data/tool-quality-audit/SKILL.md",
      "key": "majiayu000/claude-skill-registry/skills/data/tool-quality-audit/SKILL.md"
    }
  },
  "instructions": "# Tool Quality Audit\n\n## Overview\nEvaluate a tool’s reliability with a checklist and small smoke tests. Emphasize deterministic outputs, clear errors, and stable schemas.\n\n## Quick start\n1) Fill `templates/tool_audit.json`.\n2) Run smoke tests manually or via your harness.\n3) Record findings in `results.json`.\n\n## Core Guidance\n- Prefer deterministic checks before LLM-based grading.\n- Verify error contracts (consistent codes/messages).\n- Validate schemas are stable and documented.\n- Record latency and failure modes.\n\n## Resources\n- `references/tool-audit-checklist.md`: Reliability and contract ",
  "cost": {
    "context_tokens": 185
  }
}

Fetch it by URL: GET /api/v1/registry/majiayu000-claude-skill-registry-tool-quality-audit/manifest?version=1.0.0