Prompt file imported from tahamohamadi-ir/ADHD-VTD (.codex/prompts/09_candidate_generation_verifier.md). Copyright stays with the author.

09 — Candidate Generation + Verifier

Name: 09_candidate_generation_verifier
Author: tahamohamadi-ir

Read AGENTS.md.
Read:
- docs/context-hub/QUERY_SHAPE_CONTRACTS.md
- docs/context-hub/ARTIFACT_RULES.md
- src/graph/workflow.py
- src/graph/state.py
- src/sql_validation/validation_pipeline.py

Task:
Design and implement a minimal candidate generation + verifier stage.

Do not implement a complex multi-agent system.
Start with N=3 candidates maximum.

Requirements:
1. Generate diverse SQL candidates only when enabled by config.
2. Validate each candidate with syntax, safety, schema, join, aggregation, and shape checks.
3. Execute only candidates that pass safety validation.
4. Score candidates using runtime signals only, not gold labels.
5. Select best candidate or abstain/clarify if disagreement is high.
6. Record candidate traces.
7. Add ablation flag.

Candidate score should consider:
- validation_ok
- execution_ok
- shape_ok
- schema coverage
- value coverage
- candidate agreement
- unsafe penalty
- schema error penalty
- shape error penalty

Add tests:
- candidate safety
- candidate selection
- candidate disagreement abstention
- no gold leakage

Return:
- design summary
- files changed
- tests
- benchmark impact
- risks

{ "prompt": "# 09 — Candidate Generation + Verifier\n\n```text\nRead AGENTS.md.\nRead:\n- docs/context-hub/QUERY_SHAPE_CONTRACTS.md\n- docs/context-hub/ARTIFACT_RULES.md\n- src/graph/workflow.py\n- src/graph/state.py\n- src/sql_validation/validation_pipeline.py\n\nTask:\nDesign and implement a minimal candidate generation + verifier stage.\n\nDo not implement a complex multi-agent system.\nStart with N=3 candidates maximum.\n\nRequirements:\n1. Generate diverse SQL candidates only when enabled by config.\n2. Validate each candidate with syntax, safety, schema, join, aggregation, and shape checks.\n3. Execute only candidates that pass safety validation.\n4. Score candidates using runtime signals only, not gold labels.\n5. Select best candidate or abstain/clarify if disagreement is high.\n6. Record candidate traces.\n7. Add ablation flag.\n\nCandidate score should consider:\n- validation_ok\n- execution_ok\n- shape_ok\n- schema coverage\n- value coverage\n- candidate agreement\n- unsafe penalty\n- schema error penalty\n- shape error penalty\n\nAdd tests:\n- candidate safety\n- candidate selection\n- candidate disagreement abstention\n- no gold leakage\n\nReturn:\n- design summary\n- files changed\n- tests\n- benchmark impact\n- risks\n```\n\n---", "variables": [], "notes": "Task: Design and implement a minimal candidate generation + verifier stage.", "metadata": { "source": { "provider": "github-codex-prompts", "repository": "https://github.com/tahamohamadi-ir/ADHD-VTD", "path": ".codex/prompts/09_candidate_generation_verifier.md", "ref": "a39f8c81f6f4130b29508d987f2e1240bf28d632", "url": "https://github.com/tahamohamadi-ir/ADHD-VTD/blob/a39f8c81f6f4130b29508d987f2e1240bf28d632/.codex/prompts/09_candidate_generation_verifier.md", "key": "tahamohamadi-ir/ADHD-VTD/.codex/prompts/09_candidate_generation_verifier.md" } } }

09_candidate_generation_verifier

About

09 — Candidate Generation + Verifier

Use it

Manifest

Reviews