rubric-verifier
暂无简介
- License 许可
- MIT
- 最近更新
- 2026-11-02
- Stars
- ★ 0
- Forks
- 0
03 SKILL.md 正文
Rubric Verifier — execution-free candidate selector
Select the best among N candidate patches without running any tests, by having a fresh-context reviewer build a repo-grounded rubric and score each candidate against it. The output is a ranked advisory list; the coverage gate remains the hard blocker.
Why this exists
After /multi-execute, codex council, or an external-tools (Codex + Gemini) fan-out
you have N candidate diffs for the same task. The current pipeline has no principled
execution-free SELECT step:
| Existing skill | What it does | Gap |
|---|---|---|
fresh-context-verify |
re-derives one load-bearing value | single-value, not N-candidate ranking |
| VALIDATE (metaswarm) | runs tests | execution required; expensive to run N times |
code-review |
hunts for bugs in one diff | not a multi-candidate rubric scorer |
This skill fills the SELECT point: pick the best candidate before spending test-runner cycles on all N.
Trigger
Run this skill after N ≥ 2 candidate diffs exist and before VALIDATE, when:
- A
/multi-executeorcodex councilrun has produced N patches in a manifest file (default:.multi-execute/candidates/or.council/candidates/), or - External-tools (Codex CLI + Gemini CLI) have each produced a patch and you need to pick one before committing to the VALIDATE loop.
Skip when:
- Only one candidate exists (nothing to rank).
- The issue is trivially localised (one-liner typo fix) — any diff that compiles is fine.
Composition with existing gates
Phase 1 — Rubric Construction (FRESH context)
Inputs to pass to the fresh-context Task
Fresh-agent exploration protocol
Rubric format (agent output)
Phase 2 — Scoring (same or new Task per candidate)
Scorer prompt template
Parallelism option
Phase 3 — Aggregate and Report
Rubric Verifier — Advisory Ranking
Ranking
04 同仓库更多 Skills
clarify-requirements
Resolve genuine pre-execution ambiguity by scanning repo context, generating 1-6 grounded options, and asking 1-3 focused questions via AskUserQuestion. NOT for mid-task use (injection risk); NOT when the goal is already unambiguous; use to disambiguate vague prompts before any file edits.
openmm-md
Run FREE, open-source, Windows-native GPU molecular dynamics via the openmm-md MCP (OpenMM + CUDA on the local NVIDIA GPU). Use for protein / protein-ligand MD when you want a free stack or are on Windows without a Schrodinger license. Covers the full workflow (prepare, solvate, minimize, equilibrate, production, analyze, mmgbsa) AND an honest decision guide vs Schrodinger Desmond, including how to run Desmond legitimately on Linux or a cloud GPU with a real license. This is a deliberately LESSER free alternative and does NOT replace the schrodinger MCP tools. Do NOT use it to pick a free tool when a validated FEP+, WaterMap, IFD-MD, or Prime MM-GBSA result is actually required.
visual-review
Take screenshots of web pages and UI using Playwright for visual review and iteration
status
Diagnostic status report — shows metaswarm installation state, project setup, and potential issues
start
Use when starting work on any task, when the user mentions metaswarm, or when the user wants to begin tracked development work
setup
Interactive project setup — detects your project, configures metaswarm, writes project-local files