evidence-auditor

WILLOSCAR 的头像作者 WILLOSCAR

审核支持每个主张的证据,并将差距/疑虑写入`output/MISSING_EVIDENCE.md`。**触发器**:证据审核、缺失证据、不支持的主张、审稿审核、证据缺口。**使用时**:同行评审流程中,需要逐条检查主张的链证据、缺基线、财务薄缺陷。**跳过if**:缺失声明输入(例如还没有`output/CLAIMS.md`)。**网络证据**: none.**Guardrail**:只写“缺口/风险/下一步验证”,不要替作者补写走势或引发新的。

📖 中文导读:审核支持每个主张的证据,并将差距/疑虑写入`output/MISSING_EVIDENCE.md`。**触发器**:证据审核、缺失证据、不支持的主张、审稿审核、证据缺口。**使用时**:同行评审流程中,需要逐条检查主张的链证据、缺基线、财务薄缺陷。**跳过if**:缺失声明输入(例如还没有`output/CLAIMS.md`)。**网络证据**: none.**Guardrail**:只写“缺口/风险/下一步验证”,不要替作者补写走势或引发新的。 以下正文为该技能的原始 SKILL.md 内容(英文),上方安装命令可直接使用。

name: evidence-auditor description: | Audit the evidence supporting each claim and write gaps/concerns into output/MISSING_EVIDENCE.md. Trigger: evidence audit, missing evidence, unsupported claims, 审稿证据审计, 证据缺口. Use when: peer review 流程中,需要逐条检查 claim 的证据链、缺 baseline、评测薄弱点。 Skip if: 缺少 claims 输入(例如还没有 output/CLAIMS.md)。 Network: none. Guardrail: 只写“缺口/风险/下一步验证”,不要替作者补写论述或引入新主张。

Evidence Auditor (peer review)

Goal: for each claim, either (a) point to the supporting evidence in the manuscript, or (b) write a concrete gap with an actionable fix.

Inputs

  • output/CLAIMS.md

Outputs

  • output/MISSING_EVIDENCE.md

For each claim:

  • Claim: copy the claim text
  • Evidence present: what the paper provides (experiments/theory/citations)
  • Gap / concern: what is missing or weak
  • Minimal fix: the smallest additional evidence that would address the gap
  • Severity: major | minor (optional)

Workflow

  1. Iterate claims in output/CLAIMS.md.
  2. For empirical claims, check:
    • dataset/task definition is clear
    • baselines are appropriate
    • evaluation protocol is valid
    • ablations/sensitivity analyses exist where needed
  3. For conceptual claims, check:
    • definitions are unambiguous
    • assumptions are stated
    • claims do not exceed what is argued
  4. Write output/MISSING_EVIDENCE.md as a list of claim-by-claim entries.

Definition of Done

  • Every claim from output/CLAIMS.md has an evidence note or a gap item.
  • “Fix” items are actionable (what to add, not “more experiments”).

Troubleshooting

Issue: you cannot locate the evidence in the paper

Fix:

  • Mark the claim as “evidence not locatable” and ask for a clearer source pointer (or re-extract claims with better pointers).

Issue: the audit starts proposing new claims

Fix:

  • Stop; only critique what exists in output/CLAIMS.md and the manuscript.