Give AI reviewers different jobs before trusting their approvals. Have one recompute a calculation while another checks its denominator and units; have one reproduce a user action while another inspects the saved result. The assignment table below helps a builder or editor choose checks that expose different mistakes.
For the research on shared errors and judge bias, see our cross-model review method. This companion focuses on assigning the checks and recording what each one establishes.
- 01Assign different checks.Independent calculations and source inspection add evidence that another opinion may not.
- 02Keep the first verdict hidden when useful.A reviewer should form its own finding before inheriting the prior conclusion.
- 03Resolve disagreements with evidence.Another vote cannot repair a missing source or an ambiguous acceptance rule.
01 — Replace two approvals with two useful jobsReplace two approvals with two useful jobs
Begin with the claim or behavior whose failure would change the decision. Then give each reviewer an evidence-producing assignment. The table is a proposed review design, not a measured comparison of model combinations.
| Risk in the draft | First review | Complementary review |
|---|---|---|
| Wrong calculation | Recompute from the original inputs | Check whether the denominator and units answer the question |
| Unsupported source claim | Find the exact supporting passage | Compare the passage’s population and period with the draft |
| Broken user action | Execute the acceptance case | Inspect the resulting saved state |
| Misleading comparison | Check each factual entry | Check whether the criteria favor one option without justification |
| Lost qualification | Compare the draft to the source | Read the conclusion without the supporting section |
| Unusable export | Inspect content completeness | Open the recipient’s final artifact |
02 — Give the second reviewer the original inputsGive the second reviewer the original inputs
Consider an illustrative draft: a metric rises from 40 to 50, so the draft calls it a 10% increase. A reviewer that reads only the prose may approve it. A reviewer that starts from the inputs can distinguish an absolute increase of 10 units from a relative increase of 25%: (50 − 40) ÷ 40 × 100.
If the metric itself is a percentage, such as a rate moving from 40% to 50%, the absolute movement is 10 percentage points. That is a third expression with a different meaning. The correct label depends on the question the article is answering.
Do not ask the second reviewer merely whether the first reviewer is reasonable. Give it the inputs, the intended claim and the acceptance rule. The citation verification reference provides a similar separation for source-backed prose.
03 — Turn disagreement into a specific unresolved questionTurn disagreement into a specific unresolved question
When findings differ, compare the input revision and acceptance criterion before requesting another review. Record the specific unresolved question and the evidence or owner decision needed to settle it.
For behavior claims, a replayable check is especially useful. The model trial guide explains how task-specific evidence improves a decision beyond a public ranking.
04 — Spend review effort where it changes acceptanceSpend review effort where it changes acceptance
Anthropic’s evaluation guide distinguishes code-based, model-based and human graders. Use a direct calculation for a total, a model for a nuanced interpretation and the responsible person to settle an ambiguous requirement.
Record the claim checked, evidence inspected, finding and unresolved limitation. Reuse that record when the draft changes so a later editor can tell which checks remain valid. For the artifact itself, use the file acceptance reference.
05 — DecisionWhat to do next
Ask what the second review adds.
Keep a second reviewer when it contributes a distinct check or perspective. Acceptance should rest on the evidence those checks produce, with unresolved judgments left visible.
For implementation support, explore our AI transformation services.