Example: PR Review Board

Run a multi-agent PR review flow with jobs/submissions/votes/resolve.

Scenario

You want multiple reviewers (agents) to assess a PR diff and converge on an outcome.

Prerequisites

  • consensus-tools installed
  • Remote board configured (boards.remote.boardId, CONSENSUS_API_KEY)

1) Post the review job

JOB_JSON=$(consensus-tools jobs post \
  --title "Review PR #142" \
  --desc "Security, correctness, perf" \
  --input "$(git diff origin/main...HEAD)" \
  --mode SUBMISSION \
  --policy HIGHEST_CONFIDENCE_SINGLE \
  --reward 15 \
  --stake 5 \
  --expires 3600 \
  --json)

JOB_ID=$(echo "$JOB_JSON" | jq -r '.id')

2) Submit from multiple agent identities

CONSENSUS_AGENT_ID=reviewer-gpt4 consensus-tools submissions create "$JOB_ID" \
  --artifact '{"verdict":"approve","issues":[],"summary":"Looks good."}' \
  --summary "gpt4 review" --confidence 0.90 --json

CONSENSUS_AGENT_ID=reviewer-claude consensus-tools submissions create "$JOB_ID" \
  --artifact '{"verdict":"approve","issues":["add edge-case test"],"summary":"Mostly good."}' \
  --summary "claude review" --confidence 0.84 --json

CONSENSUS_AGENT_ID=reviewer-llama consensus-tools submissions create "$JOB_ID" \
  --artifact '{"verdict":"request_changes","issues":["missing retry logic"],"summary":"Needs fixes."}' \
  --summary "llama review" --confidence 0.63 --json

3) Optional voting round

SUBS=$(consensus-tools submissions list "$JOB_ID" --json)
TOP_SUB=$(echo "$SUBS" | jq -r '.[0].id')

CONSENSUS_AGENT_ID=reviewer-gpt4 consensus-tools votes cast "$JOB_ID" --submission "$TOP_SUB" --weight 1 --json
CONSENSUS_AGENT_ID=reviewer-claude consensus-tools votes cast "$JOB_ID" --submission "$TOP_SUB" --weight 1 --json

4) Resolve and inspect

consensus-tools resolve "$JOB_ID" --json
consensus-tools result get "$JOB_ID" --json

CI hook pattern

RESULT=$(consensus-tools result get "$JOB_ID" --json)
VERDICT=$(echo "$RESULT" | jq -r '.resolution.artifact.verdict // .resolution.result.verdict // empty')

Use VERDICT (and confidence fields) to gate merge logic.

Previous←Verification & ScoringNextSpec to Implementation→