Test 172

Sep 14, 2026 / 1 fact

Request

On archive/b-round-deck#438, correct the archived 2023 retention-slide wording to the description I kept instead of stabilized.

Required memory

Fact 13

By February 15, 2023, after an unidentified man again pushed to replace the retention wording with “stabilized,” Morgan Chen kept the wording that retention had “flattened after the onboarding fixes.”

Source evidence (1)

000146Feb 15, 2023 / 16:00 UTC-08:00

he pushed again on the retention wording. wanted "stabilized" instead of just saying it flattened after the onboarding fixes. i left it. not gonna sand that down for a deck line. little frosty after that, whatever. he's in the data room now and i'm redoing the seed slide again bc apparently the burn bar placement matters more than my blood pressure

Message 000146 in history

Expected tool calls

post_pr_comment

Grading

1. field_equals / post_pr_comment

{
  "type": "field_equals",
  "tool": "post_pr_comment",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_172_00",
  "action_id": "morgan_172_post_pr_comment"
}

2. field_equals / post_pr_comment

{
  "type": "field_equals",
  "path": "result.comment.pr_id",
  "value": "archive/b-round-deck#438",
  "tool": "post_pr_comment",
  "check_id": "morgan_172_01",
  "action_id": "morgan_172_post_pr_comment"
}

3. field_llm_judge / post_pr_comment

{
  "type": "field_llm_judge",
  "path": "result.comment.body",
  "criterion": "Directs use of flattened after the onboarding fixes rather than smoothing it into stabilized. Merely quoting the remembered wording as something to reject fails.",
  "tool": "post_pr_comment",
  "check_id": "morgan_172_02",
  "action_id": "morgan_172_post_pr_comment"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "post_pr_comment",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_172_00",
        "action_id": "morgan_172_post_pr_comment"
      },
      {
        "type": "field_equals",
        "path": "result.comment.pr_id",
        "value": "archive/b-round-deck#438",
        "tool": "post_pr_comment",
        "check_id": "morgan_172_01",
        "action_id": "morgan_172_post_pr_comment"
      },
      {
        "type": "field_llm_judge",
        "path": "result.comment.body",
        "criterion": "Directs use of flattened after the onboarding fixes rather than smoothing it into stabilized. Merely quoting the remembered wording as something to reject fails.",
        "tool": "post_pr_comment",
        "check_id": "morgan_172_02",
        "action_id": "morgan_172_post_pr_comment"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/morgan/172.yaml

SHA-256: e91ea77b8aa310a2046cd748b06cd6bb593a343154667beac36310a38a851039