Test 189

Sep 14, 2026 / 1 fact

Request

Update Kestrel Marketing's CRM notes with the April 2023 delivery-performance issue and how it compared with Acme and Blueline.

Required memory

Fact 71

On April 23, 2023, Morgan Chen reported that Kestrel Marketing was the third contractor that month whose deliverables were all slipping, following the same pattern as Acme and Blueline but taking longer to become apparent.

Source evidence (1)

000428Apr 23, 2023 / 16:00 UTC-07:00

third contractor this month with the exact same mess. Kestrel Marketing now too. every deliverable slipping, just took longer to show itself than Acme and Blueline. tired of being right about this stuff. Kara at Kestrel is kara@kestrel-test.com. and for the Blueline wind-down ops contact is still the one to use.

Message 000428 in history

Expected tool calls

update_crm_row

Grading

1. field_equals / update_crm_row

{
  "type": "field_equals",
  "tool": "update_crm_row",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_189_00",
  "action_id": "morgan_189_update_crm_row"
}

2. field_equals / update_crm_row

{
  "type": "field_equals",
  "path": "result.row.id",
  "value": "crm_kestrel_marketing",
  "tool": "update_crm_row",
  "check_id": "morgan_189_01",
  "action_id": "morgan_189_update_crm_row"
}

3. field_llm_judge / update_crm_row

{
  "type": "field_llm_judge",
  "path": "result.row.notes",
  "criterion": "Records Kestrel as the third contractor that month with slipping deliverables, matching Acme and Blueline, but with the problem taking longer to become apparent. Does not confuse delayed discovery with merely longer delivery time.",
  "tool": "update_crm_row",
  "check_id": "morgan_189_02",
  "action_id": "morgan_189_update_crm_row"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "update_crm_row",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_189_00",
        "action_id": "morgan_189_update_crm_row"
      },
      {
        "type": "field_equals",
        "path": "result.row.id",
        "value": "crm_kestrel_marketing",
        "tool": "update_crm_row",
        "check_id": "morgan_189_01",
        "action_id": "morgan_189_update_crm_row"
      },
      {
        "type": "field_llm_judge",
        "path": "result.row.notes",
        "criterion": "Records Kestrel as the third contractor that month with slipping deliverables, matching Acme and Blueline, but with the problem taking longer to become apparent. Does not confuse delayed discovery with merely longer delivery time.",
        "tool": "update_crm_row",
        "check_id": "morgan_189_02",
        "action_id": "morgan_189_update_crm_row"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/morgan/189.yaml

SHA-256: 4456433d0e341fd22cd53e8f9a6873c1283864608637cf4863bba151ff234ec0