Test 064

Sep 14, 2026 / 1 fact

Request

Create a short document titled Operations director reference checks explaining what we missed when hiring Reece and what HR should verify this time.

Required memory

Fact 15

Morgan Chen reported that in late 2021, their organization hired Reece as operations director and learned about two months later that Reece had been quietly pushed out of the previous job under terms that had not been disclosed to them.

Source evidence (1)

000155Feb 17, 2023 / 20:45 UTC-08:00

keep thinking about the Reece thing from late '21. we brought him in as ops director and then like two months later found out he'd been quietly pushed out of the last job under terms nobody had surfaced to us. whole exit got weird fast. ate maybe three weeks of board time for absolutely no reason. idk. Kibo is passed out by the heater and i'm still annoyed

Message 000155 in history

Expected tool calls

create_doc

Grading

1. field_equals / create_doc

{
  "type": "field_equals",
  "tool": "create_doc",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_064_00",
  "action_id": "morgan_064_create_doc"
}

2. field_llm_judge / create_doc

{
  "type": "field_llm_judge",
  "path": "result.document.body",
  "criterion": "Explains that Reece had been quietly pushed out of the previous job under undisclosed separation terms, which hiring failed to uncover. Directs HR to verify the new candidate's actual departure circumstances and separation terms with references. No exact count of questions, hiring date, or board-time recap is required.",
  "tool": "create_doc",
  "check_id": "morgan_064_01",
  "action_id": "morgan_064_create_doc"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_064_00",
        "action_id": "morgan_064_create_doc"
      },
      {
        "type": "field_llm_judge",
        "path": "result.document.body",
        "criterion": "Explains that Reece had been quietly pushed out of the previous job under undisclosed separation terms, which hiring failed to uncover. Directs HR to verify the new candidate's actual departure circumstances and separation terms with references. No exact count of questions, hiring date, or board-time recap is required.",
        "tool": "create_doc",
        "check_id": "morgan_064_01",
        "action_id": "morgan_064_create_doc"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/morgan/064.yaml

SHA-256: 4b10ff18ae0a0abccfe29aaa4d182f0db47c0c36a1699ce1b1619ea6f9a5f079