DolphinBench

Test 163

Sep 14, 2026 / 1 fact

YAML

Request

Create the original March 2023 retention-team history entry, recording the new lead's name, start date, role, and reporting line.

Required memory

Fact 24

Anna Martinez started at Scaffold on March 13, 2023 as retention-data lead, reporting to Devon.

Source evidence (1)

000231Mar 13, 2023 / 11:00 UTC-07:00

Anna Martinez started today. retention-data lead, sits under Devon. got her set up and into the docs this morning; first full week is just ramp, but feels good to have her in on this now.

Message 000231 in history

Expected tool calls

  • create_doc

Grading

1. field_equals / create_doc
{
  "type": "field_equals",
  "tool": "create_doc",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_163_00",
  "action_id": "morgan_163_create_doc"
}
2. field_llm_judge / create_doc
{
  "type": "field_llm_judge",
  "path": "result.document.body",
  "criterion": "Records Anna Martinez starting March 13, 2023 as retention-data lead reporting to Devon. Keeps the reporting line historical rather than asserting an unchanged current org chart.",
  "tool": "create_doc",
  "check_id": "morgan_163_01",
  "action_id": "morgan_163_create_doc"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_163_00",
        "action_id": "morgan_163_create_doc"
      },
      {
        "type": "field_llm_judge",
        "path": "result.document.body",
        "criterion": "Records Anna Martinez starting March 13, 2023 as retention-data lead reporting to Devon. Keeps the reporting line historical rather than asserting an unchanged current org chart.",
        "tool": "create_doc",
        "check_id": "morgan_163_01",
        "action_id": "morgan_163_create_doc"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/163.yaml

SHA-256: 634e60a554154d28c90986e90b71cc5c3bec6b80da478403b781cca9ffb77785