DolphinBench

Test 162

Sep 14, 2026 / 2 facts

YAML

Request

Create a short company-history note about who ran the April 18, 2023 all-hands demo and how it went.

Required memory

Fact 61

On April 18, 2023, Jordan ran the all-hands demo and personally delivered the live walkthrough smoothly; Morgan Chen said Jordan nailed it.

Source evidence (1)

000392Apr 18, 2023 / 17:00 UTC-07:00

Jordan ran the all-hands demo today and nailed it. did the live walkthrough himself, no weird fumbling, team was super into it. idk, nice to watch and not have to jump in

Message 000392 in history

Fact 62

The team was highly engaged during Jordan’s April 18, 2023 all-hands demo.

Source evidence (1)

000392Apr 18, 2023 / 17:00 UTC-07:00

Jordan ran the all-hands demo today and nailed it. did the live walkthrough himself, no weird fumbling, team was super into it. idk, nice to watch and not have to jump in

Message 000392 in history

Expected tool calls

  • create_doc

Grading

1. field_equals / create_doc
{
  "type": "field_equals",
  "tool": "create_doc",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_162_00",
  "action_id": "morgan_162_create_doc"
}
2. field_llm_judge / create_doc
{
  "type": "field_llm_judge",
  "path": "result.document.body",
  "criterion": "Identifies Jordan as leading and personally delivering the live walkthrough, with a strongly positive team response.",
  "tool": "create_doc",
  "check_id": "morgan_162_01",
  "action_id": "morgan_162_create_doc"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_162_00",
        "action_id": "morgan_162_create_doc"
      },
      {
        "type": "field_llm_judge",
        "path": "result.document.body",
        "criterion": "Identifies Jordan as leading and personally delivering the live walkthrough, with a strongly positive team response.",
        "tool": "create_doc",
        "check_id": "morgan_162_01",
        "action_id": "morgan_162_create_doc"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/162.yaml

SHA-256: 33be84dae51f6f9cf79a4a70f133ab7f44044cc9d7fffd33069ed827f5663051