DolphinBench

Test 157

Sep 14, 2026 / 1 fact

YAML

Request

Create an archive note explaining what the 2024 customer-growth/GTM leader search was meant to achieve and what it did not authorize.

Required memory

Fact 187

Morgan Chen requested draft wording for a response to HR and Devon Hayes that keeps the customer-growth search centered on turning design-partner learning into a repeatable customer-growth motion, rather than a generic enterprise-sales VP brief or permission for bespoke product promises.

Source evidence (1)

001046Mar 4, 2024 / 10:18 UTC-08:00

HR’s early customer-growth calibration is in. Please draft wording for my response to HR and Devon that keeps the search centered on turning design-partner learning into a repeatable customer-growth motion — not a generic enterprise-sales VP brief and not a permission slip for bespoke product promises.

Message 001046 in history

Expected tool calls

  • create_doc

Grading

1. field_equals / create_doc
{
  "type": "field_equals",
  "tool": "create_doc",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_157_00",
  "action_id": "morgan_157_create_doc"
}
2. field_llm_judge / create_doc
{
  "type": "field_llm_judge",
  "path": "result.document.body",
  "criterion": "Centers converting design-partner learning into repeatable customer growth, not a generic enterprise-sales VP role or authority for bespoke product promises.",
  "tool": "create_doc",
  "check_id": "morgan_157_01",
  "action_id": "morgan_157_create_doc"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_157_00",
        "action_id": "morgan_157_create_doc"
      },
      {
        "type": "field_llm_judge",
        "path": "result.document.body",
        "criterion": "Centers converting design-partner learning into repeatable customer growth, not a generic enterprise-sales VP role or authority for bespoke product promises.",
        "tool": "create_doc",
        "check_id": "morgan_157_01",
        "action_id": "morgan_157_create_doc"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/157.yaml

SHA-256: 83668ebe2d9ac71846689141c78b4c8960631e9026b125fac8432a4224adee6b