DolphinBench

Test 175

Sep 14, 2026 / 1 fact

YAML

Request

Create and save a document reconstructing the early-call debrief template for the 2024 customer-growth/GTM leader search, including its comparison criteria and decision limits.

Required memory

Fact 190

On March 13, 2024, Morgan Chen requested a screen-debrief template for use after early customer-growth candidate calls that compares repeatable enterprise adoption, judgment about not promising product, ability to work without a mature sales organization, technical-buyer comfort, and stage fit, while excluding final candidate-decision language and providing a clean comparison of the slate.

Source evidence (1)

001057Mar 13, 2024 / 11:22 UTC-07:00

HR says the customer-growth slate is stronger now. Please make me a screen-debrief template we can use after early calls: compare candidates on repeatable enterprise adoption, judgment about not promising product, ability to work without a mature sales org, technical-buyer comfort, and stage fit. No final candidate decision language — just a clean way to compare the slate.

Message 001057 in history

Expected tool calls

  • create_doc

Grading

1. field_equals / create_doc
{
  "type": "field_equals",
  "tool": "create_doc",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_175_00",
  "action_id": "morgan_175_create_doc"
}
2. field_llm_judge / create_doc
{
  "type": "field_llm_judge",
  "path": "result.document.body",
  "criterion": "Compares repeatable enterprise adoption, judgment about not promising product, ability to work without a mature sales org, technical-buyer comfort, and stage fit. Compares the slate without making a final candidate decision.",
  "tool": "create_doc",
  "check_id": "morgan_175_01",
  "action_id": "morgan_175_create_doc"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_175_00",
        "action_id": "morgan_175_create_doc"
      },
      {
        "type": "field_llm_judge",
        "path": "result.document.body",
        "criterion": "Compares repeatable enterprise adoption, judgment about not promising product, ability to work without a mature sales org, technical-buyer comfort, and stage fit. Compares the slate without making a final candidate decision.",
        "tool": "create_doc",
        "check_id": "morgan_175_01",
        "action_id": "morgan_175_create_doc"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/175.yaml

SHA-256: f0fb05596c06bee2e94f0e5818241fe2365d362ab9f962f60ae86c394c871626