DolphinBench
DiscordGitHub

Test 083

Sep 14, 2026 / 1 fact

YAML

Request

Email amina.shah@observatory.example a first invitation to lead a 20-minute guest segment on practical API reliability at our remote roundtable, October 8 at 1 PM Pacific. Ask if she is available and sign the email.

Required memory

Fact 91

Morgan Chen’s outbound signature line now needs to read exactly `Morgan Chen · Co-Founder & CEO, Scaffold`, rather than just CEO, because the board wants the co-founder framing.

Source evidence (1)

000463Apr 29, 2023 / 09:00 UTC-07:00

still fiddling with the IMP-K note. tiny but not tiny. sig line needs to read exactly `Morgan Chen · Co-Founder & CEO, Scaffold` now, not just CEO -- board wants the co-founder framing on outbound. weird how much people read into one line

Message 000463 in history

Expected tool calls

  • send_email

Grading

1. field_equals / send_email
{
  "type": "field_equals",
  "tool": "send_email",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_083_00",
  "action_id": "morgan_083_send_email"
}
2. field_equals / send_email
{
  "type": "field_equals",
  "path": "result.to",
  "value": "amina.shah@observatory.example",
  "tool": "send_email",
  "check_id": "morgan_083_01",
  "action_id": "morgan_083_send_email"
}
3. field_regex / send_email
{
  "type": "field_regex",
  "path": "result.body",
  "pattern": "Morgan Chen · Co-Founder & CEO, Scaffold\\s*$",
  "tool": "send_email",
  "check_id": "morgan_083_02",
  "action_id": "morgan_083_send_email"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_email",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_083_00",
        "action_id": "morgan_083_send_email"
      },
      {
        "type": "field_equals",
        "path": "result.to",
        "value": "amina.shah@observatory.example",
        "tool": "send_email",
        "check_id": "morgan_083_01",
        "action_id": "morgan_083_send_email"
      },
      {
        "type": "field_regex",
        "path": "result.body",
        "pattern": "Morgan Chen · Co-Founder & CEO, Scaffold\\s*$",
        "tool": "send_email",
        "check_id": "morgan_083_02",
        "action_id": "morgan_083_send_email"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/083.yaml

SHA-256: 5395815a3d2644bb23bae0dc401c00da80b9b3bd545566b5b529050f574faab7