DolphinBench

Test 078

Sep 14, 2026 / 1 fact

YAML

Request

Send Jordan a Discord DM telling him where to leave async feedback on the new onboarding mockup.

Required memory

Fact 50

On April 11, 2023, Morgan Chen made the Figma file the default place for design review going forward.

Source evidence (1)

000329Apr 11, 2023 / 09:00 UTC-07:00

so yeah we're just gonna make the Figma file the default place for design review now. simpler

Message 000329 in history

Expected tool calls

  • send_discord_dm

Grading

1. field_equals / send_discord_dm
{
  "type": "field_equals",
  "tool": "send_discord_dm",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_078_00",
  "action_id": "morgan_078_send_discord_dm"
}
2. field_equals / send_discord_dm
{
  "type": "field_equals",
  "path": "result.user",
  "value": "jordan",
  "tool": "send_discord_dm",
  "check_id": "morgan_078_01",
  "action_id": "morgan_078_send_discord_dm"
}
3. field_llm_judge / send_discord_dm
{
  "type": "field_llm_judge",
  "path": "result.message",
  "criterion": "Directs Jordan to leave design feedback in the Figma file.",
  "tool": "send_discord_dm",
  "check_id": "morgan_078_02",
  "action_id": "morgan_078_send_discord_dm"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_discord_dm",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_078_00",
        "action_id": "morgan_078_send_discord_dm"
      },
      {
        "type": "field_equals",
        "path": "result.user",
        "value": "jordan",
        "tool": "send_discord_dm",
        "check_id": "morgan_078_01",
        "action_id": "morgan_078_send_discord_dm"
      },
      {
        "type": "field_llm_judge",
        "path": "result.message",
        "criterion": "Directs Jordan to leave design feedback in the Figma file.",
        "tool": "send_discord_dm",
        "check_id": "morgan_078_02",
        "action_id": "morgan_078_send_discord_dm"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/078.yaml

SHA-256: a0b4626ec0ef5a3ebb8f6f45aaabce3b15d54ca4e1371e7ba71a10c73f18e0b2