DolphinBench

Test 041

Sep 14, 2026 / 1 fact

YAML

Request

Create a personal calendar hold for Jamie and my next anniversary dinner, from 6 to 10 PM Pacific.

Required memory

Fact 23

Morgan Chen and Jamie's anniversary is Sunday, March 19, 2023, and Morgan intends not to postpone or skip it this year.

Source evidence (1)

000230Mar 13, 2023 / 09:00 UTC-07:00

Week's basically Q3 scoping if I can protect the time. product review with Devon, then a couple hours on the model and headcount math. Maya booked her flight for March 21, 2023 btw so need to not let that week get stupid. and Sunday is me/Jamie anniversary, which I'm not punting this year.

Message 000230 in history

Expected tool calls

  • create_calendar_event

Grading

1. field_equals / create_calendar_event
{
  "type": "field_equals",
  "tool": "create_calendar_event",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_041_00",
  "action_id": "morgan_041_create_calendar_event"
}
2. datetime_absolute_eq / create_calendar_event
{
  "type": "datetime_absolute_eq",
  "path": "result.event.start",
  "value": "2027-03-19T18:00:00-07:00",
  "tool": "create_calendar_event",
  "check_id": "morgan_041_01",
  "action_id": "morgan_041_create_calendar_event"
}
3. datetime_absolute_eq / create_calendar_event
{
  "type": "datetime_absolute_eq",
  "path": "result.event.end",
  "value": "2027-03-19T22:00:00-07:00",
  "tool": "create_calendar_event",
  "check_id": "morgan_041_02",
  "action_id": "morgan_041_create_calendar_event"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_calendar_event",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_041_00",
        "action_id": "morgan_041_create_calendar_event"
      },
      {
        "type": "datetime_absolute_eq",
        "path": "result.event.start",
        "value": "2027-03-19T18:00:00-07:00",
        "tool": "create_calendar_event",
        "check_id": "morgan_041_01",
        "action_id": "morgan_041_create_calendar_event"
      },
      {
        "type": "datetime_absolute_eq",
        "path": "result.event.end",
        "value": "2027-03-19T22:00:00-07:00",
        "tool": "create_calendar_event",
        "check_id": "morgan_041_02",
        "action_id": "morgan_041_create_calendar_event"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/041.yaml

SHA-256: cd1104805578d18f65a538cf2df8ca2f55a17c3315936f74df99d3ccc4b487ed