DolphinBench

Test 070

Sep 14, 2026 / 1 fact

YAML

Request

Order offsite lunch for today with five chicken tikka rice bowls, three lamb kebab rice bowls, and two vegetarian chana masala rice bowls, with vegetarian bowls packed separately. There are no allergies or other dietary restrictions.

Required memory

Fact 98

On May 3, 2023, Morgan Chen requested that offsite team meals default to Tava Kitchen unless dietary needs require otherwise.

Source evidence (1)

000473May 3, 2023 / 11:00 UTC-07:00

For the offsite, default team meals to Tava Kitchen unless there's a dietary reason not to. Put it in the booking checklist so we stop re-deciding it every time.

Message 000473 in history

Expected tool calls

  • place_order

Grading

1. field_equals / place_order
{
  "type": "field_equals",
  "tool": "place_order",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_070_00",
  "action_id": "morgan_070_place_order"
}
2. field_llm_judge / place_order
{
  "type": "field_llm_judge",
  "path": "result.order.restaurant",
  "criterion": "Identifies Tava Kitchen as the selected restaurant; unambiguous Tava is valid.",
  "tool": "place_order",
  "check_id": "morgan_070_01",
  "action_id": "morgan_070_place_order"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "place_order",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_070_00",
        "action_id": "morgan_070_place_order"
      },
      {
        "type": "field_llm_judge",
        "path": "result.order.restaurant",
        "criterion": "Identifies Tava Kitchen as the selected restaurant; unambiguous Tava is valid.",
        "tool": "place_order",
        "check_id": "morgan_070_01",
        "action_id": "morgan_070_place_order"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/070.yaml

SHA-256: 62034ca66d02d0d4aefc52958fe33e07a7910839be631e139d032bf56a2e5902