DolphinBench
DiscordGitHub

Test 099

Sep 14, 2026 / 1 fact

YAML

Request

Nora at +14155550123 asks whether Kibo can have a backup treat whose label lists turkey. Text her back.

Required memory

Fact 130

Morgan Chen requested a short, reusable Kibo care note stating the blunt food rule: give Kibo no poultry-based treats or food; chicken meal counts as poultry; and if a label contains chicken, turkey, duck, poultry meal, or similar, skip it and ask Morgan instead of guessing.

Source evidence (1)

000667Aug 1, 2023 / 19:49 UTC-07:00

Jamie caught an ingredient issue for Kibo. 8/1/2023, 7:42 PM — Jamie Found a training-treat label in the new bag and wanted to check before giving Kibo any. Ingredients: salmon, oat flour, sweet potato, chicken meal, flaxseed, glycerin, mixed tocopherols. Safe for him or no because of the chicken meal? Please save a short reusable Kibo care note with the blunt food rule: no poultry-based treats or food, and chicken meal counts as poultry. If a label has chicken, turkey, duck, poultry meal, or similar, skip it and ask me instead of guessing.

Message 000667 in history

Expected tool calls

  • send_sms

Grading

1. field_equals / send_sms
{
  "type": "field_equals",
  "tool": "send_sms",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_099_00",
  "action_id": "morgan_099_send_sms"
}
2. field_equals / send_sms
{
  "type": "field_equals",
  "path": "result.to",
  "value": "+14155550123",
  "tool": "send_sms",
  "check_id": "morgan_099_01",
  "action_id": "morgan_099_send_sms"
}
3. field_llm_judge / send_sms
{
  "type": "field_llm_judge",
  "path": "result.body",
  "criterion": "Clearly says not to give Kibo the turkey-containing treat. Explaining that turkey is poultry is optional; allowing a small amount fails.",
  "tool": "send_sms",
  "check_id": "morgan_099_02",
  "action_id": "morgan_099_send_sms"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_sms",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_099_00",
        "action_id": "morgan_099_send_sms"
      },
      {
        "type": "field_equals",
        "path": "result.to",
        "value": "+14155550123",
        "tool": "send_sms",
        "check_id": "morgan_099_01",
        "action_id": "morgan_099_send_sms"
      },
      {
        "type": "field_llm_judge",
        "path": "result.body",
        "criterion": "Clearly says not to give Kibo the turkey-containing treat. Explaining that turkey is poultry is optional; allowing a small amount fails.",
        "tool": "send_sms",
        "check_id": "morgan_099_02",
        "action_id": "morgan_099_send_sms"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/099.yaml

SHA-256: ad1c713ea2e483af1a36330de74a86c10145aa40845f9d4adab79541fa9583ae