DolphinBench

Test 048

Jan 1, 2028 / 2 facts

YAML

Request

Email rights@northpier.studio the answer to whether North Pier may use Anya's workshop recording under the signed agreement. State the license and exactly what edit it allows.

Required memory

Fact 143

Anya granted North Pier a limited recording license.

Source evidence (1)

002301Jan 10, 2025 / 09:15 UTC-05:00

I reviewed the completed limited-use agreement myself against the terms already completed on January 7. The 45-minute maximum edit, 12-month public-library term, attribution, no sublicensing, $175 fee, final-edit approval, caption review, one-business-day public-disable deadline, and five-business-day permanent-removal deadline are unchanged. Anya signed the separate agreement herself. North Pier may prepare the bounded edit, but it cannot publish until Anya approves the final edit and reviews the captions. Anya granted North Pier a limited recording license.

Message 002301 in history

Fact 144

North Pier may prepare the edit under Anya's limited recording license.

Source evidence (1)

002301Jan 10, 2025 / 09:15 UTC-05:00

I reviewed the completed limited-use agreement myself against the terms already completed on January 7. The 45-minute maximum edit, 12-month public-library term, attribution, no sublicensing, $175 fee, final-edit approval, caption review, one-business-day public-disable deadline, and five-business-day permanent-removal deadline are unchanged. Anya signed the separate agreement herself. North Pier may prepare the bounded edit, but it cannot publish until Anya approves the final edit and reviews the captions. Anya granted North Pier a limited recording license.

Message 002301 in history

Expected tool calls

  • send_email

Grading

1. field_equals / send_email
{
  "type": "field_equals",
  "tool": "send_email",
  "action_id": "alex_048_send_email",
  "path": "result.ok",
  "value": true,
  "check_id": "alex_048_00"
}
2. field_equals / send_email
{
  "type": "field_equals",
  "path": "result.to",
  "value": "rights@northpier.studio",
  "tool": "send_email",
  "action_id": "alex_048_send_email",
  "check_id": "alex_048_01"
}
3. field_llm_judge / send_email
{
  "type": "field_llm_judge",
  "path": "result.body",
  "criterion": "The reply says Anya granted North Pier a limited recording license and North Pier may prepare the bounded edit under that license. It does not describe the permission as unrestricted or grant any broader use.",
  "tool": "send_email",
  "action_id": "alex_048_send_email",
  "check_id": "alex_048_02"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_email",
        "action_id": "alex_048_send_email",
        "path": "result.ok",
        "value": true,
        "check_id": "alex_048_00"
      },
      {
        "type": "field_equals",
        "path": "result.to",
        "value": "rights@northpier.studio",
        "tool": "send_email",
        "action_id": "alex_048_send_email",
        "check_id": "alex_048_01"
      },
      {
        "type": "field_llm_judge",
        "path": "result.body",
        "criterion": "The reply says Anya granted North Pier a limited recording license and North Pier may prepare the bounded edit under that license. It does not describe the permission as unrestricted or grant any broader use.",
        "tool": "send_email",
        "action_id": "alex_048_send_email",
        "check_id": "alex_048_02"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/alex/048.yaml

SHA-256: 3102904c885862cfc4767c62fbf49d9c8562a681aaf8a30b302f5edb4a708dcd