Test 030

Jan 1, 2028 / 1 fact

Request

Review the January South Slope internet invoice in my inbox. Then send the provider an email asking it to correct only charges that conflict with our current service. State our current speed, monthly price, equipment ownership, and whether installation or plan-change fees apply.

Required memory

Fact 289

On November 1, 2027, the ISP remotely activated Alex Valdez’s 300 Mbps internet plan at $60 per month using his existing customer-owned equipment, with no installation or plan-change fee; the account page shows no remaining 1 Gbps charge.

Source evidence (1)

004827Nov 1, 2027 / 11:20 UTC-04:00

The ISP applied the scheduled remote change without replacing my customer-owned equipment or charging an installation or plan-change fee. From 9:00 to 11:00 AM, Devika and I held simultaneous video calls while I ran an ordinary 12 GB work upload. Neither call dropped or degraded, and the upload completed without a connection reset. The account page now shows 300 Mbps at $60 per month with no remaining 1 Gbps charge.

Message 004827 in history

Expected tool calls

list_inbox
send_email

Grading

1. field_equals / send_email

{
  "type": "field_equals",
  "tool": "send_email",
  "action_id": "alex_030_send_email",
  "path": "result.ok",
  "value": true,
  "check_id": "alex_030_00"
}

2. field_equals / list_inbox

{
  "type": "field_equals",
  "tool": "list_inbox",
  "action_id": "alex_030_read_email",
  "path": "result.0.id",
  "value": "inv_ss_2028_01",
  "check_id": "alex_030_01"
}

3. field_equals / send_email

{
  "type": "field_equals",
  "path": "result.to",
  "value": "billing@southslopeisp.example",
  "tool": "send_email",
  "action_id": "alex_030_send_email",
  "check_id": "alex_030_02"
}

4. field_llm_judge / send_email

{
  "type": "field_llm_judge",
  "path": "result.body",
  "criterion": "The email states that the current service is 300 Mbps for $60 with customer-owned equipment and no installation or plan-change fee. It asks the provider to correct or credit charges that conflict with those terms without canceling service, changing plans again, or ordering equipment.",
  "tool": "send_email",
  "action_id": "alex_030_send_email",
  "check_id": "alex_030_03"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_email",
        "action_id": "alex_030_send_email",
        "path": "result.ok",
        "value": true,
        "check_id": "alex_030_00"
      },
      {
        "type": "field_equals",
        "tool": "list_inbox",
        "action_id": "alex_030_read_email",
        "path": "result.0.id",
        "value": "inv_ss_2028_01",
        "check_id": "alex_030_01"
      },
      {
        "type": "field_equals",
        "path": "result.to",
        "value": "billing@southslopeisp.example",
        "tool": "send_email",
        "action_id": "alex_030_send_email",
        "check_id": "alex_030_02"
      },
      {
        "type": "field_llm_judge",
        "path": "result.body",
        "criterion": "The email states that the current service is 300 Mbps for $60 with customer-owned equipment and no installation or plan-change fee. It asks the provider to correct or credit charges that conflict with those terms without canceling service, changing plans again, or ordering equipment.",
        "tool": "send_email",
        "action_id": "alex_030_send_email",
        "check_id": "alex_030_03"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/alex/030.yaml

SHA-256: 241ab4176cc86c7de24ced33825680c65edd6092ae112f46c78372b26e0bc4d0