Test 043

Jan 1, 2028 / 1 fact

Request

Create a document archiving Mom’s 2026 prescription plan. Clearly identify it as an expired, historical plan-year record rather than current coverage. Separate the fixed plan terms from the historical preferred-pharmacy status and medication costs, and include the relevant plan-year dates and medication-specific treatment.

Required memory

Fact 151

Riley Tanaka requests sending Mom this text: “We confirmed your 2026 Golden State Rx Saver (PDP): $31.70/month with a $590 annual drug deductible. River Park remains a preferred in-network pharmacy; lisinopril 10 mg and atorvastatin 20 mg stay tier 1 at $0 there, and Ventolin HFA 90 mcg/actuation is $47 after the deductible. You chose to renew for January 1–December 31, 2026; your 2026 coverage does not begin until January 1.”

Source evidence (1)

003466Nov 11, 2025 / 19:10 UTC-06:00

Send Mom this text: “We confirmed your 2026 Golden State Rx Saver (PDP): $31.70/month with a $590 annual drug deductible. River Park remains a preferred in-network pharmacy; lisinopril 10 mg and atorvastatin 20 mg stay tier 1 at $0 there, and Ventolin HFA 90 mcg/actuation is $47 after the deductible. You chose to renew for January 1–December 31, 2026; your 2026 coverage does not begin until January 1.”

Message 003466 in history

Expected tool calls

create_doc

Grading

1. field_equals / create_doc

{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_2026_archive",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_043_00"
}

2. field_llm_judge / create_doc

{
  "type": "field_llm_judge",
  "tool": "create_doc",
  "action_id": "create_2026_archive",
  "path": "args",
  "criterion": "The document is clearly an expired historical record for January 1 through December 31, 2026. It identifies Golden State Rx Saver (PDP), a $31.70 monthly premium, and a $590 annual drug deductible. It separately states that River Park was preferred and in-network; lisinopril 10 mg and atorvastatin 20 mg were tier 1 and cost $0 there; and Ventolin HFA 90 mcg cost $47 there after the deductible.",
  "check_id": "riley_043_01"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_2026_archive",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_043_00"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_doc",
        "action_id": "create_2026_archive",
        "path": "args",
        "criterion": "The document is clearly an expired historical record for January 1 through December 31, 2026. It identifies Golden State Rx Saver (PDP), a $31.70 monthly premium, and a $590 annual drug deductible. It separately states that River Park was preferred and in-network; lisinopril 10 mg and atorvastatin 20 mg were tier 1 and cost $0 there; and Ventolin HFA 90 mcg cost $47 there after the deductible.",
        "check_id": "riley_043_01"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/riley/043.yaml

SHA-256: 1ea6ba71912bdb7633464add85879ee906c449193022d9bde0430ef31ec6c595