Test 191

Jan 1, 2028 / 1 fact

Request

Create a short claim-preparation note for a January 1, 2028 South Slope water-backup incident involving about $2,600 of damaged household property and possibly two hotel nights, using the active policy terms without promising coverage.

Required memory

Fact 240

The bound South Slope renter’s-insurance policy runs from January 5, 2027 through January 5, 2028 with a $500 deductible, $40,000 in replacement-cost personal-property coverage, $12,000 in loss-of-use coverage, the water-backup endorsement, and no separate bicycle or electronics sublimits; coverage is continuous with no gap, and no renewal follow-up remains.

Source evidence (1)

003729Jan 4, 2027 / 19:10 UTC-05:00

Devika agreed, and we accepted the South Slope renter’s-insurance renewal and paid the $231 annual premium before the deadline. The bound policy runs from January 5, 2027 through January 5, 2028 with a $500 deductible, $40,000 in replacement-cost personal-property coverage, $12,000 in loss-of-use coverage, the water-backup endorsement, and no separate bicycle or electronics sublimits. Coverage is continuous with no gap, and there’s no renewal follow-up left.

Message 003729 in history

Expected tool calls

create_doc

Grading

1. field_equals / create_doc

{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "alex_191_create_doc",
  "path": "result.ok",
  "value": true,
  "check_id": "alex_191_00"
}

2. field_llm_judge / create_doc

{
  "type": "field_llm_judge",
  "path": "result.document.body",
  "criterion": "The note states the active $500 deductible, $40,000 replacement-cost personal-property limit, $12,000 loss-of-use limit, water-backup endorsement, and absence of separate bicycle or electronics sublimits. It lists practical evidence to gather for the damaged property, water event, and possible hotel expenses, and it does not promise that any item or expense is covered.",
  "tool": "create_doc",
  "action_id": "alex_191_create_doc",
  "check_id": "alex_191_01"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "alex_191_create_doc",
        "path": "result.ok",
        "value": true,
        "check_id": "alex_191_00"
      },
      {
        "type": "field_llm_judge",
        "path": "result.document.body",
        "criterion": "The note states the active $500 deductible, $40,000 replacement-cost personal-property limit, $12,000 loss-of-use limit, water-backup endorsement, and absence of separate bicycle or electronics sublimits. It lists practical evidence to gather for the damaged property, water event, and possible hotel expenses, and it does not promise that any item or expense is covered.",
        "tool": "create_doc",
        "action_id": "alex_191_create_doc",
        "check_id": "alex_191_01"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/alex/191.yaml

SHA-256: 22ceef0aab71b3c4b0810abedb2841eb54c17258fb651ec1ce3affb88fcfc081