Test 150

Jan 1, 2028 / 1 fact

Request

Sam's ordinary January rota arrived on December 29, 2027, for coverage beginning January 8, 2028. Apply our established household scheduling rule to decide whether this update requires a review. Do not substitute a general best practice if that rule is unavailable. If the rule requires a review, check January 1 through January 5 and schedule the earliest available 30-minute slot between 6:00 and 8:00 p.m. Central with Sam and me. Explain in the event why the established rule requires the review. If the rule does not require one, do not create an event.

Required memory

Fact 130

Riley Tanaka and Sam ended automatic cadence reviews; either will schedule a review within seven days if a protected Monday is used for restaurant service or Helio work, an ordinary rota arrives less than three weeks ahead, a recurring extra close is added, or Sam’s role terms change.

Source evidence (1)

003299Aug 31, 2025 / 18:15 UTC-05:00

Sam and I completed our August 31 full-summer cadence review. All ten protected Monday blocks from June 23 through August 25 stayed free of restaurant service and Helio work, and ordinary rotas arrived at least three weeks before their covered periods. Sam’s July 6, July 17, August 7, and August 16 private dinners remained replacement assignments, created no recurring extra close, and did not displace a protected Monday. Neither of us added a second mandatory shared slot, and Sunday watercolor was not used as make-up time. We’ve concluded that the structure has enough evidence to become ordinary household practice, nothing remains open from the summer review, and we’ll stop scheduling automatic cadence reviews. Monday remains Sam’s fixed no-service evening, with 6:30pm–9:30pm protected as shared time free of restaurant service and Helio work; ordinary rota notice remains due at least three weeks ahead; the evening cannot become default event coverage; and Sunday watercolor remains separate. If a protected Monday is used for restaurant service or Helio work, an ordinary rota arrives less than three weeks ahead, a recurring extra close is added, or Sam’s role terms change, either of us will schedule a cadence review within seven days. Finalize the existing August 31 summer-cadence review note with the full-period finding, the standing protections, the end of automatic checkpoints, and those four review triggers.

Message 003299 in history

Expected tool calls

list_calendar_events
create_calendar_event

Grading

1. field_equals / create_calendar_event

{
  "type": "field_equals",
  "tool": "create_calendar_event",
  "action_id": "create_cadence_review",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_150_00"
}

2. datetime_absolute_eq / create_calendar_event

{
  "type": "datetime_absolute_eq",
  "tool": "create_calendar_event",
  "action_id": "create_cadence_review",
  "path": "args.start",
  "value": "2028-01-02T18:00:00-06:00",
  "check_id": "riley_150_01"
}

3. datetime_absolute_eq / create_calendar_event

{
  "type": "datetime_absolute_eq",
  "tool": "create_calendar_event",
  "action_id": "create_cadence_review",
  "path": "args.end",
  "value": "2028-01-02T18:30:00-06:00",
  "check_id": "riley_150_02"
}

4. field_list_equals_unordered / create_calendar_event

{
  "type": "field_list_equals_unordered",
  "tool": "create_calendar_event",
  "action_id": "create_cadence_review",
  "path": "args.attendees",
  "values": [
    "riley@helio.example",
    "sam@hydeparkrestaurant.example"
  ],
  "check_id": "riley_150_03"
}

5. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_january_1",
  "path": "args.date",
  "value": "2028-01-01",
  "check_id": "riley_150_04"
}

6. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_january_1",
  "path": "args.timezone",
  "value": "America/Chicago",
  "check_id": "riley_150_05"
}

7. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_january_2",
  "path": "args.date",
  "value": "2028-01-02",
  "check_id": "riley_150_06"
}

8. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_january_2",
  "path": "args.timezone",
  "value": "America/Chicago",
  "check_id": "riley_150_07"
}

9. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_january_1",
  "path": "args.date",
  "value": "2028-01-01",
  "check_id": "riley_150_08"
}

10. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_january_1",
  "path": "args.timezone",
  "value": "America/Chicago",
  "check_id": "riley_150_09"
}

11. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_january_2",
  "path": "args.date",
  "value": "2028-01-02",
  "check_id": "riley_150_10"
}

12. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_january_2",
  "path": "args.timezone",
  "value": "America/Chicago",
  "check_id": "riley_150_11"
}

13. field_llm_judge / create_calendar_event

{
  "type": "field_llm_judge",
  "tool": "create_calendar_event",
  "action_id": "create_cadence_review",
  "path": "args",
  "criterion": "The event is identifiable as a household cadence or scheduling review. Its title and body state that Sam's ordinary January rota arrived less than three weeks before the covered period and therefore triggered a review under the household's established rule, which requires a review within seven days. The exact receipt and coverage dates need not be repeated. It need not separately state that automatic cadence reviews ended.",
  "check_id": "riley_150_12"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_calendar_event",
        "action_id": "create_cadence_review",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_150_00"
      },
      {
        "type": "datetime_absolute_eq",
        "tool": "create_calendar_event",
        "action_id": "create_cadence_review",
        "path": "args.start",
        "value": "2028-01-02T18:00:00-06:00",
        "check_id": "riley_150_01"
      },
      {
        "type": "datetime_absolute_eq",
        "tool": "create_calendar_event",
        "action_id": "create_cadence_review",
        "path": "args.end",
        "value": "2028-01-02T18:30:00-06:00",
        "check_id": "riley_150_02"
      },
      {
        "type": "field_list_equals_unordered",
        "tool": "create_calendar_event",
        "action_id": "create_cadence_review",
        "path": "args.attendees",
        "values": [
          "riley@helio.example",
          "sam@hydeparkrestaurant.example"
        ],
        "check_id": "riley_150_03"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_january_1",
        "path": "args.date",
        "value": "2028-01-01",
        "check_id": "riley_150_04"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_january_1",
        "path": "args.timezone",
        "value": "America/Chicago",
        "check_id": "riley_150_05"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_january_2",
        "path": "args.date",
        "value": "2028-01-02",
        "check_id": "riley_150_06"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_january_2",
        "path": "args.timezone",
        "value": "America/Chicago",
        "check_id": "riley_150_07"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_january_1",
        "path": "args.date",
        "value": "2028-01-01",
        "check_id": "riley_150_08"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_january_1",
        "path": "args.timezone",
        "value": "America/Chicago",
        "check_id": "riley_150_09"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_january_2",
        "path": "args.date",
        "value": "2028-01-02",
        "check_id": "riley_150_10"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_january_2",
        "path": "args.timezone",
        "value": "America/Chicago",
        "check_id": "riley_150_11"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_calendar_event",
        "action_id": "create_cadence_review",
        "path": "args",
        "criterion": "The event is identifiable as a household cadence or scheduling review. Its title and body state that Sam's ordinary January rota arrived less than three weeks before the covered period and therefore triggered a review under the household's established rule, which requires a review within seven days. The exact receipt and coverage dates need not be repeated. It need not separately state that automatic cadence reviews ended.",
        "check_id": "riley_150_12"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/riley/150.yaml

SHA-256: c68f8a3f6c6d5f2cd59846df1169035e80e7c80b6cf0e1b2fa3e9b3d1597f385