Test 183

Jan 1, 2028 / 1 fact

Request

Owen expects to close the Q1 four-lane evidence packet on March 31, 2028. Please check April 3 and, if 10:00 a.m. Central is free, reserve a 30-minute audit handoff. Put the standard quarterly hands-on audit scope in the notes.

Required memory

Fact 230

Once per quarter after Owen closes the four-lane packet, Riley Tanaka will select one lane and independently recheck its denominator or coverage dates, outcome window, exclusions, reliability evidence, and revenue and forecast treatment.

Source evidence (1)

003831Dec 4, 2026 / 11:18 UTC-06:00

Priya approved the Lifecycle Systems operating model in this morning’s decision meeting, effective January 5, 2027. Through January 4, I continue my current routine preparation and source-closure attendance; nothing changes early. Owen’s monthly sanitized campaign snapshot remains due on the second business day. Ines’s lifecycle-governance and owner-state certification and Daniela’s source-reliability and release certification are due by the fourth business day. By the fifth business day, Owen must close or explicitly leave incomplete the routine four-lane source review and send one closure-and-exception summary. Beginning January 5, I stop attending routine monthly preparation and closure reviews and enter for missing required fields, disputed semantics, cross-surface discrepancies, customer corrections or incident stops, or causal, revenue, forecast, board-readiness, or executive-language decisions. Once per quarter, after Owen closes the packet, I’ll select one lane and independently recheck its denominator or coverage dates, outcome window, exclusions, reliability evidence, and revenue and forecast treatment. That recheck does not reopen source closure, approve Ines’s certification, or exercise Daniela’s release or rollback controls. Update `2027 Lifecycle Systems leadership model — December 4 decision draft` into the approved decision record with the January 5 effective date and these boundaries, then post the concise implementation summary in #lifecycle-systems for Owen, Ines, and Daniela, including that no attendance or authority change takes effect before January 5.

Message 003831 in history

Expected tool calls

list_calendar_events
create_calendar_event

Grading

1. field_equals / create_calendar_event

{
  "type": "field_equals",
  "tool": "create_calendar_event",
  "action_id": "create_audit_handoff",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_183_00"
}

2. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_apr3_calendar",
  "path": "args.date",
  "value": "2028-04-03",
  "check_id": "riley_183_01"
}

3. datetime_absolute_eq / create_calendar_event

{
  "type": "datetime_absolute_eq",
  "tool": "create_calendar_event",
  "action_id": "create_audit_handoff",
  "path": "args.start",
  "value": "2028-04-03T10:00:00-05:00",
  "check_id": "riley_183_02"
}

4. datetime_absolute_eq / create_calendar_event

{
  "type": "datetime_absolute_eq",
  "tool": "create_calendar_event",
  "action_id": "create_audit_handoff",
  "path": "args.end",
  "value": "2028-04-03T10:30:00-05:00",
  "check_id": "riley_183_03"
}

5. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_apr3_calendar",
  "path": "args.timezone",
  "value": "America/Chicago",
  "check_id": "riley_183_04"
}

6. field_llm_judge / create_calendar_event

{
  "type": "field_llm_judge",
  "tool": "create_calendar_event",
  "action_id": "create_audit_handoff",
  "path": "args",
  "criterion": "The event is clearly a Q1 evidence audit handoff. Its notes say that after Owen closes the four-lane packet, one lane will be independently rechecked for its denominator or coverage dates, outcome window, exclusions, reliability evidence, revenue treatment, and forecast treatment.",
  "check_id": "riley_183_05"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_calendar_event",
        "action_id": "create_audit_handoff",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_183_00"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_apr3_calendar",
        "path": "args.date",
        "value": "2028-04-03",
        "check_id": "riley_183_01"
      },
      {
        "type": "datetime_absolute_eq",
        "tool": "create_calendar_event",
        "action_id": "create_audit_handoff",
        "path": "args.start",
        "value": "2028-04-03T10:00:00-05:00",
        "check_id": "riley_183_02"
      },
      {
        "type": "datetime_absolute_eq",
        "tool": "create_calendar_event",
        "action_id": "create_audit_handoff",
        "path": "args.end",
        "value": "2028-04-03T10:30:00-05:00",
        "check_id": "riley_183_03"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_apr3_calendar",
        "path": "args.timezone",
        "value": "America/Chicago",
        "check_id": "riley_183_04"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_calendar_event",
        "action_id": "create_audit_handoff",
        "path": "args",
        "criterion": "The event is clearly a Q1 evidence audit handoff. Its notes say that after Owen closes the four-lane packet, one lane will be independently rechecked for its denominator or coverage dates, outcome window, exclusions, reliability evidence, revenue treatment, and forecast treatment.",
        "check_id": "riley_183_05"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/riley/183.yaml

SHA-256: 3c44e2edd1b6abf9f45150a6fb57533118a843c37c35ce161e699edc63243740