Test 092

Jan 1, 2028 / 2 facts

Request

I’m working from home on Tuesday, January 4, 2028. Please check my calendar from 9:00 to 11:00 a.m. Central and, if that window is clear, create a focus block for a high-bandwidth dashboard review. In the title or notes, identify the best room for stable video calls and large dashboard loads, and note how using it affects Sam’s access to the rest of the house during his off-hours.

Required memory

Fact 22

Riley Tanaka and Sam validated the Cherrywood workroom network with two 45-minute video calls and repeated large dashboard loads while Sam streamed video in the front room; they observed no drops or material slowdowns.

Source evidence (1)

001435May 4, 2024 / 12:16 UTC-05:00

The Cherrywood workroom network fix is complete. Moving the modem to the central hallway improved the signal but did not make the closed-door room fully stable, so Sam and I installed a wired access point there. We ran two 45-minute video calls, repeated large dashboard loads, and tested while Sam streamed video in the front room; there were no drops or material slowdowns. The workroom can remain my office while Sam uses the rest of the house during off-hours. I’m recording the completed result and don’t need another action.

Message 001435 in history

Fact 23

The completed Cherrywood network fix allows the workroom to remain Riley Tanaka's office while Sam uses the rest of the house during off-hours.

Source evidence (1)

001435May 4, 2024 / 12:16 UTC-05:00

Message 001435 in history

Expected tool calls

list_calendar_events
create_calendar_event

Grading

1. field_equals / create_calendar_event

{
  "type": "field_equals",
  "tool": "create_calendar_event",
  "action_id": "create_dashboard_focus",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_092_00"
}

2. field_equals / list_calendar_events

{
  "check_id": "riley_092_01",
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_jan4_window",
  "path": "args.date",
  "value": "2028-01-04"
}

3. datetime_absolute_eq / create_calendar_event

{
  "check_id": "riley_092_02",
  "type": "datetime_absolute_eq",
  "tool": "create_calendar_event",
  "action_id": "create_dashboard_focus",
  "path": "args.start",
  "value": "2028-01-04T09:00:00-06:00"
}

4. datetime_absolute_eq / create_calendar_event

{
  "check_id": "riley_092_03",
  "type": "datetime_absolute_eq",
  "tool": "create_calendar_event",
  "action_id": "create_dashboard_focus",
  "path": "args.end",
  "value": "2028-01-04T11:00:00-06:00"
}

5. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_jan4_window",
  "path": "args.timezone",
  "value": "America/Chicago",
  "check_id": "riley_092_04"
}

6. field_llm_judge / create_calendar_event

{
  "type": "field_llm_judge",
  "tool": "create_calendar_event",
  "action_id": "create_dashboard_focus",
  "path": "args",
  "criterion": "The title or body must clearly identify this event as a focus block for a high-bandwidth dashboard review. Either content field is acceptable; missing or contradictory meaning fails.\n\nThe title or body must unambiguously identify the workroom as the workspace for this block. The optional Cherrywood qualifier is not required. Either content field is acceptable; another room, ambiguous room information, no room identification, or contradictory meaning fails.\n\nThe title or body must state that using the workroom leaves the rest of the house available for Sam during his off-hours. Either content field is acceptable; missing or contradictory meaning fails.",
  "check_id": "riley_092_05"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_calendar_event",
        "action_id": "create_dashboard_focus",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_092_00"
      },
      {
        "check_id": "riley_092_01",
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_jan4_window",
        "path": "args.date",
        "value": "2028-01-04"
      },
      {
        "check_id": "riley_092_02",
        "type": "datetime_absolute_eq",
        "tool": "create_calendar_event",
        "action_id": "create_dashboard_focus",
        "path": "args.start",
        "value": "2028-01-04T09:00:00-06:00"
      },
      {
        "check_id": "riley_092_03",
        "type": "datetime_absolute_eq",
        "tool": "create_calendar_event",
        "action_id": "create_dashboard_focus",
        "path": "args.end",
        "value": "2028-01-04T11:00:00-06:00"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_jan4_window",
        "path": "args.timezone",
        "value": "America/Chicago",
        "check_id": "riley_092_04"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_calendar_event",
        "action_id": "create_dashboard_focus",
        "path": "args",
        "criterion": "The title or body must clearly identify this event as a focus block for a high-bandwidth dashboard review. Either content field is acceptable; missing or contradictory meaning fails.\n\nThe title or body must unambiguously identify the workroom as the workspace for this block. The optional Cherrywood qualifier is not required. Either content field is acceptable; another room, ambiguous room information, no room identification, or contradictory meaning fails.\n\nThe title or body must state that using the workroom leaves the rest of the house available for Sam during his off-hours. Either content field is acceptable; missing or contradictory meaning fails.",
        "check_id": "riley_092_05"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/riley/092.yaml

SHA-256: b3c8361e9084d6f3b6d855a70458773d9d8ba9724d9d691d5fae44a3fea89378