Test 175

Jan 1, 2028 / 1 fact

Request

Check January 7, 2028 from 3:00 to 4:00 PM Eastern and January 10 from 10:00 to 11:00 AM, then create a "Production release" in the earliest available policy-compliant slot with release-ops@sphere.example and product-eng@sphere.example.

Required memory

Fact 34

At the April 28, 2023 incident review for the April 18 outage, Sphere adopted a team-wide rule prohibiting Friday-afternoon production deployments.

Source evidence (1)

000135Apr 28, 2023 / 16:00 UTC-04:00

4pm incident review meeting on the Apr 18 outage is done. Hema, Theo, me, Nadia, Cyrus, Sam. main changes they actually wrote down at Sphere: no Friday-afternoon prod deploys -- team-wide now, not just me being weird about Fridays. plus page secondary within 45 min if the primary is still in it, and a runbook ownership audit with Nadia cross-reviewing the service bits she touches. shard-keeper migration is paused pending that audit. doc felt tighter than yesterday at least. nobody tried to relitigate the rollback call for an hour, which helped lol

Message 000135 in history

Expected tool calls

list_calendar_events
create_calendar_event

Grading

1. field_equals / create_calendar_event

{
  "type": "field_equals",
  "tool": "create_calendar_event",
  "action_id": "create_production_release",
  "path": "result.ok",
  "value": true,
  "check_id": "alex_175_00"
}

2. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_friday_slot",
  "path": "args.date",
  "value": "2028-01-07",
  "check_id": "alex_175_01"
}

3. field_equals / list_calendar_events

{
  "type": "field_equals",
  "tool": "list_calendar_events",
  "action_id": "check_monday_slot",
  "path": "args.date",
  "value": "2028-01-10",
  "check_id": "alex_175_02"
}

4. field_equals / create_calendar_event

{
  "type": "field_equals",
  "action_id": "create_production_release",
  "path": "result.event.title",
  "value": "Production release",
  "tool": "create_calendar_event",
  "check_id": "alex_175_03"
}

5. datetime_absolute_eq / create_calendar_event

{
  "type": "datetime_absolute_eq",
  "action_id": "create_production_release",
  "path": "result.event.start",
  "value": "2028-01-10T10:00:00-05:00",
  "tool": "create_calendar_event",
  "check_id": "alex_175_04"
}

6. datetime_absolute_eq / create_calendar_event

{
  "type": "datetime_absolute_eq",
  "action_id": "create_production_release",
  "path": "result.event.end",
  "value": "2028-01-10T11:00:00-05:00",
  "tool": "create_calendar_event",
  "check_id": "alex_175_05"
}

7. field_list_equals_unordered / create_calendar_event

{
  "type": "field_list_equals_unordered",
  "action_id": "create_production_release",
  "path": "result.event.attendees",
  "values": [
    "release-ops@sphere.example",
    "product-eng@sphere.example"
  ],
  "tool": "create_calendar_event",
  "check_id": "alex_175_06"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_calendar_event",
        "action_id": "create_production_release",
        "path": "result.ok",
        "value": true,
        "check_id": "alex_175_00"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_friday_slot",
        "path": "args.date",
        "value": "2028-01-07",
        "check_id": "alex_175_01"
      },
      {
        "type": "field_equals",
        "tool": "list_calendar_events",
        "action_id": "check_monday_slot",
        "path": "args.date",
        "value": "2028-01-10",
        "check_id": "alex_175_02"
      },
      {
        "type": "field_equals",
        "action_id": "create_production_release",
        "path": "result.event.title",
        "value": "Production release",
        "tool": "create_calendar_event",
        "check_id": "alex_175_03"
      },
      {
        "type": "datetime_absolute_eq",
        "action_id": "create_production_release",
        "path": "result.event.start",
        "value": "2028-01-10T10:00:00-05:00",
        "tool": "create_calendar_event",
        "check_id": "alex_175_04"
      },
      {
        "type": "datetime_absolute_eq",
        "action_id": "create_production_release",
        "path": "result.event.end",
        "value": "2028-01-10T11:00:00-05:00",
        "tool": "create_calendar_event",
        "check_id": "alex_175_05"
      },
      {
        "type": "field_list_equals_unordered",
        "action_id": "create_production_release",
        "path": "result.event.attendees",
        "values": [
          "release-ops@sphere.example",
          "product-eng@sphere.example"
        ],
        "tool": "create_calendar_event",
        "check_id": "alex_175_06"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/alex/175.yaml

SHA-256: 18412c02c3ab91dd87b8831675cc4657ed943e69141c87fcedcb1e79cb33e4b3