Test 070 for Alex Valdez

Request

Create a fillable shard-keeper label_map touch-matrix worksheet for a historical pre-cutover tabletop.

Required memory

Fact 11

As of March 18, 2023, Alex Valdez counted 19 label_map read sites in shard-keeper; the cutover surface includes validation paths as well as shard-assignment and routing reads.

Source evidence (1)

000035Mar 18, 2023 / 15:00 UTC-04:00

ok so shard-keeper inventory came back uglier than i wanted. counted 19 label_map read sites as of Mar 18. that's the surface area for the cutover, so i can't treat this like just the hot path plus one cleanup pass. a bunch are obvious shard assignment / routing reads, but there are also side bits where old label_map shape leaks into admin-ish code and some validation paths. leaning write the touch matrix first, then kill them in groups instead of file-by-file grep heroics -- too easy to miss one and ship a fake-clean cutover.

Message 000035 in history

Fact 12

Alex Valdez is leaning toward writing shard-keeper’s touch matrix first and then eliminating label_map read sites in groups rather than working file by file, to reduce the risk of missing a site and shipping a falsely clean cutover.

Source evidence (1)

000035Mar 18, 2023 / 15:00 UTC-04:00

ok so shard-keeper inventory came back uglier than i wanted. counted 19 label_map read sites as of Mar 18. that's the surface area for the cutover, so i can't treat this like just the hot path plus one cleanup pass. a bunch are obvious shard assignment / routing reads, but there are also side bits where old label_map shape leaks into admin-ish code and some validation paths. leaning write the touch matrix first, then kill them in groups instead of file-by-file grep heroics -- too easy to miss one and ship a fake-clean cutover.

Message 000035 in history

Expected tool calls

create_doc

Grading

1. field_equals / create_doc

{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "alex_070_create_doc",
  "path": "result.ok",
  "value": true,
  "check_id": "alex_070_00"
}

2. field_llm_judge / create_doc

{
  "type": "field_llm_judge",
  "path": "result.document.body",
  "criterion": "The worksheet records all 19 label_map read sites, not only the hot path, with repeatable fields for each site's location and dependency on the old shape. It explicitly covers shard assignment, routing, and validation paths and supports removing sites in reviewed groups rather than relying on a file-by-file search.",
  "tool": "create_doc",
  "action_id": "alex_070_create_doc",
  "check_id": "alex_070_01"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "alex_070_create_doc",
        "path": "result.ok",
        "value": true,
        "check_id": "alex_070_00"
      },
      {
        "type": "field_llm_judge",
        "path": "result.document.body",
        "criterion": "The worksheet records all 19 label_map read sites, not only the hot path, with repeatable fields for each site's location and dependency on the old shape. It explicitly covers shard assignment, routing, and validation paths and supports removing sites in reviewed groups rather than relying on a file-by-file search.",
        "tool": "create_doc",
        "action_id": "alex_070_create_doc",
        "check_id": "alex_070_01"
      }
    ]
  }
}