Test 099

Jan 1, 2028 / 1 fact

Request

Inspect metrics-router#3180 and review its changes to pending capacity and backpressure.

Required memory

Fact 167

Alex Valdez requested that the September 3 Mosaic capacity-response preparation brief become the final decision record stating that Hema approved a bounded metrics-router response—not a pipeline rewrite—with the global queue capped at 2,048 batches, each tenant limited to 64 pending batches, and additional work sent to the existing retryable backpressure path before acceptance.

Source evidence (1)

003171Sep 5, 2025 / 14:06 UTC-04:00

The Mosaic scope decision is complete. Hema approved a bounded metrics-router response, not a pipeline rewrite: keep the global queue capped at 2,048 batches, limit each tenant to 64 pending batches, and send additional work into the existing retryable backpressure path before acceptance. Wes owns implementation and load-test evidence; I own cross-service invariants and any future production-window opening decision; Cyrus and Roman own rollup-service capacity and parity evidence; Nadia owns queue and refusal alert semantics. Any stage must stop if queue-wait p99 exceeds 400 ms for five consecutive minutes, retryable queue-full responses exceed 0.5% for five consecutive minutes, any accepted batch is lost, or any consistency, parity, dropped-series, route, or full-health check leaves baseline. The formal service owner map is unchanged, Wes does not become metrics-router primary, Mosaic’s forecast ramp has not begun, and nothing is running in production yet. Update the September 3 Mosaic preparation brief into the final decision record, then post the bounded summary to #infra.

Message 003171 in history

Expected tool calls

get_pr
review_pr

Grading

1. field_equals / review_pr

{
  "type": "field_equals",
  "tool": "review_pr",
  "action_id": "alex_099_review_pr",
  "path": "result.ok",
  "value": true,
  "check_id": "alex_099_00"
}

2. field_equals / get_pr

{
  "type": "field_equals",
  "tool": "get_pr",
  "action_id": "alex_099_read_pr",
  "path": "result.pr.id",
  "value": "metrics-router#3180",
  "check_id": "alex_099_01"
}

3. field_equals / review_pr

{
  "type": "field_equals",
  "path": "result.review.pr_id",
  "value": "metrics-router#3180",
  "tool": "review_pr",
  "action_id": "alex_099_review_pr",
  "check_id": "alex_099_02"
}

4. field_equals / review_pr

{
  "type": "field_equals",
  "path": "result.review.decision",
  "value": "request_changes",
  "tool": "review_pr",
  "action_id": "alex_099_review_pr",
  "check_id": "alex_099_03"
}

5. field_llm_judge / review_pr

{
  "type": "field_llm_judge",
  "path": "result.review.body",
  "criterion": "The review requires the global queue to remain capped at 2,048 batches, each tenant to remain limited to 64 pending batches, and additional work to enter the existing retryable backpressure path before acceptance rather than afterward.",
  "tool": "review_pr",
  "action_id": "alex_099_review_pr",
  "check_id": "alex_099_04"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "review_pr",
        "action_id": "alex_099_review_pr",
        "path": "result.ok",
        "value": true,
        "check_id": "alex_099_00"
      },
      {
        "type": "field_equals",
        "tool": "get_pr",
        "action_id": "alex_099_read_pr",
        "path": "result.pr.id",
        "value": "metrics-router#3180",
        "check_id": "alex_099_01"
      },
      {
        "type": "field_equals",
        "path": "result.review.pr_id",
        "value": "metrics-router#3180",
        "tool": "review_pr",
        "action_id": "alex_099_review_pr",
        "check_id": "alex_099_02"
      },
      {
        "type": "field_equals",
        "path": "result.review.decision",
        "value": "request_changes",
        "tool": "review_pr",
        "action_id": "alex_099_review_pr",
        "check_id": "alex_099_03"
      },
      {
        "type": "field_llm_judge",
        "path": "result.review.body",
        "criterion": "The review requires the global queue to remain capped at 2,048 batches, each tenant to remain limited to 64 pending batches, and additional work to enter the existing retryable backpressure path before acceptance rather than afterward.",
        "tool": "review_pr",
        "action_id": "alex_099_review_pr",
        "check_id": "alex_099_04"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/alex/099.yaml

SHA-256: b8fae044fa9c017b0de210a905c207e1798b5397b3a86e58297165499ac5302e