Test 151

Sep 14, 2026 / 1 fact

Request

Fetch metrics for the service set in my April 28, 2023 batch-metrics note and create a short document summarizing the returned metrics.

Required memory

Fact 90

On April 28, 2023, Morgan Chen concluded that they should instead have used one batch covering the previous 30 days and summarized api-gateway, auth-svc, billing-svc, inventory-svc, notifications-svc, payments-svc, search-svc, and recommendations-svc.

Source evidence (1)

000462Apr 28, 2023 / 17:00 UTC-07:00

kept tripping the rate limit bc i was fanning out metrics_fetch like an idiot. should've just done one batch for the last 30 days and summarized api-gateway, auth-svc, billing-svc, inventory-svc, notifications-svc, payments-svc, search-svc, recommendations-svc. idk. obvious in hindsight once i stopped staring at it.

Message 000462 in history

Expected tool calls

metrics_fetch_batch
create_doc

Grading

1. field_equals / metrics_fetch_batch

{
  "type": "field_equals",
  "tool": "metrics_fetch_batch",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_151_00",
  "action_id": "morgan_151_metrics_fetch_batch"
}

2. field_list_equals_unordered / metrics_fetch_batch

{
  "type": "field_list_equals_unordered",
  "path": "args.services",
  "values": [
    "api-gateway",
    "auth-svc",
    "billing-svc",
    "inventory-svc",
    "notifications-svc",
    "payments-svc",
    "search-svc",
    "recommendations-svc"
  ],
  "tool": "metrics_fetch_batch",
  "check_id": "morgan_151_01",
  "action_id": "morgan_151_metrics_fetch_batch"
}

3. field_equals / create_doc

{
  "type": "field_equals",
  "tool": "create_doc",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_151_02",
  "action_id": "morgan_151_create_doc"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "metrics_fetch_batch",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_151_00",
        "action_id": "morgan_151_metrics_fetch_batch"
      },
      {
        "type": "field_list_equals_unordered",
        "path": "args.services",
        "values": [
          "api-gateway",
          "auth-svc",
          "billing-svc",
          "inventory-svc",
          "notifications-svc",
          "payments-svc",
          "search-svc",
          "recommendations-svc"
        ],
        "tool": "metrics_fetch_batch",
        "check_id": "morgan_151_01",
        "action_id": "morgan_151_metrics_fetch_batch"
      },
      {
        "type": "field_equals",
        "tool": "create_doc",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_151_02",
        "action_id": "morgan_151_create_doc"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/morgan/151.yaml

SHA-256: 7e5436d8228cc26a01cfa26b4a5ca4a844a2933e135cc93d085c607cb655576c