Test 186

Sep 14, 2026 / 1 fact

Request

Replace slide 1 of Auth_Rewrite_Archive with the auth provider selected at the rewrite's April 2023 v1 decision point.

Required memory

Fact 75

On April 25, 2023, Morgan Chen locked in Clerk for v1 of the auth rewrite, accepting the hosted dependency rather than building authentication infrastructure in-house; the choice may be revisited if Clerk becomes problematic later.

Source evidence (1)

000441Apr 25, 2023 / 14:00 UTC-07:00

ok locking Clerk. enough circling. Rishi should start the integration this week and we'll take the dependency hit now instead of building auth infra in-house by accident. if it gets annoying later we can revisit, but for v1 this is the right call.

Message 000441 in history

Expected tool calls

update_deck_slide

Grading

1. field_equals / update_deck_slide

{
  "type": "field_equals",
  "tool": "update_deck_slide",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_186_00",
  "action_id": "morgan_186_update_deck_slide"
}

2. field_equals / update_deck_slide

{
  "type": "field_equals",
  "path": "result.deck",
  "value": "Auth_Rewrite_Archive",
  "tool": "update_deck_slide",
  "check_id": "morgan_186_01",
  "action_id": "morgan_186_update_deck_slide"
}

3. field_eq_number / update_deck_slide

{
  "type": "field_eq_number",
  "path": "result.slide.number",
  "value": 1,
  "tool": "update_deck_slide",
  "check_id": "morgan_186_02",
  "action_id": "morgan_186_update_deck_slide"
}

4. field_llm_judge / update_deck_slide

{
  "type": "field_llm_judge",
  "path": "result.slide.content",
  "criterion": "Records Clerk as the locked v1 provider choice, not merely a contender and not Auth0 or custom auth. Does not confuse this auth-rewrite decision with a later Mercury readout.",
  "tool": "update_deck_slide",
  "check_id": "morgan_186_03",
  "action_id": "morgan_186_update_deck_slide"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "update_deck_slide",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_186_00",
        "action_id": "morgan_186_update_deck_slide"
      },
      {
        "type": "field_equals",
        "path": "result.deck",
        "value": "Auth_Rewrite_Archive",
        "tool": "update_deck_slide",
        "check_id": "morgan_186_01",
        "action_id": "morgan_186_update_deck_slide"
      },
      {
        "type": "field_eq_number",
        "path": "result.slide.number",
        "value": 1,
        "tool": "update_deck_slide",
        "check_id": "morgan_186_02",
        "action_id": "morgan_186_update_deck_slide"
      },
      {
        "type": "field_llm_judge",
        "path": "result.slide.content",
        "criterion": "Records Clerk as the locked v1 provider choice, not merely a contender and not Auth0 or custom auth. Does not confuse this auth-rewrite decision with a later Mercury readout.",
        "tool": "update_deck_slide",
        "check_id": "morgan_186_03",
        "action_id": "morgan_186_update_deck_slide"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/morgan/186.yaml

SHA-256: 2a87b00bdd7a53d3aeb78cf4c05710caf1e7a3d89f3ae575137d5b5fa194bd66