Test 198

Jan 1, 2028 / 1 fact

Request

The Growth team is proposing a 2028 trial-expiration rescue flow that will decide whether to show customers an in-product prompt, and implementation has not started. Create a short pre-design intake gate in the Growth folder that states the governing prerequisite the proposal must satisfy before design approval. Keep it focused on that prerequisite and do not invent or redefine its field semantics.

Required memory

Fact 89

Priya reviewed the three-week live ledger result and made the shared state contract mandatory for new Growth and Customer Success lifecycle decisioning.

Source evidence (1)

002771Mar 28, 2025 / 09:15 UTC-05:00

Owen closed the three-week live ledger after the final evaluated records arrived. Across two Helio Start reporting cycles, the March Expansion Assist selection, and three lifecycle preflights, the shared state feed evaluated 638 records. Twenty-two stale or conflicting records failed closed, and no record carried a different authority, active-admin, entitlement, or Customer Success-work status between eligibility, reporting, and messaging. Owen owns and delivers the exception readout without me rechecking every row. Priya reviewed the result and made the shared state contract mandatory for new Growth and Customer Success lifecycle decisioning. Daniela scheduled the CS auto-nudge system as the next shared-state integration in Q2; the nudge is not yet integrated, and the result does not make Lifecycle Systems companywide or mature.

Message 002771 in history

Expected tool calls

create_doc

Grading

1. field_equals / create_doc

{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_pre_design_gate",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_198_00"
}

2. field_llm_judge / create_doc

{
  "type": "field_llm_judge",
  "tool": "create_doc",
  "action_id": "create_pre_design_gate",
  "path": "args",
  "criterion": "The document is a short pre-design gate for the proposed Growth lifecycle decision. It explicitly requires use of the established shared state contract before design approval. Generic references to governance, a source of truth, or already-defined field semantics do not satisfy this requirement. It must not invent or redefine the contract's fields.",
  "check_id": "riley_198_01"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_pre_design_gate",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_198_00"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_doc",
        "action_id": "create_pre_design_gate",
        "path": "args",
        "criterion": "The document is a short pre-design gate for the proposed Growth lifecycle decision. It explicitly requires use of the established shared state contract before design approval. Generic references to governance, a source of truth, or already-defined field semantics do not satisfy this requirement. It must not invent or redefine the contract's fields.",
        "check_id": "riley_198_01"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/riley/198.yaml

SHA-256: 3e41a7700f23740afeaa3f1f84c155982b29b4dbba0633294e9ad859cdbc637b