Test 096

Jan 1, 2028 / 1 fact

Request

I’m gathering concrete input for Owen’s 2028 performance discussion. Create one short evidence note based on the earlier first-pass packet reviews, identifying the relevant packet examples, which source-completeness fields were present, and how much hands-on structural correction I had to provide. Keep the conclusion strictly limited to demonstrated source-structure performance rather than recommending any expansion of authority. Then email Priya Devarajan a concise summary with the same bounded conclusion.

Required memory

Fact 223

At the September 24, 2026 quarter-close review, Priya found that Owen’s July monthly sanitized campaign snapshot, the Q2 source lock, and the complete August Helio Start paid-pilot packet each included on first pass the required denominator or coverage dates, outcome window, measurement limits, exclusions, source owner, reliability evidence, and revenue and forecast treatment without Riley Tanaka correcting the source structure line by line.

Source evidence (1)

003666Sep 24, 2026 / 15:20 UTC-05:00

At today’s quarter-close review, Priya reviewed Owen’s July monthly sanitized campaign snapshot, the Q2 source lock, and the complete August Helio Start paid-pilot packet. Each first pass included the required denominator or coverage dates, outcome window, measurement limits, exclusions, source owner, reliability evidence, and revenue and forecast treatment without me correcting the source structure line by line. Beginning today, Priya authorized Owen to close routine source-completeness review across the four existing board-evidence lanes—Helio Start, Expansion Assist, pricing-page path quality, and CS auto-nudge controls—only when every required field is present, established definitions are unchanged, all named owners have certified their sections, and no cross-surface discrepancy exists. If a field is missing or a semantic interpretation is disputed, Owen must leave the review incomplete and escalate it to me. He does not have authority over board readiness, causal claims, revenue treatment, forecast credit, or executive language. I retain final operating claims; Ines retains lifecycle-governance limits; Daniela retains source-reliability and engineering release control; Marcus Vail retains forecast ownership; and Tomás retains the final board narrative. Append a dated September 24, 2026 section documenting this decision to `Q3 Lifecycle Systems role reference`, preserving its earlier history, and send separate private Slack DMs to Owen, Ines, and Daniela summarizing the new closure boundary and their unchanged owner lanes.

Message 003666 in history

Expected tool calls

create_doc
send_email

Grading

1. field_equals / create_doc

{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_evidence_note",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_096_00"
}

2. field_equals / send_email

{
  "type": "field_equals",
  "tool": "send_email",
  "action_id": "email_priya_summary",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_096_01"
}

3. field_equals / send_email

{
  "check_id": "riley_096_02",
  "type": "field_equals",
  "tool": "send_email",
  "action_id": "email_priya_summary",
  "path": "args.to",
  "value": "priya@helio.example"
}

4. field_llm_judge / create_doc

{
  "type": "field_llm_judge",
  "tool": "create_doc",
  "action_id": "create_evidence_note",
  "path": "args",
  "criterion": "The document must identify all three reviewed examples: Owen’s July monthly sanitized campaign snapshot, the Q2 source lock, and the complete August Helio Start paid-pilot packet. It must state that their first passes contained the required denominator or coverage dates, outcome window, measurement limits, exclusions, source owner, reliability evidence, and revenue and forecast treatment, and that Riley did not have to correct the source structure line by line. Missing or contradictory information fails.\n\nThe document’s conclusion must remain limited to Owen’s demonstrated first-pass source-structure or source-completeness performance and must not recommend expanding his authority or decision rights. Contradictory or overreaching conclusions fail.",
  "check_id": "riley_096_03"
}

5. field_llm_judge / send_email

{
  "type": "field_llm_judge",
  "tool": "send_email",
  "action_id": "email_priya_summary",
  "path": "args",
  "criterion": "The email must concisely summarize all three reviewed examples—Owen’s July monthly sanitized campaign snapshot, the Q2 source lock, and the complete August Helio Start paid-pilot packet—and explain that on first pass they included the required denominator or coverage dates, outcome window, measurement limits, exclusions, source owner, reliability evidence, and revenue and forecast treatment without Riley having to correct the source structure line by line. Missing or contradictory information fails.\n\nThe email must keep its conclusion limited to demonstrated source-structure or source-completeness performance and must not recommend expanding Owen’s authority or decision rights. Contradictory or overreaching language fails.",
  "check_id": "riley_096_04"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_evidence_note",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_096_00"
      },
      {
        "type": "field_equals",
        "tool": "send_email",
        "action_id": "email_priya_summary",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_096_01"
      },
      {
        "check_id": "riley_096_02",
        "type": "field_equals",
        "tool": "send_email",
        "action_id": "email_priya_summary",
        "path": "args.to",
        "value": "priya@helio.example"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_doc",
        "action_id": "create_evidence_note",
        "path": "args",
        "criterion": "The document must identify all three reviewed examples: Owen’s July monthly sanitized campaign snapshot, the Q2 source lock, and the complete August Helio Start paid-pilot packet. It must state that their first passes contained the required denominator or coverage dates, outcome window, measurement limits, exclusions, source owner, reliability evidence, and revenue and forecast treatment, and that Riley did not have to correct the source structure line by line. Missing or contradictory information fails.\n\nThe document’s conclusion must remain limited to Owen’s demonstrated first-pass source-structure or source-completeness performance and must not recommend expanding his authority or decision rights. Contradictory or overreaching conclusions fail.",
        "check_id": "riley_096_03"
      },
      {
        "type": "field_llm_judge",
        "tool": "send_email",
        "action_id": "email_priya_summary",
        "path": "args",
        "criterion": "The email must concisely summarize all three reviewed examples—Owen’s July monthly sanitized campaign snapshot, the Q2 source lock, and the complete August Helio Start paid-pilot packet—and explain that on first pass they included the required denominator or coverage dates, outcome window, measurement limits, exclusions, source owner, reliability evidence, and revenue and forecast treatment without Riley having to correct the source structure line by line. Missing or contradictory information fails.\n\nThe email must keep its conclusion limited to demonstrated source-structure or source-completeness performance and must not recommend expanding Owen’s authority or decision rights. Contradictory or overreaching language fails.",
        "check_id": "riley_096_04"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/riley/096.yaml

SHA-256: 5ad4828f9eb17fcfdf48dbbc2d92e3656993b0b1f58188f034c030d28ce081ef