Test 149

Jan 1, 2028 / 1 fact

Request

Create a reusable readiness checklist for any 2028 Helio Start paid-acquisition proposal. State the mature evidence required before budget or channel tactics can be discussed, how the evidence must be combined, and the approved responsibility for the package. Do not invent separate owners for individual evidence categories.

Required memory

Fact 42

Any later Helio Start paid-acquisition proposal must combine mature retention status, refund-adjusted cash, and account-level support effort rather than relying only on first-paid, activation, or paid-active status; Owen and Customer Success are responsible for producing that combined evidence.

Source evidence (1)

001789Aug 2, 2024 / 11:45 UTC-05:00

The operating discussion settled the Helio Start boundary. I presented all four mature day-90 statuses: 39 paid-active workspaces, seven canceled workspaces, four past-due workspaces, and two workspaces on billing hold. The result is evidence that bounded organic Helio Start is operating as a real product motion, but I declined Marcus Vail's request to turn the 39 paid-active workspaces into a Q3 paid-acquisition or pipeline claim: 13 of 52 were not paid and active at day 90, the cohort came through the organic pricing-page path, and no acquisition-cost comparison exists. Priya and Tomás agreed that Helio Start remains an organic bounded channel through Q3. Any later paid-acquisition proposal must combine mature retention status with refund-adjusted cash and account-level support effort rather than relying on first-paid, activation, or paid-active status alone. Owen and Customer Success own producing that combined evidence. The settled decision is an update, not a paid test or forecast claim.

Message 001789 in history

Expected tool calls

create_doc

Grading

1. field_equals / create_doc

{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_readiness_checklist",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_149_00"
}

2. field_llm_judge / create_doc

{
  "type": "field_llm_judge",
  "tool": "create_doc",
  "action_id": "create_readiness_checklist",
  "path": "args",
  "criterion": "The document is a reusable intake checklist for Helio Start paid-acquisition proposals considered in 2028. It makes the combined evidence review a prerequisite to discussing budget or channel tactics. It requires mature retention status, refund-adjusted cash, and account-level support effort to be evaluated together rather than as substitutes. It assigns Owen and Customer Success responsibility for producing the combined evidence without inventing a separate category-level ownership split.",
  "check_id": "riley_149_01"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_readiness_checklist",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_149_00"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_doc",
        "action_id": "create_readiness_checklist",
        "path": "args",
        "criterion": "The document is a reusable intake checklist for Helio Start paid-acquisition proposals considered in 2028. It makes the combined evidence review a prerequisite to discussing budget or channel tactics. It requires mature retention status, refund-adjusted cash, and account-level support effort to be evaluated together rather than as substitutes. It assigns Owen and Customer Success responsibility for producing the combined evidence without inventing a separate category-level ownership split.",
        "check_id": "riley_149_01"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/riley/149.yaml

SHA-256: 2ef0bbc5eb758641900e2daeefc0f567f182d54acfad7a3a722e55d807f749dc