Test 058

Jan 1, 2028 / 1 fact

Request

Create a concise operating-review document titled “Helio Start — first mature day-90 cohort status-rate card.” For the first fully mature Helio Start day-90 cohort, state the fixed workspace denominator and show the count and derived percentage for each mutually exclusive workspace status. Make clear that the statuses reconcile to the full cohort and keep this card separate from day-30 settled-cash and later-refund reporting.

Required memory

Fact 37

Helio Start’s final day-90 status table has 39 paid-and-active workspaces, seven canceled before day 90, four past due at day 90, and two on billing hold at day 90; the statuses are mutually exclusive.

Source evidence (1)

001729Jul 19, 2024 / 09:25 UTC-05:00

Owen completed the day-90 audit pass for the final outstanding set of 22 workspace windows, so all 52 windows are now mature. The mutually exclusive final statuses are 39 paid and active at day 90, seven canceled before day 90, four past due at day 90, and two on billing hold at day 90. The completed status table remains separate from the validated 41-of-52 day-30 settled-cash measure and from later-refund observations. Update the existing `Helio Start first-paid measurement audit` brief with the complete table and maturity boundary, then send a concise bounded completion note to `#growth-ops`. Do not attach a paid-acquisition, pipeline, or forecast conclusion to the standard report.

Message 001729 in history

Expected tool calls

create_doc

Grading

1. field_equals / create_doc

{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_cohort_card",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_058_00"
}

2. field_equals / create_doc

{
  "check_id": "riley_058_01",
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_cohort_card",
  "path": "args.title",
  "value": "Helio Start — first mature day-90 cohort status-rate card"
}

3. field_llm_judge / create_doc

{
  "type": "field_llm_judge",
  "tool": "create_doc",
  "action_id": "create_cohort_card",
  "path": "args",
  "criterion": "The document identifies this as the first fully mature Helio Start day-90 cohort, uses a fixed denominator of 52 workspaces, and presents four mutually exclusive statuses with exactly these counts: 39 paid-active, 7 canceled, 4 past due, and 2 on billing hold. It must make clear that the four counts reconcile to all 52 workspaces.\n\nEach of the four day-90 statuses has a percentage accurately derived from its count over 52: paid-active 75%; canceled approximately 13.5%; past due approximately 7.7%; billing hold approximately 3.8%. Equivalent precision or reasonable rounding is acceptable, and the displayed rates must reconcile to approximately 100%.\n\nThe document explicitly distinguishes the day-90 workspace status card from both day-30 settled-cash reporting and later-refund reporting, without blending either measure into the day-90 status rates.",
  "check_id": "riley_058_02"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_cohort_card",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_058_00"
      },
      {
        "check_id": "riley_058_01",
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_cohort_card",
        "path": "args.title",
        "value": "Helio Start — first mature day-90 cohort status-rate card"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_doc",
        "action_id": "create_cohort_card",
        "path": "args",
        "criterion": "The document identifies this as the first fully mature Helio Start day-90 cohort, uses a fixed denominator of 52 workspaces, and presents four mutually exclusive statuses with exactly these counts: 39 paid-active, 7 canceled, 4 past due, and 2 on billing hold. It must make clear that the four counts reconcile to all 52 workspaces.\n\nEach of the four day-90 statuses has a percentage accurately derived from its count over 52: paid-active 75%; canceled approximately 13.5%; past due approximately 7.7%; billing hold approximately 3.8%. Equivalent precision or reasonable rounding is acceptable, and the displayed rates must reconcile to approximately 100%.\n\nThe document explicitly distinguishes the day-90 workspace status card from both day-30 settled-cash reporting and later-refund reporting, without blending either measure into the day-90 status rates.",
        "check_id": "riley_058_02"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/riley/058.yaml

SHA-256: d34d6de4ce79c12973f82f5e9e61793e01895cb45f1d1d8f2e67fc69b89c8373