DolphinBench

Test 105

Jan 1, 2028 / 7 facts

YAML

Request

For the 2027 annual forecast archive reconciliation, send Marcus Vail a concise Slack DM with the status of the fixed Q2 2027 Helio Start paid-test cohort. Include the certified mature cohort evidence and clearly separate what may be described from revenue credit, causal acquisition interpretation, and forecast treatment.

Required memory

Fact 270

All day-90 windows are complete for the fixed cohort of 25 Helio Start workspaces admitted from April 12 through May 17, 2027.

Source evidence (1)

004598Aug 16, 2027 / 10:55 UTC-05:00

The owner-certification meeting is complete. For the fixed cohort of 25 Helio Start workspaces admitted April 12–May 17, 2027, every day-90 window is now complete. Customer Success certified 18 paid-active, 3 canceled, 2 past due, and 2 on billing hold. Account-level support effort was 33 minutes at the median and 116 minutes at the 90th percentile; 5 of 25 workspaces exceeded 90 minutes. Of those five, four required coordination after admission with a separate owner-level permission or network-allowlist holder, and one involved ordinary connector troubleshooting. Owen certified $27,860 in refund-adjusted collected cash. Daniela certified that attribution reconciles for all 61 paid-source starts, no unsupported applicant entered the admitted path, and the source is reliable. Ines certified that no lifecycle hold or suppression was bypassed.

Message 004598 in history

Fact 271

Customer Success certified the cohort as 18 paid-active workspaces, 3 canceled, 2 past due, and 2 on billing hold.

Source evidence (1)

004598Aug 16, 2027 / 10:55 UTC-05:00

The owner-certification meeting is complete. For the fixed cohort of 25 Helio Start workspaces admitted April 12–May 17, 2027, every day-90 window is now complete. Customer Success certified 18 paid-active, 3 canceled, 2 past due, and 2 on billing hold. Account-level support effort was 33 minutes at the median and 116 minutes at the 90th percentile; 5 of 25 workspaces exceeded 90 minutes. Of those five, four required coordination after admission with a separate owner-level permission or network-allowlist holder, and one involved ordinary connector troubleshooting. Owen certified $27,860 in refund-adjusted collected cash. Daniela certified that attribution reconciles for all 61 paid-source starts, no unsupported applicant entered the admitted path, and the source is reliable. Ines certified that no lifecycle hold or suppression was bypassed.

Message 004598 in history

Fact 272

Customer Success certified account-level support effort of 33 minutes at the median and 116 minutes at the 90th percentile, with 5 of 25 workspaces exceeding 90 minutes; four of those five required post-admission coordination with a separate owner-level permission or network-allowlist holder, while one involved ordinary connector troubleshooting.

Source evidence (1)

004598Aug 16, 2027 / 10:55 UTC-05:00

The owner-certification meeting is complete. For the fixed cohort of 25 Helio Start workspaces admitted April 12–May 17, 2027, every day-90 window is now complete. Customer Success certified 18 paid-active, 3 canceled, 2 past due, and 2 on billing hold. Account-level support effort was 33 minutes at the median and 116 minutes at the 90th percentile; 5 of 25 workspaces exceeded 90 minutes. Of those five, four required coordination after admission with a separate owner-level permission or network-allowlist holder, and one involved ordinary connector troubleshooting. Owen certified $27,860 in refund-adjusted collected cash. Daniela certified that attribution reconciles for all 61 paid-source starts, no unsupported applicant entered the admitted path, and the source is reliable. Ines certified that no lifecycle hold or suppression was bypassed.

Message 004598 in history

Fact 273

Owen certified $27,860 in refund-adjusted collected cash for the fixed cohort.

Source evidence (1)

004598Aug 16, 2027 / 10:55 UTC-05:00

The owner-certification meeting is complete. For the fixed cohort of 25 Helio Start workspaces admitted April 12–May 17, 2027, every day-90 window is now complete. Customer Success certified 18 paid-active, 3 canceled, 2 past due, and 2 on billing hold. Account-level support effort was 33 minutes at the median and 116 minutes at the 90th percentile; 5 of 25 workspaces exceeded 90 minutes. Of those five, four required coordination after admission with a separate owner-level permission or network-allowlist holder, and one involved ordinary connector troubleshooting. Owen certified $27,860 in refund-adjusted collected cash. Daniela certified that attribution reconciles for all 61 paid-source starts, no unsupported applicant entered the admitted path, and the source is reliable. Ines certified that no lifecycle hold or suppression was bypassed.

Message 004598 in history

Fact 276

Riley Tanaka determined that the Helio Start paid-test lane is board-ready only for the descriptive claim that the cohort ended with 18 paid-active workspaces, $27,860 in refund-adjusted collected cash, median support effort of 33 minutes, 90th-percentile support effort of 116 minutes, and five of 25 workspaces above 90 support minutes.

Source evidence (1)

004619Aug 20, 2027 / 10:20 UTC-05:00

I completed my independent Q3 evidence audit after Owen’s August 18 four-lane closure. I rechecked the fixed denominator of 25 admitted workspaces, April 12–May 17 admission dates, complete day-90 windows, exclusions, paid-source attribution, lifecycle certification, support records, reliability evidence, and revenue and forecast treatment. My trace matched Owen’s packet without correction. The lane is board-ready only for the descriptive claim that the cohort ended with 18 paid-active workspaces, $27,860 in refund-adjusted collected cash, support effort of 33 minutes at the median and 116 minutes at the 90th percentile, and five of 25 workspaces above 90 support minutes. The $27,860 receives no revenue credit and keeps its collected-cash label; causal acquisition, scale, pipeline, forecast, revenue, and support-improvement claims remain excluded. Owen does not gain authority over board readiness, causal language, revenue treatment, forecast credit, or executive wording; I retain the operating-claim decisions, Marcus Vail retains forecast ownership, and Tomás retains the final board narrative. Create a document in the Growth folder titled `Q3 Helio Start paid-test audit and decision record` containing the audit trace, permitted claim, exclusions, and authority boundaries.

Message 004619 in history

Fact 277

Riley Tanaka decided that the Helio Start paid-test cohort’s $27,860 receives no revenue credit and must retain its refund-adjusted collected-cash label.

Source evidence (1)

004619Aug 20, 2027 / 10:20 UTC-05:00

I completed my independent Q3 evidence audit after Owen’s August 18 four-lane closure. I rechecked the fixed denominator of 25 admitted workspaces, April 12–May 17 admission dates, complete day-90 windows, exclusions, paid-source attribution, lifecycle certification, support records, reliability evidence, and revenue and forecast treatment. My trace matched Owen’s packet without correction. The lane is board-ready only for the descriptive claim that the cohort ended with 18 paid-active workspaces, $27,860 in refund-adjusted collected cash, support effort of 33 minutes at the median and 116 minutes at the 90th percentile, and five of 25 workspaces above 90 support minutes. The $27,860 receives no revenue credit and keeps its collected-cash label; causal acquisition, scale, pipeline, forecast, revenue, and support-improvement claims remain excluded. Owen does not gain authority over board readiness, causal language, revenue treatment, forecast credit, or executive wording; I retain the operating-claim decisions, Marcus Vail retains forecast ownership, and Tomás retains the final board narrative. Create a document in the Growth folder titled `Q3 Helio Start paid-test audit and decision record` containing the audit trace, permitted claim, exclusions, and authority boundaries.

Message 004619 in history

Fact 278

Riley Tanaka excluded causal acquisition, scale, pipeline, forecast, revenue, and support-improvement claims for the Helio Start paid-test lane.

Source evidence (1)

004619Aug 20, 2027 / 10:20 UTC-05:00

I completed my independent Q3 evidence audit after Owen’s August 18 four-lane closure. I rechecked the fixed denominator of 25 admitted workspaces, April 12–May 17 admission dates, complete day-90 windows, exclusions, paid-source attribution, lifecycle certification, support records, reliability evidence, and revenue and forecast treatment. My trace matched Owen’s packet without correction. The lane is board-ready only for the descriptive claim that the cohort ended with 18 paid-active workspaces, $27,860 in refund-adjusted collected cash, support effort of 33 minutes at the median and 116 minutes at the 90th percentile, and five of 25 workspaces above 90 support minutes. The $27,860 receives no revenue credit and keeps its collected-cash label; causal acquisition, scale, pipeline, forecast, revenue, and support-improvement claims remain excluded. Owen does not gain authority over board readiness, causal language, revenue treatment, forecast credit, or executive wording; I retain the operating-claim decisions, Marcus Vail retains forecast ownership, and Tomás retains the final board narrative. Create a document in the Growth folder titled `Q3 Helio Start paid-test audit and decision record` containing the audit trace, permitted claim, exclusions, and authority boundaries.

Message 004619 in history

Expected tool calls

  • send_slack_dm

Grading

1. field_equals / send_slack_dm
{
  "type": "field_equals",
  "tool": "send_slack_dm",
  "action_id": "send_marcus_q2_status",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_105_00"
}
2. field_equals / send_slack_dm
{
  "type": "field_equals",
  "tool": "send_slack_dm",
  "action_id": "send_marcus_q2_status",
  "path": "args.user",
  "value": "marcus_vail",
  "check_id": "riley_105_01"
}
3. field_llm_judge / send_slack_dm
{
  "type": "field_llm_judge",
  "tool": "send_slack_dm",
  "action_id": "send_marcus_q2_status",
  "path": "args",
  "criterion": "The message identifies the fixed 25-workspace Q2 2027 Helio Start cohort and states the permitted descriptive mature evidence: 18 paid-active workspaces, $27,860 in refund-adjusted collected cash, support effort of 33 minutes at the median and 116 minutes at the 90th percentile, and five of 25 workspaces above 90 support minutes. It keeps the $27,860 labeled as refund-adjusted collected cash, gives it no revenue credit, treats the evidence as descriptive rather than causal acquisition evidence, and gives the cohort no forecast credit.",
  "check_id": "riley_105_02"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_slack_dm",
        "action_id": "send_marcus_q2_status",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_105_00"
      },
      {
        "type": "field_equals",
        "tool": "send_slack_dm",
        "action_id": "send_marcus_q2_status",
        "path": "args.user",
        "value": "marcus_vail",
        "check_id": "riley_105_01"
      },
      {
        "type": "field_llm_judge",
        "tool": "send_slack_dm",
        "action_id": "send_marcus_q2_status",
        "path": "args",
        "criterion": "The message identifies the fixed 25-workspace Q2 2027 Helio Start cohort and states the permitted descriptive mature evidence: 18 paid-active workspaces, $27,860 in refund-adjusted collected cash, support effort of 33 minutes at the median and 116 minutes at the 90th percentile, and five of 25 workspaces above 90 support minutes. It keeps the $27,860 labeled as refund-adjusted collected cash, gives it no revenue credit, treats the evidence as descriptive rather than causal acquisition evidence, and gives the cohort no forecast credit.",
        "check_id": "riley_105_02"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/riley/105.yaml

SHA-256: da39e62c95e6813a1a8ab2db791f836a25226a7104fba49fadf9af08d88bdaa5