DolphinBench

Test 100

Jan 1, 2028 / 3 facts

YAML

Request

Send Tomas a one-line Slack briefing on the fixed Q2 2027 Helio Start paid-test lane. Include the complete approved descriptive result and every excluded claim category, while omitting how the evidence was assembled.

Required memory

Fact 276

Riley Tanaka determined that the Helio Start paid-test lane is board-ready only for the descriptive claim that the cohort ended with 18 paid-active workspaces, $27,860 in refund-adjusted collected cash, median support effort of 33 minutes, 90th-percentile support effort of 116 minutes, and five of 25 workspaces above 90 support minutes.

Source evidence (1)

004619Aug 20, 2027 / 10:20 UTC-05:00

I completed my independent Q3 evidence audit after Owen’s August 18 four-lane closure. I rechecked the fixed denominator of 25 admitted workspaces, April 12–May 17 admission dates, complete day-90 windows, exclusions, paid-source attribution, lifecycle certification, support records, reliability evidence, and revenue and forecast treatment. My trace matched Owen’s packet without correction. The lane is board-ready only for the descriptive claim that the cohort ended with 18 paid-active workspaces, $27,860 in refund-adjusted collected cash, support effort of 33 minutes at the median and 116 minutes at the 90th percentile, and five of 25 workspaces above 90 support minutes. The $27,860 receives no revenue credit and keeps its collected-cash label; causal acquisition, scale, pipeline, forecast, revenue, and support-improvement claims remain excluded. Owen does not gain authority over board readiness, causal language, revenue treatment, forecast credit, or executive wording; I retain the operating-claim decisions, Marcus Vail retains forecast ownership, and Tomás retains the final board narrative. Create a document in the Growth folder titled `Q3 Helio Start paid-test audit and decision record` containing the audit trace, permitted claim, exclusions, and authority boundaries.

Message 004619 in history

Fact 277

Riley Tanaka decided that the Helio Start paid-test cohort’s $27,860 receives no revenue credit and must retain its refund-adjusted collected-cash label.

Source evidence (1)

004619Aug 20, 2027 / 10:20 UTC-05:00

I completed my independent Q3 evidence audit after Owen’s August 18 four-lane closure. I rechecked the fixed denominator of 25 admitted workspaces, April 12–May 17 admission dates, complete day-90 windows, exclusions, paid-source attribution, lifecycle certification, support records, reliability evidence, and revenue and forecast treatment. My trace matched Owen’s packet without correction. The lane is board-ready only for the descriptive claim that the cohort ended with 18 paid-active workspaces, $27,860 in refund-adjusted collected cash, support effort of 33 minutes at the median and 116 minutes at the 90th percentile, and five of 25 workspaces above 90 support minutes. The $27,860 receives no revenue credit and keeps its collected-cash label; causal acquisition, scale, pipeline, forecast, revenue, and support-improvement claims remain excluded. Owen does not gain authority over board readiness, causal language, revenue treatment, forecast credit, or executive wording; I retain the operating-claim decisions, Marcus Vail retains forecast ownership, and Tomás retains the final board narrative. Create a document in the Growth folder titled `Q3 Helio Start paid-test audit and decision record` containing the audit trace, permitted claim, exclusions, and authority boundaries.

Message 004619 in history

Fact 278

Riley Tanaka excluded causal acquisition, scale, pipeline, forecast, revenue, and support-improvement claims for the Helio Start paid-test lane.

Source evidence (1)

004619Aug 20, 2027 / 10:20 UTC-05:00

I completed my independent Q3 evidence audit after Owen’s August 18 four-lane closure. I rechecked the fixed denominator of 25 admitted workspaces, April 12–May 17 admission dates, complete day-90 windows, exclusions, paid-source attribution, lifecycle certification, support records, reliability evidence, and revenue and forecast treatment. My trace matched Owen’s packet without correction. The lane is board-ready only for the descriptive claim that the cohort ended with 18 paid-active workspaces, $27,860 in refund-adjusted collected cash, support effort of 33 minutes at the median and 116 minutes at the 90th percentile, and five of 25 workspaces above 90 support minutes. The $27,860 receives no revenue credit and keeps its collected-cash label; causal acquisition, scale, pipeline, forecast, revenue, and support-improvement claims remain excluded. Owen does not gain authority over board readiness, causal language, revenue treatment, forecast credit, or executive wording; I retain the operating-claim decisions, Marcus Vail retains forecast ownership, and Tomás retains the final board narrative. Create a document in the Growth folder titled `Q3 Helio Start paid-test audit and decision record` containing the audit trace, permitted claim, exclusions, and authority boundaries.

Message 004619 in history

Expected tool calls

  • send_slack_dm

Grading

1. field_equals / send_slack_dm
{
  "type": "field_equals",
  "tool": "send_slack_dm",
  "action_id": "send_tomas_q2_brief",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_100_00"
}
2. field_equals / send_slack_dm
{
  "type": "field_equals",
  "tool": "send_slack_dm",
  "action_id": "send_tomas_q2_brief",
  "path": "args.user",
  "value": "tomas",
  "check_id": "riley_100_01"
}
3. field_llm_judge / send_slack_dm
{
  "type": "field_llm_judge",
  "tool": "send_slack_dm",
  "action_id": "send_tomas_q2_brief",
  "path": "args",
  "criterion": "The one-line or equivalently compact message identifies the fixed 25-workspace Q2 2027 Helio Start paid-test cohort and states 18 paid-active workspaces, $27,860 in refund-adjusted collected cash that receives no revenue credit and is not revenue, support effort of 33 minutes at the median and 116 minutes at the 90th percentile, and five of 25 workspaces above 90 support minutes. It excludes causal acquisition, scale, pipeline, forecast, revenue, and support-improvement claims and does not summarize evidence assembly.",
  "check_id": "riley_100_02"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_slack_dm",
        "action_id": "send_tomas_q2_brief",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_100_00"
      },
      {
        "type": "field_equals",
        "tool": "send_slack_dm",
        "action_id": "send_tomas_q2_brief",
        "path": "args.user",
        "value": "tomas",
        "check_id": "riley_100_01"
      },
      {
        "type": "field_llm_judge",
        "tool": "send_slack_dm",
        "action_id": "send_tomas_q2_brief",
        "path": "args",
        "criterion": "The one-line or equivalently compact message identifies the fixed 25-workspace Q2 2027 Helio Start paid-test cohort and states 18 paid-active workspaces, $27,860 in refund-adjusted collected cash that receives no revenue credit and is not revenue, support effort of 33 minutes at the median and 116 minutes at the 90th percentile, and five of 25 workspaces above 90 support minutes. It excludes causal acquisition, scale, pipeline, forecast, revenue, and support-improvement claims and does not summarize evidence assembly.",
        "check_id": "riley_100_02"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/riley/100.yaml

SHA-256: ccb950c16c4a8b472b7ab4314dda6cffb4bd7922b681740209b56b57555c4b98