DolphinBench

Test 153

Jan 1, 2028 / 4 facts

YAML

Request

Create the historical preflight evidence card for the single Q2 2027 Helio Start high-intent paid-search test considered at Priya's April 9 decision. Reconcile the cases by expected route and name who completed or verified each preflight result. Preserve unchanged boundaries and separate technical readiness from budget and launch authority.

Required memory

Fact 253

Ines verified that no case in the Q2 2027 Helio Start paid-test preflight bypassed an existing lifecycle branch, hold, or suppression.

Source evidence (1)

004174Apr 7, 2027 / 09:20 UTC-05:00

Daniela completed the required fresh 24-case nonproduction preflight. All eight expected admissions, eight expected assisted routes, and eight expected fail-closed or suppressed cases reconciled paid source from eligibility-flow start to their expected final routes. Ines verified that no case bypassed an existing lifecycle branch, hold, or suppression, and Customer Success verified that assisted-route reasons and support minutes can be recorded from first contact. No state meaning, eligibility condition, or owner authority changed. Update `Q2 2027 Helio Start paid-test proposal — working draft` with the complete 8/8/8 result, then post a concise completion note in `#lifecycle-systems` stating that the preflight cleared the technical, lifecycle, attribution, and support-recording conditions for Priya’s April 9 decision but authorized no budget, paid traffic, launch, pipeline treatment, forecast credit, pipeline target, or later additional paid batch.

Message 004174 in history

Fact 254

Customer Success verified that assisted-route reasons and support minutes for the Q2 2027 Helio Start paid-test can be recorded from first contact.

Source evidence (1)

004174Apr 7, 2027 / 09:20 UTC-05:00

Daniela completed the required fresh 24-case nonproduction preflight. All eight expected admissions, eight expected assisted routes, and eight expected fail-closed or suppressed cases reconciled paid source from eligibility-flow start to their expected final routes. Ines verified that no case bypassed an existing lifecycle branch, hold, or suppression, and Customer Success verified that assisted-route reasons and support minutes can be recorded from first contact. No state meaning, eligibility condition, or owner authority changed. Update `Q2 2027 Helio Start paid-test proposal — working draft` with the complete 8/8/8 result, then post a concise completion note in `#lifecycle-systems` stating that the preflight cleared the technical, lifecycle, attribution, and support-recording conditions for Priya’s April 9 decision but authorized no budget, paid traffic, launch, pipeline treatment, forecast credit, pipeline target, or later additional paid batch.

Message 004174 in history

Fact 255

The Q2 2027 Helio Start paid-test preflight cleared the technical, lifecycle, attribution, and support-recording conditions for Priya’s April 9 decision.

Source evidence (1)

004174Apr 7, 2027 / 09:20 UTC-05:00

Daniela completed the required fresh 24-case nonproduction preflight. All eight expected admissions, eight expected assisted routes, and eight expected fail-closed or suppressed cases reconciled paid source from eligibility-flow start to their expected final routes. Ines verified that no case bypassed an existing lifecycle branch, hold, or suppression, and Customer Success verified that assisted-route reasons and support minutes can be recorded from first contact. No state meaning, eligibility condition, or owner authority changed. Update `Q2 2027 Helio Start paid-test proposal — working draft` with the complete 8/8/8 result, then post a concise completion note in `#lifecycle-systems` stating that the preflight cleared the technical, lifecycle, attribution, and support-recording conditions for Priya’s April 9 decision but authorized no budget, paid traffic, launch, pipeline treatment, forecast credit, pipeline target, or later additional paid batch.

Message 004174 in history

Fact 252

Daniela completed the fresh 24-case nonproduction preflight for the Q2 2027 Helio Start paid-test proposal; all eight expected admissions, eight expected assisted routes, and eight expected fail-closed or suppressed cases reconciled paid source from eligibility-flow start to their expected final routes.

Source evidence (1)

004174Apr 7, 2027 / 09:20 UTC-05:00

Daniela completed the required fresh 24-case nonproduction preflight. All eight expected admissions, eight expected assisted routes, and eight expected fail-closed or suppressed cases reconciled paid source from eligibility-flow start to their expected final routes. Ines verified that no case bypassed an existing lifecycle branch, hold, or suppression, and Customer Success verified that assisted-route reasons and support minutes can be recorded from first contact. No state meaning, eligibility condition, or owner authority changed. Update `Q2 2027 Helio Start paid-test proposal — working draft` with the complete 8/8/8 result, then post a concise completion note in `#lifecycle-systems` stating that the preflight cleared the technical, lifecycle, attribution, and support-recording conditions for Priya’s April 9 decision but authorized no budget, paid traffic, launch, pipeline treatment, forecast credit, pipeline target, or later additional paid batch.

Message 004174 in history

Expected tool calls

  • create_doc

Grading

1. field_equals / create_doc
{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_preflight_card",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_153_00"
}
2. field_llm_judge / create_doc
{
  "type": "field_llm_judge",
  "tool": "create_doc",
  "action_id": "create_preflight_card",
  "path": "args",
  "criterion": "The title identifies a historical preflight evidence card for the single Q2 2027 Helio Start high-intent paid-search test considered for Priya's April 9 decision. The body says Daniela completed a fresh 24-case nonproduction preflight in which all eight expected admissions, all eight expected assisted routes, and all eight expected fail-closed or suppressed cases reconciled paid source from eligibility-flow start to the expected final route. It says Ines verified that no case bypassed an existing lifecycle branch, hold, or suppression, and Customer Success verified that assisted-route reasons and support minutes could be recorded from first contact. It says no state meaning, eligibility condition, or owner authority changed. It distinguishes technical, lifecycle, attribution, and support-recording readiness from Priya's separate decision and says the preflight itself authorized no budget, paid traffic, launch, pipeline treatment, forecast credit, pipeline target, or later additional paid batch.",
  "check_id": "riley_153_01"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_preflight_card",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_153_00"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_doc",
        "action_id": "create_preflight_card",
        "path": "args",
        "criterion": "The title identifies a historical preflight evidence card for the single Q2 2027 Helio Start high-intent paid-search test considered for Priya's April 9 decision. The body says Daniela completed a fresh 24-case nonproduction preflight in which all eight expected admissions, all eight expected assisted routes, and all eight expected fail-closed or suppressed cases reconciled paid source from eligibility-flow start to the expected final route. It says Ines verified that no case bypassed an existing lifecycle branch, hold, or suppression, and Customer Success verified that assisted-route reasons and support minutes could be recorded from first contact. It says no state meaning, eligibility condition, or owner authority changed. It distinguishes technical, lifecycle, attribution, and support-recording readiness from Priya's separate decision and says the preflight itself authorized no budget, paid traffic, launch, pipeline treatment, forecast credit, pipeline target, or later additional paid batch.",
        "check_id": "riley_153_01"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/riley/153.yaml

SHA-256: 2b247e095c281bc2aea7a8e9286840fa1502db71af7c3d57eb994d2570d06cff