DolphinBench

Test 040

Jan 1, 2028 / 2 facts

YAML

Request

Please create a brief historical decision-rights note titled “July 2023 decision rights — Helio Start and retained-mid expansion” for our governance retrospective. Cover both workstreams during July 2023, distinguish the strategic decision lane from routine execution, and explicitly label the note as a period-specific record rather than current org policy.

Required memory

Fact 408

For July 2023, Owen is the default owner of the Helio Start baseline readout shape and the retained-mid expansion eligibility cuts.

Source evidence (1)

000377Jul 4, 2023 / 11:38 UTC-05:00

Quick note to remember for later: the 10:30 owner-lanes block with Priya finished, and we did make a concrete July split, but not as a permanent org chart. Owen is the default owner of the Helio Start baseline readout shape and the retained-mid expansion eligibility cuts. Ines owns the lifecycle fork risk map and the copy boundaries that flow from both Helio Start and the expansion-nudge learning. I keep the decision rules, executive tradeoffs, and cross-functional guardrails. Priya was explicit that we are reusing the investigation framework informally for July work, not turning it into a formal company process. No deliverable right now; I just want that captured.

Message 000377 in history

Fact 410

For July 2023, Riley Tanaka owns the decision rules, executive tradeoffs, and cross-functional guardrails.

Source evidence (1)

000377Jul 4, 2023 / 11:38 UTC-05:00

Quick note to remember for later: the 10:30 owner-lanes block with Priya finished, and we did make a concrete July split, but not as a permanent org chart. Owen is the default owner of the Helio Start baseline readout shape and the retained-mid expansion eligibility cuts. Ines owns the lifecycle fork risk map and the copy boundaries that flow from both Helio Start and the expansion-nudge learning. I keep the decision rules, executive tradeoffs, and cross-functional guardrails. Priya was explicit that we are reusing the investigation framework informally for July work, not turning it into a formal company process. No deliverable right now; I just want that captured.

Message 000377 in history

Expected tool calls

  • create_doc

Grading

1. field_equals / create_doc
{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_historical_decision_rights_note",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_040_00"
}
2. field_equals / create_doc
{
  "check_id": "riley_040_01",
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_historical_decision_rights_note",
  "path": "args.title",
  "value": "July 2023 decision rights — Helio Start and retained-mid expansion"
}
3. field_llm_judge / create_doc
{
  "type": "field_llm_judge",
  "tool": "create_doc",
  "action_id": "create_historical_decision_rights_note",
  "path": "args",
  "criterion": "The body must state that during July 2023 Riley retained the decision rules, executive tradeoffs, and cross-functional guardrails for both Helio Start and retained-mid expansion, while making clear that routine execution was outside this retained high-level lane. Missing either workstream or assigning Riley undifferentiated routine execution ownership must fail.\n\nThe body must clearly label the allocation as specific to July 2023 and must not present it as current policy, a permanent org chart, or a formal company-wide process. Missing or contradictory temporal framing must fail.",
  "check_id": "riley_040_02"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_historical_decision_rights_note",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_040_00"
      },
      {
        "check_id": "riley_040_01",
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_historical_decision_rights_note",
        "path": "args.title",
        "value": "July 2023 decision rights — Helio Start and retained-mid expansion"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_doc",
        "action_id": "create_historical_decision_rights_note",
        "path": "args",
        "criterion": "The body must state that during July 2023 Riley retained the decision rules, executive tradeoffs, and cross-functional guardrails for both Helio Start and retained-mid expansion, while making clear that routine execution was outside this retained high-level lane. Missing either workstream or assigning Riley undifferentiated routine execution ownership must fail.\n\nThe body must clearly label the allocation as specific to July 2023 and must not present it as current policy, a permanent org chart, or a formal company-wide process. Missing or contradictory temporal framing must fail.",
        "check_id": "riley_040_02"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/riley/040.yaml

SHA-256: 39baea95448d26e042758548c7c6de67f437583593acc1feaad8743e83275064