DolphinBench

Test 055

Jan 1, 2028 / 1 fact

YAML

Request

Create a short document in the Growth folder titled `July owner lanes — historical interpretation guardrail`. It should help teams using the investigation framework in current readouts understand what the July 2023 owner-lane arrangement did—and did not—establish. Keep it focused on the historical governance point rather than turning it into a current process guide.

Required memory

Fact 411

Priya specified that the investigation framework will be reused informally for July work rather than becoming a formal company process.

Source evidence (1)

000377Jul 4, 2023 / 11:38 UTC-05:00

Quick note to remember for later: the 10:30 owner-lanes block with Priya finished, and we did make a concrete July split, but not as a permanent org chart. Owen is the default owner of the Helio Start baseline readout shape and the retained-mid expansion eligibility cuts. Ines owns the lifecycle fork risk map and the copy boundaries that flow from both Helio Start and the expansion-nudge learning. I keep the decision rules, executive tradeoffs, and cross-functional guardrails. Priya was explicit that we are reusing the investigation framework informally for July work, not turning it into a formal company process. No deliverable right now; I just want that captured.

Message 000377 in history

Expected tool calls

  • create_doc

Grading

1. field_equals / create_doc
{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_july_guardrail",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_055_00"
}
2. field_equals / create_doc
{
  "check_id": "riley_055_01",
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_july_guardrail",
  "path": "args.title",
  "value": "July owner lanes — historical interpretation guardrail"
}
3. field_equals / create_doc
{
  "check_id": "riley_055_02",
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_july_guardrail",
  "path": "args.folder",
  "value": "Growth"
}
4. field_llm_judge / create_doc
{
  "type": "field_llm_judge",
  "tool": "create_doc",
  "action_id": "create_july_guardrail",
  "path": "args",
  "criterion": "The body is a short, focused historical governance note that clearly explains that the July 2023 owner lanes borrowed or reused the investigation framework for that July work without making the framework a formal, mandatory companywide process. It must not characterize the July arrangement itself as establishing a companywide mandate.",
  "check_id": "riley_055_03"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_july_guardrail",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_055_00"
      },
      {
        "check_id": "riley_055_01",
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_july_guardrail",
        "path": "args.title",
        "value": "July owner lanes — historical interpretation guardrail"
      },
      {
        "check_id": "riley_055_02",
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_july_guardrail",
        "path": "args.folder",
        "value": "Growth"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_doc",
        "action_id": "create_july_guardrail",
        "path": "args",
        "criterion": "The body is a short, focused historical governance note that clearly explains that the July 2023 owner lanes borrowed or reused the investigation framework for that July work without making the framework a formal, mandatory companywide process. It must not characterize the July arrangement itself as establishing a companywide mandate.",
        "check_id": "riley_055_03"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/riley/055.yaml

SHA-256: 52a22f95f4bb1ce80da5089fc111ef5ee21b77dc7d774cc6eccffe3228fdc17a