DolphinBench

Test 062

Jan 1, 2028 / 5 facts

YAML

Request

Create a concise Lifecycle Systems ownership reference for new collaborators. Include the approved function lead and the standing lanes for measurement, lifecycle governance, and engineering reliability.

Required memory

Fact 75

The January 24 organizational decision approved Lifecycle Systems as a formal Helio function beginning January 27, 2025, with Riley Tanaka as lead.

Source evidence (1)

002453Jan 24, 2025 / 15:40 UTC-06:00

Record the approved January 24 decision on the existing charter proposal, announce in #growth that Lifecycle Systems begins as a formal Helio function on Monday, January 27 with me as lead, and create the January 27 operating kickoff from 10:00am to 10:45am with Priya Devarajan, Owen Pham, Ines Kovac, Daniela Schultz, and me. Include the agreed lanes: Owen on measurement, definitions, and exception reporting; Ines on lifecycle governance and message-state controls; Daniela's team as the engineering partner for event and state reliability; and me on high-stakes cuts and the self-serve operating model, including support load beside activation. Keep clear that the shared state contract is not live in production.

Message 002453 in history

Fact 76

Owen Pham’s approved Lifecycle Systems lane covers measurement, definitions, and exception reporting.

Source evidence (1)

002453Jan 24, 2025 / 15:40 UTC-06:00

Record the approved January 24 decision on the existing charter proposal, announce in #growth that Lifecycle Systems begins as a formal Helio function on Monday, January 27 with me as lead, and create the January 27 operating kickoff from 10:00am to 10:45am with Priya Devarajan, Owen Pham, Ines Kovac, Daniela Schultz, and me. Include the agreed lanes: Owen on measurement, definitions, and exception reporting; Ines on lifecycle governance and message-state controls; Daniela's team as the engineering partner for event and state reliability; and me on high-stakes cuts and the self-serve operating model, including support load beside activation. Keep clear that the shared state contract is not live in production.

Message 002453 in history

Fact 77

Ines Kovac’s approved Lifecycle Systems lane covers lifecycle governance and message-state controls.

Source evidence (1)

002453Jan 24, 2025 / 15:40 UTC-06:00

Record the approved January 24 decision on the existing charter proposal, announce in #growth that Lifecycle Systems begins as a formal Helio function on Monday, January 27 with me as lead, and create the January 27 operating kickoff from 10:00am to 10:45am with Priya Devarajan, Owen Pham, Ines Kovac, Daniela Schultz, and me. Include the agreed lanes: Owen on measurement, definitions, and exception reporting; Ines on lifecycle governance and message-state controls; Daniela's team as the engineering partner for event and state reliability; and me on high-stakes cuts and the self-serve operating model, including support load beside activation. Keep clear that the shared state contract is not live in production.

Message 002453 in history

Fact 78

Daniela Schultz’s team is the approved Lifecycle Systems engineering partner for event and state reliability.

Source evidence (1)

002453Jan 24, 2025 / 15:40 UTC-06:00

Record the approved January 24 decision on the existing charter proposal, announce in #growth that Lifecycle Systems begins as a formal Helio function on Monday, January 27 with me as lead, and create the January 27 operating kickoff from 10:00am to 10:45am with Priya Devarajan, Owen Pham, Ines Kovac, Daniela Schultz, and me. Include the agreed lanes: Owen on measurement, definitions, and exception reporting; Ines on lifecycle governance and message-state controls; Daniela's team as the engineering partner for event and state reliability; and me on high-stakes cuts and the self-serve operating model, including support load beside activation. Keep clear that the shared state contract is not live in production.

Message 002453 in history

Fact 79

Riley Tanaka’s approved Lifecycle Systems lane covers high-stakes cuts and Helio’s self-serve operating model, with support load measured beside activation.

Source evidence (2)

002453Jan 24, 2025 / 15:40 UTC-06:00

Record the approved January 24 decision on the existing charter proposal, announce in #growth that Lifecycle Systems begins as a formal Helio function on Monday, January 27 with me as lead, and create the January 27 operating kickoff from 10:00am to 10:45am with Priya Devarajan, Owen Pham, Ines Kovac, Daniela Schultz, and me. Include the agreed lanes: Owen on measurement, definitions, and exception reporting; Ines on lifecycle governance and message-state controls; Daniela's team as the engineering partner for event and state reliability; and me on high-stakes cuts and the self-serve operating model, including support load beside activation. Keep clear that the shared state contract is not live in production.

Message 002453 in history
004079Mar 5, 2027 / 08:05 UTC-06:00

Send a text-only email to the electricity supplier with subject `Unexpected $9.95 plan service fee on Cherrywood electricity statement` and this exact body: `Hello, my latest statement includes a separate $9.95 plan service fee. My active fixed plan runs through August 12, 2027 and has no monthly plan fee. The statement otherwise shows 721 kWh at the contracted $0.138 per kWh rate. Please identify the contractual basis for this fee or correct the statement, and confirm the result in writing. Thank you, Riley Tanaka.`

Message 004079 in history

Expected tool calls

  • create_doc

Grading

1. field_equals / create_doc
{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_ownership_reference",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_062_00"
}
2. field_llm_judge / create_doc
{
  "type": "field_llm_judge",
  "tool": "create_doc",
  "action_id": "create_ownership_reference",
  "path": "args",
  "criterion": "The reference names Riley as the approved Lifecycle Systems function lead. It says Owen's lane covers measurement, definitions, and exception reporting; Ines's lane covers lifecycle governance and message-state controls; and Daniela's team handles event and state reliability.",
  "check_id": "riley_062_01"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_ownership_reference",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_062_00"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_doc",
        "action_id": "create_ownership_reference",
        "path": "args",
        "criterion": "The reference names Riley as the approved Lifecycle Systems function lead. It says Owen's lane covers measurement, definitions, and exception reporting; Ines's lane covers lifecycle governance and message-state controls; and Daniela's team handles event and state reliability.",
        "check_id": "riley_062_01"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/riley/062.yaml

SHA-256: 1c2ac98b94b7406f50d259e20a95d3c426644905236d3056e8ec3e3077706c6c