DolphinBench

Test 067

Jan 1, 2028 / 1 fact

YAML

Request

Create a concise implementation checklist for future changes to Lantern's locked v0 data and UI boundary.

Required memory

Fact 70

Alex Valdez requested one final contract-lock comment on lantern#3 to establish a single authoritative v0 boundary: the backend emits a thin event envelope; facts are appended to the store; provenance fields are mandatory; the stable status enum remains small; the UI uses a derived read model instead of guessing hidden transitions; and v0 excludes raw incident bodies and unpermissioned status chatter.

Source evidence (1)

000331Jul 20, 2023 / 11:55 UTC-04:00

I finished the Lantern v0 contract pass with Iris and the decision is locked now, not just drifting toward consensus. Please post one final contract-lock comment on lantern#3 so there's a single authoritative boundary for v0. It needs to say the backend emits a thin event envelope, facts are append-only into the store, provenance fields are mandatory, the stable status enum stays small, the UI reads from a derived read model rather than guessing hidden transitions, and v0 excludes raw incident bodies plus unpermissioned status chatter.

Message 000331 in history

Expected tool calls

  • create_doc

Grading

1. field_equals / create_doc
{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "alex_067_create_doc",
  "path": "result.ok",
  "value": true,
  "check_id": "alex_067_00"
}
2. field_llm_judge / create_doc
{
  "type": "field_llm_judge",
  "path": "result.document.body",
  "criterion": "The checklist gives concrete review questions for a thin event envelope, append-only facts, mandatory provenance, a small stable status enum, and UI consumption of a derived read model rather than hidden-transition guesses.",
  "tool": "create_doc",
  "action_id": "alex_067_create_doc",
  "check_id": "alex_067_01"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "alex_067_create_doc",
        "path": "result.ok",
        "value": true,
        "check_id": "alex_067_00"
      },
      {
        "type": "field_llm_judge",
        "path": "result.document.body",
        "criterion": "The checklist gives concrete review questions for a thin event envelope, append-only facts, mandatory provenance, a small stable status enum, and UI consumption of a derived read model rather than hidden-transition guesses.",
        "tool": "create_doc",
        "action_id": "alex_067_create_doc",
        "check_id": "alex_067_01"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/alex/067.yaml

SHA-256: 64bd90467c1355a7891db2f160720fd634269d161f95d6f63e8a9b9a6017b3b1