DolphinBench

Test 085

Jan 1, 2028 / 5 facts

YAML

Request

Create a document containing a compact table comparing documented Harbor Health and Mosaic Commerce use across Lantern's first three 2026 evidence windows.

Required memory

Fact 201

Harbor Health used Lantern’s existing view in seven release follow-ups during the January 1–March 15, 2026 continuation period.

Source evidence (1)

003389Mar 16, 2026 / 15:18 UTC-04:00

Iris and I completed the evidence-freeze session and reconciled the full January 1–March 15 Lantern continuation export for Harbor Health and Mosaic Commerce, the two authorized accounts. We found 2,236 customer sessions and 431 logical explanation requests: 287 eligible combined explanations, 94 valid cases kept separate because source timestamps differed by more than 24 hours, and 50 explicit-unknown outcomes for stale or missing input. There were zero eligible renderer failures, and those explanation categories reconcile to all 431 requests. The safety audit found zero authorization-wrapper bypasses, adapter calls after denial, cross-tenant material, stale or missing sources rendered as anything other than explicit unknown, excluded-field exposures, deploy events missing required provenance, unpublished ownership renders, incident-load summaries missing their source timestamps, read-only enforcement losses, or other automatic-stop conditions. Harbor Health used the existing view in seven release follow-ups, and Mosaic Commerce used it in six incident handoffs. Update “Lantern continuation evidence freeze — March 16 worksheet” from the blank working sheet into the complete frozen result record with these figures, the safety audit, and account usage. Also add a neutral final-evidence section with the same figures and boundaries to “Lantern platform boundary proposal — March 26 strategy review.” Preserve that the March 26 direction decision remains pending, the existing two-account read-only authorization stays unchanged through March 31, 2026, and Harbor Health’s readiness-label request and Mosaic Commerce’s per-service cost request remain unresolved product questions rather than authorized features; don’t record a strategy outcome or change customer authorization.

Message 003389 in history

Fact 202

Mosaic Commerce used Lantern’s existing view in six incident handoffs during the January 1–March 15, 2026 continuation period.

Source evidence (1)

003389Mar 16, 2026 / 15:18 UTC-04:00

Iris and I completed the evidence-freeze session and reconciled the full January 1–March 15 Lantern continuation export for Harbor Health and Mosaic Commerce, the two authorized accounts. We found 2,236 customer sessions and 431 logical explanation requests: 287 eligible combined explanations, 94 valid cases kept separate because source timestamps differed by more than 24 hours, and 50 explicit-unknown outcomes for stale or missing input. There were zero eligible renderer failures, and those explanation categories reconcile to all 431 requests. The safety audit found zero authorization-wrapper bypasses, adapter calls after denial, cross-tenant material, stale or missing sources rendered as anything other than explicit unknown, excluded-field exposures, deploy events missing required provenance, unpublished ownership renders, incident-load summaries missing their source timestamps, read-only enforcement losses, or other automatic-stop conditions. Harbor Health used the existing view in seven release follow-ups, and Mosaic Commerce used it in six incident handoffs. Update “Lantern continuation evidence freeze — March 16 worksheet” from the blank working sheet into the complete frozen result record with these figures, the safety audit, and account usage. Also add a neutral final-evidence section with the same figures and boundaries to “Lantern platform boundary proposal — March 26 strategy review.” Preserve that the March 26 direction decision remains pending, the existing two-account read-only authorization stays unchanged through March 31, 2026, and Harbor Health’s readiness-label request and Mosaic Commerce’s per-service cost request remain unresolved product questions rather than authorized features; don’t record a strategy outcome or change customer authorization.

Message 003389 in history

Fact 208

Harbor Health used the Lantern view in eight release follow-ups, including two on the corrected published-alias path, while Mosaic Commerce used it in seven incident handoffs.

Source evidence (1)

003455Jun 24, 2026 / 11:28 UTC-04:00

The June 24 Lantern operating-evidence review is complete. We reconciled the frozen April 1 through June 15 export at 2,087 customer sessions and 402 logical explanation requests: 269 eligible combined explanations, 87 valid cases kept separate because source timestamps differed by more than 24 hours, and 46 explicit-unknown outcomes for stale or missing input. There were zero eligible renderer failures. The audit found no authorization-wrapper bypass, adapter call after denial, cross-tenant material, stale or missing source rendered as anything other than explicit unknown, missing required provenance or source timestamp, unpublished ownership render, excluded-field exposure, or loss of read-only enforcement. Harbor Health used the view in eight release follow-ups, including two on the corrected published-alias path, and Mosaic Commerce used it in seven incident handoffs. This is the first complete post-transition operating package and shows customer use behind shared registration and the published-alias rule while the safety conditions held. Update “Lantern April 1–June 15 operating-evidence review prep” with a dated June 24 final-review outcome section containing these results and the unchanged boundary: Harbor Health and Mosaic Commerce remain the only authorized read-only accounts, and cost data, CSV export, release-readiness labels, and additional accounts remain outside the current authorization.

Message 003455 in history

Fact 217

Harbor Health used Lantern in nine release follow-ups during the June 16–September 15, 2026 evidence period, including three uses of the published-alias path.

Source evidence (1)

003517Sep 18, 2026 / 11:28 UTC-04:00

The 10:30–11:15 AM Lantern operating-evidence and rehearsal review is complete. Alex, Iris, Hema, and Product Engineering reconciled the frozen June 16–September 15 export at 2,476 customer sessions and 478 logical explanation requests: 319 eligible combined explanations, 104 valid cases kept separate because source timestamps differed by more than 24 hours, and 55 explicit-unknown outcomes for stale or missing input. There were zero eligible renderer failures. The audit found no authorization-wrapper bypass, adapter call after denial, cross-tenant material, stale or missing source rendered as anything other than explicit unknown, missing required provenance or source timestamp, unpublished ownership render, excluded-field exposure, or loss of read-only enforcement. Harbor Health used the view in nine release follow-ups, including three on the published-alias path, and Mosaic Commerce used it in eight incident handoffs. Harbor Health’s owner-correction request and Mosaic Commerce’s limit-and-cost request remain outside the authorized surface. The completed September 8 staff-only rehearsal remains a separate evidence track. The reference model remains staff-only and inactive in Harbor Health and Mosaic Commerce, and this review did not authorize customer exposure, access expansion, or a later platform-cycle decision.

Message 003517 in history

Fact 218

Mosaic Commerce used Lantern in eight incident handoffs during the June 16–September 15, 2026 evidence period.

Source evidence (1)

003517Sep 18, 2026 / 11:28 UTC-04:00

The 10:30–11:15 AM Lantern operating-evidence and rehearsal review is complete. Alex, Iris, Hema, and Product Engineering reconciled the frozen June 16–September 15 export at 2,476 customer sessions and 478 logical explanation requests: 319 eligible combined explanations, 104 valid cases kept separate because source timestamps differed by more than 24 hours, and 55 explicit-unknown outcomes for stale or missing input. There were zero eligible renderer failures. The audit found no authorization-wrapper bypass, adapter call after denial, cross-tenant material, stale or missing source rendered as anything other than explicit unknown, missing required provenance or source timestamp, unpublished ownership render, excluded-field exposure, or loss of read-only enforcement. Harbor Health used the view in nine release follow-ups, including three on the published-alias path, and Mosaic Commerce used it in eight incident handoffs. Harbor Health’s owner-correction request and Mosaic Commerce’s limit-and-cost request remain outside the authorized surface. The completed September 8 staff-only rehearsal remains a separate evidence track. The reference model remains staff-only and inactive in Harbor Health and Mosaic Commerce, and this review did not authorize customer exposure, access expansion, or a later platform-cycle decision.

Message 003517 in history

Expected tool calls

  • create_doc

Grading

1. field_equals / create_doc
{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "alex_085_create_doc",
  "path": "result.ok",
  "value": true,
  "check_id": "alex_085_00"
}
2. field_llm_judge / create_doc
{
  "type": "field_llm_judge",
  "path": "result.document.body",
  "criterion": "The table keeps the windows distinct. January 1 through March 15 shows Harbor Health with 7 release follow-ups and Mosaic Commerce with 6 incident handoffs. April 1 through June 15 shows Harbor Health with 8 release follow-ups, including 2 on the corrected published-alias path, and Mosaic Commerce with 7 incident handoffs. June 16 through September 15 shows Harbor Health with 9 release follow-ups, including 3 on the published-alias path, and Mosaic Commerce with 8 incident handoffs.",
  "tool": "create_doc",
  "action_id": "alex_085_create_doc",
  "check_id": "alex_085_01"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "alex_085_create_doc",
        "path": "result.ok",
        "value": true,
        "check_id": "alex_085_00"
      },
      {
        "type": "field_llm_judge",
        "path": "result.document.body",
        "criterion": "The table keeps the windows distinct. January 1 through March 15 shows Harbor Health with 7 release follow-ups and Mosaic Commerce with 6 incident handoffs. April 1 through June 15 shows Harbor Health with 8 release follow-ups, including 2 on the corrected published-alias path, and Mosaic Commerce with 7 incident handoffs. June 16 through September 15 shows Harbor Health with 9 release follow-ups, including 3 on the published-alias path, and Mosaic Commerce with 8 incident handoffs.",
        "tool": "create_doc",
        "action_id": "alex_085_create_doc",
        "check_id": "alex_085_01"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/alex/085.yaml

SHA-256: c4a3e09a916d98bdd2a36561f79df6a9c0f572e40bb6de0078a2c495ea193bb9