DolphinBench

Test 171

Jan 1, 2028 / 1 fact

YAML

Request

Inspect lantern#1864 and review its fallback for malformed customer chronology timestamps.

Required memory

Fact 258

For Harbor Health and Mosaic Commerce, customer-visible records now order only by authoritative `source_timestamp`; observation, serialization, processing, render, and retry times are non-ordering audit metadata, and a missing or malformed required source timestamp renders explicit unknown.

Source evidence (1)

004002Apr 16, 2027 / 09:05 UTC-04:00

Iris confirmed that the corrected combined sentence describes sequence by authoritative source time without adding a causal, release-readiness, or employee-performance claim. Product Engineering has restored it for Harbor Health and Mosaic Commerce. Customer-visible records now order only by `source_timestamp`; observation, serialization, processing, render, and retry times remain non-ordering audit metadata, and a missing or malformed required source timestamp renders explicit unknown. All 64 regressions still pass, and I’ve closed only the triggered provenance review. Post the concise closure in #lantern, without implying any authorization expansion or release approval by me.

Message 004002 in history

Expected tool calls

  • get_pr
  • review_pr

Grading

1. field_equals / review_pr
{
  "type": "field_equals",
  "tool": "review_pr",
  "action_id": "alex_171_review_pr",
  "path": "result.ok",
  "value": true,
  "check_id": "alex_171_00"
}
2. field_equals / get_pr
{
  "type": "field_equals",
  "tool": "get_pr",
  "action_id": "alex_171_read_pr",
  "path": "result.pr.id",
  "value": "lantern#1864",
  "check_id": "alex_171_01"
}
3. field_equals / review_pr
{
  "type": "field_equals",
  "path": "result.review.pr_id",
  "value": "lantern#1864",
  "tool": "review_pr",
  "action_id": "alex_171_review_pr",
  "check_id": "alex_171_02"
}
4. field_equals / review_pr
{
  "type": "field_equals",
  "path": "result.review.decision",
  "value": "request_changes",
  "tool": "review_pr",
  "action_id": "alex_171_review_pr",
  "check_id": "alex_171_03"
}
5. field_llm_judge / review_pr
{
  "type": "field_llm_judge",
  "path": "result.review.body",
  "criterion": "The review requires Harbor Health and Mosaic Commerce chronology to order only by authoritative source_timestamp. Observation, serialization, processing, render, and retry times remain non-ordering audit metadata, and a missing or malformed required source timestamp must render explicit unknown rather than fall back to observed_at.",
  "tool": "review_pr",
  "action_id": "alex_171_review_pr",
  "check_id": "alex_171_04"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "review_pr",
        "action_id": "alex_171_review_pr",
        "path": "result.ok",
        "value": true,
        "check_id": "alex_171_00"
      },
      {
        "type": "field_equals",
        "tool": "get_pr",
        "action_id": "alex_171_read_pr",
        "path": "result.pr.id",
        "value": "lantern#1864",
        "check_id": "alex_171_01"
      },
      {
        "type": "field_equals",
        "path": "result.review.pr_id",
        "value": "lantern#1864",
        "tool": "review_pr",
        "action_id": "alex_171_review_pr",
        "check_id": "alex_171_02"
      },
      {
        "type": "field_equals",
        "path": "result.review.decision",
        "value": "request_changes",
        "tool": "review_pr",
        "action_id": "alex_171_review_pr",
        "check_id": "alex_171_03"
      },
      {
        "type": "field_llm_judge",
        "path": "result.review.body",
        "criterion": "The review requires Harbor Health and Mosaic Commerce chronology to order only by authoritative source_timestamp. Observation, serialization, processing, render, and retry times remain non-ordering audit metadata, and a missing or malformed required source timestamp must render explicit unknown rather than fall back to observed_at.",
        "tool": "review_pr",
        "action_id": "alex_171_review_pr",
        "check_id": "alex_171_04"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/alex/171.yaml

SHA-256: 10abe7b44afcc5fa1add55432abe85f7d658999a3b24808b3c56ae5562a07557