DolphinBench

Test 147

Sep 14, 2026 / 3 facts

YAML

Request

On scaffold/evidence#2741, review the import that changes MER-1279's historical columns and copies Figma decisions into ledger notes. Explain the correct structure and evidence handling.

Required memory

Fact 124

On July 24, 2023, Leo Park created the `MER-1279 Mercury launch-readiness ledger` with the columns `risk`, `evidence source`, `owner`, `verification needed`, and `weekly decision`.

Source evidence (1)

000649Jul 24, 2023 / 09:44 UTC-07:00

MER-1279 is now agreed enough that I want the team habit set before it drifts. Discord — #eng-team 2023-07-24 09:18 Leo Park Pulled the first Mercury release-risk readout into one working place so the evidence stops living across PRs, Linear, Figma comments, and Discord threads. Created: MER-1279 Mercury launch-readiness ledger Columns: risk | evidence source | owner | verification needed | weekly decision Why this exists: the readout itself was useful, but it was too blunt because the support for each call was scattered. The ledger is meant to hold the actual row-level evidence and the specific decision question for the weekly, not a separate narrative status doc. Owner split for MER-1279: - Marcus owns implementation gates and current dogfood blockers. - Priya's Figma files/comments remain the design source of truth; ledger rows should link to the relevant frame/comment instead of duplicating design decisions. - Leo owns cross-service platform-seam risk notes and missing-evidence callouts. - Jake runs the Mercury weekly from the ledger's weekly-decision column. If you're updating something launch-relevant, please add the evidence link to the row instead of dropping a standalone summary in chat. 09:24 Priya +1 on keeping design resolution in Figma. If a row needs design context, link the frame/comment thread; don't restate it loosely in the ledger. 09:27 Marcus Works for me. I'll keep the implementation-gate and dogfood-blocker rows current there. 09:31 Jake Yep. I'll run the Mercury weekly from MER-1279 and use the weekly-decision column instead of asking each owner for a separate status story. Please post one concise note in the engineering Discord confirming that MER-1279 is the working source for Mercury launch readiness: Marcus owns implementation gates and dogfood blockers, Priya's Figma remains the design source of truth, Leo owns cross-service platform-seam risk notes, and Jake will run the weekly from the ledger instead of collecting separate owner narratives.

Message 000649 in history

Fact 125

MER-1279 rows needing Mercury design context are to link to the relevant Figma frame or comment instead of duplicating design decisions in the ledger.

Source evidence (1)

000649Jul 24, 2023 / 09:44 UTC-07:00

MER-1279 is now agreed enough that I want the team habit set before it drifts. Discord — #eng-team 2023-07-24 09:18 Leo Park Pulled the first Mercury release-risk readout into one working place so the evidence stops living across PRs, Linear, Figma comments, and Discord threads. Created: MER-1279 Mercury launch-readiness ledger Columns: risk | evidence source | owner | verification needed | weekly decision Why this exists: the readout itself was useful, but it was too blunt because the support for each call was scattered. The ledger is meant to hold the actual row-level evidence and the specific decision question for the weekly, not a separate narrative status doc. Owner split for MER-1279: - Marcus owns implementation gates and current dogfood blockers. - Priya's Figma files/comments remain the design source of truth; ledger rows should link to the relevant frame/comment instead of duplicating design decisions. - Leo owns cross-service platform-seam risk notes and missing-evidence callouts. - Jake runs the Mercury weekly from the ledger's weekly-decision column. If you're updating something launch-relevant, please add the evidence link to the row instead of dropping a standalone summary in chat. 09:24 Priya +1 on keeping design resolution in Figma. If a row needs design context, link the frame/comment thread; don't restate it loosely in the ledger. 09:27 Marcus Works for me. I'll keep the implementation-gate and dogfood-blocker rows current there. 09:31 Jake Yep. I'll run the Mercury weekly from MER-1279 and use the weekly-decision column instead of asking each owner for a separate status story. Please post one concise note in the engineering Discord confirming that MER-1279 is the working source for Mercury launch readiness: Marcus owns implementation gates and dogfood blockers, Priya's Figma remains the design source of truth, Leo owns cross-service platform-seam risk notes, and Jake will run the weekly from the ledger instead of collecting separate owner narratives.

Message 000649 in history

Fact 126

On July 24, 2023, Leo Park asked contributors to add evidence links to MER-1279 rows for launch-relevant updates instead of posting standalone chat summaries.

Source evidence (1)

000649Jul 24, 2023 / 09:44 UTC-07:00

MER-1279 is now agreed enough that I want the team habit set before it drifts. Discord — #eng-team 2023-07-24 09:18 Leo Park Pulled the first Mercury release-risk readout into one working place so the evidence stops living across PRs, Linear, Figma comments, and Discord threads. Created: MER-1279 Mercury launch-readiness ledger Columns: risk | evidence source | owner | verification needed | weekly decision Why this exists: the readout itself was useful, but it was too blunt because the support for each call was scattered. The ledger is meant to hold the actual row-level evidence and the specific decision question for the weekly, not a separate narrative status doc. Owner split for MER-1279: - Marcus owns implementation gates and current dogfood blockers. - Priya's Figma files/comments remain the design source of truth; ledger rows should link to the relevant frame/comment instead of duplicating design decisions. - Leo owns cross-service platform-seam risk notes and missing-evidence callouts. - Jake runs the Mercury weekly from the ledger's weekly-decision column. If you're updating something launch-relevant, please add the evidence link to the row instead of dropping a standalone summary in chat. 09:24 Priya +1 on keeping design resolution in Figma. If a row needs design context, link the frame/comment thread; don't restate it loosely in the ledger. 09:27 Marcus Works for me. I'll keep the implementation-gate and dogfood-blocker rows current there. 09:31 Jake Yep. I'll run the Mercury weekly from MER-1279 and use the weekly-decision column instead of asking each owner for a separate status story. Please post one concise note in the engineering Discord confirming that MER-1279 is the working source for Mercury launch readiness: Marcus owns implementation gates and dogfood blockers, Priya's Figma remains the design source of truth, Leo owns cross-service platform-seam risk notes, and Jake will run the weekly from the ledger instead of collecting separate owner narratives.

Message 000649 in history

Expected tool calls

  • post_pr_comment

Grading

1. field_equals / post_pr_comment
{
  "type": "field_equals",
  "tool": "post_pr_comment",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_147_00",
  "action_id": "morgan_147_post_pr_comment"
}
2. field_equals / post_pr_comment
{
  "type": "field_equals",
  "path": "result.comment.pr_id",
  "value": "scaffold/evidence#2741",
  "tool": "post_pr_comment",
  "check_id": "morgan_147_01",
  "action_id": "morgan_147_post_pr_comment"
}
3. field_llm_judge / post_pr_comment
{
  "type": "field_llm_judge",
  "path": "result.comment.body",
  "criterion": "Preserves risk, evidence source, owner, verification needed, and weekly decision columns. Puts launch evidence links on corresponding ledger rows and links the relevant Figma frame/comment rather than duplicating design decisions. Incidental non-decision context is allowed.",
  "tool": "post_pr_comment",
  "check_id": "morgan_147_02",
  "action_id": "morgan_147_post_pr_comment"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "post_pr_comment",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_147_00",
        "action_id": "morgan_147_post_pr_comment"
      },
      {
        "type": "field_equals",
        "path": "result.comment.pr_id",
        "value": "scaffold/evidence#2741",
        "tool": "post_pr_comment",
        "check_id": "morgan_147_01",
        "action_id": "morgan_147_post_pr_comment"
      },
      {
        "type": "field_llm_judge",
        "path": "result.comment.body",
        "criterion": "Preserves risk, evidence source, owner, verification needed, and weekly decision columns. Puts launch evidence links on corresponding ledger rows and links the relevant Figma frame/comment rather than duplicating design decisions. Incidental non-decision context is allowed.",
        "tool": "post_pr_comment",
        "check_id": "morgan_147_02",
        "action_id": "morgan_147_post_pr_comment"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/147.yaml

SHA-256: 6fddedd8023939788378c8f209dec99806bdce4f1b03e6c39e374c45080cb65b