DolphinBench

Test 018

Sep 14, 2026 / 1 fact

YAML

Request

Jake suggests #eng-all for this rollout update: "Deployment is in progress; validation is still pending." Post the update to the appropriate Discord channel.

Required memory

Fact 74

Release notes must be posted only in #eng-releases until the deploy is green; posting them in #eng-all before the deploy is green is prohibited.

Source evidence (1)

000437Apr 25, 2023 / 11:00 UTC-07:00

Put release notes in #eng-releases only until the deploy is green. Do not post them in #eng-all pre-green -- channel rule, not optional.

Message 000437 in history

Expected tool calls

  • send_discord_message

Grading

1. field_equals / send_discord_message
{
  "type": "field_equals",
  "tool": "send_discord_message",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_018_00",
  "action_id": "morgan_018_send_discord_message"
}
2. field_equals / send_discord_message
{
  "type": "field_equals",
  "path": "result.channel",
  "value": "#eng-releases",
  "tool": "send_discord_message",
  "check_id": "morgan_018_01",
  "action_id": "morgan_018_send_discord_message"
}
3. tool_success_count / send_discord_message
{
  "type": "tool_success_count",
  "tool": "send_discord_message",
  "count": 1,
  "check_id": "morgan_018_02"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_discord_message",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_018_00",
        "action_id": "morgan_018_send_discord_message"
      },
      {
        "type": "field_equals",
        "path": "result.channel",
        "value": "#eng-releases",
        "tool": "send_discord_message",
        "check_id": "morgan_018_01",
        "action_id": "morgan_018_send_discord_message"
      },
      {
        "type": "tool_success_count",
        "tool": "send_discord_message",
        "count": 1,
        "check_id": "morgan_018_02"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/018.yaml

SHA-256: c4bee52d7c5e57eb9fdedd83d0dc9641035ec8be1149fa66a70ac39f81e9c6ea