DolphinBench

Test 052

Sep 14, 2026 / 1 fact

YAML

Request

Acme asks whether its JWT clock-skew docs issue warrants a Compass proof point or an Atlas sequencing item. Email support@scaffold.dev the triage decision.

Required memory

Fact 294

As of April 17, 2026, Morgan Chen considered the Atlas/API v2 JWT matter closed for now as documentation and support cleanup, not as Compass proof or a new Atlas sequencing item.

Source evidence (1)

002895Apr 17, 2026 / 08:54 UTC-07:00

Context for later: Leo and Sarah gave me the first support read after the Atlas/API v2 JWT docs patch. Support has seen no new non-Acme `nbf` clock-skew cases since the patch went live. Acme's audit team accepted the updated written docs link for its Q2 file through the normal Atlas/API v2 support path and did not ask for a product-priority item, founder-direct review, or special recurring attestation. This is docs/support cleanup closed for now, not Compass proof and not a new Atlas sequencing item.

Message 002895 in history

Expected tool calls

  • send_email

Grading

1. field_equals / send_email
{
  "type": "field_equals",
  "tool": "send_email",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_052_00",
  "action_id": "morgan_052_send_email"
}
2. field_equals / send_email
{
  "type": "field_equals",
  "path": "result.to",
  "value": "support@scaffold.dev",
  "tool": "send_email",
  "check_id": "morgan_052_01",
  "action_id": "morgan_052_send_email"
}
3. field_llm_judge / send_email
{
  "type": "field_llm_judge",
  "path": "result.body",
  "criterion": "Treats the issue as closed-for-now docs/support cleanup through normal Atlas/API v2 support, not Compass proof or a new Atlas sequencing item. The rejected alternatives need not be repeated if the disposition is unambiguous and not contradicted.",
  "tool": "send_email",
  "check_id": "morgan_052_02",
  "action_id": "morgan_052_send_email"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_email",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_052_00",
        "action_id": "morgan_052_send_email"
      },
      {
        "type": "field_equals",
        "path": "result.to",
        "value": "support@scaffold.dev",
        "tool": "send_email",
        "check_id": "morgan_052_01",
        "action_id": "morgan_052_send_email"
      },
      {
        "type": "field_llm_judge",
        "path": "result.body",
        "criterion": "Treats the issue as closed-for-now docs/support cleanup through normal Atlas/API v2 support, not Compass proof or a new Atlas sequencing item. The rejected alternatives need not be repeated if the disposition is unambiguous and not contradicted.",
        "tool": "send_email",
        "check_id": "morgan_052_02",
        "action_id": "morgan_052_send_email"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/052.yaml

SHA-256: 27e1ad52680a9bdf344b195fe9c7763efb253902e70552e5506e89017ddb7b34