Test 111

Sep 14, 2026 / 1 fact

Request

Email finance@scaffold.dev with the decision on whether March's lower Evergreen usage can offset April's overage in the invoice true-up.

Required memory

Fact 295

Morgan Chen ruled that March cannot create an April offset, department cap, seat-trade carveout, or rolling credit under the standard Growth monthly active developer mechanics.

Source evidence (1)

002953May 5, 2026 / 08:36 UTC-07:00

Devon and Sarah brought me the locked Evergreen April usage line. April 2026 is final at 214 monthly active developers, which creates one standard $1,000 Growth overage increment under Evergreen's renewed annual terms. Evergreen's admin team asked whether March's below-threshold result can offset April, either as unused capacity, a department cap, a seat-trade carveout, or a rolling credit. My answer stays inside the standard monthly active developer mechanics: the current-state CSV can explain what happened, but March cannot create an offset, department cap, carveout, or rolling credit. Draft the customer-facing answer Sarah can send Evergreen: clear, respectful, and grounded in the standard Growth monthly active developer mechanics. Devon final billing note, May 5, 8:12 AM PT: - Account: Evergreen Bank - April 2026 monthly active developer export locked: 214 - Growth included monthly active developers: 200 - Overage increment size: additional 50 monthly active developers - April overage result: one increment = $1,000 - March locked usage: 199 monthly active developers Evergreen admin question to Sarah: `Since March was below the included 200 and April is only 14 over, can we net March unused capacity against April or treat April as covered for departments that were under threshold last month? If not, can the current-state CSV show a department-level offset so procurement understands the spike?`

Message 002953 in history

Expected tool calls

send_email

Grading

1. field_equals / send_email

{
  "type": "field_equals",
  "tool": "send_email",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_111_00",
  "action_id": "morgan_111_send_email"
}

2. field_equals / send_email

{
  "type": "field_equals",
  "path": "result.to",
  "value": "finance@scaffold.dev",
  "tool": "send_email",
  "check_id": "morgan_111_01",
  "action_id": "morgan_111_send_email"
}

3. field_llm_judge / send_email

{
  "type": "field_llm_judge",
  "path": "result.body",
  "criterion": "Rejects netting March unused capacity against April overage or creating a rolling credit/carveout. Standard monthly Growth usage applies. Exact monthly counts are optional.",
  "tool": "send_email",
  "check_id": "morgan_111_02",
  "action_id": "morgan_111_send_email"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_email",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_111_00",
        "action_id": "morgan_111_send_email"
      },
      {
        "type": "field_equals",
        "path": "result.to",
        "value": "finance@scaffold.dev",
        "tool": "send_email",
        "check_id": "morgan_111_01",
        "action_id": "morgan_111_send_email"
      },
      {
        "type": "field_llm_judge",
        "path": "result.body",
        "criterion": "Rejects netting March unused capacity against April overage or creating a rolling credit/carveout. Standard monthly Growth usage applies. Exact monthly counts are optional.",
        "tool": "send_email",
        "check_id": "morgan_111_02",
        "action_id": "morgan_111_send_email"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/morgan/111.yaml

SHA-256: fe83d4cc7cce773024ebf3d33178fc16dc925da8ce23c08dbbb7bf85a8f35b1e