Test 095

Sep 14, 2026 / 1 fact

Request

Email support@scaffold.dev the final disposition of acct_01J7M4QK's December 10, 2023 downgrade credit memo and what to do if the customer reports a balance discrepancy.

Required memory

Fact 159

Morgan Chen requested that Rishi be messaged in the current internal team chat with a safe sentence for either acct_01J7M4QK or acct_01J7MB2T: the downgrade credit state has been reconciled against Stripe, no duplicate credit was issued, and support should let the team know if the customer sees any balance discrepancy.

Source evidence (1)

000919Dec 13, 2023 / 13:07 UTC-08:00

Marcus says the two December credit-memo rows are reconciled now, with no duplicate credits, and the support line is precautionary. Please message Rishi in the current internal team chat with a safe sentence he can use if either account writes in: the downgrade credit state has been reconciled against Stripe, no duplicate credit was issued, and support should let us know if the customer sees any balance discrepancy. Then reply privately to Marcus that we can close unless either account reports a discrepancy.

Message 000919 in history

Expected tool calls

send_email

Grading

1. field_equals / send_email

{
  "type": "field_equals",
  "tool": "send_email",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_095_00",
  "action_id": "morgan_095_send_email"
}

2. field_equals / send_email

{
  "type": "field_equals",
  "path": "result.to",
  "value": "support@scaffold.dev",
  "tool": "send_email",
  "check_id": "morgan_095_01",
  "action_id": "morgan_095_send_email"
}

3. field_llm_judge / send_email

{
  "type": "field_llm_judge",
  "path": "result.body",
  "criterion": "Reports that the account's downgrade credit was reconciled against Stripe without duplicate credit, and asks Support to flag a reported balance discrepancy for follow-up. The credit memo is cm_01J7N0A1 if named; do not confuse it with the other account's memo.",
  "tool": "send_email",
  "check_id": "morgan_095_02",
  "action_id": "morgan_095_send_email"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_email",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_095_00",
        "action_id": "morgan_095_send_email"
      },
      {
        "type": "field_equals",
        "path": "result.to",
        "value": "support@scaffold.dev",
        "tool": "send_email",
        "check_id": "morgan_095_01",
        "action_id": "morgan_095_send_email"
      },
      {
        "type": "field_llm_judge",
        "path": "result.body",
        "criterion": "Reports that the account's downgrade credit was reconciled against Stripe without duplicate credit, and asks Support to flag a reported balance discrepancy for follow-up. The credit memo is cm_01J7N0A1 if named; do not confuse it with the other account's memo.",
        "tool": "send_email",
        "check_id": "morgan_095_02",
        "action_id": "morgan_095_send_email"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/morgan/095.yaml

SHA-256: b453c4c910443bcf203ba16d1b371fe23bd0d8e0945c900a7b1b28ede3728ffe