Test 037

Sep 14, 2026 / 1 fact

Request

Email sarah@scaffold.dev Harbor Health's standard monthly Mercury Growth quote for 300 active developers, without enterprise add-ons. Include a short price breakdown.

Required memory

Fact 136

As of August 29, 2023, new Mercury design-partner and post-launch quotes use a hybrid model rather than treating pricing as a pure-MAU-versus-pure-seat choice: Pilot has a $2,500 monthly platform minimum including up to 50 monthly active developers; Growth has a $7,500 monthly platform minimum including up to 200 monthly active developers; overage costs $1,000 per additional 50 monthly active developers; and enterprise add-ons such as SSO, audit logs, and advanced admin controls are quoted separately only after those features ship. The rationale is to preserve usage-based ramping while providing a cleaner floor for forecasting and procurement conversations.

Source evidence (1)

000703Aug 29, 2023 / 08:58 UTC-07:00

Pricing check with Devon is done. Create a new internal decision record and quote-guidance doc titled “Mercury pricing decision — hybrid platform minimums.” Record that we’re no longer treating Mercury pricing as a pure-MAU-versus-pure-seat debate. After looking at the first design-partner usage patterns, new Mercury design-partner and post-launch quotes use the hybrid model: - Pilot platform minimum: $2,500/month, including up to 50 monthly active developers - Growth platform minimum: $7,500/month, including up to 200 monthly active developers - Overage: $1,000 per additional 50 monthly active developers - Enterprise add-ons like SSO, audit logs, and advanced admin controls are quoted separately only after those features actually ship Add the rationale plainly: this keeps the usage-ramp logic honest while giving Devon a cleaner floor for forecasting and procurement conversations.

Message 000703 in history

Expected tool calls

send_email

Grading

1. field_equals / send_email

{
  "type": "field_equals",
  "tool": "send_email",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_037_00",
  "action_id": "morgan_037_send_email"
}

2. field_equals / send_email

{
  "type": "field_equals",
  "path": "result.to",
  "value": "sarah@scaffold.dev",
  "tool": "send_email",
  "check_id": "morgan_037_01",
  "action_id": "morgan_037_send_email"
}

3. field_llm_judge / send_email

{
  "type": "field_llm_judge",
  "path": "result.body",
  "criterion": "Quotes $9,500 per month: a $7,500 Growth minimum including 200 monthly active developers plus two additional 50-developer increments at $1,000 each. Equivalent arithmetic and formatting are valid; a seat-count price or a different total fails.",
  "tool": "send_email",
  "check_id": "morgan_037_02",
  "action_id": "morgan_037_send_email"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_email",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_037_00",
        "action_id": "morgan_037_send_email"
      },
      {
        "type": "field_equals",
        "path": "result.to",
        "value": "sarah@scaffold.dev",
        "tool": "send_email",
        "check_id": "morgan_037_01",
        "action_id": "morgan_037_send_email"
      },
      {
        "type": "field_llm_judge",
        "path": "result.body",
        "criterion": "Quotes $9,500 per month: a $7,500 Growth minimum including 200 monthly active developers plus two additional 50-developer increments at $1,000 each. Equivalent arithmetic and formatting are valid; a seat-count price or a different total fails.",
        "tool": "send_email",
        "check_id": "morgan_037_02",
        "action_id": "morgan_037_send_email"
      }
    ]
  }
}

App state

Download JSON

Source file

tests/morgan/037.yaml

SHA-256: 4ccc3012b2633dc782873231d9046bf47ef7101d3c821dcbd0193f22bf72067e