DolphinBench

Test 138

Sep 14, 2026 / 2 facts

YAML

Request

Email the Pinecone integration contact for current reproduction details before we change the connector docs again. Copy the usual person on the external thread.

Required memory

Fact 34

Morgan Chen requested that Sarah Kim (sarah@atlas-test.com) be CC'd on outside email threads from the start so she can see the full thread.

Source evidence (1)

000292Apr 6, 2023 / 10:00 UTC-07:00

ok so for outside email, just cc Sarah Kim on it. sarah@atlas-test.com. easier if she sees the thread from the start

Message 000292 in history

Fact 83

The Pinecone-side contact for the integration is integrations@pinecone-test.com.

Source evidence (1)

000454Apr 27, 2023 / 10:00 UTC-07:00

also need to remember we're kicking off the Pinecone integration now. contact on their side is integrations@pinecone-test.com. i'll prob have to keep nudging that thread

Message 000454 in history

Expected tool calls

  • send_email

Grading

1. field_equals / send_email
{
  "type": "field_equals",
  "tool": "send_email",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_138_00",
  "action_id": "morgan_138_send_email"
}
2. field_equals / send_email
{
  "type": "field_equals",
  "path": "result.to",
  "value": "integrations@pinecone-test.com",
  "tool": "send_email",
  "check_id": "morgan_138_01",
  "action_id": "morgan_138_send_email"
}
3. field_list_includes / send_email
{
  "type": "field_list_includes",
  "path": "result.cc",
  "values": [
    "sarah@atlas-test.com"
  ],
  "tool": "send_email",
  "check_id": "morgan_138_02",
  "action_id": "morgan_138_send_email"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_email",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_138_00",
        "action_id": "morgan_138_send_email"
      },
      {
        "type": "field_equals",
        "path": "result.to",
        "value": "integrations@pinecone-test.com",
        "tool": "send_email",
        "check_id": "morgan_138_01",
        "action_id": "morgan_138_send_email"
      },
      {
        "type": "field_list_includes",
        "path": "result.cc",
        "values": [
          "sarah@atlas-test.com"
        ],
        "tool": "send_email",
        "check_id": "morgan_138_02",
        "action_id": "morgan_138_send_email"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/138.yaml

SHA-256: 2bd051112bfe3586e09a0a33f01f1327f115198208236a3c3340d3dacfd7e2a2