DolphinBench

Test 109

Sep 14, 2026 / 2 facts

YAML

Request

Add a CRM entry for Anna Rao from our April 19, 2023 conversation. Record her company, role, and what the company did then, clearly as historical information.

Required memory

Fact 63

As of April 19, 2023, Anna Rao was a co-founder of Tessl.

Source evidence (1)

000397Apr 19, 2023 / 17:00 UTC-07:00

met Anna Rao today. co-founder at Tessl -- they're doing data tooling for ML pipelines. berkeley database PhD, very very sharp. and shipping fast, not just talking about it. idk, stuck with me for some reason

Message 000397 in history

Fact 64

As of April 19, 2023, Tessl was developing data tooling for machine-learning pipelines.

Source evidence (1)

000397Apr 19, 2023 / 17:00 UTC-07:00

met Anna Rao today. co-founder at Tessl -- they're doing data tooling for ML pipelines. berkeley database PhD, very very sharp. and shipping fast, not just talking about it. idk, stuck with me for some reason

Message 000397 in history

Expected tool calls

  • add_crm_row

Grading

1. field_equals / add_crm_row
{
  "type": "field_equals",
  "tool": "add_crm_row",
  "path": "result.ok",
  "value": true,
  "check_id": "morgan_109_00",
  "action_id": "morgan_109_add_crm_row"
}
2. field_equals / add_crm_row
{
  "type": "field_equals",
  "path": "result.row.name",
  "value": "Anna Rao",
  "tool": "add_crm_row",
  "check_id": "morgan_109_01",
  "action_id": "morgan_109_add_crm_row"
}
3. field_llm_judge / add_crm_row
{
  "type": "field_llm_judge",
  "path": "result.row",
  "criterion": "Sets the company to Tessl, allowing unambiguous capitalization or business-name variants, and records Anna as a co-founder doing data tooling for ML pipelines at that time. Does not assert these old details remain current.",
  "tool": "add_crm_row",
  "check_id": "morgan_109_02",
  "action_id": "morgan_109_add_crm_row"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2026-09-14",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "add_crm_row",
        "path": "result.ok",
        "value": true,
        "check_id": "morgan_109_00",
        "action_id": "morgan_109_add_crm_row"
      },
      {
        "type": "field_equals",
        "path": "result.row.name",
        "value": "Anna Rao",
        "tool": "add_crm_row",
        "check_id": "morgan_109_01",
        "action_id": "morgan_109_add_crm_row"
      },
      {
        "type": "field_llm_judge",
        "path": "result.row",
        "criterion": "Sets the company to Tessl, allowing unambiguous capitalization or business-name variants, and records Anna as a co-founder doing data tooling for ML pipelines at that time. Does not assert these old details remain current.",
        "tool": "add_crm_row",
        "check_id": "morgan_109_02",
        "action_id": "morgan_109_add_crm_row"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/morgan/109.yaml

SHA-256: 255f0cd18d2f0b7f008f6008eca9b7365c881bb933c77e181ae87c57a6079eb2