DolphinBench

Test 010

Jan 1, 2028 / 1 fact

YAML

Request

I need an informal critique of a Figma-heavy UI prototype. Send the best-matched colleague a Slack DM asking for a short UI review.

Required memory

Fact 56

Iris Kemper works in product engineering and previously worked at Figma.

Source evidence (1)

000188May 24, 2023 / 11:30 UTC-04:00

Block 12:30-1:30 for lunch w Iris Kemper on May 24. Theo set it up. Product eng, ex-Figma. Keep it near Sphere if possible -- it's a first 1:1 and I want to feel out the Q3 cross-team observability/UI project thing he's been hinting at.

Message 000188 in history

Expected tool calls

  • send_slack_dm

Grading

1. field_equals / send_slack_dm
{
  "type": "field_equals",
  "tool": "send_slack_dm",
  "action_id": "alex_010_send_slack_dm",
  "path": "result.ok",
  "value": true,
  "check_id": "alex_010_00"
}
2. field_equals / send_slack_dm
{
  "type": "field_equals",
  "path": "result.user",
  "value": "iris",
  "tool": "send_slack_dm",
  "action_id": "alex_010_send_slack_dm",
  "check_id": "alex_010_01"
}
3. field_llm_judge / send_slack_dm
{
  "type": "field_llm_judge",
  "path": "result.message",
  "criterion": "The message briefly explains that the prototype is Figma-heavy and asks Iris for a short, informal UI-focused critique.",
  "tool": "send_slack_dm",
  "action_id": "alex_010_send_slack_dm",
  "check_id": "alex_010_02"
}
Complete grading specification
{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "assertions": [
      {
        "type": "field_equals",
        "tool": "send_slack_dm",
        "action_id": "alex_010_send_slack_dm",
        "path": "result.ok",
        "value": true,
        "check_id": "alex_010_00"
      },
      {
        "type": "field_equals",
        "path": "result.user",
        "value": "iris",
        "tool": "send_slack_dm",
        "action_id": "alex_010_send_slack_dm",
        "check_id": "alex_010_01"
      },
      {
        "type": "field_llm_judge",
        "path": "result.message",
        "criterion": "The message briefly explains that the prototype is Figma-heavy and asks Iris for a short, informal UI-focused critique.",
        "tool": "send_slack_dm",
        "action_id": "alex_010_send_slack_dm",
        "check_id": "alex_010_02"
      }
    ]
  }
}
App stateDownload JSON
Source file

tests/alex/010.yaml

SHA-256: dd2660274249fdb9bf635c719da4c359801029d66e92b69733690b62c4072323