Test 200 for Riley Tanaka

Request

Create a new document titled `Helio Start 2028 bounded proposal worksheet`. Make it a reusable worksheet for a proposed 2028 Helio Start run, with fill-in sections for scope, owner, dates, budget, operating safeguards, and approval/sign-off. Prefill the maximum-admissions field using the Customer Success capacity we established. Set the approval section to Pending, and make clear that neither the staffing capacity nor this worksheet authorizes paid traffic or a launch; those require separate approval.

Required memory

Fact 248

Customer Success certified that it could staff a future Helio Start run capped at 25 admitted workspaces without displacing ordinary assisted-path coverage.

Source evidence (1)

004114Mar 17, 2027 / 13:10 UTC-05:00

Owen and Customer Success have completed and certified the 90-day account-level support cut for all 45 organic Helio Start workspaces that received the authority checklist from September 15 through October 31. All 45 have complete windows. Support effort was 24 minutes at the median and 86 minutes at the 90th percentile; three of 45 exceeded 90 support minutes, and no unsupported case entered the admitted path. The result remains descriptive because there was no randomized control. Customer Success separately certified that it could staff a future capped run of no more than 25 admitted workspaces without displacing ordinary assisted-path coverage. Priya set a March 24 decision on whether these inputs justify developing, but not launching, a Q2 proposal. Replace the preliminary section in `Lifecycle Systems Q2 kickoff — March 18 open questions` with the certified input, then post a concise summary in `#lifecycle-systems` preserving the descriptive limitation, 25-admission cap, March 24 decision boundary, and the fact that no proposal development, launch, budget, paid traffic, pipeline treatment, forecast credit, eligibility change, lifecycle bypass, or fifth shared-state consumer is authorized now.

Message 004114 in history

Fact 249

Priya scheduled a March 24, 2027 decision on whether the certified Helio Start support and staffing inputs justify developing, but not launching, a Q2 proposal.

Source evidence (1)

004114Mar 17, 2027 / 13:10 UTC-05:00

Owen and Customer Success have completed and certified the 90-day account-level support cut for all 45 organic Helio Start workspaces that received the authority checklist from September 15 through October 31. All 45 have complete windows. Support effort was 24 minutes at the median and 86 minutes at the 90th percentile; three of 45 exceeded 90 support minutes, and no unsupported case entered the admitted path. The result remains descriptive because there was no randomized control. Customer Success separately certified that it could staff a future capped run of no more than 25 admitted workspaces without displacing ordinary assisted-path coverage. Priya set a March 24 decision on whether these inputs justify developing, but not launching, a Q2 proposal. Replace the preliminary section in `Lifecycle Systems Q2 kickoff — March 18 open questions` with the certified input, then post a concise summary in `#lifecycle-systems` preserving the descriptive limitation, 25-admission cap, March 24 decision boundary, and the fact that no proposal development, launch, budget, paid traffic, pipeline treatment, forecast credit, eligibility change, lifecycle bypass, or fifth shared-state consumer is authorized now.

Message 004114 in history

Fact 250

As of March 17, 2027, no Helio Start proposal development, launch, budget, paid traffic, pipeline treatment, forecast credit, eligibility change, lifecycle bypass, or fifth shared-state consumer is authorized.

Source evidence (1)

004114Mar 17, 2027 / 13:10 UTC-05:00

Owen and Customer Success have completed and certified the 90-day account-level support cut for all 45 organic Helio Start workspaces that received the authority checklist from September 15 through October 31. All 45 have complete windows. Support effort was 24 minutes at the median and 86 minutes at the 90th percentile; three of 45 exceeded 90 support minutes, and no unsupported case entered the admitted path. The result remains descriptive because there was no randomized control. Customer Success separately certified that it could staff a future capped run of no more than 25 admitted workspaces without displacing ordinary assisted-path coverage. Priya set a March 24 decision on whether these inputs justify developing, but not launching, a Q2 proposal. Replace the preliminary section in `Lifecycle Systems Q2 kickoff — March 18 open questions` with the certified input, then post a concise summary in `#lifecycle-systems` preserving the descriptive limitation, 25-admission cap, March 24 decision boundary, and the fact that no proposal development, launch, budget, paid traffic, pipeline treatment, forecast credit, eligibility change, lifecycle bypass, or fifth shared-state consumer is authorized now.

Message 004114 in history

Expected tool calls

create_doc

Grading

1. field_equals / create_doc

{
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_2028_helio_proposal",
  "path": "result.ok",
  "value": true,
  "check_id": "riley_200_00"
}

2. field_equals / create_doc

{
  "check_id": "riley_200_01",
  "type": "field_equals",
  "tool": "create_doc",
  "action_id": "create_2028_helio_proposal",
  "path": "args.title",
  "value": "Helio Start 2028 bounded proposal worksheet"
}

3. field_llm_judge / create_doc

{
  "type": "field_llm_judge",
  "tool": "create_doc",
  "action_id": "create_2028_helio_proposal",
  "path": "args",
  "criterion": "The body is a reusable proposal worksheet rather than a completed launch announcement. It provides clearly identifiable fill-in areas for scope, owner, dates, budget, operating safeguards, and approval or sign-off.\n\nThe worksheet has a clearly labeled maximum-admissions field prefilled with exactly 25 admitted workspaces as the operational ceiling. Fail if the field is blank, gives another number, treats 25 only as an unrelated historical result, or permits more than 25 admissions.\n\nThe approval section is clearly marked Pending. The body also explicitly states that the staffing capacity and worksheet do not authorize paid traffic or launch and that separate approval is required; it must not imply that a 2028 run is already approved or live.",
  "check_id": "riley_200_02"
}

Complete grading specification

{
  "type": "tool_trace",
  "config": {
    "check_version": 2,
    "today": "2028-01-01",
    "semantic_judge_version": 2,
    "assertions": [
      {
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_2028_helio_proposal",
        "path": "result.ok",
        "value": true,
        "check_id": "riley_200_00"
      },
      {
        "check_id": "riley_200_01",
        "type": "field_equals",
        "tool": "create_doc",
        "action_id": "create_2028_helio_proposal",
        "path": "args.title",
        "value": "Helio Start 2028 bounded proposal worksheet"
      },
      {
        "type": "field_llm_judge",
        "tool": "create_doc",
        "action_id": "create_2028_helio_proposal",
        "path": "args",
        "criterion": "The body is a reusable proposal worksheet rather than a completed launch announcement. It provides clearly identifiable fill-in areas for scope, owner, dates, budget, operating safeguards, and approval or sign-off.\n\nThe worksheet has a clearly labeled maximum-admissions field prefilled with exactly 25 admitted workspaces as the operational ceiling. Fail if the field is blank, gives another number, treats 25 only as an unrelated historical result, or permits more than 25 admissions.\n\nThe approval section is clearly marked Pending. The body also explicitly states that the staffing capacity and worksheet do not authorize paid traffic or launch and that separate approval is required; it must not imply that a 2028 run is already approved or live.",
        "check_id": "riley_200_02"
      }
    ]
  }
}