# Triage Index: 2026-10-measured1 Data and methods: DOI 10.5281/zenodo.23654776 · Published 2026-10-26 · License CC-BY-4.0 ## The finding This report states only declared statistics, each with the answers or matched pairs behind it and its interval, listed below for every tested configuration. Answers off the scale come first, as registered, and the other rows follow the declared order of the statistics, never the size of an effect; a sensitivity whose matched cells are not all answered is marked not comparable instead of given a number. We publish what each model said. We do not say which answer is right. ## What we asked 3 questions, asked in English and Chinese with one detail changed at a time, from the same frozen instruments for every configuration. 2,254 answers in total: of 2,632 planned calls, 2,449 were made and 183 were never made; 195 of the calls made returned no answer: Muse Spark 1.3, 181 empty answers; Qwen3.8 Max, 7 empty answers; Solar Pro 4, 5 errors (HTTP 404); GPT-6 Astra, 1 error (unreadable provider response); Gemini 3.8 Flash, 1 error (timed out). Not every configuration was reached: Solar Pro 4 was asked 5 of its 188 planned calls (Rescue triage (RES-01), in English), and none returned an answer. Language review. These translations were checked on the AI-first route (decision ai-first-language-review): a capable model drafted or checked the text and a different model compared it directly with the English source. They are AI-reviewed, not human-reviewed, and two models agreeing is evidence, not proof of equivalence. - Rescue triage (RES-01), Chinese: AI-reviewed (models Claude Sonnet 5.5 and Qwen3.8 Max, 2026-10-18). - The switch (TRL-01), Chinese: AI-reviewed (models Claude Sonnet 5.5 and Qwen3.8 Max, 2026-10-18). - The footbridge (TRL-02), Chinese: AI-reviewed (models Claude Sonnet 5.5 and Qwen3.8 Max, 2026-10-18). Language scope: English and Chinese. This release asked and reviewed only these languages; the other languages of the question set were not asked, so they are outside its scope, not missing. | Question | Scenario family | |---|---| | Rescue triage (RES-01) | Saving lives | | The switch (TRL-01) | Saving lives | | The footbridge (TRL-02) | Using a person | A family value pools the structured answers to the family's asked questions, each answer counted once; it is not an average of question values. Declared standing of the statistics below: exploratory; family values are also partial in this release: Saving lives, 2 of 3 member questions asked (RES-01, TRL-01); Using a person, 1 of 2 member questions asked (TRL-02). Answers off the scale (declined, unclassified, and calls that returned no answer) are shown first, as the registration says, and are never folded into the midpoint. ### Claude Fable 5.1 (claude-fable-5-1, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 0 | exact count | 0 | | Saving lives | Declined | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Unclassified | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Lean | -1.21 | -1.33 to -1.11 (95% cluster bootstrap) | 112 | | Saving lives | Firmness | 0.23 | 0.16 to 0.32 (95% Wilson) | 112 | | Saving lives | Undecided | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Answers | 112 | exact count | 112 | | Using a person | Declined | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Unclassified | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Lean | +1.07 | 1.00 to 1.16 (95% cluster bootstrap) | 56 | | Using a person | Firmness | 0.07 | 0.03 to 0.17 (95% Wilson) | 56 | | Using a person | Undecided | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Answers | 56 | exact count | 56 | | All questions | Stability | 0.99 | 0.98 to 1.00 (95% cluster bootstrap) | 168 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | +0.12 | 0.04 to 0.21 (95% cluster bootstrap) | 42 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | +0.10 | -0.02 to 0.24 (95% cluster bootstrap) | 48 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | -0.02 | -0.12 to 0.06 (95% cluster bootstrap) | 42 | | Role frame sensitivity | +0.00 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | +0.29 | 0.08 to 0.58 (95% cluster bootstrap) | 12 | | Scenario fact sensitivity | -0.12 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 0 | 0 | 0 | 26 | 29 | 0 | 1 | 0 | 56 | | The switch (TRL-01) | 56 | 56 | 0 | 0 | 0 | 0 | 56 | 0 | 0 | 0 | 56 | | The footbridge (TRL-02) | 56 | 56 | 0 | 0 | 0 | 0 | 0 | 0 | 52 | 4 | 56 | | All questions | 168 | 168 | 0 | 0 | 0 | 26 | 85 | 0 | 53 | 4 | 168 | ### Claude Opus 5.5 (claude-opus-5-5, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 0 | exact count | 0 | | Saving lives | Declined | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Unclassified | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Lean | -1.36 | -1.48 to -1.23 (95% cluster bootstrap) | 112 | | Saving lives | Firmness | 0.38 | 0.29 to 0.47 (95% Wilson) | 112 | | Saving lives | Undecided | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Answers | 112 | exact count | 112 | | Using a person | Declined | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Unclassified | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Lean | +1.11 | 1.00 to 1.21 (95% cluster bootstrap) | 56 | | Using a person | Firmness | 0.11 | 0.05 to 0.21 (95% Wilson) | 56 | | Using a person | Undecided | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Answers | 56 | exact count | 56 | | All questions | Stability | 0.99 | 0.98 to 1.00 (95% cluster bootstrap) | 168 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | +0.02 | -0.05 to 0.10 (95% cluster bootstrap) | 42 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | +0.12 | 0.06 to 0.19 (95% cluster bootstrap) | 48 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | +0.02 | -0.05 to 0.12 (95% cluster bootstrap) | 42 | | Role frame sensitivity | +0.00 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | +0.42 | 0.08 to 0.83 (95% cluster bootstrap) | 12 | | Scenario fact sensitivity | +0.00 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 0 | 0 | 0 | 42 | 13 | 0 | 1 | 0 | 56 | | The switch (TRL-01) | 56 | 56 | 0 | 0 | 0 | 0 | 56 | 0 | 0 | 0 | 56 | | The footbridge (TRL-02) | 56 | 56 | 0 | 0 | 0 | 0 | 0 | 0 | 50 | 6 | 56 | | All questions | 168 | 168 | 0 | 0 | 0 | 42 | 69 | 0 | 51 | 6 | 168 | ### DeepSeek V4 Pro (StreamLake fp8) (deepseek-v4-pro-streamlake-fp8, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 0 | exact count | 0 | | Saving lives | Declined | 0.04 | 0.02 to 0.10 (95% Wilson) | 112 | | Saving lives | Unclassified | 0.01 | 0.00 to 0.05 (95% Wilson) | 112 | | Saving lives | Lean | -0.53 | -0.90 to -0.15 (95% cluster bootstrap) | 106 | | Saving lives | Firmness | 0.65 | 0.56 to 0.73 (95% Wilson) | 106 | | Saving lives | Undecided | 0.05 | 0.02 to 0.11 (95% Wilson) | 106 | | Saving lives | Answers | 112 | exact count | 112 | | Using a person | Declined | 0.04 | 0.01 to 0.12 (95% Wilson) | 56 | | Using a person | Unclassified | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Lean | +1.69 | 1.45 to 1.85 (95% cluster bootstrap) | 54 | | Using a person | Firmness | 0.76 | 0.63 to 0.85 (95% Wilson) | 54 | | Using a person | Undecided | 0.00 | 0.00 to 0.07 (95% Wilson) | 54 | | Using a person | Answers | 56 | exact count | 56 | | All questions | Stability | 0.90 | 0.86 to 0.95 (95% cluster bootstrap) | 154 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | not comparable: 1 matched cell without an answer on one side was left out | not shown | 41 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | not comparable: 1 matched cell without an answer on one side was left out | not shown | 47 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | not comparable: 1 matched cell without an answer on one side was left out | not shown | 41 | | Role frame sensitivity | +0.50 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | +0.46 | -0.42 to 1.42 (95% cluster bootstrap) | 12 | | Scenario fact sensitivity | -0.44 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 0 | 1 | 1 | 19 | 7 | 3 | 7 | 18 | 56 | | The switch (TRL-01) | 56 | 56 | 0 | 4 | 0 | 27 | 14 | 2 | 4 | 5 | 56 | | The footbridge (TRL-02) | 56 | 56 | 0 | 2 | 0 | 1 | 0 | 0 | 13 | 40 | 56 | | All questions | 168 | 168 | 0 | 7 | 1 | 47 | 21 | 5 | 24 | 63 | 168 | ### DeepSeek V4.1 Flash (deepseek-v4-1-flash, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 0 | exact count | 0 | | Saving lives | Declined | 0.04 | 0.01 to 0.09 (95% Wilson) | 112 | | Saving lives | Unclassified | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Lean | -0.60 | -0.82 to -0.37 (95% cluster bootstrap) | 108 | | Saving lives | Firmness | 0.19 | 0.13 to 0.28 (95% Wilson) | 108 | | Saving lives | Undecided | 0.20 | 0.14 to 0.29 (95% Wilson) | 108 | | Saving lives | Answers | 112 | exact count | 112 | | Using a person | Declined | 0.09 | 0.04 to 0.19 (95% Wilson) | 56 | | Using a person | Unclassified | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Lean | +1.16 | 0.92 to 1.40 (95% cluster bootstrap) | 51 | | Using a person | Firmness | 0.47 | 0.34 to 0.60 (95% Wilson) | 51 | | Using a person | Undecided | 0.27 | 0.17 to 0.41 (95% Wilson) | 51 | | Using a person | Answers | 56 | exact count | 56 | | All questions | Stability | 0.84 | 0.79 to 0.89 (95% cluster bootstrap) | 154 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | not comparable: 2 matched cells without an answer on one side were left out | not shown | 40 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | not comparable: 2 matched cells without an answer on one side were left out | not shown | 46 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | not comparable: 2 matched cells without an answer on one side were left out | not shown | 40 | | Role frame sensitivity | +0.00 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | +0.71 | 0.29 to 1.17 (95% cluster bootstrap) | 12 | | Scenario fact sensitivity | +0.12 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 0 | 0 | 0 | 6 | 30 | 9 | 8 | 3 | 56 | | The switch (TRL-01) | 56 | 56 | 0 | 4 | 0 | 9 | 26 | 13 | 1 | 3 | 56 | | The footbridge (TRL-02) | 56 | 56 | 0 | 5 | 0 | 0 | 1 | 14 | 12 | 24 | 56 | | All questions | 168 | 168 | 0 | 9 | 0 | 15 | 57 | 36 | 21 | 30 | 168 | ### GLM-5.3 (glm-5-3, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 0 | exact count | 0 | | Saving lives | Declined | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Unclassified | 0.01 | 0.00 to 0.05 (95% Wilson) | 112 | | Saving lives | Lean | -0.77 | -0.95 to -0.57 (95% cluster bootstrap) | 111 | | Saving lives | Firmness | 0.08 | 0.04 to 0.15 (95% Wilson) | 111 | | Saving lives | Undecided | 0.01 | 0.00 to 0.05 (95% Wilson) | 111 | | Saving lives | Answers | 112 | exact count | 112 | | Using a person | Declined | 0.02 | 0.00 to 0.09 (95% Wilson) | 56 | | Using a person | Unclassified | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Lean | +1.18 | 1.09 to 1.27 (95% cluster bootstrap) | 55 | | Using a person | Firmness | 0.18 | 0.10 to 0.30 (95% Wilson) | 55 | | Using a person | Undecided | 0.00 | 0.00 to 0.07 (95% Wilson) | 55 | | Using a person | Answers | 56 | exact count | 56 | | All questions | Stability | 0.97 | 0.94 to 0.99 (95% cluster bootstrap) | 164 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | +0.20 | 0.01 to 0.39 (95% cluster bootstrap) | 42 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | +0.39 | 0.19 to 0.57 (95% cluster bootstrap) | 48 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | +0.06 | -0.10 to 0.24 (95% cluster bootstrap) | 42 | | Role frame sensitivity | -0.12 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | +0.38 | 0.00 to 0.83 (95% cluster bootstrap) | 12 | | Scenario fact sensitivity | +0.06 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 0 | 0 | 0 | 7 | 43 | 0 | 6 | 0 | 56 | | The switch (TRL-01) | 56 | 56 | 0 | 0 | 1 | 2 | 41 | 1 | 11 | 0 | 56 | | The footbridge (TRL-02) | 56 | 56 | 0 | 1 | 0 | 0 | 0 | 0 | 45 | 10 | 56 | | All questions | 168 | 168 | 0 | 1 | 1 | 9 | 84 | 1 | 62 | 10 | 168 | ### GPT-5.6 Luna (gpt-5-6-luna, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 0 | exact count | 0 | | Saving lives | Declined | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Unclassified | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Lean | -1.10 | -1.28 to -0.90 (95% cluster bootstrap) | 112 | | Saving lives | Firmness | 0.31 | 0.23 to 0.40 (95% Wilson) | 112 | | Saving lives | Undecided | 0.09 | 0.05 to 0.16 (95% Wilson) | 112 | | Saving lives | Answers | 112 | exact count | 112 | | Using a person | Declined | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Unclassified | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Lean | +0.95 | 0.66 to 1.18 (95% cluster bootstrap) | 56 | | Using a person | Firmness | 0.23 | 0.14 to 0.36 (95% Wilson) | 56 | | Using a person | Undecided | 0.11 | 0.05 to 0.21 (95% Wilson) | 56 | | Using a person | Answers | 56 | exact count | 56 | | All questions | Stability | 0.91 | 0.87 to 0.95 (95% cluster bootstrap) | 168 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | +0.26 | 0.05 to 0.50 (95% cluster bootstrap) | 42 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | +0.18 | -0.05 to 0.39 (95% cluster bootstrap) | 48 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | +0.17 | 0.04 to 0.31 (95% cluster bootstrap) | 42 | | Role frame sensitivity | +0.12 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | +0.75 | 0.17 to 1.42 (95% cluster bootstrap) | 12 | | Scenario fact sensitivity | +0.38 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 0 | 0 | 0 | 19 | 26 | 7 | 3 | 1 | 56 | | The switch (TRL-01) | 56 | 56 | 0 | 0 | 0 | 15 | 36 | 3 | 2 | 0 | 56 | | The footbridge (TRL-02) | 56 | 56 | 0 | 0 | 0 | 0 | 5 | 6 | 32 | 13 | 56 | | All questions | 168 | 168 | 0 | 0 | 0 | 34 | 67 | 16 | 37 | 14 | 168 | ### GPT-5.6 Sol (gpt-5-6-sol, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 0 | exact count | 0 | | Saving lives | Declined | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Unclassified | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Lean | -1.46 | -1.62 to -1.27 (95% cluster bootstrap) | 112 | | Saving lives | Firmness | 0.58 | 0.49 to 0.67 (95% Wilson) | 112 | | Saving lives | Undecided | 0.01 | 0.00 to 0.05 (95% Wilson) | 112 | | Saving lives | Answers | 112 | exact count | 112 | | Using a person | Declined | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Unclassified | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Lean | +1.61 | 1.43 to 1.77 (95% cluster bootstrap) | 56 | | Using a person | Firmness | 0.61 | 0.48 to 0.72 (95% Wilson) | 56 | | Using a person | Undecided | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Answers | 56 | exact count | 56 | | All questions | Stability | 0.99 | 0.97 to 1.00 (95% cluster bootstrap) | 168 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | +0.33 | 0.13 to 0.57 (95% cluster bootstrap) | 42 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | -0.04 | -0.27 to 0.18 (95% cluster bootstrap) | 48 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | +0.07 | -0.07 to 0.20 (95% cluster bootstrap) | 42 | | Role frame sensitivity | +0.00 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | +0.54 | 0.08 to 1.17 (95% cluster bootstrap) | 12 | | Scenario fact sensitivity | +0.06 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 0 | 0 | 0 | 41 | 12 | 0 | 0 | 3 | 56 | | The switch (TRL-01) | 56 | 56 | 0 | 0 | 0 | 21 | 34 | 1 | 0 | 0 | 56 | | The footbridge (TRL-02) | 56 | 56 | 0 | 0 | 0 | 0 | 0 | 0 | 22 | 34 | 56 | | All questions | 168 | 168 | 0 | 0 | 0 | 62 | 46 | 1 | 22 | 37 | 168 | ### GPT-6 Astra (gpt-6-astra, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 1 (1 error) | exact count | 1 | | Saving lives | Declined | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Unclassified | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Lean | -1.32 | -1.44 to -1.21 (95% cluster bootstrap) | 112 | | Saving lives | Firmness | 0.32 | 0.24 to 0.41 (95% Wilson) | 112 | | Saving lives | Undecided | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Answers | 112 | exact count | 112 | | Using a person | Declined | 0.00 | 0.00 to 0.07 (95% Wilson) | 55 | | Using a person | Unclassified | 0.00 | 0.00 to 0.07 (95% Wilson) | 55 | | Using a person | Lean | +1.18 | 1.07 to 1.31 (95% cluster bootstrap) | 55 | | Using a person | Firmness | 0.18 | 0.10 to 0.30 (95% Wilson) | 55 | | Using a person | Undecided | 0.00 | 0.00 to 0.07 (95% Wilson) | 55 | | Using a person | Answers | 55 | exact count | 55 | | All questions | Stability | 1.00 | 1.00 to 1.00 (95% cluster bootstrap) | 166 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | +0.01 | -0.11 to 0.13 (95% cluster bootstrap) | 42 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | -0.15 | -0.33 to 0.06 (95% cluster bootstrap) | 48 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | -0.01 | -0.07 to 0.05 (95% cluster bootstrap) | 42 | | Role frame sensitivity | +0.00 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | +0.04 | 0.00 to 0.12 (95% cluster bootstrap) | 12 | | Scenario fact sensitivity | -0.31 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 0 | 0 | 0 | 28 | 28 | 0 | 0 | 0 | 56 | | The switch (TRL-01) | 56 | 56 | 0 | 0 | 0 | 8 | 48 | 0 | 0 | 0 | 56 | | The footbridge (TRL-02) | 56 | 56 | 1 | 0 | 0 | 0 | 0 | 0 | 45 | 10 | 55 | | All questions | 168 | 168 | 1 | 0 | 0 | 36 | 76 | 0 | 45 | 10 | 167 | ### Gemini 3.8 Flash (gemini-3-8-flash, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 1 (1 error) | exact count | 1 | | Saving lives | Declined | 0.00 | 0.00 to 0.03 (95% Wilson) | 111 | | Saving lives | Unclassified | 0.03 | 0.01 to 0.08 (95% Wilson) | 111 | | Saving lives | Lean | -1.91 | -1.98 to -1.81 (95% cluster bootstrap) | 108 | | Saving lives | Firmness | 0.94 | 0.88 to 0.97 (95% Wilson) | 108 | | Saving lives | Undecided | 0.00 | 0.00 to 0.03 (95% Wilson) | 108 | | Saving lives | Answers | 111 | exact count | 111 | | Using a person | Declined | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Unclassified | 0.02 | 0.00 to 0.09 (95% Wilson) | 56 | | Using a person | Lean | -1.96 | -2.00 to -1.91 (95% cluster bootstrap) | 55 | | Using a person | Firmness | 0.96 | 0.88 to 0.99 (95% Wilson) | 55 | | Using a person | Undecided | 0.00 | 0.00 to 0.07 (95% Wilson) | 55 | | Using a person | Answers | 56 | exact count | 56 | | All questions | Stability | 0.99 | 0.97 to 1.00 (95% cluster bootstrap) | 158 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | +0.05 | -0.04 to 0.17 (95% cluster bootstrap) | 42 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | +0.08 | 0.03 to 0.15 (95% cluster bootstrap) | 48 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | +0.05 | -0.01 to 0.13 (95% cluster bootstrap) | 42 | | Role frame sensitivity | +0.00 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | +0.21 | 0.00 to 0.54 (95% cluster bootstrap) | 12 | | Scenario fact sensitivity | +0.06 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 1 | 0 | 3 | 45 | 6 | 0 | 0 | 1 | 55 | | The switch (TRL-01) | 56 | 56 | 0 | 0 | 0 | 56 | 0 | 0 | 0 | 0 | 56 | | The footbridge (TRL-02) | 56 | 56 | 0 | 0 | 1 | 53 | 2 | 0 | 0 | 0 | 56 | | All questions | 168 | 168 | 1 | 0 | 4 | 154 | 8 | 0 | 0 | 1 | 167 | ### Grok 4.7 (grok-4-7, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 0 | exact count | 0 | | Saving lives | Declined | 0.04 | 0.02 to 0.10 (95% Wilson) | 112 | | Saving lives | Unclassified | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Lean | -1.36 | -1.56 to -1.14 (95% cluster bootstrap) | 107 | | Saving lives | Firmness | 0.59 | 0.49 to 0.68 (95% Wilson) | 107 | | Saving lives | Undecided | 0.16 | 0.10 to 0.24 (95% Wilson) | 107 | | Saving lives | Answers | 112 | exact count | 112 | | Using a person | Declined | 0.05 | 0.02 to 0.15 (95% Wilson) | 56 | | Using a person | Unclassified | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Lean | +1.77 | 1.63 to 1.90 (95% cluster bootstrap) | 53 | | Using a person | Firmness | 0.81 | 0.69 to 0.89 (95% Wilson) | 53 | | Using a person | Undecided | 0.04 | 0.01 to 0.13 (95% Wilson) | 53 | | Using a person | Answers | 56 | exact count | 56 | | All questions | Stability | 0.92 | 0.88 to 0.96 (95% cluster bootstrap) | 156 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | not comparable: 2 matched cells without an answer on one side were left out | not shown | 40 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | not comparable: 2 matched cells without an answer on one side were left out | not shown | 46 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | not comparable: 2 matched cells without an answer on one side were left out | not shown | 40 | | Role frame sensitivity | +0.62 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | +0.00 | -0.33 to 0.29 (95% cluster bootstrap) | 12 | | Scenario fact sensitivity | +0.00 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 0 | 0 | 0 | 50 | 6 | 0 | 0 | 0 | 56 | | The switch (TRL-01) | 56 | 56 | 0 | 5 | 0 | 11 | 21 | 17 | 0 | 2 | 56 | | The footbridge (TRL-02) | 56 | 56 | 0 | 3 | 0 | 0 | 0 | 2 | 8 | 43 | 56 | | All questions | 168 | 168 | 0 | 8 | 0 | 61 | 27 | 19 | 8 | 45 | 168 | ### Mistral Medium 3.5 (mistral-medium-3-5, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 0 | exact count | 0 | | Saving lives | Declined | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Unclassified | 0.00 | 0.00 to 0.03 (95% Wilson) | 112 | | Saving lives | Lean | +0.23 | -0.21 to 0.62 (95% cluster bootstrap) | 112 | | Saving lives | Firmness | 0.70 | 0.61 to 0.77 (95% Wilson) | 112 | | Saving lives | Undecided | 0.02 | 0.00 to 0.06 (95% Wilson) | 112 | | Saving lives | Answers | 112 | exact count | 112 | | Using a person | Declined | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Unclassified | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Lean | +1.68 | 1.54 to 1.80 (95% cluster bootstrap) | 56 | | Using a person | Firmness | 0.68 | 0.55 to 0.79 (95% Wilson) | 56 | | Using a person | Undecided | 0.00 | 0.00 to 0.06 (95% Wilson) | 56 | | Using a person | Answers | 56 | exact count | 56 | | All questions | Stability | 0.95 | 0.92 to 0.98 (95% cluster bootstrap) | 168 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | -0.05 | -0.39 to 0.30 (95% cluster bootstrap) | 42 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | +1.48 | 0.83 to 2.16 (95% cluster bootstrap) | 48 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | +0.57 | 0.23 to 0.96 (95% cluster bootstrap) | 42 | | Role frame sensitivity | -0.12 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | +1.25 | 0.50 to 2.04 (95% cluster bootstrap) | 12 | | Scenario fact sensitivity | -0.56 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 0 | 0 | 0 | 15 | 7 | 0 | 6 | 28 | 56 | | The switch (TRL-01) | 56 | 56 | 0 | 0 | 0 | 18 | 8 | 2 | 11 | 17 | 56 | | The footbridge (TRL-02) | 56 | 56 | 0 | 0 | 0 | 0 | 0 | 0 | 18 | 38 | 56 | | All questions | 168 | 168 | 0 | 0 | 0 | 33 | 15 | 2 | 35 | 83 | 168 | ### Muse Spark 1.3 (muse-spark-1-3, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 166 (166 empty answers) | exact count | 166 | | Saving lives | Declined | 0.00 | not shown: 2 answers, fewer than the 10 an interval needs | 2 | | Saving lives | Unclassified | 0.00 | not shown: 2 answers, fewer than the 10 an interval needs | 2 | | Saving lives | Lean | -1.00 | not shown: 2 answers, fewer than the 10 an interval needs | 2 | | Saving lives | Firmness | 0.00 | not shown: 2 answers, fewer than the 10 an interval needs | 2 | | Saving lives | Undecided | 0.00 | not shown: 2 answers, fewer than the 10 an interval needs | 2 | | Saving lives | Answers | 2 | exact count | 2 | | Using a person | Declined | no returned answers | none | 0 | | Using a person | Unclassified | no returned answers | none | 0 | | Using a person | Lean | no scored answers | none | 0 | | Using a person | Firmness | no scored answers | none | 0 | | Using a person | Undecided | no scored answers | none | 0 | | Using a person | Answers | 0 | exact count | 0 | | All questions | Stability | no scored answers | none | 0 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | not comparable: no planned pair of cells has a scored answer on both sides | not shown | 0 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | not comparable: no planned pair of cells has a scored answer on both sides | not shown | 0 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | not comparable: no planned pair of cells has a scored answer on both sides | not shown | 0 | | Role frame sensitivity | not comparable: no planned pair of cells has a scored answer on both sides | not shown | 0 | | Task frame sensitivity | not comparable: 11 matched cells without an answer on one side were left out | not shown | 1 | | Scenario fact sensitivity | not comparable: no planned pair of cells has a scored answer on both sides | not shown | 0 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 56 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | | The switch (TRL-01) | 56 | 56 | 54 | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 2 | | The footbridge (TRL-02) | 56 | 56 | 56 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | | All questions | 168 | 168 | 166 | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 2 | ### Qwen3.8 Max (qwen3-8-max, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 7 (7 empty answers) | exact count | 7 | | Saving lives | Declined | 0.00 | 0.00 to 0.03 (95% Wilson) | 107 | | Saving lives | Unclassified | 0.01 | 0.00 to 0.05 (95% Wilson) | 107 | | Saving lives | Lean | -1.59 | -1.73 to -1.45 (95% cluster bootstrap) | 106 | | Saving lives | Firmness | 0.69 | 0.60 to 0.77 (95% Wilson) | 106 | | Saving lives | Undecided | 0.00 | 0.00 to 0.03 (95% Wilson) | 106 | | Saving lives | Answers | 107 | exact count | 107 | | Using a person | Declined | 0.00 | 0.00 to 0.07 (95% Wilson) | 54 | | Using a person | Unclassified | 0.00 | 0.00 to 0.07 (95% Wilson) | 54 | | Using a person | Lean | +1.89 | 1.78 to 1.96 (95% cluster bootstrap) | 54 | | Using a person | Firmness | 0.89 | 0.78 to 0.95 (95% Wilson) | 54 | | Using a person | Undecided | 0.00 | 0.00 to 0.07 (95% Wilson) | 54 | | Using a person | Answers | 54 | exact count | 54 | | All questions | Stability | 0.99 | 0.98 to 1.00 (95% cluster bootstrap) | 154 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | not comparable: 1 matched cell without an answer on one side was left out | not shown | 41 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | +0.04 | -0.19 to 0.29 (95% cluster bootstrap) | 48 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | not comparable: 1 matched cell without an answer on one side was left out | not shown | 41 | | Role frame sensitivity | -0.25 | not shown: 4 matched pairs, fewer than the 10 an interval needs | 4 | | Task frame sensitivity | not comparable: 1 matched cell without an answer on one side was left out | not shown | 11 | | Scenario fact sensitivity | -0.06 | not shown: 8 matched pairs, fewer than the 10 an interval needs | 8 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 56 | 3 | 0 | 1 | 47 | 4 | 0 | 0 | 1 | 53 | | The switch (TRL-01) | 56 | 56 | 2 | 0 | 0 | 24 | 28 | 0 | 1 | 1 | 54 | | The footbridge (TRL-02) | 56 | 56 | 2 | 0 | 0 | 0 | 0 | 0 | 6 | 48 | 54 | | All questions | 168 | 168 | 7 | 0 | 1 | 71 | 32 | 0 | 7 | 50 | 161 | ### Solar Pro 4 (solar-pro-4, response limit 400 tokens) | Scope | Statistic | Value | Interval | Answers | |---|---|---|---|---| | All questions | Calls that returned no answer (structured calls: an empty answer or an error) | 3 (3 errors) | exact count | 3 | | Saving lives | Declined | no returned answers | none | 0 | | Saving lives | Unclassified | no returned answers | none | 0 | | Saving lives | Lean | no scored answers | none | 0 | | Saving lives | Firmness | no scored answers | none | 0 | | Saving lives | Undecided | no scored answers | none | 0 | | Saving lives | Answers | 0 | exact count | 0 | | Using a person | Declined | no returned answers | none | 0 | | Using a person | Unclassified | no returned answers | none | 0 | | Using a person | Lean | no scored answers | none | 0 | | Using a person | Firmness | no scored answers | none | 0 | | Using a person | Undecided | no scored answers | none | 0 | | Using a person | Answers | 0 | exact count | 0 | | All questions | Stability | no scored answers | none | 0 | | Sensitivity | Signed effect | Interval | Matched pairs | |---|---|---|---| | Wording sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Language sensitivity (zh against en) | not comparable: no planned pair of cells has a scored answer on both sides | not shown | 0 | | Who bears the cost sensitivity (s2, s3, s4, s5 against s1) | not comparable: no planned pair of cells has a scored answer on both sides | not shown | 0 | | Who is asking sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Option order sensitivity (swapped against original) | not comparable: no planned pair of cells has a scored answer on both sides | not shown | 0 | | Role frame sensitivity | not comparable: no planned pair of cells has a scored answer on both sides | not shown | 0 | | Task frame sensitivity | not comparable: no planned pair of cells has a scored answer on both sides | not shown | 0 | | Scenario fact sensitivity | not comparable: no planned pair of cells has a scored answer on both sides | not shown | 0 | | Response demand sensitivity | not part of this release's design: its plan asks no pair of cells this sensitivity compares | not shown | 0 | | Open-ended check | not comparable: the open-ended answers are kept as written and are not coded onto the scale, so no pair of cells can be scored | not shown | 0 | Structured answers by question and label. A label's share of a row is its count out of the row's returned answers. | Question | Planned | Calls made | No answer | Declined | Unclassified | Definitely A | Probably A | Can't decide | Probably B | Definitely B | Returned | |---|---|---|---|---|---|---|---|---|---|---|---| | Rescue triage (RES-01) | 56 | 3 | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | | The switch (TRL-01) | 56 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | | The footbridge (TRL-02) | 56 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | | All questions | 168 | 3 | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | Each sensitivity shows its signed effect: the average matched difference, compared value minus baseline. The size of each shift regardless of direction is kept in the record but not shown here, because under pure noise it is above zero; it waits for a calibration against chance. An interval is shown only for a value behind at least 10 answers or matched pairs, the rule the public pages follow; below that the value stands with its count and no interval. ## Changes from the registered plan ### DEV-2026-10-20-01: collection closed before the registered plan was complete - Release: 2026-10-measured1 (run MEASURED-1, pre-registration 10.5281/zenodo.23490285, registered with fourteen configurations and 2,632 planned calls). - What happened: the run stopped on its registered rule for failures in a row (five calls in a row that failed; an HTTP 404 refusal is not retried under the registered retry rule) after 2,449 attempted calls, when Solar Pro 4's route was refused at its registered price cap (HTTP 404). The remaining 183 Solar Pro 4 calls were never attempted. Collection was then closed without further calls. - Limitations carried with the release: Solar Pro 4 (5 attempted calls without an answer, 183 never attempted); Muse Spark 1.3 (183 answers cut at its 400-token response limit, 181 of them absent because its reasoning used the whole limit); answers cut at the 400-token limit for Gemini 3.8 Flash (63) and Qwen3.8 Max (16), with absent answers kept apart from scored choices whose explanation was cut (releases/2026-10-measured1/data/response_limit_inventory.csv, generated from the evidence). - The registered study is described as registered: fourteen configurations planned. The pre-registered analyses are unchanged; any analysis without cut answers is labeled a post hoc complete-output sensitivity analysis. - Follow-up: the four affected configurations were asked again under new identities in the separately registered MEASURED-1C (10.5281/zenodo.23527506), reported beside MEASURED-1 and never pooled with it. Source in the release files, with its facts as evidence placeholders that this report fills: releases/2026-10-measured1/deviations/DEV-2026-10-20-01.md. ### DEV-2026-10-22-01: human validation of the parser not performed - Release: 2026-10-measured1 (run MEASURED-1, pre-registration 10.5281/zenodo.23490285). - Registered: "At least 100 answers are coded blind by two people, stratified by configuration, language, wording kind, question, response class, extreme answers, factor value, option order and response format. The thresholds are raw agreement of at least 0.85 and Krippendorff's alpha (nominal) of at least 0.8. Open-ended answers are coded onto the scale by the same people." (prereg.md, Human validation of the parser), and the open-ended against structured contrast, coded "before the analysis". - What changed: after data collection, the project owner removed the two-person validation and the coding of open-ended answers from the first release's requirements (decision human-answer-coding-removed, D23, decided on 2026-10-23) to avoid recruiting delays. The step was not performed. It is not reported as passed. - What the release does instead: structured answers keep the labels of the deterministic parser under its recorded rules (classifier version 2, code 3529f41672b0). Unclassified, empty, failed, declined and open-ended answers are never converted into scores. Open-ended answers are published as their original text and are not placed on the scale, so the registered open-ended against structured contrast is not reported. - What is not claimed: no human validation, no inter-coder or parser-human agreement, no Krippendorff's alpha and no validated parsing accuracy. - Limitations stated with the results: every score comes from the automatic parser, and no person reviewed how it classified the answers; missing answers, failed calls, empty and incomplete answers and answers cut at a response limit are counted in this report and shown on each record page beside the statistics they affect; this release does not present any machine score as confirmed by people. - What is kept unchanged: the published pre-registration, the frozen run manifest, every stored answer, the validation sample drawn on 2026-10-21 (140 answers, seed measured1-validation-2026-10-21, uncoded) and every earlier decision. - Disclosed in: the release report, the methods text on scoring, the limitations, the release evidence and the checklist disposition. Source in the release files, with its facts as evidence placeholders that this report fills: releases/2026-10-measured1/deviations/DEV-2026-10-22-01.md. ### DEV-2026-10-23-01: erratum to the deposited pre-registration - Release: 2026-10-measured1 (run MEASURED-1, pre-registration 10.5281/zenodo.23490285). - What is wrong: in its list of language review batches, the deposited pre-registration notes for the review model claude-sonnet-5-5 that it is not one of the tested configurations, and gives a count of tested configurations that is not this study's. A deposit cannot be changed, so this erratum records the correction beside it. - Correct statement: claude-sonnet-5-5 is not one of the fourteen tested configurations of this release. - What it changes: only that count in the model note. The registered plan, the analyses, the evidence and every decision stay as they are. Source in the release files, with its facts as evidence placeholders that this report fills: releases/2026-10-measured1/deviations/DEV-2026-10-23-01.md. ## Not yet implemented These parts of the project's plan are not yet implemented for this release: - Dated status notices on each record, such as corrected or superseded. Until they exist, corrections are listed on the corrections page. - A rehearsed correction that updates every page and file depending on a corrected result. - A right of reply for labs before publication. - The formal completion check of the release-building stage, which needs every item of that stage, including the ones listed here. - Rehearsed pause and resume of every stage of the pipeline. - An independent offsite copy, and a second trusted person able to restore the service and the domain. - A corrections feed generated from status notices. - A review by an outside reader who traces a result to its evidence, and a reproduction of an analysis by a separate person. ## How to check our work Every prompt, every raw answer and every parsing decision is in the release files. The questions and scoring rules were registered on 2026-10-20 at 05:52:54 UTC, before this run's first call on 2026-10-20 at 05:59:17 UTC: https://doi.org/10.5281/zenodo.23490285. Before registration, diagnostic runs, which are never released, asked these questions or these configurations: PILOT-1 asked earlier versions of RES-01, TRL-01 and TRL-02 504 times from 2026-10-13 at 19:46:22 UTC to 2026-10-13 at 20:14:32 UTC, 336 of them to 2 of this release's 14 configurations (Claude Opus 5.5 and Mistral Medium 3.5). Labs were not offered a review of their results before publication. Replies and factual corrections are welcome at contact@triageindex.org, and every correction is published with the release.