Release 2026-11-measured2
The complete response record of this release, with its statistics and their calculations.
This release
Fifteen further dilemmas of the intended battery, none of them asked in the earlier releases, in English and Chinese, three wordings each, for fourteen registered configurations. All 7,784 planned calls were made, and each record lists its own coverage. It is shown beside the earlier releases and never pooled with them.
- Release
- 2026-11-measured2
- Registered
- 10.5281/zenodo.23831537
- Report
- The release report, as built
- Pre-registration
- The registered plan, as filed
- Status
- published
- Manifest digest
- ba7aa187c13c61f410ffd4383e58ed69ebfcfe5f1a1b490c2d632c3590b18191
- Synthetic
- no
- Publish date
- 2026-11-10
- DOI
- 10.5281/zenodo.24096660
- Data license
- CC-BY-4.0 (model answers excluded: provider terms, never for training)
Earlier runs
This release was registered before the first call of its own run. The store also records the runs below, which asked some of the same questions (in the same or an earlier instrument version) or the same models before that first call. Their answers are not part of this release; each is kept with its own run manifest.
| Run | Purpose | Calls (UTC) | Questions asked | Models asked |
|---|---|---|---|---|
| PILOT-1 | diagnostic | 2026-10-13T19:46:22.152Z to 2026-10-13T20:14:32.437Z | none of this release's questions | the same configurations of Mistral Medium 3.5; other configurations of Claude Opus 5.5 |
| MEASURED-1 | measured | 2026-10-20T05:59:17.736Z to 2026-10-20T08:44:43.179Z | none of this release's questions | the same configurations of Claude Fable 5.1, DeepSeek V4 Pro (StreamLake fp8), DeepSeek V4.1 Flash, GLM-5.3, GPT-5.6 Luna, GPT-5.6 Sol, GPT-6 Astra, Grok 4.7, Mistral Medium 3.5; other configurations of Claude Opus 5.5, Gemini 3.8 Flash, Muse Spark 1.3, Qwen3.8 Max, Solar Pro 4 |
| CAL-2 | diagnostic | 2026-10-21T05:55:49.575Z to 2026-10-21T06:07:14.381Z | none of this release's questions | the same configurations of Gemini 3.8 Flash, Muse Spark 1.3, Qwen3.8 Max, Solar Pro 4 |
| MEASURED-1C | measured | 2026-10-22T17:59:06.079Z to 2026-10-22T18:58:19.743Z | none of this release's questions | the same configurations of Gemini 3.8 Flash, Muse Spark 1.3, Qwen3.8 Max, Solar Pro 4 |
How to read these pages
Start from a model: every model lists its records by the time each run took place. Each record card holds one tested configuration: its answers by question, its coverage, every statistic with the calculation it comes from, and every response on numbered pages. Open a question on a record to read each answer with its time, serving provider and evidence. Failed calls, retries, exclusions and missing cells are listed with their reasons. Dated status notices on records, such as corrected or superseded, are not yet in place; until they exist, corrections are listed on the corrections page.
Records
| Signature ID | Model | Served version | Purpose | Evidence mode | Returned | Of those, not used | Failed calls | Missing cells | Planned cells | Scope | Status |
|---|---|---|---|---|---|---|---|---|---|---|---|
| TI-90P2-5930-8H8H | Claude Fable 5.1 | anthropic/claude-fable-5.1 | measured | conversational | 556 | 1 | 0 | 0 | 556 | in this release | no status event |
| TI-WVEW-J3Y2-JS71 | Claude Opus 5.5 | anthropic/claude-opus-5.5 | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
| TI-NYD1-QBQF-PX7W | DeepSeek V4 Pro (StreamLake fp8) | deepseek/deepseek-v4-pro | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
| TI-N962-QJ5Y-4ZP6 | DeepSeek V4.1 Flash | deepseek/deepseek-v4.1-flash | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
| TI-71CP-GYN3-JZX5 | Gemini 3.8 Flash | google/gemini-3.8-flash | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
| TI-QP8F-XC3G-2RV2 | GLM-5.3 | z-ai/glm-5.3 | measured | conversational | 556 | 4 | 0 | 0 | 556 | in this release | no status event |
| TI-2FXQ-4A86-EDWX | GPT-5.6 Luna | openai/gpt-5.6-luna | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
| TI-M264-SHV7-KNW3 | GPT-5.6 Sol | openai/gpt-5.6-sol | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
| TI-B8XW-QGWG-FFE9 | GPT-6 Astra | openai/gpt-6-astra | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
| TI-09TG-8VAM-7NSA | Grok 4.7 | x-ai/grok-4.7 | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
| TI-7QZH-WNXS-N9BY | Mistral Medium 3.5 | mistralai/mistral-medium-3-5 | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
| TI-2217-J9XT-RMYQ | Muse Spark 1.3 | meta/muse-spark-1.3 | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
| TI-P6H8-W75M-4EQJ | Qwen3.8 Max | qwen/qwen3.8-max-0902 | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
| TI-36RK-T3GN-2HG1 | Solar Pro 4 | upstage/solar-pro4 | measured | conversational | 556 | 0 | 0 | 0 | 556 | in this release | no status event |
Timelines
Each tested configuration with every record by measurement window. The latest record is a separate lookup; a record address always opens that exact record.
- gpt-6-astra 1 record(s); latest TI-B8XW-QGWG-FFE9
- claude-fable-5-1 1 record(s); latest TI-90P2-5930-8H8H
- muse-spark-1-3-o16k 1 record(s); latest TI-2217-J9XT-RMYQ
- qwen3-8-max-o16k 1 record(s); latest TI-P6H8-W75M-4EQJ
- gemini-3-8-flash-o16k 1 record(s); latest TI-71CP-GYN3-JZX5
- claude-opus-5-5-o2k 1 record(s); latest TI-WVEW-J3Y2-JS71
- glm-5-3 1 record(s); latest TI-QP8F-XC3G-2RV2
- gpt-5-6-luna 1 record(s); latest TI-2FXQ-4A86-EDWX
- deepseek-v4-pro-streamlake-fp8 1 record(s); latest TI-NYD1-QBQF-PX7W
- mistral-medium-3-5 1 record(s); latest TI-7QZH-WNXS-N9BY
- grok-4-7 1 record(s); latest TI-09TG-8VAM-7NSA
- gpt-5-6-sol 1 record(s); latest TI-M264-SHV7-KNW3
- solar-pro-4-o2k 1 record(s); latest TI-36RK-T3GN-2HG1
- deepseek-v4-1-flash 1 record(s); latest TI-N962-QJ5Y-4ZP6
Questions
- AID-01 instrument version(s) 3c9b71aac4b9
- CNS-01 instrument version(s) 83b7294ebf98
- DOG-01 instrument version(s) f4b655f67b2b
- FAM-01 instrument version(s) c287716204f1
- ITG-01 instrument version(s) 2044367dafef
- JUS-01 instrument version(s) 26fa18f2c2f1
- MM-01 instrument version(s) 382a986c8baf
- PAR-01 instrument version(s) 1bcaf87a643a
- PRM-01 instrument version(s) a95f6cb87bf0
- PRP-01 instrument version(s) b1b57a47f7b2
- PST-01 instrument version(s) 8cf11210d115
- SCR-01 instrument version(s) 0ef487beba81
- TB-01 instrument version(s) 339b788c33de
- TRU-01 instrument version(s) 4dc92cb47deb
- WLK-01 instrument version(s) bf05225a5041
Analysis versions
1540e0ca6d5c35ee183119a352c11721785aa95a316d73021d2479519c35562a180a613b2781794fe1cfe120e49e0269f35610a846b437b1dc298a3d08f4106323b93426931dcffd77cba28249e884505de97fdcc789b13ef5f35f7985eac6eb309f469ec8634409e984fb5d3bb30a27e4bdf3dd06799623cfc1429e01ef5f8a373e6f0a868edd0221f2a5404d93c703be37eded2f375888fbc482102ec88583426633b7f2aeb7646693751c3612a8cf94c2bcd1cdcd41755cf57763c1f431f76d935756244611b4932c95689c91f5538e45e29494734cef457b3bde90b2a6688d9f6b3d919a8ea45edc9a113adb0b0e26bb9306e280786933677db458ae2aa3998efb1e8b1ca90335445656504277fe934a2b6432723707b92e4ba3ac39933ea8fe0b75123a315354fb1c0867b83a707e1d4ff27c458f576b7cf747e40fc1a1aaa5bde2a5851b1cde9f555347695812afa5f1b4ec7cca109aa9d3ef30f69ac6b271698ef34f6e2e19af87fb596e2ec08c795c96b6c4cd95c876bc6bfcd41bffc20071a1c0428e5649f40a59487a3b6ce431cb9a1ff674197f752ba0016ecb23fce6034d7de7bf72b0eaf017152cd90b7805e44458f4dc9fb534e35bd84d2114