Versioned benchmark collection

Space Flight v1

Harness v1 · 8 measured runs across 1 target. Each entry is a single recorded attempt; repeat-run reliability is not established.

Spacecraft approaching a ringed planet in the Space Flight v1 collection
Spacecraft approaching a ringed planet in the Space Flight v1 collection
8Measured runs
1Frozen targets
6Model families
7Configurations
Collection scope

Recorded evidence, without a synthetic score.

Runs share the same frozen target and prompt within each test, with disclosed provider-specific stacks. Costs are recorded estimates as labelled in each ledger, not subscription invoices.

Targets

  • Explorable space-flight game

Model coverage

  • Claude Fable 5 · Max
  • Claude Fable 5 · Medium
  • GPT-5.6 Luna · xhigh
  • GPT-5.6 Sol · Ultra
  • GPT-5.6 Terra · Ultra
  • Kimi K3 · Max
  • Qwen3.8 Max Preview · Unreported

Evidence available

  • Eight measured run ledgers
  • Public browser builds
  • Cost, token, and workflow timing

Still missing

  • Browser/hardware environment
  • Local FPS
  • Final capture metadata
  • Minimum blind-vote sample
Public receipts

8 measured run ledgers

Open any row for its recorded workflow cost, timing, token usage, stack disclosure, artifact integrity, and explicit evidence gaps.

01Claude Fable 5Max reasoning · Explorable space-flight game$151.55 API-equivalent estimate, not a subscription invoicerecorded estimate1:05:19.2 wall-clockEnd-to-end workflowOpen 02Claude Fable 5Medium reasoning · Explorable space-flight game$22.85 Anthropic first-party Claude API, standard global pricingrecorded estimate18:37.7 wall-clockEnd-to-end workflowOpen 03GPT-5.6 Lunaxhigh reasoning · Explorable space-flight game$0.33 API-equivalent estimate, not a subscription invoicerecorded estimate10:55.9 wall-clockEnd-to-end workflowOpen 04GPT-5.6 SolUltra reasoning · Explorable space-flight game$17.94 user-supplied API-equivalent pre-request snapshotrecorded estimate37:44.2 wall-clockEnd-to-end workflowOpen 05GPT-5.6 TerraUltra reasoning · Explorable space-flight game$1.44 API-equivalent estimate, not a subscription invoicerecorded estimate16:51.4 wall-clockEnd-to-end workflowOpen 06Kimi K3Max reasoning · Explorable space-flight game$3.25 API-equivalent usage accounting, not an itemized subscription cash chargerecorded estimate1:04:11 wall-clockEnd-to-end workflowOpen 07Qwen3.8 Max PreviewUnreported reasoning · Explorable space-flight game$45.89 Qualified third-party NanoGPT API-list-price scenario for the measured token mix; not an Alibaba Token Plan cash chargerecorded estimate2h 4m 17.3s wall-clockEnd-to-end workflowOpen 08Qwen3.8 Max PreviewUnreported reasoning · Explorable space-flight game$6.95 Third-party NanoGPT API-list-price equivalent for the measured token mix; not an Alibaba Token Plan cash chargerecorded estimate38m 43.2s wall-clockEnd-to-end workflowOpen