'#1' means one board — the benchmark-gaming trap
The episode's 'K3 jumped the fence to #1' is true only on the Frontend Code Arena; K3 is #3 overall. The cautionary precedent: Meta submitted a chat-tuned experimental Llama 4 Maverick that scored ~#2 on LMArena while the public build ranked far lower — LMArena banned the practice (2025-04) and Yann LeCun later conceded the results were 'fudged' (FT, reported 2026-01-02). Leaderboard rank is a marketing surface; name the board, date the claim, or be gamed.
Why it matters (spine — hype). The hype ledger — kept on purpose, as the discipline. Institutionalise 'name the board + freshness date' on every capability claim in the cabinet; stand up MKG's audited benchmark/claims registry.
What would prove it wrong (falsifier). Independent, un-gamed evals confirm a model's blanket '#1' across domains, making the single-board caveat unnecessary.
Live-status check + triangulation. The episode's 'K3 jumped the fence to #1' is true only on the Frontend Code Arena; K3 is #3 overall. The cautionary precedent: Meta submitted a chat-tuned experimental Llama 4 Maverick that scored ~#2 on LMArena while the public build ranked far lower — LMArena banned the practice (2025-04) and Yann LeCun later conceded the results were 'fudged' (FT, reported 2026-01-02). Leaderboard rank is a marketing surface; name the board, date the claim, or be gamed. Source: Reporting · Financial Times (via Fast Company) (2026-01-02); see source link. Every post-cutoff figure was tool-fetched against a live source during the Kimi K3 sweep (2026-07-20); see sweeps/2026-07-20-VERIFIED_DIGEST.md for the full provenance and any corrections of record.
Institutionalise 'name the board + freshness date' on every capability claim in the cabinet; stand up MKG's audited benchmark/claims registry.
domains: verification · honest-measurement · hype-ledger