tensor.news
Integrity IndexModelsCompareLabsPapersMethodologyAbout
tensor.news

© 2026

Evidence

  • Integrity Index
  • Model Claim Ledger
  • Compare

Entities

  • Models
  • Benchmarks
  • Labs
  • Papers

Method

  • Methodology
  • About
  • Privacy

Machine

  • Feed (Atom)
  • llms.txt
  • llms-full.txt
  • Sitemap

tensor.news grades benchmarks and tags model claims by evidence status. Every fact carries a source record and provenance. Scores are framed as task performance under a disclosed harness, never as deployed capability.

← Integrity Index

OTIS Mock AIME 2024-2025

OTIS Mock AIME 2024-2025

Rank #21 of 51 · 112 models scored · top score 100

AINTEGRITY 88 / 100

unknown

Strongest on discrimination, weakest on contamination resistance. Caveat: the public test set leaves contamination on the table.

consistent harnesspublic test setsaturated

Headroom to ceiling

0 headroomtop 100ceiling 100

Score distribution

median 57.7GPT-5.5 100052104

State of the art over time

05210410020232026

Integrity breakdown

Weighted composite. Each signal is computed from the source-backed leaderboard below.

Discrimination30%100

Does it still separate models?

Saturation headroom30%96

How far from ceiling / clustered at the top?

Contamination resistance15%36

Public vs held-out; training-leak risk.

Harness comparability15%100

Apples-to-apples, or mixed / vendor-optimized?

Freshness10%89

How old is the benchmark?

Leaderboard

#ModelScoreEvidenceMeasured
1GPT-5.5100reproduced· optimized2026-04-23
2GPT-5.5 Pro100reproduced· optimized2026-04-23
3Claude Fable 599.72reproduced· optimized2026-06-09
4Claude Opus 4.898.33reproduced· optimized2026-05-28
5Claude Opus 4.797.8reproduced· optimized2026-04-16
6DeepSeek-V4-Pro96.66reproduced· optimized2026-04-24
7Kimi K2.7 Code96.39reproduced· optimized2026-06-12
8Kimi K2.696.11reproduced· optimized2026-04-20
9GPT-5.296.11reproduced· optimized2025-12-11
10Gemini 3.1 Pro95.6reproduced· optimized2026-02-19
11Gemini 3.5 Flash95.55reproduced· optimized2026-05-19
12GPT-5.495.3reproduced· optimized2026-03-05
13Qwen3.7-Max94.99reproduced· optimized2026-05-19
14Claude Opus 4.694.44reproduced· optimized2026-02-05
15Grok 4.3 Beta93.33reproduced· optimized2026-04-17
16Gemini 3 Flash92.77reproduced· optimized2025-12-17
17GLM-5.192.21reproduced· optimized2026-04-07
18Kimi K2.592.19reproduced· optimized2026-02-02
19Gemini 3 Pro91.38reproduced· optimized2025-11-18
20GPT-591.38reproduced· optimized2025-08-07
21Qwen 3.6 Max (Preview)91.1reproduced· optimized2026-04-20
22Qwen 3.6 Plus90.55reproduced· optimized2026-04-01
23Muse Spark88.89reproduced· optimized2026-04-08
24gpt-oss-120b88.88reproduced· optimized2025-08-05
25GPT-5.188.6reproduced· optimized2025-11-13
26DeepSeek-V3.287.81reproduced· optimized2025-12-01
27GPT-5.4 Nano87.77reproduced· optimized2026-03-17
28GPT-5.4 Mini87.21reproduced· optimized2026-03-17
29Qwen3-235B-A22B-Thinking (Jul 2025)86.65reproduced· optimized2025-07-25
30GPT-5 mini86.65reproduced· optimized2025-08-07
31GLM-5.286.38reproduced· optimized2026-06-16
32Qwen 3.6 Flash86.1reproduced· optimized2026-04-26
33Claude Opus 4.586.1reproduced· optimized2025-11-24
34Claude Sonnet 4.685.78reproduced· optimized2026-02-17
35Qwen 3.5 Flash (hosted 35B-A3B)85.54reproduced· optimized2026-02-25
36Qwen 3.5 Plus (hosted 397B-A17B)84.98reproduced· optimized2026-02-16
37Gemini 2.5 Pro (Jun 2025)84.71reproduced· optimized2025-06-05
38Grok 483.98reproduced· optimized2025-07-09
39o383.87reproduced· optimized2024-12-20
40GLM-4.783.32reproduced· optimized2025-12-22
41Kimi K2 Thinking83.04reproduced· optimized2025-11-06
42o4-mini81.65reproduced· optimized2025-04-16
43GPT-5 nano81.09reproduced· optimized2025-08-07
44GLM-579.98reproduced· optimized2026-02-11
45Grok-3 mini77.76reproduced· optimized2025-02-19
46Claude Sonnet 4.577.76reproduced· optimized2025-09-29
47o3-mini76.92reproduced· optimized2025-01-31
48Qwen3-Max73.31reproduced· optimized2025-09-05
49o173.31reproduced· optimized2024-12-05
50Gemini 2.5 Flash (Apr 2025)73.03reproduced· optimized2025-04-17
51Claude Sonnet 471.08reproduced· optimized2025-05-22
52Gemini 2.5 Flash (May 2025)70.8reproduced· optimized2025-05-20
53Claude Opus 4.168.86reproduced· optimized2025-08-05
54Claude Haiku 4.566.63reproduced· optimized2025-10-15
55DeepSeek-R1 (May 2025)66.36reproduced· optimized2025-05-28
56Claude Opus 464.41reproduced· optimized2025-05-22
57Claude 3.7 Sonnet57.74reproduced· optimized2025-02-24
58Gemini 2.0 Flash Thinking (Jan 2025)57.74reproduced· optimized2025-01-21
59Grok 355.51reproduced· optimized2025-02-17
60DeepSeek-R153.29reproduced· optimized2025-01-20
61o1-mini46.89reproduced· optimized2024-09-12
62GPT-4.1 mini44.67reproduced· optimized2025-04-14
63GPT-4.138.27reproduced· optimized2025-04-14
64DeepSeek-V3 (Mar 2025)37.72reproduced· optimized2025-03-24
65GPT-4.537.72reproduced· optimized2025-02-27
66Mistral Medium 332.15reproduced· optimized2025-05-07
67o1-preview31.04reproduced· optimized2024-09-12
68Gemini 2.0 Flash (Feb 2025)31.04reproduced· optimized2024-12-11
69Magistral Small 1.129.93reproduced· optimized2025-06-10
70GPT-4.1 nano28.82reproduced· optimized2025-04-14
71Gemini 1.5 Pro (Sept 2024)22.98reproduced· optimized2024-09-24
72Llama 4 Maverick20.48reproduced· optimized2025-04-05
73Gemma 3 27B19.64reproduced· optimized2025-03-12
74Gemini 1.5 Flash (Sep 2024)16.17reproduced· optimized2024-05-10
75Qwen2.5-Max16.03reproduced· optimized2025-01-25
76DeepSeek-V315.75reproduced· optimized2024-12-24
77Phi-413.66reproduced· optimized2024-12-12
78Grok-2 (Dec 2024)11.44reproduced· optimized2024-08-13
79Llama 3.1-405B9.63reproduced· optimized2024-07-23
80Claude 3.5 Sonnet (October 2024)8.38reproduced· optimized2024-10-22
81Mistral Large 2 (Jul 2024)8.38reproduced· optimized2024-07-24
82Qwen2.5-72B7.96reproduced· optimized2024-09-19
83Llama 4 Scout7.69reproduced· optimized2025-04-05
84Mistral Large 2 (Nov 2024)7.69reproduced· optimized2024-07-24
85GPT-4o mini6.85reproduced· optimized2024-07-18
86Gemini 1.5 Pro (May 2024)6.71reproduced· optimized2024-05-14
87GPT-4 Turbo (Apr 2024)6.57reproduced· optimized2024-04-09
88Claude 3.5 Sonnet6.43reproduced· optimized2024-06-20
89GPT-4o (Aug 2024)6.3reproduced· optimized2024-05-13
90GPT-4o (May 2024)6.16reproduced· optimized2024-05-13
91GPT-4o (Nov 2024)6.16reproduced· optimized2024-05-13
92Mistral Small 3.15.74reproduced· optimized2025-03-17
93Llama 3.3 70B5.04reproduced· optimized2024-12-06
94Claude 3 Opus4.63reproduced· optimized2024-03-04
95Claude 3.5 Haiku4.21reproduced· optimized2024-10-22
96Llama 3-70B4.21reproduced· optimized2024-04-18
97Gemini 1.5 Flash (May 2024)3.79reproduced· optimized2024-05-10
98Llama 3.1-70B3.51reproduced· optimized2024-07-23
99Llama 3.2 90B2.54reproduced· optimized2024-09-24
100Claude 3 Sonnet2.4reproduced· optimized2024-03-04
101Llama 3.1-8B2.4reproduced· optimized2024-07-23
102Claude 22.4reproduced· optimized2023-07-11
103Mistral Large1.85reproduced· optimized2024-02-26
104Claude 2.11.85reproduced· optimized2023-11-21
105Claude 3 Haiku1.71reproduced· optimized2024-03-04
106Gemma 2 27B1.29reproduced· optimized2024-06-24
107GPT-4 (Jun 2023)1.01reproduced· optimized2023-06-13
108Gemini 1.0 Pro1.01reproduced· optimized2023-12-06
109Llama 3-8B0.73reproduced· optimized2024-04-18
110Gemma 2 9B0.46reproduced· optimized2024-06-24
111GPT-4 (Mar 2023)0.46reproduced· optimized2023-03-15
112Llama 2-70B0reproduced· optimized2023-07-18

At a glance

Models scored
112
Top model
GPT-5.5
Top score
100
Score spread
100
Headroom
0

Benchmark context

Task type
math
Metric
normalized performance in Epoch CSV, rendered as accuracy (%)
Score ceiling
100
Human baseline
unknown
Test-set privacy
unknown
Construction
unknown
Key assumptions
unknown
Limitations
unknown
Contamination history
unknown
Harness notes
Epoch CSV reports model, model version, performance, optimized flag, score source, benchmark release date, and model date.
Authors
unknown
Released
2024-12-19
License
CC BY 4.0
Source
epoch.ai/data/eci_benchmarks.csv

Provenance

112 source records · scores from epoch_benchmarks. Every fact on this page is evidence-linked.

Follow the record

Integrity neighbors

  • ExploitBenchA · 89
  • GeoBenchA · 89
  • PostTrainBenchA · 89
  • WeirdMLA · 88
  • Aider polyglotA · 87
  • Fiction.LiveBenchA · 87

Top models here

  • GPT-5.5100
  • GPT-5.5 Pro100
  • Claude Fable 599.72
  • Claude Opus 4.898.33
  • Claude Opus 4.797.8

Head-to-head

  • GPT-5.5 vs GPT-5.5 Pro
  • GPT-5.5 vs Claude Fable 5
  • GPT-5.5 Pro vs Claude Fable 5