tensor.news
Integrity IndexModelsCompareLabsPapersMethodologyAbout
tensor.news

© 2026

Evidence

  • Integrity Index
  • Model Claim Ledger
  • Compare

Entities

  • Models
  • Benchmarks
  • Labs
  • Papers

Method

  • Methodology
  • About
  • Privacy

Machine

  • Feed (Atom)
  • llms.txt
  • llms-full.txt
  • Sitemap

tensor.news grades benchmarks and tags model claims by evidence status. Every fact carries a source record and provenance. Scores are framed as task performance under a disclosed harness, never as deployed capability.

← Integrity Index

ARC-AGI

ARC-AGI

Rank #38 of 51 · 59 models scored · top score 98

BINTEGRITY 74 / 100

unknown

Strongest on discrimination, weakest on contamination resistance. Caveat: the public test set leaves contamination on the table.

consistent harnesspublic test set

Headroom to ceiling

2 headroomtop 98ceiling 100

Score distribution

median 51.5Gemini 3.1 Pro 98051102

State of the art over time

0511029820242026

Integrity breakdown

Weighted composite. Each signal is computed from the source-backed leaderboard below.

Discrimination30%100

Does it still separate models?

Saturation headroom30%97

How far from ceiling / clustered at the top?

Contamination resistance15%0

Public vs held-out; training-leak risk.

Harness comparability15%100

Apples-to-apples, or mixed / vendor-optimized?

Freshness10%0

How old is the benchmark?

Leaderboard

#ModelScoreEvidenceMeasured
1Gemini 3.1 Pro98unverified· optimized2026-02-19
2GPT-5.5 Pro96.5unverified· optimized2026-04-23
3GPT-5.595unverified· optimized2026-04-23
4GPT-5.4 Pro94.5unverified· optimized2026-03-05
5Claude Opus 4.694unverified· optimized2026-02-05
6GPT-5.493.67unverified· optimized2026-03-05
7Claude Opus 4.793.5unverified· optimized2026-04-16
8Gemini 3.5 Flash92.5unverified· optimized2026-05-19
9Claude Opus 4.892.5unverified· optimized2026-05-28
10GPT-5.2 Pro90.5unverified· optimized2025-12-11
11Grok 4.2089.5unverified· optimized2026-02-17
12Claude Sonnet 4.686.5unverified· optimized2026-02-17
13GPT-5.286.2unverified· optimized2025-12-11
14Claude Opus 4.580unverified· optimized2025-11-24
15GLM-5.277unverified· optimized2026-06-16
16Gemini 3 Pro75unverified· optimized2025-11-18
17GPT-5.172.8unverified· optimized2025-11-13
18GPT-5 Pro70.2unverified· optimized2025-10-07
19Grok 466.67unverified· optimized2025-07-09
20GPT-565.7unverified· optimized2025-08-07
21Kimi K2.565.33unverified· optimized2026-02-02
22MiniMax-M2.563.67unverified· optimized2026-02-12
23Claude Sonnet 4.563.67unverified· optimized2025-09-29
24GPT-5.4 Mini63.67unverified· optimized2026-03-17
25o360.8unverified· optimized2024-12-20
26o3-pro59.3unverified· optimized2025-06-10
27o4-mini58.7unverified· optimized2025-04-16
28DeepSeek-V3.257unverified· optimized2025-12-01
29GPT-5 mini54.33unverified· optimized2025-08-07
30GPT-5.4 Nano51.5unverified· optimized2026-03-17
31Grok 4 Fast48.5unverified· optimized2025-09-19
32Claude Haiku 4.547.67unverified· optimized2025-10-15
33GLM-544.67unverified· optimized2026-02-11
34Gemini 2.5 Pro (Jun 2025)41unverified· optimized2025-06-05
35Claude Sonnet 440unverified· optimized2025-05-22
36Claude Opus 435.7unverified· optimized2025-05-22
37o3-mini34.5unverified· optimized2025-01-31
38Gemini 2.5 Flash (May 2025)33.3unverified· optimized2025-05-20
39Gemini 2.5 Pro (Mar 2025)33unverified· optimized2025-03-25
40Gemini 2.5 Flash (Apr 2025)32.3unverified· optimized2025-04-17
41o130.7unverified· optimized2024-12-05
42Claude 3.7 Sonnet28.6unverified· optimized2025-02-24
43Gemini 3 Flash21.5unverified· optimized2025-12-17
44DeepSeek-R1 (May 2025)21.2unverified· optimized2025-05-28
45GPT-5 nano20.71unverified· optimized2025-08-07
46o1-preview18unverified· optimized2024-09-12
47Grok-3 mini16.5unverified· optimized2025-02-19
48DeepSeek-R115.8unverified· optimized2025-01-20
49o1-mini14unverified· optimized2024-09-12
50Qwen3-235B-A22B-Instruct (Jul 2025)11unverified· optimized2025-07-25
51GPT-4.510.3unverified· optimized2025-02-27
52Grok 35.5unverified· optimized2025-02-17
53GPT-4.15.5unverified· optimized2025-04-14
54Magistral Small 1.15unverified· optimized2025-06-10
55GPT-4o (Nov 2024)4.5unverified· optimized2024-05-13
56Llama 4 Maverick4.4unverified· optimized2025-04-05
57GPT-4.1 mini3.5unverified· optimized2025-04-14
58Llama 4 Scout0.5unverified· optimized2025-04-05
59GPT-4.1 nano0unverified· optimized2025-04-14

At a glance

Models scored
59
Top model
Gemini 3.1 Pro
Top score
98
Score spread
98
Headroom
2

Benchmark context

Task type
reasoning
Metric
normalized performance in Epoch CSV, rendered as accuracy (%)
Score ceiling
100
Human baseline
unknown
Test-set privacy
unknown
Construction
unknown
Key assumptions
unknown
Limitations
unknown
Contamination history
unknown
Harness notes
Epoch CSV reports model, model version, performance, optimized flag, score source, benchmark release date, and model date.
Authors
unknown
Released
2019-11-05
License
CC BY 4.0
Source
epoch.ai/data/eci_benchmarks.csv

Provenance

59 source records · scores from epoch_benchmarks. Every fact on this page is evidence-linked.

Follow the record

Integrity neighbors

  • CybenchB · 79
  • DeepResearch BenchB · 78
  • Lech Mazur WritingB · 76
  • MATH level 5B · 73
  • BBHB · 71
  • GSM8KC · 69

Top models here

  • Gemini 3.1 Pro98
  • GPT-5.5 Pro96.5
  • GPT-5.595
  • GPT-5.4 Pro94.5
  • Claude Opus 4.694

Head-to-head

  • Gemini 3.1 Pro vs GPT-5.5 Pro
  • Gemini 3.1 Pro vs GPT-5.5
  • GPT-5.5 Pro vs GPT-5.5