tensor.news
Integrity IndexModelsCompareLabsPapersMethodologyAbout
tensor.news

© 2026

Evidence

  • Integrity Index
  • Model Claim Ledger
  • Compare

Entities

  • Models
  • Benchmarks
  • Labs
  • Papers

Method

  • Methodology
  • About
  • Privacy

Machine

  • Feed (Atom)
  • llms.txt
  • llms-full.txt
  • Sitemap

tensor.news grades benchmarks and tags model claims by evidence status. Every fact carries a source record and provenance. Scores are framed as task performance under a disclosed harness, never as deployed capability.

← Integrity Index

ARC-AGI-2

ARC-AGI-2

Rank #5 of 51 · 58 models scored · top score 85

AINTEGRITY 99 / 100

Fluid intelligence / novel skill via abstract grid puzzles

Strongest on discrimination, weakest on saturation headroom.

consistent harnessheld-out test set

Headroom to ceiling

15 headroomtop 85ceiling 100

Score distribution

median 5.3GPT-5.5 85044.589

State of the art over time

045898520242026

Integrity breakdown

Weighted composite. Each signal is computed from the source-backed leaderboard below.

Discrimination30%100

Does it still separate models?

Saturation headroom30%96

How far from ceiling / clustered at the top?

Contamination resistance15%100

Public vs held-out; training-leak risk.

Harness comparability15%100

Apples-to-apples, or mixed / vendor-optimized?

Freshness10%100

How old is the benchmark?

Leaderboard

#ModelScoreEvidenceMeasured
1GPT-5.585unverified2026-04-23
2GPT-5.5 Pro84.58unverified2026-04-23
3GPT-5.4 Pro83.33unverified2026-03-05
4Gemini 3.1 Pro77.1unverified2026-02-19
5Claude Opus 4.775.8unverified2026-04-16
6GPT-5.473.95unverified2026-03-05
7Gemini 3.5 Flash72.08unverified2026-05-19
8Claude Opus 4.872.08unverified2026-05-28
9Claude Opus 4.669.17unverified2026-02-05
10Grok 4.2065.14unverified2026-02-17
11Claude Sonnet 4.660.42unverified2026-02-17
12GPT-5.2 Pro54.16unverified2025-12-11
13GPT-5.252.91unverified2025-12-11
14Claude Opus 4.537.64unverified2025-11-24
15Gemini 3 Flash33.61unverified2025-12-17
16Gemini 3 Pro31.11unverified2025-11-18
17GLM-5.222.78unverified2026-06-16
18GPT-5.4 Mini18.9unverified2026-03-17
19GPT-5 Pro18.33unverified2025-10-07
20GPT-5.117.64unverified2025-11-13
21Grok 415.97unverified2025-07-09
22Claude Sonnet 4.513.61unverified2025-09-29
23Kimi K2.511.81unverified2026-02-02
24GPT-59.86unverified2025-08-07
25Claude Opus 48.61unverified2025-05-22
26o36.53unverified2024-12-20
27o4-mini6.11unverified2025-04-16
28Claude Sonnet 45.93unverified2025-05-22
29GPT-5.4 Nano5.69unverified2026-03-17
30Grok 4 Fast5.28unverified2025-09-19
31MiniMax-M2.54.86unverified2026-02-12
32o3-pro4.86unverified2025-06-10
33GLM-54.86unverified2026-02-11
34Gemini 2.5 Pro (Jun 2025)4.86unverified2025-06-05
35GPT-5 mini4.44unverified2025-08-07
36Claude Haiku 4.54.03unverified2025-10-15
37DeepSeek-V3.24.03unverified2025-12-01
38o3-mini2.99unverified2025-01-31
39GPT-5 nano2.61unverified2025-08-07
40Gemini 2.5 Flash (May 2025)2.54unverified2025-05-20
41DeepSeek-R11.3unverified2025-01-20
42Gemini 2.0 Flash (Feb 2025)1.3unverified2024-12-11
43Qwen3-235B-A22B-Instruct (Jul 2025)1.25unverified2025-07-25
44DeepSeek-R1 (May 2025)1.12unverified2025-05-28
45Claude 3.7 Sonnet0.9unverified2025-02-24
46o1-mini0.83unverified2024-09-12
47GPT-4.50.8unverified2025-02-27
48Gemini 1.5 Pro (Sept 2024)0.8unverified2024-09-24
49Grok-3 mini0.42unverified2025-02-19
50GPT-4.10.42unverified2025-04-14
51Grok 30unverified2025-02-17
52Llama 4 Maverick0unverified2025-04-05
53Llama 4 Scout0unverified2025-04-05
54Magistral Small 1.10unverified2025-06-10
55GPT-4.1 mini0unverified2025-04-14
56GPT-4.1 nano0unverified2025-04-14
57GPT-4o (Nov 2024)0unverified2024-05-13
58GPT-4o mini0unverified2024-07-18

At a glance

Models scored
58
Top model
GPT-5.5
Top score
85
Score spread
85
Headroom
15

Benchmark context

Task type
abstract-reasoning
Metric
pass@2 accuracy
Score ceiling
100
Human baseline
Human panel 100%; avg individual ~60%
Test-set privacy
private
Construction
Hand-designed grid tasks, human-calibrated; public train/eval + secret eval set
Key assumptions
Tasks novel to any corpus; human-solvable-model-hard isolates general reasoning
Limitations
Narrow grid domain; program-search brute-forces; score reflects search+compute budget
Contamination history
Private eval not released; low contamination by design
Harness notes
pass@2, extreme test-time-compute sensitivity; Prize caps compute/cost
Authors
ARC Prize Foundation (Chollet)
Released
2025-03
License
Apache-2.0 (public tasks)
Source
arxiv.org/abs/2505.11831

Provenance

58 source records · scores from epoch_benchmarks. Every fact on this page is evidence-linked.

Follow the record

Integrity neighbors

  • Chess PuzzlesA · 100
  • HLEA · 100
  • SimpleQA VerifiedA · 100
  • FrontierMath-2025-02-28-PrivateA · 99
  • FrontierMath-Tier-4-v2-PrivateA · 99
  • CadEvalA · 98

Top models here

  • GPT-5.585
  • GPT-5.5 Pro84.58
  • GPT-5.4 Pro83.33
  • Gemini 3.1 Pro77.1
  • Claude Opus 4.775.8

Head-to-head

  • GPT-5.5 vs GPT-5.5 Pro
  • GPT-5.5 vs GPT-5.4 Pro
  • GPT-5.5 Pro vs GPT-5.4 Pro