Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Abstract Reasoning research benchmarks · SOTA2 Research

Abstract Reasoning

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

83.41AbsR Accuracy

56

Feb 26, 2026

77.1Pass@2

24

Jun 16, 2026

97.8Accuracy (Overall)

21

Apr 21, 2026

Human panel (average)

60Accuracy

18

Jun 26, 2026

97Accuracy

18

Jun 26, 2026

ARC-AGI v1 (test)

98Accuracy

17

Jun 4, 2026

97.29Accuracy

16

Jun 26, 2026

Bespoke (Grok-4)

79.6Pass@2

12

Jun 2, 2026

ARC-AGI v2 (test)

100Accuracy

11

May 20, 2026

ARC-AGI 2 (Semi-private)

100Accuracy

10

Jul 1, 2026

Bongard-LOGO (BD)

72Mean Accuracy

10

Apr 24, 2026

Bongard-LOGO (FF)

79.3Mean Accuracy

10

Apr 24, 2026

63.04Accuracy

9

Jun 26, 2026

Bongard-LOGO (HD)

C–G + Concept (AP + C)

61.1Mean Accuracy

8

Apr 24, 2026

CLEVR-RPM (test)

100Accuracy

7

Feb 26, 2026

63.21Accuracy

5

May 20, 2026

Private human-curated 177 ARC-style tasks (evaluation set)

55.93Pass@k

5

Mar 10, 2026

PGM Triples (test)

24.6Accuracy

5

Feb 26, 2026

PGM Triples (val)

Neural Interpreters

79.9Accuracy

5

Feb 26, 2026

PGM Triple Pairs (test)

Neural Interpreters

45.2Accuracy

5

Feb 26, 2026

PGM Triple Pairs (val)

Neural Interpreters

68.6Accuracy

5

Feb 26, 2026

PGM Attribute Pairs (test)

36.8Accuracy

5

Feb 26, 2026

PGM Attribute Pairs (val)

70.1Accuracy

5

Feb 26, 2026

PGM Neutral (test)

Neural Interpreters

77Accuracy

5

Feb 26, 2026

PGM Neutral (val)

Neural Interpreters

77.3Accuracy

5

Feb 26, 2026

Page 1 of 2

PreviousNext

Popular datasets

PGM ARC-AGI ARC Bongard-LOGO PGM Triples

Follow for updates

Join SOTA2 Contact