Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Indirect Object Identification research benchmarks · SOTA2 Research

Indirect Object Identification

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

0.15Last-Token KL Divergence

40

Apr 21, 2026

3.491CPR

16

Jun 11, 2026

Mechanistic Interpretability Benchmark (MIB) Indirect Object Identification (IOI) (standard)

0CMD

12

Feb 26, 2026

Indirect Object Identification (IOI) (500 randomly-sampled examples)

GPT2 / DistilGPT2

0.918Alignment

2

Mar 10, 2026

Wang-style IOI templates

Manifestation Units

4.49Lift (routing)

1

Jul 2, 2026

IOI evaluation episodes (held-out)

2.976Policy Score

1

May 27, 2026

Popular datasets

IOI Mechanistic Interpretability Benchmark Indirect Object Identification IOI templates

Follow for updates

Join SOTA2 Contact