Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Best Arm Identification research benchmarks – Page 2 · SOTA2 Research

Best Arm Identification

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Example 3 Synthetic

1False Selection Rate

10

Feb 26, 2026

Example 2 Synthetic

3False Selection Probability

10

Feb 26, 2026

Example 1 Synthetic

3False Selection Probability

10

Feb 26, 2026

Random Gaussian instances K=10

0.06Avg CPU Time (s)

9

Feb 26, 2026

Synthetic Bandit (N=128, T=896)

0.045Average Simple Regret

6

Feb 26, 2026

Synthetic Multi-Armed Bandit (N=1,024, T=10,240) T = N log2 N (test)

0.02Avg Simple Regret

6

Feb 26, 2026

On-Line Auto Lending auto-loan replay

TabPFN structured proxy

40.6Mean Stopping Time

5

Jul 9, 2026

Synthetic Small-gap Instance Feature set 1, d=10

187,924.68Average Tau

5

Apr 7, 2026

Uniform-feature instance d=10, K=100

1Avg Tau

5

Apr 7, 2026

ε-Best-Arm Problem 10D, ε=0.2

90.5Correctness

5

Feb 26, 2026

ε-Best-Arm Problem 8D, ε=0.2

92.9Correctness

5

Feb 26, 2026

ε-Best-Arm Problem 6D, ε=0.2

96.2Correctness

5

Feb 26, 2026

ε-Best-Arm Problem 10D, ε=0.1

91.5Correctness

5

Feb 26, 2026

ε-Best-Arm Problem 8D, ε=0.1

98.8Correctness

5

Feb 26, 2026

ε-Best-Arm Problem 6D, ε=0.1

95.3Correctness

5

Feb 26, 2026

One group of suboptimal arms K=40

5.96Error Probability (T=30k)

5

Feb 26, 2026

One group of suboptimal arms K=20

8.39Error Probability (T=12k)

5

Feb 26, 2026

One group of suboptimal arms K=10

7.29Error Rate (T=6,400)

5

Feb 26, 2026

NeuralEmbedding

100Success Rate

5

Feb 26, 2026

KernelEmbedding

100Success Rate

5

Feb 26, 2026

12,928Median

4

Jul 7, 2026

framing dataset

5,888Median Stopping Time

4

Jul 7, 2026

Jester maximal complete case subset (50,699 users)

98Success Probability

4

Apr 7, 2026

Ring Graph Large: K=10, H=50

62Identification Probability

4

Mar 4, 2026

Ring Graph Small: K=5, H=25

79Best Arm Identification Probability

4

Mar 4, 2026

Page 2 of 3

Popular datasets

ε-Best-Arm Problem Convex arm-to-reward function One group of suboptimal arms Two groups of suboptimal arms Concave arm-to-reward function

Follow for updates

Join SOTA2 Contact