Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Best Arm Identification research benchmarks · SOTA2 Research

Best Arm Identification

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Unstructured instances K=40

5.43Samples

31

Feb 26, 2026

Linear instances K=50, d=20 Appendix G (randomly generated)

14.71Samples

30

Feb 26, 2026

6.633True Rank

15

Mar 4, 2026

2.067True Rank of Reported Winner

15

Mar 4, 2026

3.233True Rank of Reported Winner

15

Mar 4, 2026

Stair arm-to-reward function K=55

0.57Error Rate

15

Feb 26, 2026

Stair arm-to-reward function K=21

0.09Error Probability

15

Feb 26, 2026

Stair arm-to-reward function K=15

0.02Error Rate

15

Feb 26, 2026

Linear arm-to-reward function K=40

10.67Error Rate

15

Feb 26, 2026

Linear arm-to-reward function K=20

3.73Error Probability

15

Feb 26, 2026

Linear arm-to-reward function K=10

0.006Error Probability

15

Feb 26, 2026

Concave arm-to-reward function (K=40) (synthetic)

0.02Error Rate

15

Feb 26, 2026

Concave arm-to-reward function K=20 (synthetic)

0.09Error Probability

15

Feb 26, 2026

Concave arm-to-reward function K=10 (synthetic)

0.04Error Rate

15

Feb 26, 2026

55-arm convex mapping bandit

0.6Error Probability

15

Feb 26, 2026

Two groups of suboptimal arms (K=40)

2.24Error Probability

15

Feb 26, 2026

Two groups of suboptimal arms K=20

4.27Error Probability

15

Feb 26, 2026

Two groups of suboptimal arms (K=10)

0.99Error Probability

15

Feb 26, 2026

Convex arm-to-reward function K=40 (test)

0.25Error Rate

15

Feb 26, 2026

Convex arm-to-reward function K=20 (test)

0.21Error Probability

15

Feb 26, 2026

Convex arm-to-reward function K=10 (test)

0.62Error Rate

15

Feb 26, 2026

10 Synthetic Gaussian Instances K=40 arms

Simple Tracking

53.7H1

10

Apr 10, 2026

New Yorker Cartoon Caption Contest Caption 854

0.04False Selection Probability

10

Feb 26, 2026

Drug Review Dataset Selection

23Probability of False Selection

10

Feb 26, 2026

Dose-finding ACR50

1Probability of False Selection

10

Feb 26, 2026

Page 1 of 3

PreviousNext

Popular datasets

ε-Best-Arm Problem Convex arm-to-reward function One group of suboptimal arms Two groups of suboptimal arms Concave arm-to-reward function

Follow for updates

Join SOTA2 Contact