# Best Arm Identification on New Yorker Cartoon Caption Contest Caption 854

Source: [Best Arm Identification on New Yorker Cartoon Caption Contest Caption 854](<https://www.sota2.com/research/sota/best-arm-identification-on-new-yorker-cartoon-caption-contest-caption-854>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:45:11.851Z

Evaluation of Best Arm Identification performance on the New Yorker Cartoon Caption Contest Caption 854 dataset, measured by Probability of false selection.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Best Arm Identification |
| Dataset (including any stated split) | New Yorker Cartoon Caption Contest Caption 854 |
| Metric | False Selection Probability |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [False Selection Probability](<https://www.sota2.com/research/sota/best-arm-identification-on-new-yorker-cartoon-caption-contest-caption-854.md?metric=False%20Selection%20Probability>): Lower is better; unit: SCALAR.

## Recorded results

| Method | False Selection Probability | Result date | Report paper |
| --- | --- | --- | --- |
| iKG | 0.04 | Not recorded | 68fa710a1e209131cea4ed72 |
| KG | 0.05 | Not recorded | 68fa710a1e209131cea4ed72 |
| TTEI | 0.06 | Not recorded | 68fa710a1e209131cea4ed72 |
| iKG | 0.07 | Not recorded | 68fa710a1e209131cea4ed72 |
| TTEI | 0.1 | Not recorded | 68fa710a1e209131cea4ed72 |
| KG | 0.11 | Not recorded | 68fa710a1e209131cea4ed72 |
| Equal Allocation | 0.18 | Not recorded | 68fa710a1e209131cea4ed72 |
| EI | 0.23 | Not recorded | 68fa710a1e209131cea4ed72 |
| Equal Allocation | 0.26 | Not recorded | 68fa710a1e209131cea4ed72 |
| EI | 0.26 | Not recorded | 68fa710a1e209131cea4ed72 |

### iKG

False Selection Probability: 0.04. Result ID: 6991910f3a6c314849090737.

[Reporting paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

Recorded evaluation configuration: {"Sample size":"18000"}. This record does not assert independent reproduction.

### KG

False Selection Probability: 0.05. Result ID: 6991910f3a6c314849090735.

[Reporting paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

Recorded evaluation configuration: {"Sample size":"18000"}. This record does not assert independent reproduction.

### TTEI

False Selection Probability: 0.06. Result ID: 6991910f3a6c314849090733.

[Reporting paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63691e209131ce9fe8ae.md>)

Recorded evaluation configuration: {"Sample size":"18000"}. This record does not assert independent reproduction.

### iKG

False Selection Probability: 0.07. Result ID: 6991910f3a6c314849090736.

[Reporting paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

Recorded evaluation configuration: {"Sample size":"12000"}. This record does not assert independent reproduction.

### TTEI

False Selection Probability: 0.1. Result ID: 6991910f3a6c314849090732.

[Reporting paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63691e209131ce9fe8ae.md>)

Recorded evaluation configuration: {"Sample size":"12000"}. This record does not assert independent reproduction.

### KG

False Selection Probability: 0.11. Result ID: 6991910f3a6c314849090734.

[Reporting paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

Recorded evaluation configuration: {"Sample size":"12000"}. This record does not assert independent reproduction.

### Equal Allocation

False Selection Probability: 0.18. Result ID: 6991910f3a6c31484909072f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

Recorded evaluation configuration: {"Sample size":"18000"}. This record does not assert independent reproduction.

### EI

False Selection Probability: 0.23. Result ID: 6991910f3a6c314849090731.

[Reporting paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

Recorded evaluation configuration: {"Sample size":"18000"}. This record does not assert independent reproduction.

### Equal Allocation

False Selection Probability: 0.26. Result ID: 6991910f3a6c31484909072e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

Recorded evaluation configuration: {"Sample size":"12000"}. This record does not assert independent reproduction.

### EI

False Selection Probability: 0.26. Result ID: 6991910f3a6c314849090730.

[Reporting paper](<https://www.sota2.com/research/paper/68fa710a1e209131cea4ed72.md>)

Recorded evaluation configuration: {"Sample size":"12000"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.