Win-rate attribution on LiveCodeBench 880 problems
1Tau of MeanFlat win-rate (normalised pass rate)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Flat win-rate (normalised pass rate)Information=Full2026.05 | 1 | — | |
| Hierarchical win-rate (tree-normalised)Information=Full2026.05 | 0.997 | — | |
| Online win-rate (Laplace-smoothed)Information=Matched2026.05 | 0.941 | 0.789 | |
| BOHMInformation=Matched, Number of seeds=202026.05 | 0.928 | 0.739 | |
| Uniform-within-tierInformation=Full2026.05 | 0.838 | — |