Competitive Programming Reasoning on CF-73
96Pass RateOracle
Evaluation results
| Method | Links | |
|---|---|---|
| OracleModel=Gemini 3.1 Pro, Protocol=gen-0 pass@20, n=202026.05 | 96 | |
| OpenDeepThink (Generation 1)Protocol=Bradley–Terry top-1, Generation=12026.05 | 96 | |
| OpenDeepThink (Generation 3)Protocol=Bradley–Terry top-1, Generation=32026.05 | 96 | |
| OpenDeepThink (Generation 2)Protocol=Bradley–Terry top-1, Generation=22026.05 | 95 | |
| OpenDeepThink (Generation 0)Protocol=Bradley–Terry top-1, Generation=02026.05 | 92 | |
| Pass@1Model=Gemini 3.1 Pro, Protocol=Single unranked gen-0 sample2026.05 | 80 |