CODEx
Benchmarks
TaskDatasetSOTA resultTrendResults
CoDEx-m
0.78Accuracy
28
CoDEx-s
81Accuracy
28
CODEX 49-marker panel (test)
84.2Balanced Accuracy
22
CodeX
48.96CodeX Score
20
Codex-Eval
94.1Pass@10
16
Codex GPT-5
0Exact Match (EM)
12
CoDeX S
89.01Accuracy
12
CODEx L (test)
0.345MRR
9
CoDEx-L
0.359MRR
8
CoDEx M (Inference 1)
70.11Hits@10
7
CoDEx-M v1 (test)
28.9MRR
5
CoDEx-S v1 (test)
34.4MRR
5
CoDEx-M transductive (test)
0.526Hit@10
5
CoDEx-L v1 (test)
0.297MRR
4
CoDEx M
54.7MRR
3
Codex
77.67C-F Rate
3
CoDEx Small
49.6MRR
3
CoDEx Small transductive (test)
49MRR
3
CoDEx-L
54MRR
2
CoDEx Medium pre-training (test)
37.2MRR
2