CRUX
Benchmarks
TaskDatasetSOTA resultTrendResults
CRUX (test)
69.3Pass@1
30
CRUX
55.08Accuracy @5
27
CRUX
87.37Accuracy
26
CRUX official (test)
51.1Pass@1 Accuracy
20
CRUX
57.2Score (%)
18
CRUX Multi-News
38Precision@10
14
CRUX DUC04
73.8Precision@10
14
CRUX
25.75CRUX Score
6