SciQ
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SciQ
83.3Accuracy
7
SciQ
89.3Accuracy
7
SciQ
86.3Accuracy (SciQ)
6
SciQ
64.8EigenWD M1 Score
6
SciQ
83.8nDCG@5
6
SciQ-ar
55.68Accuracy
6
SciQ
40.8Accuracy
5
SciQ
0.424Spearman Correlation (ρ)
4
SciQ (held-out)
33.98Accuracy (SciQ)
4
SciQ
72.8Accuracy
4
SciQ
38.1nAUPC
4
SciQ
52.8ANLL
4
SciQ (test)
59.9ANLL
4
SciQ
81.1Accuracy
4
SciQ
80.8Accuracy
3
SciQ 30% Label Noise (train)
1.561NLL
3
SciQ 20% Label Noise (train)
1.456NLL
3
SciQ full (test val)
31.9Accuracy
3
SciQ Abstract
80.6Accuracy
3
SCIQ
58.92Exact Match
3
SciQ
75.98Exact Match
3
SciQ MC
86.7Accuracy
2
SciQ
0.005MAE
2
SciQ MC
86.7Accuracy
1
SciQ (dev)
—Accuracy
0