SVAMP
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SVAMP (test)
53.3ANLL
4
SVAMP-100 (pilot)
92Accuracy
3
SVAMP 5-shot
10Accuracy
3
SVAMP
88.67Pass@1
3
SVAMP Near-shift OOD
94.88Accuracy
3
SVAMP (test)
52.5Accuracy
3
SVAMP OOD
73Base Accuracy
2
SVAMP
94.48pass@4 Accuracy
2
SVAMP
11.81ECE
2
SVAMP
62.1Accuracy (format-specific)
2
SVAMP
73.67Initial Accuracy
1