Question Answering on SciQ (Accuracy, Data Efficiency)
80.8Accuracyq0 (scaled)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| q0 (scaled)evaluation protocol=zero-shot, total epochs=960, ensemble size (K)=1282026.06 | 80.8 | 19.9 | |
| q0evaluation protocol=zero-shot, total epochs=256, ensemble size (K)=1282026.06 | 80.3 | 18.8 | |
| Baselineevaluation protocol=zero-shot, total epochs=2562026.06 | 78.5 | 13.4 |