Question Answering on ARC Easy (Accuracy, Data Efficiency)
49.45Accuracy (ARC Easy)q0 (scaled)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| q0 (scaled)evaluation protocol=zero-shot, total epochs=960, ensemble size (K)=1282026.06 | 49.45 | 13.2 | |
| q0evaluation protocol=zero-shot, total epochs=256, ensemble size (K)=1282026.06 | 48.65 | 12.7 | |
| Baselineevaluation protocol=zero-shot, total epochs=2562026.06 | 47.81 | 7.9 |