Question Answering on PIQA (Accuracy, Data Efficiency)
68.23Accuracyq0
Evaluation results
| Method | Links | ||
|---|---|---|---|
| q0evaluation protocol=zero-shot, total epochs=256, ensemble size (K)=1282026.06 | 68.23 | 17 | |
| q0 (scaled)evaluation protocol=zero-shot, total epochs=960, ensemble size (K)=1282026.06 | 67.74 | 14.7 | |
| Baselineevaluation protocol=zero-shot, total epochs=2562026.06 | 66.97 | 8 |