Science Question Answering on SciQ (test)
90.2AccuracyPythia-12B
Evaluation results
| Method | Links | |
|---|---|---|
| Pythia-12BParameters=12B, Zero-shot=true2023.04 | 90.2 | |
| Pythia-6.9BParameters=6.9B, Zero-shot=true2023.04 | 89.7 | |
| Pythia-2.8BParameters=2.8B, Zero-shot=true2023.04 | 88.2 | |
| Pythia-1.4BParameters=1.4B, Zero-shot=true2023.04 | 86.5 | |
| Pythia-1BParameters=1B, Zero-shot=true2023.04 | 84 | |
| Pythia-410MParameters=410M, Zero-shot=true2023.04 | 81.1 | |
| Pythia-160MParameters=160M, Zero-shot=true2023.04 | 74.1 | |
| Pythia-70MParameters=70M, Zero-shot=true2023.04 | 60.1 |