Question Answering on PIQA (zero-shot, Normalized Accuracy)
60.8Normalized Accuracy (zero-shot)RNN PPT
Evaluation results
| Method | Links | |
|---|---|---|
| RNN PPTscale=160M, zero-shot=true, noise level=0%2026.05 | 60.8 | |
| Dyck PPTscale=160M, zero-shot=true, noise level=0%2026.05 | 60.7 | |
| Baselinescale=160M, zero-shot=true, noise level=0%2026.05 | 60.5 | |
| RNN PPTscale=160M, zero-shot=true, noise level=10%2026.05 | 60.5 | |
| Dyck PPTscale=160M, zero-shot=true, noise level=10%2026.05 | 60 | |
| Baselinescale=160M, zero-shot=true, noise level=10%2026.05 | 59.9 | |
| RNN PPTscale=160M, zero-shot=true, noise level=30%2026.05 | 59.7 | |
| Baselinescale=160M, zero-shot=true, noise level=30%2026.05 | 59.6 | |
| Dyck PPTscale=160M, zero-shot=true, noise level=30%2026.05 | 59.6 | |
| RNN PPTscale=160M, zero-shot=true, noise level=50%2026.05 | 59.2 | |
| Dyck PPTscale=160M, zero-shot=true, noise level=50%2026.05 | 58.7 | |
| Baselinescale=160M, zero-shot=true, noise level=50%2026.05 | 58.5 |