Closed Book Question Answering on TriviaQA (accuracy)
82AccuracyU-PaLM
Evaluation Results
| Method | Links | |
|---|---|---|
| U-PaLMSize=540B, FLOPS (ZFLOPS)=2529.7, Shot=few-shot2022.10 | 82 | |
| PaLMSize=540B, FLOPS (ZFLOPS)=2527.2, Shot=few-shot2022.10 | 81.4 | |
| PaLMSize=540B, FLOPS (ZFLOPS)=2527.2, Shot=0-shot2022.10 | 76.9 | |
| U-PaLMSize=540B, FLOPS (ZFLOPS)=2529.7, Shot=0-shot2022.10 | 76.4 | |
| U-PaLMSize=62B, FLOPS (ZFLOPS)=298.7, Shot=few-shot2022.10 | 73.6 | |
| ChinchillaSize=70B, FLOPS (ZFLOPS)=588, Shot=few-shot2022.10 | 73.2 | |
| PaLMSize=62B, FLOPS (ZFLOPS)=295.7, Shot=few-shot2022.10 | 72.7 | |
| U-PaLMSize=62B, FLOPS (ZFLOPS)=298.7, Shot=0-shot2022.10 | 68.3 | |
| PaLMSize=62B, FLOPS (ZFLOPS)=295.7, Shot=0-shot2022.10 | 67.3 | |
| ChinchillaSize=70B, FLOPS (ZFLOPS)=588, Shot=0-shot2022.10 | 67 | |
| GopherSize=280B, FLOPS (ZFLOPS)=504, Shot=few-shot2022.10 | 63.6 | |
| GopherSize=280B, FLOPS (ZFLOPS)=504, Shot=0-shot2022.10 | 52.8 |