List your company
ResearchFormerly WizWand

Closed Book Question Answering on TriviaQA (accuracy)

82AccuracyU-PaLM
51.63259.51667.475.284Oct 20, 2022
Updated 8mo ago

Evaluation results

MethodLinks
U-PaLMSize=540B, FLOPS (ZFLOPS)=2529.7, Shot=few-shot2022.1082
PaLMSize=540B, FLOPS (ZFLOPS)=2527.2, Shot=few-shot2022.1081.4
PaLMSize=540B, FLOPS (ZFLOPS)=2527.2, Shot=0-shot2022.1076.9
U-PaLMSize=540B, FLOPS (ZFLOPS)=2529.7, Shot=0-shot2022.1076.4
U-PaLMSize=62B, FLOPS (ZFLOPS)=298.7, Shot=few-shot2022.1073.6
ChinchillaSize=70B, FLOPS (ZFLOPS)=588, Shot=few-shot2022.1073.2
PaLMSize=62B, FLOPS (ZFLOPS)=295.7, Shot=few-shot2022.1072.7
U-PaLMSize=62B, FLOPS (ZFLOPS)=298.7, Shot=0-shot2022.1068.3
PaLMSize=62B, FLOPS (ZFLOPS)=295.7, Shot=0-shot2022.1067.3
ChinchillaSize=70B, FLOPS (ZFLOPS)=588, Shot=0-shot2022.1067
GopherSize=280B, FLOPS (ZFLOPS)=504, Shot=few-shot2022.1063.6
GopherSize=280B, FLOPS (ZFLOPS)=504, Shot=0-shot2022.1052.8