List your company
ResearchFormerly WizWand

Multiple Choice Classification on StrategyQA

83.4AccuracyUnifiedQA-3b
42.94453.44763.9574.453Jul 19, 2023
Updated 8mo ago

Evaluation results

MethodLinks
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=Yes2023.0783.4
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=Yes2023.0766.4
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=No2023.0757.6
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=Yes2023.0757.2
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=Yes2023.0755.9
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=No2023.0754.1
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=No2023.0753.3
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=Yes2023.0753.3
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=No2023.0753.3
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=Yes2023.0753.3
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=Yes2023.0750.2
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=Yes2023.0748.9
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=No2023.0748.5
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=No2023.0748.5
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=No2023.0747.2
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=No2023.0744.5