List your company
ResearchFormerly WizWand

Multiple Choice Classification on CIKQA

66.9AccuracyUnifiedQA-3b
49.11653.73358.3562.967Jul 19, 2023
Updated 8mo ago

Evaluation results

MethodLinks
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=Yes2023.0766.9
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=Yes2023.0762.1
UnifiedQA-3bparameters=3B, Protocol=Transfer-learning, External Knowledge=No2023.0761.3
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=Yes2023.0759.6
UnifiedQA-largeparameters=770M, Protocol=Transfer-learning, External Knowledge=No2023.0759.6
UnifiedQA-baseparameters=220M, Protocol=Transfer-learning, External Knowledge=No2023.0756
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=No2023.0752.6
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=Yes2023.0751.8
T5-baseparameters=220M, Protocol=Zero-shot, External Knowledge=No2023.0751.5
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=Yes2023.0750.7
T5-3bparameters=3B, Protocol=Zero-shot, External Knowledge=Yes2023.0750.5
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=No2023.0750
T5-largeparameters=770M, Protocol=Zero-shot, External Knowledge=Yes2023.0750
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=No2023.0750
OPT-30bparameters=30B, Protocol=Zero-shot, External Knowledge=Yes2023.0750
GPT-Jparameters=6B, Protocol=Zero-shot, External Knowledge=No2023.0749.8