List your company
ResearchFormerly WizWand

Discriminative Tasks on BIG-bench (13 tasks, val)

58.7AccuracyUD+
38.10843.45448.854.146Nov 15, 2022
Updated 8mo ago

Evaluation results

MethodLinks
UD+Scale=XXL, Zero-shot=true2022.1158.7
UD+Model Scale=XXL, Zero-shot=true2022.1156.7
UDScale=XXL, Zero-shot=true2022.1155.5
UDModel Scale=XXL, Zero-shot=true2022.1151.3
Flan-T5Model Scale=XXL, Zero-shot=true2022.1149.4
UDScale=XL, Zero-shot=true2022.1148.9
T0Scale=XXL, Zero-shot=true2022.1147.4
UDModel Scale=XL, Zero-shot=true2022.1147.3
T0Model Scale=XXL, Zero-shot=true2022.1145
T0Scale=XL, Zero-shot=true2022.1144.8
Flan-T5Model Scale=XL, Zero-shot=true2022.1144.6
UDModel Scale=Large, Zero-shot=true2022.1144.2
UDScale=Large, Zero-shot=true2022.1143.5
T0Model Scale=XL, Zero-shot=true2022.1140.4
T0Scale=Large, Zero-shot=true2022.1139.6
Flan-T5Model Scale=Large, Zero-shot=true2022.1139.5
T0Model Scale=Large, Zero-shot=true2022.1138.9