List your company

Zero-shot Natural Language Understanding on Standard NLU Suite

21.22ARC ChallengeMaxScore
18.765619.402820.0420.6772Aug 18, 2025

Evaluation results

MethodLinks
MaxScoreSize=XL2025.0821.2247.663.635.5725.9369.9529.975.267.921.645.85
MaxScoreSparsity=2:642025.0821.1146.1764.2433.3823.4167.9528.973.364.61944.21
MaxScoreSparsity=2:322025.0820.944.663.7333.2423.7667.6329.0473.564.4118.843.96
MaxScoreSize=Large2025.0820.945.9262.393424.9668.2829.6774.366.1219.844.63
MaxScoreSparsity=2:162025.0820.7344.4962.2332.8523.2767.4128.5272.56418.443.44
MaxScoreSize=Base2025.0820.7344.4962.2332.8523.2767.4128.5272.56418.443.44
DropLessSize=XL2025.0820.1446.661.6935.1124.3468.3429.1972.467.5520.244.56
DropLessSize=Large2025.0820.0545.2461.1933.9723.667.6327.6669.763.9517.243.02
GShardSize=XL2025.0820.0546.6863.0935.1425.0569.3129.1972.767.52044.87
GShardSize=Base2025.0819.8844.4961.931.7421.5466.3828.5269.462.0816.242.11
GShardSparsity=2:642025.0819.844.8662.2633.0522.267.328.4669.463.1717.642.81
GShardSparsity=2:322025.0819.6244.5762.2832.6321.9967.1929.0469.662.7718.242.79
DropLessSparsity=2:322025.0819.6244.5162.2332.3621.7967.127.4668.362.216.842.24
DropLessSparsity=2:642025.0819.644.6962.432.7921.6567.2727.5669.563.0517.642.61
DropLessSparsity=2:162025.0819.2844.0761.1632.0321.3567.1427.0867.961.551641.76
DropLessSize=Base2025.0819.2844.0761.1632.0321.3567.1427.0867.961.551641.76
GShardSparsity=2:162025.0818.8644.4961.931.7421.5466.3828.5269.462.0816.242.11
GShardSize=Large2025.0818.8645.5862.1633.3423.6967.7429.287064.9919.243.59