List your company
ResearchFormerly WizWand

Multilingual Understanding on M-ARC

1.155Normalized PerformanceMETIS
0.904360.969431.03451.09957Jun 15, 2026
Updated 4mo ago

Evaluation results

MethodLinks
METISCategory=Ours, Backbone=Llama-3.2-3B2026.061.155
TSV-MCategory=State-of-the-Art (+Many-shot), Backbone=Llama-3.2-3B2026.060.994
Iso-CTSCategory=State-of-the-Art (+Many-shot), Backbone=Llama-3.2-3B2026.060.988
q-FedAvgCategory=Iterative / FL, Backbone=Llama-3.2-3B2026.060.988
Iso-CCategory=State-of-the-Art (+Many-shot), Backbone=Llama-3.2-3B2026.060.969
FedMergeCategory=Iterative / FL, Backbone=Llama-3.2-3B2026.060.969
TIESCategory=Conventional Method (+Many-shot), Backbone=Llama-3.2-3B2026.060.969
TA + Subspace BoostingCategory=State-of-the-Art (+Many-shot), Backbone=Llama-3.2-3B2026.060.957
ColD FusionCategory=Iterative / FL, Backbone=Llama-3.2-3B2026.060.957
Task ArithmeticCategory=Conventional Method (+Many-shot), Backbone=Llama-3.2-3B2026.060.957
DARECategory=Conventional Method (+Many-shot), Backbone=Llama-3.2-3B2026.060.957
TULU 3Category=Data-Mixing, Backbone=Llama-3.2-3B2026.060.914
ConsensusTACategory=Conventional Method (+Many-shot), Backbone=Llama-3.2-3B2026.060.914