List your company
ResearchFormerly WizWand

Multi-task Language Evaluation on GSM8K, ARC-C, MedQA, BoolQ, and CoLA Average

79.87Average AccuracyPROMPT CLASSIFICATION
65.10268.93672.7776.604Jun 30, 2026
Updated 4mo ago

Evaluation results

MethodLinks
PROMPT CLASSIFICATIONComposition Type=NONE, Routing Granularity=PROMPT-LEVEL/DYNAMIC, Extra Objective=BERT CLASSIFICATION, Backbone=Llama-8B2026.0679.87
HARD-ROUTED MOR-LORAComposition Type=HARD UNIT-SCALE ROUTING, Routing Granularity=TOKEN-LEVEL, Extra Objective=NONE, Backbone=Llama-8B2026.0679.8
MOLE (α = 0.5)Composition Type=SOFT MOE-LORA ROUTING, Routing Granularity=TOKEN-LEVEL, Extra Objective=LOAD BALANCING, Backbone=Llama-8B2026.0678.5
LORAMIXER TOPK=2 NORM.Composition Type=NORMALIZED SOFT ROUTING, Routing Granularity=TOKEN-LEVEL, Extra Objective=PRESERVATION LOSS, Backbone=Llama-8B2026.0678.33
MOLE (α = 0.1)Composition Type=SOFT MOE-LORA ROUTING, Routing Granularity=TOKEN-LEVEL, Extra Objective=LOAD BALANCING, Backbone=Llama-8B2026.0678.02
LORAMIXER TOPK=1Composition Type=SOFT MIXTURE ROUTING, Routing Granularity=TOKEN-LEVEL, Extra Objective=PRESERVATION LOSS, Backbone=Llama-8B2026.0677.74
LORAHUBComposition Type=STATIC ADAPTER MERGING, Routing Granularity=PROMPT-LEVEL/STATIC, Extra Objective=BLACK-BOX WEIGHT SEARCH, Backbone=Llama-8B2026.0675.76
PROMPT CLASSIFICATIONComposition Type=NONE, Routing Granularity=PROMPT-LEVEL/DYNAMIC, Extra Objective=BERT CLASSIFICATION, Backbone=Llama-3B2026.0672.79
HARD-ROUTED MOR-LORAComposition Type=HARD UNIT-SCALE ROUTING, Routing Granularity=TOKEN-LEVEL, Extra Objective=NONE, Backbone=Llama-3B2026.0672.07
LORAMIXER TOPK=2 NORM.Composition Type=NORMALIZED SOFT ROUTING, Routing Granularity=TOKEN-LEVEL, Extra Objective=PRESERVATION LOSS, Backbone=Llama-3B2026.0670.81
MOLE (α = 0.1)Composition Type=SOFT MOE-LORA ROUTING, Routing Granularity=TOKEN-LEVEL, Extra Objective=LOAD BALANCING, Backbone=Llama-3B2026.0668.66
MOLE (α = 0.5)Composition Type=SOFT MOE-LORA ROUTING, Routing Granularity=TOKEN-LEVEL, Extra Objective=LOAD BALANCING, Backbone=Llama-3B2026.0668.5
LORAHUBComposition Type=STATIC ADAPTER MERGING, Routing Granularity=PROMPT-LEVEL/STATIC, Extra Objective=BLACK-BOX WEIGHT SEARCH, Backbone=Llama-3B2026.0667.75
LORAMIXER TOPK=1Composition Type=SOFT MIXTURE ROUTING, Routing Granularity=TOKEN-LEVEL, Extra Objective=PRESERVATION LOSS, Backbone=Llama-3B2026.0665.67