List your company
ResearchFormerly WizWand

Medical Question Answering on MedQA (Acc, Token usage, Speed)

78.3AccuracyLatentMAS
45.43653.96862.571.032Nov 25, 2025Dec 31, 2025Feb 5, 2026Mar 13, 2026Apr 18, 2026May 24, 2026Jun 30, 2026
Updated 4mo ago

Evaluation results

MethodLinks
LatentMASBackbone=Qwen3-14B, MAS Setting=Hierarchical2025.1178.38991,250—
TextMASBackbone=Qwen3-14B, MAS Setting=Hierarchical2025.11785,4737,591—
LatentMASBackbone=Qwen3-8B, MAS Setting=Hierarchical2025.11771,007964—
TextMASBackbone=Qwen3-8B, MAS Setting=Hierarchical2025.1176.36,8933,387—
LatentMASBackbone=Llama-3.1-8B-Instruct, MAS Setting=Hierarchical2025.1167.7191—204
LatentMASBackbone=Qwen3-4B, MAS Setting=Hierarchical2025.1167.31,015557—
LatentMASBackbone=Llama-3.1-8B-Instruct, MAS Setting=Sequential2025.1165.3316—182
TextMASBackbone=Qwen3-4B, MAS Setting=Hierarchical2025.11656,7021,495—
TextMASBackbone=Llama-3.1-8B-Instruct, MAS Setting=Sequential2025.11652,354—589
BiRG-LoRASetting=Qwen, CMExam train2026.0665———
SingleBackbone=Qwen3-14B, MAS Setting=Hierarchical2025.1164.71,7461,360—
TextMASBackbone=Llama-3.1-8B-Instruct, MAS Setting=Hierarchical2025.1164.31,847—464
MoELoRASetting=Qwen, CMExam train2026.0664.14———
DoRASetting=Qwen, CMExam train2026.0663.71———
BiRG-LoRASetting=Llama, CMB train2026.0662.71———
DoRASetting=Llama, CMB train2026.0661.86———
MoELoRASetting=Llama, CMB train2026.0661.57———
SingleBackbone=Llama-3.1-8B-Instruct, MAS Setting=Sequential2025.1159382—112
SingleBackbone=Llama-3.1-8B-Instruct, MAS Setting=Hierarchical2025.1159382—112
SingleBackbone=Qwen3-8B, MAS Setting=Hierarchical2025.11532,098476—
TextMASBackbone=Llama-3.2-3B-Instruct, MAS Setting=Hierarchical2025.1150.31,729—282
LatentMASBackbone=Llama-3.2-3B-Instruct, MAS Setting=Hierarchical2025.1150359—73
TextMASBackbone=Llama-3.2-3B-Instruct, MAS Setting=Sequential2025.11481,595—236
LatentMASBackbone=Llama-3.2-3B-Instruct, MAS Setting=Sequential2025.1148403—85
SingleBackbone=Qwen3-4B, MAS Setting=Hierarchical2025.1147.72,134236—
SingleBackbone=Llama-3.2-3B-Instruct, MAS Setting=Sequential2025.1146.7405—51
SingleBackbone=Llama-3.2-3B-Instruct, MAS Setting=Hierarchical2025.1146.7405—51