Visual Question Answering on VQA v2 (Detailed Metric Breakdown)
57.72Accuracy (Rec.)LoRAMoE + Muon
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LoRAMoE + MuonArchitecture=LoRAMoE, Optimizer=Muon2026.06 | 57.72 | 41.31 | 80.48 | 76.77 | 48.88 | 76.04 | 73.73 | 63.25 | 61.35 | 29.03 | 60.86 | 17.39 | |
| LoRAMoE + FOGOArchitecture=LoRAMoE, Optimizer=FOGO2026.06 | 57.72 | 41.6 | 82.95 | 79.95 | 52.91 | 77.83 | 75.56 | 63.91 | 62.72 | 29.85 | 62.5 | 7.14 | |
| LoRAMoE + AdamWArchitecture=LoRAMoE, Optimizer=AdamW2026.06 | 55.88 | 41.45 | 80.64 | 76.45 | 48.9 | 75.48 | 73.36 | 62.68 | 61.97 | 29.95 | 60.68 | 18.12 | |
| CL-MoEArchitecture=CL-MoE2026.06 | 55.74 | 41.74 | 80.39 | 76.77 | 49.47 | 75.41 | 73.56 | 63.17 | 61.03 | 30.41 | 60.77 | 17.7 |