Multiple Choice Question Answering on BLOGS-MC
75.63AccuracyMiCA (optimal)
Evaluation Results
| Method | Links | |
|---|---|---|
| MiCA (optimal)Base Model=Qwen2.5-7B-Instr., r=32, LR=5e-4, Ep.=8, Params=6M2026.04 | 75.63 | |
| LoRA (optimal)Base Model=Qwen2.5-7B-Instr., r=32, LR=5e-4, Ep.=4, Params=10M2026.04 | 73.87 | |
| Qwen2.5-7B-Instr.Params=7,626M2026.04 | 72.91 | |
| MiCA (optimal)Base Model=Llama-2-7B-chat, r=16, LR=5e-4, Ep.=4, Params=4M2026.04 | 61.33 | |
| LoRA (optimal)Base Model=Llama-2-7B-chat, r=128, LR=1e-4, Ep.=8, Params=67M2026.04 | 58.28 | |
| Llama-2-7B-chatParams=6,747M2026.04 | 56.18 |