Multimodal Scientific Reasoning on ScienceQA
97.07AccuracyFP16
Evaluation Results
| Method | Links | |
|---|---|---|
| FP16Model=InternVL2-8B, Spiking=false, Time Step=N/A2026.04 | 97.07 | |
| SpikeMLLM(QuaRot+MSTS+TC-LIF)Model=InternVL2-8B, Spiking=true, Time Step=3/42026.04 | 96.83 | |
| FP16Model=MiniCPM-V-2.6-8B, Spiking=false, Time Step=N/A2026.04 | 96.58 | |
| SpikeMLLM(QuaRot)Model=InternVL2-8B, Spiking=true, Time Step=152026.04 | 95.98 | |
| SpikeMLLM(QuaRot+MSTS+TC-LIF)Model=MiniCPM-V-2.6-8B, Spiking=true, Time Step=3/42026.04 | 95.88 | |
| SpikeMLLM(GPTQ)Model=MiniCPM-V-2.6-8B, Spiking=true, Time Step=2552026.04 | 95.14 | |
| SpikeMLLM(QuaRot)Model=MiniCPM-V-2.6-8B, Spiking=true, Time Step=152026.04 | 94.15 | |
| SpikeMLLM(QuaRot+MSTS+TC-LIF)Model=InternVL2-8B, Spiking=true, Time Step=2/32026.04 | 92.71 | |
| SpikeMLLM(RTN)Model=MiniCPM-V-2.6-8B, Spiking=true, Time Step=2552026.04 | 92.56 | |
| SpikeMLLM(GPTQ)Model=InternVL2-8B, Spiking=true, Time Step=2552026.04 | 90.83 | |
| SpikeMLLM(QuaRot+MSTS+TC-LIF)Model=MiniCPM-V-2.6-8B, Spiking=true, Time Step=2/32026.04 | 89.64 | |
| SpikeMLLM(RTN)Model=InternVL2-8B, Spiking=true, Time Step=2552026.04 | 88.5 | |
| FP16Model=Qwen2VL-7B, Spiking=false, Time Step=N/A2026.04 | 85.67 | |
| SpikeMLLM(QuaRot+MSTS+TC-LIF)Model=Qwen2VL-7B, Spiking=true, Time Step=3/42026.04 | 85.57 | |
| SpikeMLLM(QuaRot)Model=Qwen2VL-7B, Spiking=true, Time Step=152026.04 | 83.54 | |
| SpikeMLLM(GPTQ)Model=Qwen2VL-7B, Spiking=true, Time Step=2552026.04 | 83.29 | |
| SpikeMLLM(RTN)Model=Qwen2VL-7B, Spiking=true, Time Step=2552026.04 | 80.71 | |
| SpikeMLLM(QuaRot+MSTS+TC-LIF)Model=Qwen2VL-7B, Spiking=true, Time Step=2/32026.04 | 80.37 | |
| SpikeMLLM(QuaRot+MSTS+TC-LIF)Model=Qwen-VL-Chat-9.6B, Spiking=true, Time Step=3/42026.04 | 68.07 | |
| FP16Model=Qwen-VL-Chat-9.6B, Spiking=false, Time Step=N/A2026.04 | 67.58 | |
| SpikeMLLM(GPTQ)Model=Qwen-VL-Chat-9.6B, Spiking=true, Time Step=2552026.04 | 63.06 | |
| SpikeMLLM(QuaRot)Model=Qwen-VL-Chat-9.6B, Spiking=true, Time Step=152026.04 | 63.06 | |
| SpikeMLLM(QuaRot+MSTS+TC-LIF)Model=Qwen-VL-Chat-9.6B, Spiking=true, Time Step=2/32026.04 | 62.47 | |
| SpikeMLLM(RTN)Model=Qwen-VL-Chat-9.6B, Spiking=true, Time Step=2552026.04 | 61.13 | |
| SpikeMLLM(QuaRot)Model=InternVL2-8B, Spiking=true, Time Step=72026.04 | 44.42 | |
| SpikeMLLM(QuaRot)Model=Qwen2VL-7B, Spiking=true, Time Step=72026.04 | 21.84 | |
| SpikeMLLM(QuaRot)Model=MiniCPM-V-2.6-8B, Spiking=true, Time Step=72026.04 | 16.38 | |
| SpikeMLLM(QuaRot)Model=Qwen-VL-Chat-9.6B, Spiking=true, Time Step=72026.04 | 9.18 |