Multiple Choice Question Answering on Arc-Easy v1 (test)
83.21AccuracyFP16
Evaluation Results
| Method | Links | |
|---|---|---|
| FP16Backbone=Qwen3-32B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.06 | 83.21 | |
| FP16Backbone=Qwen3-14B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.06 | 83.08 | |
| FP16Backbone=LLaMA2-70B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.06 | 81.02 | |
| FP16Backbone=Qwen3-8B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.06 | 80.93 | |
| TWLABackbone=LLaMA2-70B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 80.73 | |
| TWLABackbone=Qwen3-32B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 79.53 | |
| FP16Backbone=LLaMA3-8B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.06 | 77.9 | |
| FP16Backbone=LLaMA2-13B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.06 | 77.57 | |
| TWLABackbone=Qwen3-14B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 76.26 | |
| QuaRotBackbone=LLaMA2-70B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.06 | 75.5 | |
| FP16Backbone=LLaMA2-7B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.06 | 74.66 | |
| SliM-LLMBackbone=Qwen3-32B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.06 | 74.03 | |
| TWLABackbone=Qwen3-8B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 71.38 | |
| PB-LLMBackbone=Qwen3-32B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.06 | 71.04 | |
| PT2-LLMBackbone=LLaMA2-70B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 71 | |
| TWLABackbone=LLaMA2-13B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 70.24 | |
| TWLABackbone=LLaMA3-8B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 67.3 | |
| TWLABackbone=LLaMA2-7B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 65.87 | |
| PT2-LLMBackbone=LLaMA2-13B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 62.85 | |
| SliM-LLMBackbone=LLaMA2-13B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.06 | 56.71 | |
| PT2-LLMBackbone=Qwen3-14B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 53.03 | |
| SliM-LLMBackbone=Qwen3-14B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.06 | 52.7 | |
| QuaRotBackbone=LLaMA2-13B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.06 | 51.98 | |
| SliM-LLMBackbone=LLaMA2-7B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.06 | 50.44 | |
| PB-LLMBackbone=LLaMA2-70B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.06 | 50.05 | |
| GPTQBackbone=LLaMA2-70B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.06 | 49.83 | |
| PT2-LLMBackbone=LLaMA2-7B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 47.01 | |
| PB-LLMBackbone=Qwen3-14B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.06 | 46.21 | |
| SliM-LLMBackbone=Qwen3-8B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.06 | 42.45 | |
| PB-LLMBackbone=Qwen3-8B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.06 | 41.08 | |
| QuaRotBackbone=LLaMA2-7B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.06 | 40.95 | |
| QuaRotBackbone=LLaMA3-8B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.06 | 40.87 | |
| GPTQBackbone=Qwen3-32B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.06 | 38.72 | |
| PT2-LLMBackbone=LLaMA3-8B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.06 | 34.22 | |
| GPTQBackbone=Qwen3-14B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.06 | 32.49 | |
| GPTQBackbone=LLaMA2-7B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.06 | 32.45 | |
| SliM-LLMBackbone=LLaMA3-8B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.06 | 31.82 | |
| PB-LLMBackbone=LLaMA3-8B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.06 | 31.52 | |
| GPTQBackbone=Qwen3-8B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.06 | 30.35 | |
| PB-LLMBackbone=LLaMA2-7B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.06 | 29.29 | |
| GPTQBackbone=LLaMA3-8B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.06 | 28.28 | |
| PB-LLMBackbone=LLaMA2-13B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.06 | 27.82 | |
| GPTQBackbone=LLaMA2-13B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.06 | 26.39 |