Commonsense Reasoning on Commonsense
74.6RCCNeuronLLM
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NeuronLLMBackbone=Baichuan 2-7B2026.01 | 74.6 | 56.7 | — | — | — | — | — | — | — | — | — | — | |
| NeuronLLMBackbone=LLaMA 2-7B2026.01 | 62 | 50.3 | — | — | — | — | — | — | — | — | — | — | |
| NeuronLLMBackbone=LLaMA 2-13B2026.01 | 37.9 | 33.8 | — | — | — | — | — | — | — | — | — | — | |
| KNBackbone=Baichuan 2-7B2026.01 | 34.3 | 30.9 | — | — | — | — | — | — | — | — | — | — | |
| NeuronLLMBackbone=LLaMA 2-7B2026.01 | 28 | — | — | — | — | — | — | — | — | — | 8.9 | — | |
| QRNCABackbone=Baichuan 2-7B2026.01 | 23.9 | 18.9 | — | — | — | — | — | — | — | — | — | — | |
| TNBackbone=LLaMA 2-7B2026.01 | 12 | — | — | — | — | — | — | — | — | — | 5.3 | — | |
| NeuronLLMBackbone=LLaMA 2-13B2026.01 | 10.6 | — | — | — | — | — | — | — | — | — | 8.1 | — | |
| NeuronLLMBackbone=Baichuan 2-7B2026.01 | 10.4 | — | — | — | — | — | — | — | — | — | 10 | — | |
| TNBackbone=LLaMA 2-13B2026.01 | 9.1 | 6.1 | — | — | — | — | — | — | — | — | — | — | |
| QRNCABackbone=LLaMA 2-13B2026.01 | 9.1 | 5.1 | — | — | — | — | — | — | — | — | — | — | |
| QRNCABackbone=LLaMA 2-7B2026.01 | 8 | — | — | — | — | — | — | — | — | — | 2.4 | — | |
| KNBackbone=LLaMA 2-7B2026.01 | 7.5 | — | — | — | — | — | — | — | — | — | 2.8 | — | |
| TNBackbone=Baichuan 2-7B2026.01 | 6 | 7 | — | — | — | — | — | — | — | — | — | — | |
| TNBackbone=Baichuan 2-7B2026.01 | 4.5 | — | — | — | — | — | — | — | — | — | 1.5 | — | |
| KNBackbone=LLaMA 2-13B2026.01 | 1.5 | 1.5 | — | — | — | — | — | — | — | — | — | — | |
| TNBackbone=LLaMA 2-13B2026.01 | 1.5 | — | — | — | — | — | — | — | — | — | 2 | — | |
| QRNCABackbone=LLaMA 2-13B2026.01 | 1.5 | — | — | — | — | — | — | — | — | — | 3 | — | |
| TNBackbone=LLaMA 2-7B2026.01 | 0 | 9.5 | — | — | — | — | — | — | — | — | — | — | |
| ACTBackbone=LLaMA 2-7B2026.01 | 0 | 0 | — | — | — | — | — | — | — | — | — | — | |
| ACTBackbone=Baichuan 2-7B2026.01 | 0 | 0 | — | — | — | — | — | — | — | — | — | — | |
| RANDOMBackbone=Baichuan 2-7B2026.01 | 0 | 0 | — | — | — | — | — | — | — | — | — | — | |
| ACTBackbone=LLaMA 2-13B2026.01 | 0 | 0 | — | — | — | — | — | — | — | — | — | — | |
| RANDOMBackbone=LLaMA 2-13B2026.01 | 0 | 0 | — | — | — | — | — | — | — | — | — | — | |
| ACTBackbone=LLaMA 2-7B2026.01 | 0 | — | — | — | — | — | — | — | — | — | 0 | — | |
| RANDOMBackbone=LLaMA 2-7B2026.01 | 0 | — | — | — | — | — | — | — | — | — | 0.7 | — | |
| RANDOMBackbone=Baichuan 2-7B2026.01 | 0 | — | — | — | — | — | — | — | — | — | 0 | — | |
| ACTBackbone=LLaMA 2-13B2026.01 | 0 | — | — | — | — | — | — | — | — | — | 0 | — | |
| RANDOMBackbone=LLaMA 2-13B2026.01 | 0 | — | — | — | — | — | — | — | — | — | 0 | — | |
| 95BT-8BA BaselineActive Params=8.47B, Total Params=94.4B2026.01 | — | — | — | — | — | — | — | — | — | — | — | 74.32 | |
| Base2024.10 | — | 45.7 | 44.3 | 42.3 | 41.4 | 42.7 | 36.7 | 33.4 | 28.3 | 32.8 | — | — | |
| BaselineActive Params=8.09B, Total Params=72.6B2026.01 | — | — | — | — | — | — | — | — | — | — | — | 81.73 | |
| BTAdditional Information=Noise Position2024.10 | — | 47.7 | 23.5 | 28.3 | 32.5 | 28.1 | 11.6 | 11 | 15.8 | 12.8 | — | — | |
| CCAdditional Information=Clean Demo2024.10 | — | 48.3 | 45.7 | 43.6 | 44 | 44.4 | 42.1 | 40.8 | 40.5 | 41.1 | — | — | |
| CD-CoTAdditional Information=Clean Demo2024.10 | — | 49 | 50.3 | 54.7 | 50.3 | 51.8 | 51 | 49.7 | 49.7 | 50.1 | — | — | |
| Full Fine-TuningRank (r)=N/A, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 79.2 | |
| l-MoEaccActive Params=8.02B, Total Params=72.8B2026.01 | — | — | — | — | — | — | — | — | — | — | — | 82.1 | |
| ℓ-MoEaccActive Params=8.44B, Total Params=94.8B2026.01 | — | — | — | — | — | — | — | — | — | — | — | 75.18 | |
| l-MoEeffActive Params=5.91B, Total Params=72.8B2026.01 | — | — | — | — | — | — | — | — | — | — | — | 80.78 | |
| ℓ-MoEeffActive Params=5.62B, Total Params=94.8B2026.01 | — | — | — | — | — | — | — | — | — | — | — | 73.72 | |
| LoRARank (r)=16, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 66.56 | |
| LoRARank (r)=128, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 73.64 | |
| LoRA-αRank (r)=16, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 77.42 | |
| LoRA-αRank (r)=128, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 78.38 | |
| LoRA+Rank (r)=16, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 72.19 | |
| LoRA+Rank (r)=128, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 78.19 | |
| LoRAMRank (r)=16, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 75.19 | |
| LoRAMRank (r)=128, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 77.81 | |
| PiSSARank (r)=16, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 73.72 | |
| PiSSARank (r)=128, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 77.28 | |
| RsLoRARank (r)=16, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 73.24 | |
| RsLoRARank (r)=128, Backbone Model=Llama 2-7B2026.06 | — | — | — | — | — | — | — | — | — | — | — | 77.01 | |
| SCOAdditional Information=Ground Truth2024.10 | — | 63.5 | 60.1 | 56.1 | 60.3 | 58.8 | 56.2 | 58.5 | 57.9 | 57.5 | — | — |