Logical Reasoning on BBH (test)
88.29Top@1 AccuracyFAA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| FAABackbone Model=Deepseek R1-1.5B, Trainable Parameters=1.63M2025.12 | 88.29 | — | — | |
| FFBackbone Model=Deepseek R1-1.5B, Trainable Parameters=1.5B2025.12 | 88.27 | — | — | |
| AdapterHBackbone Model=Deepseek R1-1.5B, Trainable Parameters=1.63M2025.12 | 88.21 | — | — | |
| LoRABackbone Model=Deepseek R1-1.5B, Trainable Parameters=1.21M2025.12 | 88.17 | — | — | |
| FourierFTBackbone Model=Deepseek R1-1.5B, Trainable Parameters=0.15M2025.12 | 88.07 | — | — | |
| Full ReasoningBase Model=DeepSeek-R1-Qwen2.5-14b2026.01 | 85.25 | 92.34 | 1,287 | |
| SyncThinkBase Model=DeepSeek-R1-Qwen2.5-14b2026.01 | 83.84 | 58.65 | 817 | |
| T2TBackbone=LLaDA2.1-mini (16B MoE), Decoding Strategy=greedy decoding, Temperature=0, block length=322026.04 | 75.5 | — | — | |
| T2MBackbone=LLaDA2.1-mini (16B MoE), Decoding Strategy=greedy decoding, Temperature=0, block length=32, LOWPROB parameters=τ=0.3, Cmax=1, ρmax=0.252026.04 | 75.38 | — | — | |
| Full ReasoningBase Model=DeepSeek-R1-LLaMA3.1-8b2026.01 | 73.33 | 69.03 | 1,445 | |
| SyncThinkBase Model=DeepSeek-R1-LLaMA3.1-8b2026.01 | 67.68 | 38.24 | 796 | |
| FAABackbone Model=Qwen2 7B, Trainable Parameters=7.30M2025.12 | 67.1 | — | — | |
| LoRABackbone Model=Qwen2 7B, Trainable Parameters=5.40M2025.12 | 67.09 | — | — | |
| FourierFTBackbone Model=Qwen2 7B, Trainable Parameters=0.85M2025.12 | 67.05 | — | — | |
| AdapterHBackbone Model=Qwen2 7B, Trainable Parameters=7.29M2025.12 | 66.89 | — | — | |
| FFBackbone Model=Qwen2 7B, Trainable Parameters=7.07B2025.12 | 66.74 | — | — | |
| Full ReasoningBase Model=DeepSeek-R1-Qwen2.5-7b2026.01 | 65.86 | 44.65 | 1,005 | |
| SyncThinkBase Model=DeepSeek-R1-Qwen2.5-7b2026.01 | 63.03 | 24.46 | 541 | |
| No ReasoningBase Model=DeepSeek-R1-Qwen2.5-7b2026.01 | 61.21 | 16.08 | 362 | |
| FAABackbone Model=LLaMA3 8B, Trainable Parameters=8.73M2025.12 | 56.89 | — | — | |
| FFBackbone Model=LLaMA3 8B, Trainable Parameters=8.03B2025.12 | 56.87 | — | — | |
| FourierFTBackbone Model=LLaMA3 8B, Trainable Parameters=0.91M2025.12 | 56.85 | — | — | |
| AdapterHBackbone Model=LLaMA3 8B, Trainable Parameters=8.73M2025.12 | 56.82 | — | — | |
| LoRABackbone Model=LLaMA3 8B, Trainable Parameters=6.47M2025.12 | 56.81 | — | — | |
| FAABackbone Model=LLaMA2 7B, Trainable Parameters=7.27M2025.12 | 43.71 | — | — | |
| LoRABackbone Model=LLaMA2 7B, Trainable Parameters=5.37M2025.12 | 43.68 | — | — | |
| FFBackbone Model=LLaMA2 7B, Trainable Parameters=6.94B2025.12 | 43.67 | — | — | |
| AdapterHBackbone Model=LLaMA2 7B, Trainable Parameters=7.27M2025.12 | 43.65 | — | — | |
| FourierFTBackbone Model=LLaMA2 7B, Trainable Parameters=0.82M2025.12 | 43.62 | — | — |