General Reasoning and Coding on GPQA, GSM8K, MATH, and MBPP suite
24.15DeltaRepE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RepEBackbone=MoE, Adapter type=LoRA2026.06 | 24.15 | — | — | |
| AdapterFusionBackbone=Q8B, Adapter type=LoRA2026.06 | 2.9 | — | — | |
| AdapterFusionBackbone=DS32B, Adapter type=LoRA2026.06 | 2.71 | — | — | |
| TALAN+LoRABackbone=Q8B, Adapter type=LoRA2026.06 | 2.67 | — | — | |
| DELIFTBackbone=Q8B, Adapter type=LoRA2026.06 | 1.79 | — | — | |
| RepEBackbone=Q8B, Adapter type=LoRA2026.06 | 1.76 | — | — | |
| AdapterFusionBackbone=Q32B, Adapter type=LoRA2026.06 | 1.52 | — | — | |
| TALAN+LoRABackbone=DS32B, Adapter type=LoRA2026.06 | 1.49 | — | — | |
| DoRABackbone=DS32B, Adapter type=LoRA2026.06 | 1.27 | — | — | |
| DELIFTBackbone=DS32B, Adapter type=LoRA2026.06 | 1.07 | — | — | |
| TALAN+LoRABackbone=MoE, Adapter type=LoRA2026.06 | 1.04 | — | — | |
| DoRABackbone=Q8B, Adapter type=LoRA2026.06 | 0.83 | — | — | |
| CogSteerBackbone=Q8B, Adapter type=LoRA2026.06 | 0.71 | — | — | |
| CogSteerBackbone=MoE, Adapter type=LoRA2026.06 | 0.7 | — | — | |
| AdapterFusionBackbone=MoE, Adapter type=LoRA2026.06 | 0.56 | — | — | |
| RepEBackbone=DS32B, Adapter type=LoRA2026.06 | 0.45 | — | — | |
| DELIFTBackbone=MoE, Adapter type=LoRA2026.06 | 0.44 | — | — | |
| TALAN+LoRABackbone=Q32B, Adapter type=LoRA2026.06 | 0.43 | — | — | |
| DELIFTBackbone=Q32B, Adapter type=LoRA2026.06 | 0.11 | — | — | |
| CogSteerBackbone=Q32B, Adapter type=LoRA2026.06 | 0.07 | — | — | |
| CogSteerBackbone=DS32B, Adapter type=LoRA2026.06 | 0.05 | — | — | |
| RepEBackbone=Q32B, Adapter type=LoRA2026.06 | 0.03 | — | — | |
| DoRABackbone=Q32B, Adapter type=LoRA2026.06 | 0.03 | — | — | |
| DoRABackbone=MoE, Adapter type=LoRA2026.06 | 0.02 | — | — | |
| LoRA baselineBackbone=Q32B, Adapter type=LoRA2026.06 | 0 | — | — | |
| LoRA baselineBackbone=DS32B, Adapter type=LoRA2026.06 | 0 | — | — | |
| LoRA baselineBackbone=Q8B, Adapter type=LoRA2026.06 | 0 | — | — | |
| LoRA baselineBackbone=MoE, Adapter type=LoRA2026.06 | 0 | — | — | |
| AdapterFusionBackbone=Aggregate, Adapter type=LoRA2026.06 | — | 0.88 | — | |
| CogSteerBackbone=Aggregate, Adapter type=LoRA2026.06 | — | 0 | — | |
| DELIFTBackbone=Aggregate, Adapter type=LoRA2026.06 | — | 0.8 | — | |
| DoRABackbone=Aggregate, Adapter type=LoRA2026.06 | — | 0.52 | — | |
| LoRA baselineBackbone=Aggregate, Adapter type=LoRA2026.06 | — | 0 | — | |
| RepEBackbone=Aggregate, Adapter type=LoRA2026.06 | — | 5.72 | — | |
| TALAN+LoRABackbone=Aggregate, Adapter type=LoRA2026.06 | — | 1.41 | — |