General Reasoning on BBH (SR %)
85.6Success Rate (BBH General Reasoning)LC-ERD (Dual-72B)
Evaluation results
| Method | Links | |
|---|---|---|
| LC-ERD (Dual-72B)#Params=144B, VRAM (Avg.)=~112GB, Time (Rel.)=~2.1x, Multi-agent or MARL framework=true2026.05 | 85.6 | |
| LC-ERD (72B)#Params=72B, VRAM (Avg.)=~56GB, Time (Rel.)=~1.8x, Multi-agent or MARL framework=true2026.05 | 82.4 | |
| PRM#Params=72B+, VRAM (Avg.)=~64GB, Time (Rel.)=~1.6x, Multi-agent or MARL framework=true2026.05 | 80.4 | |
| InfiGUI-R1#Params=72B, VRAM (Avg.)=~63GB, Time (Rel.)=~1.3x, Multi-agent or MARL framework=true2026.05 | 78.4 | |
| MaAS#Params=72B+, VRAM (Avg.)=~60GB, Time (Rel.)=~2.1x, Multi-agent or MARL framework=true2026.05 | 75.6 | |
| AFlow#Params=72B+, VRAM (Avg.)=~64GB, Time (Rel.)=~3.2x, Multi-agent or MARL framework=true2026.05 | 73.1 | |
| Gen-Verifier#Params=72B, VRAM (Avg.)=~68GB, Time (Rel.)=~2.1x2026.05 | 72.6 | |
| EndoRM#Params=72B, VRAM (Avg.)=~54GB, Time (Rel.)=~1.4x2026.05 | 71.5 | |
| LPO#Params=72B, VRAM (Avg.)=~52GB, Time (Rel.)=~1.5x2026.05 | 71.3 | |
| STaR#Params=72B, VRAM (Avg.)=~58GB, Time (Rel.)=~2.5x, Multi-agent or MARL framework=true2026.05 | 70.4 | |
| Iterative-DPO#Params=72B, VRAM (Avg.)=~56GB, Time (Rel.)=~2.1x2026.05 | 68.4 | |
| SimPO#Params=72B, VRAM (Avg.)=~52GB, Time (Rel.)=~1.1x2026.05 | 67.5 | |
| DPO#Params=72B, VRAM (Avg.)=~52GB, Time (Rel.)=~1.8x2026.05 | 66.8 | |
| Qwen2.5-72B (Base)#Params=72B, VRAM (Avg.)=~52GB, Time (Rel.)=1.0x (SFT)2026.05 | 64.2 |