Logic Consistency Evaluation on Aggregate of 16 tasks
93.5LCS (Avg)LC-ERD (Dual-72B)
Evaluation results
| Method | Links | |
|---|---|---|
| LC-ERD (Dual-72B)#Params=144B, VRAM (Avg.)=~112GB, Time (Rel.)=~2.1x, Multi-agent or MARL framework=true2026.05 | 93.5 | |
| LC-ERD (72B)#Params=72B, VRAM (Avg.)=~56GB, Time (Rel.)=~1.8x, Multi-agent or MARL framework=true2026.05 | 91.2 | |
| PRM#Params=72B+, VRAM (Avg.)=~64GB, Time (Rel.)=~1.6x, Multi-agent or MARL framework=true2026.05 | 79.8 | |
| MaAS#Params=72B+, VRAM (Avg.)=~60GB, Time (Rel.)=~2.1x, Multi-agent or MARL framework=true2026.05 | 74.3 | |
| AFlow#Params=72B+, VRAM (Avg.)=~64GB, Time (Rel.)=~3.2x, Multi-agent or MARL framework=true2026.05 | 68.2 | |
| InfiGUI-R1#Params=72B, VRAM (Avg.)=~63GB, Time (Rel.)=~1.3x, Multi-agent or MARL framework=true2026.05 | 65.5 | |
| EndoRM#Params=72B, VRAM (Avg.)=~54GB, Time (Rel.)=~1.4x2026.05 | 62.4 | |
| Gen-Verifier#Params=72B, VRAM (Avg.)=~68GB, Time (Rel.)=~2.1x2026.05 | 61.8 | |
| LPO#Params=72B, VRAM (Avg.)=~52GB, Time (Rel.)=~1.5x2026.05 | 61.2 | |
| STaR#Params=72B, VRAM (Avg.)=~58GB, Time (Rel.)=~2.5x, Multi-agent or MARL framework=true2026.05 | 59.6 | |
| SimPO#Params=72B, VRAM (Avg.)=~52GB, Time (Rel.)=~1.1x2026.05 | 55.6 | |
| Iterative-DPO#Params=72B, VRAM (Avg.)=~56GB, Time (Rel.)=~2.1x2026.05 | 54.6 | |
| DPO#Params=72B, VRAM (Avg.)=~52GB, Time (Rel.)=~1.8x2026.05 | 51.2 | |
| Qwen2.5-72B (Base)#Params=72B, VRAM (Avg.)=~52GB, Time (Rel.)=1.0x (SFT)2026.05 | 48.1 |