Mathematical Word Problem Solving on SVAMP (Robustness Metrics)
100Accuracy under AttackReporting-and-penalty mechanism
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Reporting-and-penalty mechanismAttack Type=All Attack Types, LLM Model=All Above Models2026.04 | 100 | 100 | |
| GroupGuardAttack Type=False Consensus, LLM Model=Deepseek-V3.12026.04 | 55 | 98 | |
| GroupGuardAttack Type=False Consensus, LLM Model=Qwen3-32B2026.04 | 52 | 83 | |
| GroupGuardAttack Type=False Consensus, LLM Model=Qwen3-235B2026.04 | 51 | 77 |