Mathematical Reasoning on Swahili and Telugu Math Reasoning (Medium)
35.2Accuracy (Swahili)Loop-Retry
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Loop-RetryTest-time control method=Loop-Retry, Backbone Model=Qwen3-4B2026.05 | 35.2 | 8.8 | 22 | 1.809 | 50.4 | 1.9 | |
| Formula-RetryTest-time control method=Formula-Retry, Backbone Model=Qwen3-4B2026.05 | 18.4 | 9.6 | 14 | 1.937 | 46.8 | 2 | |
| BaseTest-time control method=None, Backbone Model=Qwen3-4B2026.05 | 4.8 | 8 | 6.4 | 1.772 | 0 | 1 |