Mathematical Reasoning on Swahili and Telugu Math (Low Difficulty)
87.2Accuracy (Swahili)Formula-Retry
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Formula-RetryTest-time control method=Formula-Retry, Backbone Model=Qwen3-4B2026.05 | 87.2 | 75.2 | 81.2 | 0.311 | 10 | 1.1 | |
| Loop-RetryTest-time control method=Loop-Retry, Backbone Model=Qwen3-4B2026.05 | 74.4 | 74.4 | 74.4 | 0.395 | 22.4 | 1.31 | |
| BaseTest-time control method=None, Backbone Model=Qwen3-4B2026.05 | 45.6 | 64.8 | 55.2 | 0.522 | 0 | 1 |