Mathematical Problem Solving on HMMT 2025
76.67AccuracyMajority Vote
Evaluation results
| Method | Links | |
|---|---|---|
| Majority VoteModel Pool=Gemini-2.5-flash2026.04 | 76.67 | |
| ParaManagerStrategy=Model Orchestration2026.04 | 75 | |
| Self RefineModel Pool=Gemini-2.5-flash2026.04 | 73.33 | |
| PuppeteerStrategy=Model Orchestration2026.04 | 73.33 | |
| ToolOrchestraStrategy=Model Orchestration2026.04 | 72.92 | |
| Majority VoteModel Pool=GPT-OSS-120B2026.04 | 66.67 | |
| BaseModel Pool=Gemini-2.5-flash2026.04 | 60.83 | |
| Self RefineModel Pool=GPT-OSS-120B2026.04 | 60 | |
| pass@32k=322026.06 | 56.7 | |
| Self RefineModel Pool=Qwen3-235B-A22B-Instruct-25072026.04 | 50.83 | |
| BaseModel Pool=Qwen3-235B-A22B-Instruct-25072026.04 | 50.42 | |
| Majority VoteModel Pool=Qwen3-235B-A22B-Instruct-25072026.04 | 50 | |
| BaseModel Pool=GPT-OSS-120B2026.04 | 48.33 | |
| iS@1k=12026.06 | 35 | |
| SCsamples=322026.06 | 30.8 | |
| pass@1k=12026.06 | 30.2 |