Reasoning on ARC Hard
1.22Accuracy ImprovementN-GRAM SAMPLING
Evaluation Results
| Method | Links | |
|---|---|---|
| N-GRAM SAMPLINGNumber of Parameters=350M2025.06 | 1.22 | |
| N-GRAM SAMPLINGNumber of Parameters=1.5B2025.06 | 0.82 | |
| N-GRAM SAMPLINGNumber of Parameters=3B2025.06 | 0.72 | |
| PPL SAMPLINGNumber of Parameters=350M2025.06 | 0.6 | |
| AUTOMIXER-350MNumber of Parameters=350M2025.06 | 0.55 | |
| PPL SAMPLINGNumber of Parameters=1.5B2025.06 | 0.52 | |
| AUTOMIXER-350MNumber of Parameters=1.5B2025.06 | 0.39 | |
| AUTOMIXER-350MNumber of Parameters=3B2025.06 | 0.34 | |
| PPL SAMPLINGNumber of Parameters=3B2025.06 | 0.32 | |
| AUTOMIXER-75MNumber of Parameters=350M2025.06 | 0.12 | |
| AUTOMIXER-75MNumber of Parameters=1.5B2025.06 | 0.01 | |
| AUTOMIXER-75MNumber of Parameters=3B2025.06 | 0.01 |