Reasoning on GSM8K zero-shot (accuracy)
86.9AccuracyIn-Writing-Base
Evaluation results
| Method | Links | |
|---|---|---|
| In-Writing-BaseModel=Gemma2-9B-it, Prompting=Zero-shot, Variations=92026.01 | 86.9 | |
| NL-to-FormatModel=Gemma2-9B-it, Prompting=Zero-shot, Variations=92026.01 | 86.5 | |
| In-Writing-BaseModel=LLaMA3-8B-it, Prompting=Zero-shot, Variations=92026.01 | 77.9 | |
| NL-to-FormatModel=LLaMA3-8B-it, Prompting=Zero-shot, Variations=92026.01 | 74.7 |