Reasoning on Last Letter Concatenation zero-shot
70.1Accuracy (Zero-shot)NL-to-Format
Evaluation results
| Method | Links | |
|---|---|---|
| NL-to-FormatModel=LLaMA3-8B-it, Prompting=Zero-shot, Variations=92026.01 | 70.1 | |
| In-Writing-BaseModel=LLaMA3-8B-it, Prompting=Zero-shot, Variations=92026.01 | 69.1 | |
| In-Writing-BaseModel=Gemma2-9B-it, Prompting=Zero-shot, Variations=92026.01 | 65.9 | |
| NL-to-FormatModel=Gemma2-9B-it, Prompting=Zero-shot, Variations=92026.01 | 56.8 |