Reasoning on Shuffled Objects zero-shot
50.8AccuracyIn-Writing-Base
Evaluation results
| Method | Links | |
|---|---|---|
| In-Writing-BaseModel=Gemma2-9B-it, Prompting=Zero-shot, Variations=92026.01 | 50.8 | |
| NL-to-FormatModel=Gemma2-9B-it, Prompting=Zero-shot, Variations=92026.01 | 49.4 | |
| In-Writing-BaseModel=LLaMA3-8B-it, Prompting=Zero-shot, Variations=92026.01 | 39 | |
| NL-to-FormatModel=LLaMA3-8B-it, Prompting=Zero-shot, Variations=92026.01 | 27 |