JSON to Zen Grid Translation on Zen Grid Generation 1.0 (test)
100ValidityGPT-5-mini
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-5-miniFamily=OpenAI, Prompting Strategy=Few-shot2026.04 | 100 | |
| GPT-5-miniFamily=OpenAI, Prompting Strategy=Zero-shot2026.04 | 100 | |
| GPT-5.1Family=OpenAI, Prompting Strategy=Few-shot2026.04 | 100 | |
| GPT-5.1Family=OpenAI, Prompting Strategy=Zero-shot2026.04 | 100 | |
| GPT-4oFamily=OpenAI, Prompting Strategy=Few-shot2026.04 | 100 | |
| GPT-4oFamily=OpenAI, Prompting Strategy=Zero-shot2026.04 | 100 | |
| Claude Sonnet 4Family=Anthropic, Prompting Strategy=Few-shot2026.04 | 100 | |
| Claude Sonnet 4Family=Anthropic, Prompting Strategy=Zero-shot2026.04 | 100 | |
| Claude 3.5 HaikuFamily=Anthropic, Prompting Strategy=Few-shot2026.04 | 100 | |
| Claude 3.5 HaikuFamily=Anthropic, Prompting Strategy=Zero-shot2026.04 | 100 | |
| Claude 3 HaikuFamily=Anthropic, Prompting Strategy=Few-shot2026.04 | 100 | |
| Claude 3 HaikuFamily=Anthropic, Prompting Strategy=Zero-shot2026.04 | 100 | |
| Gemini 2.5 FlashFamily=Google, Prompting Strategy=Few-shot2026.04 | 100 | |
| Gemini 2.5 FlashFamily=Google, Prompting Strategy=Zero-shot2026.04 | 100 | |
| Gemini 2.5 ProFamily=Google, Prompting Strategy=Few-shot2026.04 | 100 | |
| Gemini 2.5 ProFamily=Google, Prompting Strategy=Zero-shot2026.04 | 100 | |
| Gemini 3 FlashFamily=Google, Prompting Strategy=Few-shot2026.04 | 100 | |
| Gemini 3 FlashFamily=Google, Prompting Strategy=Zero-shot2026.04 | 100 | |
| Llama 3.3 70BFamily=Meta, Prompting Strategy=Few-shot2026.04 | 100 | |
| Llama 3.3 70BFamily=Meta, Prompting Strategy=Zero-shot2026.04 | 100 | |
| Llama 4 ScoutFamily=Meta, Prompting Strategy=Few-shot2026.04 | 100 | |
| Llama 4 ScoutFamily=Meta, Prompting Strategy=Zero-shot2026.04 | 100 | |
| Kimi K2Family=Moonshot, Prompting Strategy=Few-shot2026.04 | 100 | |
| Kimi K2Family=Moonshot, Prompting Strategy=Zero-shot2026.04 | 100 | |
| Overall (12 models)Prompting Strategy=Few-shot2026.04 | 100 | |
| Overall (12 models)Prompting Strategy=Zero-shot2026.04 | 100 |