Symbolic Music Reasoning on CSyMR-Bench (Reddit)
61.17AccuracyClaude-3.7-Sonnet
Evaluation Results
| Method | Links | |
|---|---|---|
| Claude-3.7-SonnetSetting=Direct LLM2025.12 | 61.17 | |
| GPT-4.1-miniSetting=Direct LLM2025.12 | 56.47 | |
| DS-V3.1Setting=Direct LLM2025.12 | 55.29 | |
| GPT-4.1Setting=Direct LLM2025.12 | 54.12 | |
| Gemini-1.5-ProSetting=Direct LLM2025.12 | 54.12 |