Symbolic Music Reasoning on CSyMR-Bench (Total)
52.38AccuracyClaude-3.7-Sonnet
Evaluation Results
| Method | Links | |
|---|---|---|
| Claude-3.7-SonnetSetting=Direct LLM2025.12 | 52.38 | |
| GPT-4.1-miniSetting=Direct LLM2025.12 | 50.79 | |
| GPT-4.1Setting=Direct LLM2025.12 | 47.62 | |
| DS-V3.1Setting=Direct LLM2025.12 | 47.62 | |
| Gemini-1.5-ProSetting=Direct LLM2025.12 | 46.03 |