Spreadsheet Manipulation on SpreadsheetBench
57.7Pass@1Copilot Agent Mode
Evaluation results
| Method | Links | |
|---|---|---|
| Copilot Agent ModeEnvironment Access=Windows, Excel2026.05 | 57.7 | |
| ChatGPT agent with .xlsx accessEnvironment Access=OSX, LibreOffice2026.05 | 45.5 | |
| Claude Files Opus 4.1Environment Access=Windows, Excel2026.05 | 42.9 | |
| ChatGPT agentEnvironment Access=OSX, LibreOffice2026.05 | 35.3 | |
| Qwen3-4B-Thinking-2507 + Spreadsheet-RL post-trainingEnvironment Access=Spreadsheet Gym2026.05 | 23.4 | |
| OpenAI o3Environment Access=OSX, LibreOffice2026.05 | 23.3 | |
| Qwen3-4B-Thinking-2507 + Comprehensive spreadsheet-tool accessEnvironment Access=Spreadsheet Gym2026.05 | 19.3 | |
| GPT-4oEnvironment Access=Windows, Excel2026.05 | 18.4 | |
| Qwen3-32BEnvironment Access=Spreadsheet Gym2026.05 | 17.6 | |
| GPT-4oEnvironment Access=OSX, LibreOffice2026.05 | 16.8 | |
| Qwen3-8BEnvironment Access=Spreadsheet Gym2026.05 | 15.9 | |
| Qwen3-4B-Thinking-2507 + Spreadsheet-native interaction harnessEnvironment Access=Spreadsheet Gym2026.05 | 15.6 | |
| Qwen3-14BEnvironment Access=Spreadsheet Gym2026.05 | 15 | |
| Qwen3-4B-Thinking-2507Environment Access=Spreadsheet Gym2026.05 | 12 | |
| Qwen3-4BEnvironment Access=Spreadsheet Gym2026.05 | 11 | |
| Qwen3-4B-Instruct-2507Environment Access=Spreadsheet Gym2026.05 | 9.3 |