Executable spreadsheet operations on SheetCopilot
99.8Exec@1TabClaw
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TabClawCategory=Ours, Backbone=DeepSeek-v3.22026.06 | 99.8 | 77.4 | |
| SpreadsheetLLMCategory=Context Augmentation, Backbone=DeepSeek-v3.22026.06 | 98.7 | 71.5 | |
| NormTabCategory=Context Augmentation, Backbone=DeepSeek-v3.22026.06 | 97.5 | 72.8 | |
| ReActCategory=Autonomous Agent, Backbone=DeepSeek-v3.22026.06 | 96.8 | 72.6 | |
| BinderCategory=Context Augmentation, Backbone=DeepSeek-v3.22026.06 | 96.5 | 69.3 | |
| VanillaCategory=Direct Inference, Backbone=DeepSeek-v3.22026.06 | 95.5 | 69.4 | |
| SheetAgentCategory=Autonomous Agent, Backbone=DeepSeek-v3.22026.06 | 93.3 | 61.3 | |
| Chain-of-TableCategory=Context Augmentation, Backbone=DeepSeek-v3.22026.06 | 87.1 | 61.3 |