Tabular Data Processing on ProfiliTable single-step 1.0 (test)
89.66ATSProfiliTable
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| ProfiliTableBase Model=gpt-5.2, Avg. Tokens=24,907, Avg. Time (s)=130.262026.05 | 89.66 | 73.33 | 94.44 | 97.78 | 88.62 | — | 87.88 | |
| ProfiliTableBase Model=gpt-4o, Avg. Tokens=25,794, Avg. Time (s)=51.442026.05 | 86.82 | 68.89 | 93.33 | 97.78 | 86.31 | — | 84.72 | |
| ChatDev2.0Base Model=gpt-5.2, Avg. Tokens=120,849, Avg. Time (s)=170.082026.05 | 70.02 | 60 | 75.56 | 83.33 | 72.35 | — | 72.82 | |
| DataGovAgentBase Model=gpt-5.2, Avg. Tokens=29,965, Avg. Time (s)=72.422026.05 | 67.94 | 61.11 | 74.44 | 82.22 | 73.23 | — | 80.43 | |
| MetaGPTBase Model=gpt-5.2, Avg. Tokens=74,985, Avg. Time (s)=115.052026.05 | 67.31 | 54.44 | 73.33 | 87.78 | 70.37 | — | 68.97 | |
| CAMELBase Model=gpt-5.2, Avg. Tokens=36,828, Avg. Time (s)=72.742026.05 | 61.14 | 47.78 | 68.89 | 82.22 | 66.66 | — | 73.27 | |
| MetaGPTBase Model=gpt-4o, Avg. Tokens=15,241, Avg. Time (s)=69.182026.05 | 56.21 | 44.44 | 62.22 | 75.56 | 59.22 | — | 57.66 | |
| ChatDev2.0Base Model=gpt-4o, Avg. Tokens=114,785, Avg. Time (s)=133.232026.05 | 55.89 | 44.44 | 61.11 | 70 | 56.79 | — | 52.5 | |
| DataGovAgentBase Model=gpt-4o, Avg. Tokens=28,501, Avg. Time (s)=51.562026.05 | 52.34 | 45.56 | 56.67 | 67.78 | 55.36 | — | 54.46 | |
| CAMELBase Model=gpt-4o, Avg. Tokens=82,845, Avg. Time (s)=70.562026.05 | 46.83 | 33.33 | 54.44 | 72.22 | 50.33 | — | 44.83 | |
| CleanAgentBase Model=gpt-5.2, Avg. Tokens=33,497, Avg. Time (s)=44.752026.05 | 45.91 | 35.56 | 53.33 | 86.67 | 54.42 | — | 50.64 | |
| DeepAnalyzeFramework=DeepAnalyze, Backbone=ds-0528-qwen3-8b, Fine-tuning (CoT)=true2026.05 | 44.47 | 32.22 | 54.44 | 85.56 | 54.17 | 39.36 | — | |
| CleanAgentBase Model=gpt-4o, Avg. Tokens=18,043, Avg. Time (s)=17.932026.05 | 37.03 | 30 | 46.67 | 78.89 | 49.95 | — | 57.14 |