Schema Content Overlap on ARXIV2TABLE
55Precisioniterative batch-based generation method
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| iterative batch-based generation methodBackbone Model=GPT-o32025.04 | 55 | 62 | 58.3 | |
| iterative batch-based generation methodBackbone Model=GPT-4o, Chain of Thought=true2025.04 | 53 | 60.5 | 56.5 | |
| iterative batch-based generation methodBackbone Model=GPT-4o2025.04 | 51.5 | 59.4 | 55.2 | |
| Newman et al.Backbone Model=GPT-4o, Chain of Thought=true2025.04 | 47 | 49 | 48 | |
| iterative batch-based generation methodBackbone Model=GPT-4o-mini2025.04 | 46.5 | 59.7 | 52.3 | |
| iterative batch-based generation methodBackbone Model=Mistral-Large (123B)2025.04 | 45.4 | 56.7 | 50.4 | |
| Newman et al.Backbone Model=GPT-4o2025.04 | 45 | 47.9 | 46.4 | |
| iterative batch-based generation methodBackbone Model=LLaMa-3.3 (70B)2025.04 | 41.9 | 55.4 | 47.7 | |
| Newman et al.Backbone Model=GPT-4o-mini2025.04 | 40.3 | 45.9 | 42.9 | |
| Newman et al.Backbone Model=Mistral-Large (123B)2025.04 | 39.9 | 41.6 | 40.7 | |
| iterative batch-based generation methodBackbone Model=DeepSeek-V3 (685B)2025.04 | 39.6 | 56.9 | 46.7 | |
| Newman et al.Backbone Model=DeepSeek-V3 (685B)2025.04 | 39.4 | 44.2 | 41.7 | |
| Baseline 1Backbone Model=DeepSeek-V3 (685B)2025.04 | 38.7 | 41.7 | 40.1 | |
| Newman et al.Backbone Model=LLaMa-3.3 (70B)2025.04 | 36.4 | 40.5 | 38.3 | |
| Baseline 1Backbone Model=GPT-4o2025.04 | 35.8 | 43.2 | 39.2 | |
| Baseline 2Backbone Model=DeepSeek-V3 (685B)2025.04 | 34.9 | 69 | 46.4 | |
| Baseline 2Backbone Model=GPT-4o2025.04 | 34.2 | 68 | 45.5 | |
| Baseline 1Backbone Model=Mistral-Large (123B)2025.04 | 33.1 | 34.5 | 33.8 | |
| Baseline 1Backbone Model=GPT-4o-mini2025.04 | 32 | 35.7 | 33.7 | |
| Baseline 2Backbone Model=GPT-4o-mini2025.04 | 31.5 | 67.7 | 43 | |
| Baseline 1Backbone Model=LLaMa-3.3 (70B)2025.04 | 31.3 | 37.7 | 34.2 | |
| Baseline 2Backbone Model=Mistral-Large (123B)2025.04 | 27.4 | 65 | 38.5 | |
| Baseline 2Backbone Model=LLaMa-3.3 (70B)2025.04 | 26.7 | 69.3 | 38.5 |