Web Information Extraction on LIVEWEB-IE Type IV 1.0 (test)
82.74PrecisionHuman
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Human2026.03 | 82.74 | 87.51 | 84.14 | |
| VGSModel=GPT -4o2026.03 | 41.33 | 41.86 | 41.5 | |
| VGSModel=Gemini-2.5-Flash2026.03 | 38.6 | 38.32 | 38.13 | |
| VGSModel=Gemma-3-27B2026.03 | 33.58 | 29.65 | 28.46 | |
| VGSModel=Qwen-2.5-72B2026.03 | 30.42 | 31.91 | 31.06 | |
| VGSModel=GPT -4o-mini2026.03 | 30.29 | 30.72 | 29.68 | |
| VGSModel=Qwen-2.5-32B2026.03 | 28.09 | 38.31 | 28.67 | |
| AutoScraperModel=Gemini-2.5-Flash2026.03 | 14.36 | 23.75 | 9.66 | |
| AutoScraperModel=GPT -4o-mini2026.03 | 13.67 | 22.62 | 9.2 | |
| VGSModel=Qwen-2.5-7B2026.03 | 13.07 | 15.28 | 13.58 | |
| ReflexionModel=Gemini-2.5-Flash2026.03 | 12.83 | 23.11 | 8.67 | |
| AutoScraperModel=GPT -4o2026.03 | 12.6 | 13.37 | 6.92 | |
| COTModel=Qwen-2.5-72B2026.03 | 12.42 | 18.75 | 11.49 | |
| COTModel=GPT -4o-mini2026.03 | 12.22 | 22.01 | 8.26 | |
| COTModel=GPT -4o2026.03 | 11.2 | 16.7 | 7.24 | |
| AutoScraperModel=Gemma-3-27B2026.03 | 10.92 | 13.36 | 10.31 | |
| COTModel=Gemini-2.5-Flash2026.03 | 10.16 | 10.9 | 7.4 | |
| AutoScraperModel=Qwen-2.5-72B2026.03 | 9.83 | 17.69 | 9.59 | |
| ReflexionModel=GPT -4o-mini2026.03 | 9.68 | 10.38 | 7.05 | |
| ReflexionModel=Gemma-3-27B2026.03 | 9.28 | 15.83 | 9.27 | |
| ReflexionModel=Qwen-2.5-32B2026.03 | 7.53 | 13.38 | 7.98 | |
| ReflexionModel=GPT -4o2026.03 | 7.24 | 3.69 | 3.76 | |
| AutoScraperModel=Gemma-3-4B2026.03 | 7.08 | 17.94 | 7.61 | |
| ReflexionModel=Qwen-2.5-72B2026.03 | 6.53 | 7.94 | 4.95 | |
| COTModel=Gemma-3-27B2026.03 | 6.15 | 17.24 | 7.29 | |
| AutoScraperModel=Qwen-2.5-32B2026.03 | 5.48 | 9.27 | 5.22 | |
| ReflexionModel=Qwen-2.5-7B2026.03 | 5.03 | 16.55 | 5.5 | |
| VGSModel=Gemma-3-4B2026.03 | 4.98 | 29.53 | 7.19 | |
| ReflexionModel=Gemma-3-4B2026.03 | 4.19 | 4.79 | 4.21 | |
| COTModel=Qwen-2.5-32B2026.03 | 4.04 | 10.67 | 4.61 | |
| AutoScraperModel=Qwen-2.5-7B2026.03 | 3.77 | 21.55 | 5.9 | |
| COTModel=Qwen-2.5-7B2026.03 | 2.28 | 8.16 | 3.45 | |
| COTModel=Gemma-3-4B2026.03 | 0.6 | 1.19 | 0.79 |