Web Information Extraction on LIVEWEB-IE Type II 1.0 (test)
0.8556PrecisionHuman
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Human2026.03 | 0.8556 | 0.9405 | 0.8606 | |
| VGSModel=GPT -4o2026.03 | 0.4467 | 0.5549 | 0.4635 | |
| VGSModel=Gemini-2.5-Flash2026.03 | 0.4236 | 0.5376 | 0.4482 | |
| AutoScraperModel=GPT -4o2026.03 | 0.4193 | 0.5279 | 0.4265 | |
| ReflexionModel=Gemini-2.5-Flash2026.03 | 0.3987 | 0.3959 | 0.394 | |
| VGSModel=Qwen-2.5-32B2026.03 | 0.3978 | 0.4007 | 0.3783 | |
| COTModel=GPT -4o2026.03 | 0.3953 | 0.4951 | 0.4084 | |
| ReflexionModel=GPT -4o2026.03 | 0.3946 | 0.4354 | 0.3964 | |
| VGSModel=Qwen-2.5-72B2026.03 | 0.3738 | 0.6063 | 0.411 | |
| AutoScraperModel=Qwen-2.5-32B2026.03 | 0.3542 | 0.4648 | 0.362 | |
| AutoScraperModel=Qwen-2.5-72B2026.03 | 0.3353 | 0.5169 | 0.3761 | |
| COTModel=Qwen-2.5-32B2026.03 | 0.3249 | 0.3736 | 0.3208 | |
| VGSModel=GPT -4o-mini2026.03 | 0.3237 | 0.463 | 0.3332 | |
| COTModel=Gemini-2.5-Flash2026.03 | 0.3219 | 0.548 | 0.3517 | |
| COTModel=GPT -4o-mini2026.03 | 0.3186 | 0.5423 | 0.348 | |
| AutoScraperModel=Gemini-2.5-Flash2026.03 | 0.3147 | 0.5576 | 0.3439 | |
| AutoScraperModel=GPT -4o-mini2026.03 | 0.3114 | 0.5517 | 0.3403 | |
| ReflexionModel=Qwen-2.5-32B2026.03 | 0.309 | 0.4848 | 0.3305 | |
| COTModel=Qwen-2.5-72B2026.03 | 0.3018 | 0.4569 | 0.3387 | |
| ReflexionModel=Qwen-2.5-72B2026.03 | 0.3015 | 0.3529 | 0.3138 | |
| ReflexionModel=GPT -4o-mini2026.03 | 0.2484 | 0.3137 | 0.2595 | |
| VGSModel=Gemma-3-27B2026.03 | 0.2375 | 0.6127 | 0.2846 | |
| VGSModel=Qwen-2.5-7B2026.03 | 0.23 | 0.4367 | 0.235 | |
| VGSModel=Gemma-3-4B2026.03 | 0.2103 | 0.2766 | 0.2233 | |
| AutoScraperModel=Gemma-3-27B2026.03 | 0.1951 | 0.5335 | 0.2287 | |
| AutoScraperModel=Qwen-2.5-7B2026.03 | 0.1941 | 0.4157 | 0.1953 | |
| COTModel=Gemma-3-27B2026.03 | 0.1706 | 0.4696 | 0.2007 | |
| ReflexionModel=Gemma-3-27B2026.03 | 0.1524 | 0.2573 | 0.1635 | |
| ReflexionModel=Qwen-2.5-7B2026.03 | 0.1219 | 0.1975 | 0.133 | |
| AutoScraperModel=Gemma-3-4B2026.03 | 0.1154 | 0.3019 | 0.1404 | |
| ReflexionModel=Gemma-3-4B2026.03 | 0.1054 | 0.3 | 0.1361 | |
| COTModel=Qwen-2.5-7B2026.03 | 0.0944 | 0.1625 | 0.0982 | |
| COTModel=Gemma-3-4B2026.03 | 0.0381 | 0.1011 | 0.0471 |