Web Information Extraction on LIVEWEB-IE Type I 1.0 (test)
83.31PrecisionHuman
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Human2026.03 | 83.31 | 92.4 | 87.13 | |
| VGSModel=GPT -4o, Setting=Zero-shot2026.03 | 64.51 | 69.78 | 65.87 | |
| AutoScraperModel=GPT -4o, Setting=Zero-shot2026.03 | 53.23 | 59.52 | 55.22 | |
| VGSModel=GPT -4o-mini, Setting=Zero-shot2026.03 | 49.11 | 57.55 | 50.36 | |
| VGSModel=Qwen-2.5-72B, Setting=Zero-shot2026.03 | 48.09 | 53.96 | 48.63 | |
| VGSModel=Gemini-2.5-Flash, Setting=Zero-shot2026.03 | 47.83 | 55.85 | 49.02 | |
| ReflexionModel=GPT -4o, Setting=Zero-shot2026.03 | 47.75 | 50.75 | 48.75 | |
| VGSModel=Qwen-2.5-32B, Setting=Zero-shot2026.03 | 46.85 | 52.45 | 46.76 | |
| COTModel=GPT -4o, Setting=Zero-shot2026.03 | 45.96 | 52.83 | 47.54 | |
| AutoScraperModel=Qwen-2.5-32B, Setting=Zero-shot2026.03 | 40.63 | 44.72 | 41.07 | |
| AutoScraperModel=Qwen-2.5-72B, Setting=Zero-shot2026.03 | 38.03 | 61.04 | 41.71 | |
| VGSModel=Qwen-2.5-7B, Setting=Zero-shot2026.03 | 37.99 | 47.36 | 37.31 | |
| ReflexionModel=Qwen-2.5-32B, Setting=Zero-shot2026.03 | 37.3 | 44.91 | 37.57 | |
| VGSModel=Gemma-3-27B, Setting=Zero-shot2026.03 | 36.99 | 50 | 38.72 | |
| ReflexionModel=Gemma-3-27B, Setting=Zero-shot2026.03 | 36.71 | 44.31 | 37.84 | |
| ReflexionModel=Qwen-2.5-7B, Setting=Zero-shot2026.03 | 36.56 | 46.98 | 38.12 | |
| AutoScraperModel=Gemini-2.5-Flash, Setting=Zero-shot2026.03 | 36.52 | 42.35 | 37.25 | |
| AutoScraperModel=Qwen-2.5-7B, Setting=Zero-shot2026.03 | 36 | 42.08 | 36.75 | |
| COTModel=Qwen-2.5-72B, Setting=Zero-shot2026.03 | 35.77 | 57.93 | 39.98 | |
| AutoScraperModel=GPT -4o-mini, Setting=Zero-shot2026.03 | 35.1 | 43.23 | 36.25 | |
| COTModel=Qwen-2.5-7B, Setting=Zero-shot2026.03 | 34.41 | 43.21 | 35.08 | |
| AutoScraperModel=Gemma-3-27B, Setting=Zero-shot2026.03 | 33.5 | 45.85 | 34.63 | |
| ReflexionModel=Gemini-2.5-Flash, Setting=Zero-shot2026.03 | 33 | 48.31 | 35.96 | |
| COTModel=GPT -4o-mini, Setting=Zero-shot2026.03 | 32.15 | 41.08 | 33.41 | |
| COTModel=Gemini-2.5-Flash, Setting=Zero-shot2026.03 | 32.04 | 49.01 | 34.36 | |
| ReflexionModel=GPT -4o-mini, Setting=Zero-shot2026.03 | 31.97 | 38.15 | 33.17 | |
| COTModel=Gemma-3-27B, Setting=Zero-shot2026.03 | 31.53 | 47.08 | 32.63 | |
| ReflexionModel=Qwen-2.5-72B, Setting=Zero-shot2026.03 | 30.32 | 33.69 | 31.33 | |
| COTModel=Qwen-2.5-32B, Setting=Zero-shot2026.03 | 28.83 | 42.59 | 30.78 | |
| VGSModel=Gemma-3-4B, Setting=Zero-shot2026.03 | 19.97 | 21.47 | 20.1 | |
| AutoScraperModel=Gemma-3-4B, Setting=Zero-shot2026.03 | 14.3 | 18.06 | 14.95 | |
| ReflexionModel=Gemma-3-4B, Setting=Zero-shot2026.03 | 12.19 | 15.94 | 12.45 | |
| COTModel=Gemma-3-4B, Setting=Zero-shot2026.03 | 12.14 | 25.23 | 14.62 |