# Web Information Extraction on LIVEWEB-IE Type I 1.0 (test) Source: [Web Information Extraction on LIVEWEB-IE Type I 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-03-17T08:40:21.187Z Evaluation of Web Information Extraction performance on the test split of the LIVEWEB-IE Type I 1.0 dataset, measured using Precision, Recall, and F1 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Web Information Extraction | | Dataset (including any stated split) | LIVEWEB-IE Type I 1.0 (test) | | Metric | Precision | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 33 of 33 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Precision](): Higher is better; unit: PERCENT. - [Recall](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Precision | Result date | Report paper | | --- | --- | --- | --- | | Human | 83.31 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 64.51 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 53.23 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 49.11 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 48.09 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 47.83 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 47.75 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 46.85 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 45.96 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 40.63 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 38.03 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 37.99 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 37.3 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 36.99 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 36.71 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 36.56 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 36.52 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 36 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 35.77 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 35.1 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 34.41 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 33.5 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 33 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 32.15 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 32.04 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 31.97 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 31.53 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 30.32 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 28.83 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 19.97 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 14.3 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 12.19 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 12.14 | Not recorded | 69b8dfec0636e5bf4afbe857 | ### Human Precision: 83.31. Result ID: 69b912ce47f34ce924a1a3c4. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VGS Precision: 64.51. Result ID: 69b912ce47f34ce924a1a3af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### AutoScraper Precision: 53.23. Result ID: 69b912ce47f34ce924a1a3ae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### VGS Precision: 49.11. Result ID: 69b912ce47f34ce924a1a3ab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### VGS Precision: 48.09. Result ID: 69b912ce47f34ce924a1a3c3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### VGS Precision: 47.83. Result ID: 69b912ce47f34ce924a1a3a7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### Reflexion Precision: 47.75. Result ID: 69b912ce47f34ce924a1a3ad. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT -4o","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### VGS Precision: 46.85. Result ID: 69b912ce47f34ce924a1a3bf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### COT Precision: 45.96. Result ID: 69b912ce47f34ce924a1a3ac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### AutoScraper Precision: 40.63. Result ID: 69b912ce47f34ce924a1a3be. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### AutoScraper Precision: 38.03. Result ID: 69b912ce47f34ce924a1a3c2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### VGS Precision: 37.99. Result ID: 69b912ce47f34ce924a1a3bb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### Reflexion Precision: 37.3. Result ID: 69b912ce47f34ce924a1a3bd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### VGS Precision: 36.99. Result ID: 69b912ce47f34ce924a1a3b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### Reflexion Precision: 36.71. Result ID: 69b912ce47f34ce924a1a3b5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemma-3-27B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### Reflexion Precision: 36.56. Result ID: 69b912ce47f34ce924a1a3b9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### AutoScraper Precision: 36.52. Result ID: 69b912ce47f34ce924a1a3a6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### AutoScraper Precision: 36. Result ID: 69b912ce47f34ce924a1a3ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### COT Precision: 35.77. Result ID: 69b912ce47f34ce924a1a3c0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### AutoScraper Precision: 35.1. Result ID: 69b912ce47f34ce924a1a3aa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### COT Precision: 34.41. Result ID: 69b912ce47f34ce924a1a3b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### AutoScraper Precision: 33.5. Result ID: 69b912ce47f34ce924a1a3b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### Reflexion Precision: 33. Result ID: 69b912ce47f34ce924a1a3a5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### COT Precision: 32.15. Result ID: 69b912ce47f34ce924a1a3a8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### COT Precision: 32.04. Result ID: 69b912ce47f34ce924a1a3a4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### Reflexion Precision: 31.97. Result ID: 69b912ce47f34ce924a1a3a9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT -4o-mini","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### COT Precision: 31.53. Result ID: 69b912ce47f34ce924a1a3b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### Reflexion Precision: 30.32. Result ID: 69b912ce47f34ce924a1a3c1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### COT Precision: 28.83. Result ID: 69b912ce47f34ce924a1a3bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### VGS Precision: 19.97. Result ID: 69b912ce47f34ce924a1a3b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### AutoScraper Precision: 14.3. Result ID: 69b912ce47f34ce924a1a3b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### Reflexion Precision: 12.19. Result ID: 69b912ce47f34ce924a1a3b1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemma-3-4B","Setting":"Zero-shot"}. This record does not assert independent reproduction. ### COT Precision: 12.14. Result ID: 69b912ce47f34ce924a1a3b0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B","Setting":"Zero-shot"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.