# Web Information Extraction on LIVEWEB-IE Type IV 1.0 (test) Source: [Web Information Extraction on LIVEWEB-IE Type IV 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-03-17T08:40:21.263Z Evaluation of Web Information Extraction performance on the test split of the LIVEWEB-IE Type IV 1.0 dataset, measured using Precision, Recall, and F1 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Web Information Extraction | | Dataset (including any stated split) | LIVEWEB-IE Type IV 1.0 (test) | | Metric | Precision | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 33 of 33 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Precision](): Higher is better; unit: PERCENT. - [Recall](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Precision | Result date | Report paper | | --- | --- | --- | --- | | Human | 82.74 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 41.33 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 38.6 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 33.58 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 30.42 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 30.29 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 28.09 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 14.36 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 13.67 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 13.07 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 12.83 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 12.6 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 12.42 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 12.22 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 11.2 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 10.92 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 10.16 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 9.83 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 9.68 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 9.28 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 7.53 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 7.24 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 7.08 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 6.53 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 6.15 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 5.48 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 5.03 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 4.98 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 4.19 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 4.04 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 3.77 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 2.28 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 0.6 | Not recorded | 69b8dfec0636e5bf4afbe857 | ### Human Precision: 82.74. Result ID: 69b912ce47f34ce924a1a427. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VGS Precision: 41.33. Result ID: 69b912ce47f34ce924a1a412. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### VGS Precision: 38.6. Result ID: 69b912ce47f34ce924a1a40a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### VGS Precision: 33.58. Result ID: 69b912ce47f34ce924a1a41a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### VGS Precision: 30.42. Result ID: 69b912ce47f34ce924a1a426. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### VGS Precision: 30.29. Result ID: 69b912ce47f34ce924a1a40e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### VGS Precision: 28.09. Result ID: 69b912ce47f34ce924a1a422. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 14.36. Result ID: 69b912ce47f34ce924a1a409. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### AutoScraper Precision: 13.67. Result ID: 69b912ce47f34ce924a1a40d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### VGS Precision: 13.07. Result ID: 69b912ce47f34ce924a1a41e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### Reflexion Precision: 12.83. Result ID: 69b912ce47f34ce924a1a408. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### AutoScraper Precision: 12.6. Result ID: 69b912ce47f34ce924a1a411. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### COT Precision: 12.42. Result ID: 69b912ce47f34ce924a1a423. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### COT Precision: 12.22. Result ID: 69b912ce47f34ce924a1a40b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### COT Precision: 11.2. Result ID: 69b912ce47f34ce924a1a40f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### AutoScraper Precision: 10.92. Result ID: 69b912ce47f34ce924a1a419. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### COT Precision: 10.16. Result ID: 69b912ce47f34ce924a1a407. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### AutoScraper Precision: 9.83. Result ID: 69b912ce47f34ce924a1a425. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### Reflexion Precision: 9.68. Result ID: 69b912ce47f34ce924a1a40c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### Reflexion Precision: 9.28. Result ID: 69b912ce47f34ce924a1a418. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### Reflexion Precision: 7.53. Result ID: 69b912ce47f34ce924a1a420. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### Reflexion Precision: 7.24. Result ID: 69b912ce47f34ce924a1a410. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### AutoScraper Precision: 7.08. Result ID: 69b912ce47f34ce924a1a415. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### Reflexion Precision: 6.53. Result ID: 69b912ce47f34ce924a1a424. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### COT Precision: 6.15. Result ID: 69b912ce47f34ce924a1a417. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 5.48. Result ID: 69b912ce47f34ce924a1a421. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### Reflexion Precision: 5.03. Result ID: 69b912ce47f34ce924a1a41c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### VGS Precision: 4.98. Result ID: 69b912ce47f34ce924a1a416. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### Reflexion Precision: 4.19. Result ID: 69b912ce47f34ce924a1a414. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### COT Precision: 4.04. Result ID: 69b912ce47f34ce924a1a41f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 3.77. Result ID: 69b912ce47f34ce924a1a41d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### COT Precision: 2.28. Result ID: 69b912ce47f34ce924a1a41b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### COT Precision: 0.6. Result ID: 69b912ce47f34ce924a1a413. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.