# Web Information Extraction on LIVEWEB-IE Type II 1.0 (test) Source: [Web Information Extraction on LIVEWEB-IE Type II 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-03-17T08:40:21.212Z Evaluation of Web Information Extraction performance on the test split of the LIVEWEB-IE Type II 1.0 dataset, typically measured using Precision, Recall, and F1 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Web Information Extraction | | Dataset (including any stated split) | LIVEWEB-IE Type II 1.0 (test) | | Metric | Precision | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 33 of 33 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Precision](): Higher is better; unit: PERCENT. - [Recall](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Precision | Result date | Report paper | | --- | --- | --- | --- | | Human | 0.8556 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 0.4467 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 0.4236 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 0.4193 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 0.3987 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 0.3978 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 0.3953 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 0.3946 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 0.3738 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 0.3542 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 0.3353 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 0.3249 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 0.3237 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 0.3219 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 0.3186 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 0.3147 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 0.3114 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 0.309 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 0.3018 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 0.3015 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 0.2484 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 0.2375 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 0.23 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 0.2103 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 0.1951 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 0.1941 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 0.1706 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 0.1524 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 0.1219 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 0.1154 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 0.1054 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 0.0944 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 0.0381 | Not recorded | 69b8dfec0636e5bf4afbe857 | ### Human Precision: 0.8556. Result ID: 69b912ce47f34ce924a1a3e5. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VGS Precision: 0.4467. Result ID: 69b912ce47f34ce924a1a3d0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### VGS Precision: 0.4236. Result ID: 69b912ce47f34ce924a1a3c8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### AutoScraper Precision: 0.4193. Result ID: 69b912ce47f34ce924a1a3cf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### Reflexion Precision: 0.3987. Result ID: 69b912ce47f34ce924a1a3c6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### VGS Precision: 0.3978. Result ID: 69b912ce47f34ce924a1a3e0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### COT Precision: 0.3953. Result ID: 69b912ce47f34ce924a1a3cd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### Reflexion Precision: 0.3946. Result ID: 69b912ce47f34ce924a1a3ce. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### VGS Precision: 0.3738. Result ID: 69b912ce47f34ce924a1a3e4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 0.3542. Result ID: 69b912ce47f34ce924a1a3df. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 0.3353. Result ID: 69b912ce47f34ce924a1a3e3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### COT Precision: 0.3249. Result ID: 69b912ce47f34ce924a1a3dd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### VGS Precision: 0.3237. Result ID: 69b912ce47f34ce924a1a3cc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### COT Precision: 0.3219. Result ID: 69b912ce47f34ce924a1a3c5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### COT Precision: 0.3186. Result ID: 69b912ce47f34ce924a1a3c9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### AutoScraper Precision: 0.3147. Result ID: 69b912ce47f34ce924a1a3c7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### AutoScraper Precision: 0.3114. Result ID: 69b912ce47f34ce924a1a3cb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### Reflexion Precision: 0.309. Result ID: 69b912ce47f34ce924a1a3de. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### COT Precision: 0.3018. Result ID: 69b912ce47f34ce924a1a3e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### Reflexion Precision: 0.3015. Result ID: 69b912ce47f34ce924a1a3e2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### Reflexion Precision: 0.2484. Result ID: 69b912ce47f34ce924a1a3ca. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### VGS Precision: 0.2375. Result ID: 69b912ce47f34ce924a1a3d8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### VGS Precision: 0.23. Result ID: 69b912ce47f34ce924a1a3dc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### VGS Precision: 0.2103. Result ID: 69b912ce47f34ce924a1a3d4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 0.1951. Result ID: 69b912ce47f34ce924a1a3d7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 0.1941. Result ID: 69b912ce47f34ce924a1a3db. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### COT Precision: 0.1706. Result ID: 69b912ce47f34ce924a1a3d5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### Reflexion Precision: 0.1524. Result ID: 69b912ce47f34ce924a1a3d6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### Reflexion Precision: 0.1219. Result ID: 69b912ce47f34ce924a1a3da. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 0.1154. Result ID: 69b912ce47f34ce924a1a3d3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### Reflexion Precision: 0.1054. Result ID: 69b912ce47f34ce924a1a3d2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### COT Precision: 0.0944. Result ID: 69b912ce47f34ce924a1a3d9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### COT Precision: 0.0381. Result ID: 69b912ce47f34ce924a1a3d1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.