# Web Information Extraction on LIVEWEB-IE Overall 1.0 (test) Source: [Web Information Extraction on LIVEWEB-IE Overall 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-03-17T08:40:21.287Z Evaluation of Web Information Extraction performance on the test split of the LIVEWEB-IE Overall 1.0 dataset, measured using Precision, Recall, and F1 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Web Information Extraction | | Dataset (including any stated split) | LIVEWEB-IE Overall 1.0 (test) | | Metric | Precision | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 33 of 33 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Precision](): Higher is better; unit: PERCENT. - [Recall](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Precision | Result date | Report paper | | --- | --- | --- | --- | | Human | 85.24 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 47.78 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 42.81 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 37.12 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 35.57 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 35.48 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 29.87 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 28.94 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 26.47 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 26.03 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 23.53 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 22.41 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 22.1 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 21.9 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 21.6 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 21.02 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 21.01 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 20.58 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 20.36 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 20.01 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 18.86 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 17.75 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 17.63 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 17.3 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 16.42 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 15.3 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 15.18 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 15.01 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 13.22 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 10.99 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 10.44 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 9.01 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 5.11 | Not recorded | 69b8dfec0636e5bf4afbe857 | ### Human Precision: 85.24. Result ID: 69b912ce47f34ce924a1a448. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VGS Precision: 47.78. Result ID: 69b912ce47f34ce924a1a433. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### VGS Precision: 42.81. Result ID: 69b912ce47f34ce924a1a42b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### VGS Precision: 37.12. Result ID: 69b912ce47f34ce924a1a447. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### VGS Precision: 35.57. Result ID: 69b912ce47f34ce924a1a443. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### VGS Precision: 35.48. Result ID: 69b912ce47f34ce924a1a42f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### VGS Precision: 29.87. Result ID: 69b912ce47f34ce924a1a43b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 28.94. Result ID: 69b912ce47f34ce924a1a432. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### Reflexion Precision: 26.47. Result ID: 69b912ce47f34ce924a1a431. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### COT Precision: 26.03. Result ID: 69b912ce47f34ce924a1a430. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### Reflexion Precision: 23.53. Result ID: 69b912ce47f34ce924a1a429. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### AutoScraper Precision: 22.41. Result ID: 69b912ce47f34ce924a1a42a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### AutoScraper Precision: 22.1. Result ID: 69b912ce47f34ce924a1a42e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### AutoScraper Precision: 21.9. Result ID: 69b912ce47f34ce924a1a446. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### VGS Precision: 21.6. Result ID: 69b912ce47f34ce924a1a43f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 21.02. Result ID: 69b912ce47f34ce924a1a442. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### COT Precision: 21.01. Result ID: 69b912ce47f34ce924a1a444. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### COT Precision: 20.58. Result ID: 69b912ce47f34ce924a1a42c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### COT Precision: 20.36. Result ID: 69b912ce47f34ce924a1a428. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### Reflexion Precision: 20.01. Result ID: 69b912ce47f34ce924a1a441. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### Reflexion Precision: 18.86. Result ID: 69b912ce47f34ce924a1a445. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### Reflexion Precision: 17.75. Result ID: 69b912ce47f34ce924a1a42d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### COT Precision: 17.63. Result ID: 69b912ce47f34ce924a1a440. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 17.3. Result ID: 69b912ce47f34ce924a1a43a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### Reflexion Precision: 16.42. Result ID: 69b912ce47f34ce924a1a439. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 15.3. Result ID: 69b912ce47f34ce924a1a43e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### VGS Precision: 15.18. Result ID: 69b912ce47f34ce924a1a437. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### COT Precision: 15.01. Result ID: 69b912ce47f34ce924a1a438. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### Reflexion Precision: 13.22. Result ID: 69b912ce47f34ce924a1a43d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### COT Precision: 10.99. Result ID: 69b912ce47f34ce924a1a43c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 10.44. Result ID: 69b912ce47f34ce924a1a436. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### Reflexion Precision: 9.01. Result ID: 69b912ce47f34ce924a1a435. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### COT Precision: 5.11. Result ID: 69b912ce47f34ce924a1a434. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.