# Web Information Extraction on LIVEWEB-IE Type III 1.0 (test) Source: [Web Information Extraction on LIVEWEB-IE Type III 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-03-17T08:40:21.238Z Evaluation of Web Information Extraction performance on the test split of the LIVEWEB-IE Type III 1.0 dataset, measured using Precision, Recall, and F1 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Web Information Extraction | | Dataset (including any stated split) | LIVEWEB-IE Type III 1.0 (test) | | Metric | Precision | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 33 of 33 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Precision](): Higher is better; unit: PERCENT. - [Recall](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Precision | Result date | Report paper | | --- | --- | --- | --- | | Human | 89.3 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 45.25 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 43.61 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 35.3 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 33.87 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 30.33 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 27.9 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 16.63 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 15.99 | Not recorded | 69b8dfec0636e5bf4afbe857 | | VGS | 15.02 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 13.95 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 12.14 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 11.74 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 10.94 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 10.69 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 10.29 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 10.16 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 10.05 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 9.81 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 9.67 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 9.66 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 9.57 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 9.56 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 9.48 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 8.88 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 8.47 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 8.26 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 7.35 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 7.2 | Not recorded | 69b8dfec0636e5bf4afbe857 | | AutoScraper | 7.11 | Not recorded | 69b8dfec0636e5bf4afbe857 | | Reflexion | 5.64 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 5.63 | Not recorded | 69b8dfec0636e5bf4afbe857 | | COT | 4.37 | Not recorded | 69b8dfec0636e5bf4afbe857 | ### Human Precision: 89.3. Result ID: 69b912ce47f34ce924a1a406. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VGS Precision: 45.25. Result ID: 69b912ce47f34ce924a1a3f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### VGS Precision: 43.61. Result ID: 69b912ce47f34ce924a1a3e9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### VGS Precision: 35.3. Result ID: 69b912ce47f34ce924a1a405. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### VGS Precision: 33.87. Result ID: 69b912ce47f34ce924a1a3ed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### VGS Precision: 30.33. Result ID: 69b912ce47f34ce924a1a401. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### VGS Precision: 27.9. Result ID: 69b912ce47f34ce924a1a3f9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### VGS Precision: 16.63. Result ID: 69b912ce47f34ce924a1a3fd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### Reflexion Precision: 15.99. Result ID: 69b912ce47f34ce924a1a3ef. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### VGS Precision: 15.02. Result ID: 69b912ce47f34ce924a1a3f5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 13.95. Result ID: 69b912ce47f34ce924a1a3f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### COT Precision: 12.14. Result ID: 69b912ce47f34ce924a1a3ee. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o"}. This record does not assert independent reproduction. ### AutoScraper Precision: 11.74. Result ID: 69b912ce47f34ce924a1a3ec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### AutoScraper Precision: 10.94. Result ID: 69b912ce47f34ce924a1a3e8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### Reflexion Precision: 10.69. Result ID: 69b912ce47f34ce924a1a403. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### Reflexion Precision: 10.29. Result ID: 69b912ce47f34ce924a1a3e7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### Reflexion Precision: 10.16. Result ID: 69b912ce47f34ce924a1a3f7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 10.05. Result ID: 69b912ce47f34ce924a1a404. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 9.81. Result ID: 69b912ce47f34ce924a1a3f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 9.67. Result ID: 69b912ce47f34ce924a1a3f4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### COT Precision: 9.66. Result ID: 69b912ce47f34ce924a1a3e6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini-2.5-Flash"}. This record does not assert independent reproduction. ### Reflexion Precision: 9.57. Result ID: 69b912ce47f34ce924a1a3f3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### COT Precision: 9.56. Result ID: 69b912ce47f34ce924a1a3f6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction. ### COT Precision: 9.48. Result ID: 69b912ce47f34ce924a1a402. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction. ### COT Precision: 8.88. Result ID: 69b912ce47f34ce924a1a3ea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### Reflexion Precision: 8.47. Result ID: 69b912ce47f34ce924a1a3ff. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### Reflexion Precision: 8.26. Result ID: 69b912ce47f34ce924a1a3eb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT -4o-mini"}. This record does not assert independent reproduction. ### AutoScraper Precision: 7.35. Result ID: 69b912ce47f34ce924a1a3fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### COT Precision: 7.2. Result ID: 69b912ce47f34ce924a1a3fe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### AutoScraper Precision: 7.11. Result ID: 69b912ce47f34ce924a1a400. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction. ### Reflexion Precision: 5.64. Result ID: 69b912ce47f34ce924a1a3fb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### COT Precision: 5.63. Result ID: 69b912ce47f34ce924a1a3f2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction. ### COT Precision: 4.37. Result ID: 69b912ce47f34ce924a1a3fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.