# Web Information Extraction on SWDE original (test)

Source: [Web Information Extraction on SWDE original (test)](<https://www.sota2.com/research/sota/web-information-extraction-on-swde-original-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-17T08:40:21.138Z

Evaluation of Web Information Extraction performance on the original test split of the SWDE dataset, measured using Precision, Recall, and F1 scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Web Information Extraction |
| Dataset (including any stated split) | SWDE original (test) |
| Metric | Precision |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 32 of 32 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Precision](<https://www.sota2.com/research/sota/web-information-extraction-on-swde-original-test.md?metric=Precision>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/web-information-extraction-on-swde-original-test.md?metric=Recall>): Higher is better; unit: PERCENT.

- [F1 Score](<https://www.sota2.com/research/sota/web-information-extraction-on-swde-original-test.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Precision | Result date | Report paper |
| --- | --- | --- | --- |
| VGS | 97.04 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| VGS | 96.92 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| VGS | 96.2 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| VGS | 95.69 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| Reflexion | 95.48 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| Reflexion | 94.95 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| Reflexion | 94.69 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| VGS | 94.38 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| Reflexion | 94.31 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| AutoScraper | 94.06 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| AutoScraper | 93.94 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| AutoScraper | 93.87 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| Reflexion | 93.33 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| COT | 92.83 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| COT | 92.81 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| AutoScraper | 92.78 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| AutoScraper | 92.68 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| COT | 92.62 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| COT | 92.35 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| Reflexion | 92.11 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| COT | 91.91 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| AutoScraper | 91.67 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| Reflexion | 90.71 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| COT | 89.65 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| AutoScraper | 88.9 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| Reflexion | 88.22 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| COT | 88.01 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| COT | 87.12 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| AutoScraper | 86.75 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| VGS | 77.14 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| VGS | 71.39 | Not recorded | 69b8dfec0636e5bf4afbe857 |
| VGS | 66.62 | Not recorded | 69b8dfec0636e5bf4afbe857 |

### VGS

Precision: 97.04. Result ID: 69b912ce47f34ce924a1a37f.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction.

### VGS

Precision: 96.92. Result ID: 69b912ce47f34ce924a1a36f.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction.

### VGS

Precision: 96.2. Result ID: 69b912ce47f34ce924a1a367.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

Recorded evaluation configuration: {"Model":"Gemini 2.5 Flash"}. This record does not assert independent reproduction.

### VGS

Precision: 95.69. Result ID: 69b912ce47f34ce924a1a36b.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

Recorded evaluation configuration: {"Model":"GPT-4o-mini"}. This record does not assert independent reproduction.

### Reflexion

Precision: 95.48. Result ID: 69b912ce47f34ce924a1a37d.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction.

### Reflexion

Precision: 94.95. Result ID: 69b912ce47f34ce924a1a381.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction.

### Reflexion

Precision: 94.69. Result ID: 69b912ce47f34ce924a1a36d.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction.

### VGS

Precision: 94.38. Result ID: 69b912ce47f34ce924a1a383.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction.

### Reflexion

Precision: 94.31. Result ID: 69b912ce47f34ce924a1a365.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Model":"Gemini 2.5 Flash"}. This record does not assert independent reproduction.

### AutoScraper

Precision: 94.06. Result ID: 69b912ce47f34ce924a1a36e.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74fb1e209131cea65132.md>)

Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction.

### AutoScraper

Precision: 93.94. Result ID: 69b912ce47f34ce924a1a37e.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74fb1e209131cea65132.md>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction.

### AutoScraper

Precision: 93.87. Result ID: 69b912ce47f34ce924a1a366.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74fb1e209131cea65132.md>)

Recorded evaluation configuration: {"Model":"Gemini 2.5 Flash"}. This record does not assert independent reproduction.

### Reflexion

Precision: 93.33. Result ID: 69b912ce47f34ce924a1a379.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction.

### COT

Precision: 92.83. Result ID: 69b912ce47f34ce924a1a380.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction.

### COT

Precision: 92.81. Result ID: 69b912ce47f34ce924a1a36c.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction.

### AutoScraper

Precision: 92.78. Result ID: 69b912ce47f34ce924a1a382.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74fb1e209131cea65132.md>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-72B"}. This record does not assert independent reproduction.

### AutoScraper

Precision: 92.68. Result ID: 69b912ce47f34ce924a1a37a.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74fb1e209131cea65132.md>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction.

### COT

Precision: 92.62. Result ID: 69b912ce47f34ce924a1a364.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"Gemini 2.5 Flash"}. This record does not assert independent reproduction.

### COT

Precision: 92.35. Result ID: 69b912ce47f34ce924a1a370.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction.

### Reflexion

Precision: 92.11. Result ID: 69b912ce47f34ce924a1a369.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Model":"GPT-4o-mini"}. This record does not assert independent reproduction.

### COT

Precision: 91.91. Result ID: 69b912ce47f34ce924a1a378.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction.

### AutoScraper

Precision: 91.67. Result ID: 69b912ce47f34ce924a1a36a.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74fb1e209131cea65132.md>)

Recorded evaluation configuration: {"Model":"GPT-4o-mini"}. This record does not assert independent reproduction.

### Reflexion

Precision: 90.71. Result ID: 69b912ce47f34ce924a1a371.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction.

### COT

Precision: 89.65. Result ID: 69b912ce47f34ce924a1a37c.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-32B"}. This record does not assert independent reproduction.

### AutoScraper

Precision: 88.9. Result ID: 69b912ce47f34ce924a1a376.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74fb1e209131cea65132.md>)

Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction.

### Reflexion

Precision: 88.22. Result ID: 69b912ce47f34ce924a1a375.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction.

### COT

Precision: 88.01. Result ID: 69b912ce47f34ce924a1a368.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"GPT-4o-mini"}. This record does not assert independent reproduction.

### COT

Precision: 87.12. Result ID: 69b912ce47f34ce924a1a374.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction.

### AutoScraper

Precision: 86.75. Result ID: 69b912ce47f34ce924a1a372.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74fb1e209131cea65132.md>)

Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction.

### VGS

Precision: 77.14. Result ID: 69b912ce47f34ce924a1a377.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

Recorded evaluation configuration: {"Model":"Gemma-3-27B"}. This record does not assert independent reproduction.

### VGS

Precision: 71.39. Result ID: 69b912ce47f34ce924a1a37b.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

Recorded evaluation configuration: {"Model":"Qwen-2.5-7B"}. This record does not assert independent reproduction.

### VGS

Precision: 66.62. Result ID: 69b912ce47f34ce924a1a373.

[Reporting paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8dfec0636e5bf4afbe857.md>)

Recorded evaluation configuration: {"Model":"Gemma-3-4B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
