# Triple Extraction on WebNLG+ 2020 (test)

Source: [Triple Extraction on WebNLG+ 2020 (test)](<https://www.sota2.com/research/sota/triple-extraction-on-webnlg-plus-2020-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:43:11.820Z

Evaluation of Triple Extraction performance on the test split of the WebNLG+ 2020 dataset, measured using Precision, Recall, and F1 scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Triple Extraction |
| Dataset (including any stated split) | WebNLG+ 2020 (test) |
| Metric | F1 Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 27 of 27 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [F1 Score](<https://www.sota2.com/research/sota/triple-extraction-on-webnlg-plus-2020-test.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

- [Precision](<https://www.sota2.com/research/sota/triple-extraction-on-webnlg-plus-2020-test.md?metric=Precision>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/triple-extraction-on-webnlg-plus-2020-test.md?metric=Recall>): Higher is better; unit: PERCENT.

## Recorded results

| Method | F1 Score | Result date | Report paper |
| --- | --- | --- | --- |
| ReGen | 76.7 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 75 | Not recorded | 68fa6df81e209131cea3d09d |
| ReGen | 72.3 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 72.2 | Not recorded | 68fa6df81e209131cea3d09d |
| ReGen | 72 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 71.9 | Not recorded | 68fa6df81e209131cea3d09d |
| BT5 | 71.3 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 71.3 | Not recorded | 68fa6df81e209131cea3d09d |
| Amazon AI | 69.6 | Not recorded | 68fa6df81e209131cea3d09d |
| Amazon AI | 68.9 | Not recorded | 68fa6df81e209131cea3d09d |
| Amazon AI | 68.6 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 68.3 | Not recorded | 68fa6df81e209131cea3d09d |
| BT5 | 68.2 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 68.1 | Not recorded | 68fa6df81e209131cea3d09d |
| BT5 | 67.5 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 46.6 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 39.5 | Not recorded | 68fa6df81e209131cea3d09d |
| CycleGT | 36 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 36 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 34.7 | Not recorded | 68fa6df81e209131cea3d09d |
| CycleGT | 34.2 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 32.5 | Not recorded | 68fa6df81e209131cea3d09d |
| CycleGT | 30.9 | Not recorded | 68fa6df81e209131cea3d09d |
| Grapher | 28.9 | Not recorded | 68fa6df81e209131cea3d09d |
| Stanford OIE | 20 | Not recorded | 68fa6df81e209131cea3d09d |
| Stanford OIE | 15.8 | Not recorded | 68fa6df81e209131cea3d09d |
| Stanford OIE | 12.7 | Not recorded | 68fa6df81e209131cea3d09d |

### ReGen

F1 Score: 76.7. Result ID: 698ffc823a6c314849fd4568.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6aac1e209131cea29a8c.md>)

Recorded evaluation configuration: {"Matching Criterion":"Partial"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 75. Result ID: 698ffc823a6c314849fd4574.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Text Nodes","Edge Approach":"Class Edges","Matching Criterion":"Partial"}. This record does not assert independent reproduction.

### ReGen

F1 Score: 72.3. Result ID: 698ffc823a6c314849fd4567.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6aac1e209131cea29a8c.md>)

Recorded evaluation configuration: {"Matching Criterion":"Exact"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 72.2. Result ID: 698ffc823a6c314849fd4573.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Text Nodes","Edge Approach":"Class Edges","Matching Criterion":"Exact"}. This record does not assert independent reproduction.

### ReGen

F1 Score: 72. Result ID: 698ffc823a6c314849fd4569.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6aac1e209131cea29a8c.md>)

Recorded evaluation configuration: {"Matching Criterion":"Strict"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 71.9. Result ID: 698ffc823a6c314849fd4575.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Text Nodes","Edge Approach":"Class Edges","Matching Criterion":"Strict"}. This record does not assert independent reproduction.

### BT5

F1 Score: 71.3. Result ID: 698ffc823a6c314849fd455f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Partial"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 71.3. Result ID: 698ffc823a6c314849fd4571.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Text Nodes","Edge Approach":"Gen Edges","Matching Criterion":"Partial"}. This record does not assert independent reproduction.

### Amazon AI

F1 Score: 69.6. Result ID: 698ffc823a6c314849fd455c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Partial"}. This record does not assert independent reproduction.

### Amazon AI

F1 Score: 68.9. Result ID: 698ffc823a6c314849fd455b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Exact"}. This record does not assert independent reproduction.

### Amazon AI

F1 Score: 68.6. Result ID: 698ffc823a6c314849fd455d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Strict"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 68.3. Result ID: 698ffc823a6c314849fd4570.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Text Nodes","Edge Approach":"Gen Edges","Matching Criterion":"Exact"}. This record does not assert independent reproduction.

### BT5

F1 Score: 68.2. Result ID: 698ffc823a6c314849fd455e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Exact"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 68.1. Result ID: 698ffc823a6c314849fd4572.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Text Nodes","Edge Approach":"Gen Edges","Matching Criterion":"Strict"}. This record does not assert independent reproduction.

### BT5

F1 Score: 67.5. Result ID: 698ffc823a6c314849fd4560.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Strict"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 46.6. Result ID: 698ffc823a6c314849fd456d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Query Nodes","Edge Approach":"Class Edges","Matching Criterion":"Exact"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 39.5. Result ID: 698ffc823a6c314849fd456a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Query Nodes","Edge Approach":"Gen Edges","Matching Criterion":"Exact"}. This record does not assert independent reproduction.

### CycleGT

F1 Score: 36. Result ID: 698ffc823a6c314849fd4562.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Partial"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 36. Result ID: 698ffc823a6c314849fd456e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Query Nodes","Edge Approach":"Class Edges","Matching Criterion":"Partial"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 34.7. Result ID: 698ffc823a6c314849fd456f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Query Nodes","Edge Approach":"Class Edges","Matching Criterion":"Strict"}. This record does not assert independent reproduction.

### CycleGT

F1 Score: 34.2. Result ID: 698ffc823a6c314849fd4561.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Exact"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 32.5. Result ID: 698ffc823a6c314849fd456b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Query Nodes","Edge Approach":"Gen Edges","Matching Criterion":"Partial"}. This record does not assert independent reproduction.

### CycleGT

F1 Score: 30.9. Result ID: 698ffc823a6c314849fd4563.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Strict"}. This record does not assert independent reproduction.

### Grapher

F1 Score: 28.9. Result ID: 698ffc823a6c314849fd456c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

[Implementation](<https://github.com/IBM/Grapher>)

Recorded evaluation configuration: {"Node Approach":"Query Nodes","Edge Approach":"Gen Edges","Matching Criterion":"Strict"}. This record does not assert independent reproduction.

### Stanford OIE

F1 Score: 20. Result ID: 698ffc823a6c314849fd4565.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Partial"}. This record does not assert independent reproduction.

### Stanford OIE

F1 Score: 15.8. Result ID: 698ffc823a6c314849fd4564.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Exact"}. This record does not assert independent reproduction.

### Stanford OIE

F1 Score: 12.7. Result ID: 698ffc823a6c314849fd4566.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d09d.md>)

Recorded evaluation configuration: {"Matching Criterion":"Strict"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
