# Relation Extraction on SemEval RE

Source: [Relation Extraction on SemEval RE](<https://www.sota2.com/research/sota/relation-extraction-on-semeval-re>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-14T09:45:10.291Z

Evaluation of Relation Extraction performance on the SemEval RE dataset, measured using Relation Strict F1 score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Relation Extraction |
| Dataset (including any stated split) | semeval RE |
| Metric | Relation Strict F1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Relation Strict F1](<https://www.sota2.com/research/sota/relation-extraction-on-semeval-re.md?metric=Relation%20Strict%20F1>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Relation Strict F1 | Result date | Report paper |
| --- | --- | --- | --- |
| InstructUIE | 76 | Not recorded | 68fa6f151e209131cea43cef |
| InstructUIE | 73.23 | Not recorded | 68fa79061e209131cea7bc57 |
| InstructUIE | 73.23 | Not recorded | 68fa6f151e209131cea43cef |
| InstructUIE | 73.23 | Not recorded | 69ddca187d0172140ec79a37 |
| ProUIE | 68.62 | Not recorded | 69ddca187d0172140ec79a37 |
| KnowCoder | 66.3 | Not recorded | 68fa72851e209131cea56fe5 |
| KnowCoder | 66.3 | Not recorded | 68fa79061e209131cea7bc57 |
| KnowCoder | 66.3 | Not recorded | 69ddca187d0172140ec79a37 |
| InstructUIE | 65.8 | Not recorded | 68fa72851e209131cea56fe5 |
| KnowCoder-X | 64.79 | Not recorded | 68fa79061e209131cea7bc57 |
| KnowCoder-X | 64.79 | Not recorded | 68fa79061e209131cea7bc57 |
| YAYI-UIE | 61.02 | Not recorded | 68fa79061e209131cea7bc57 |
| YAYI-UIE | 61.02 | Not recorded | 68fa79061e209131cea7bc57 |
| IEPILE | 58.47 | Not recorded | 68fa79061e209131cea7bc57 |
| IEPILE | 58.47 | Not recorded | 68fa79061e209131cea7bc57 |

### InstructUIE

Relation Strict F1: 76. Result ID: 69a1517135dfcabb00e63512.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f151e209131cea43cef.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f151e209131cea43cef.md>)

[Implementation](<https://github.com/BeyonderXX/InstructUIE>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### InstructUIE

Relation Strict F1: 73.23. Result ID: 6995bb823badfaffe6bd101b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f151e209131cea43cef.md>)

[Implementation](<https://github.com/BeyonderXX/InstructUIE>)

Recorded evaluation configuration: {"Evaluation Mode":"Supervised"}. This record does not assert independent reproduction.

### InstructUIE

Relation Strict F1: 73.23. Result ID: 69a1517135dfcabb00e63571.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f151e209131cea43cef.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f151e209131cea43cef.md>)

[Implementation](<https://github.com/BeyonderXX/InstructUIE>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### InstructUIE

Relation Strict F1: 73.23. Result ID: 69de0c9e47f34ce924c5e07b.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca187d0172140ec79a37.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f151e209131cea43cef.md>)

[Implementation](<https://github.com/BeyonderXX/InstructUIE>)

Recorded evaluation configuration: {"Parameters":"11B"}. This record does not assert independent reproduction.

### ProUIE

Relation Strict F1: 68.62. Result ID: 69de0c9e47f34ce924c5e07d.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca187d0172140ec79a37.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca187d0172140ec79a37.md>)

Recorded evaluation configuration: {"Parameters":"4B"}. This record does not assert independent reproduction.

### KnowCoder

Relation Strict F1: 66.3. Result ID: 69925a453a6c3148490e6097.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72851e209131cea56fe5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72851e209131cea56fe5.md>)

[Implementation](<https://ict-goknow.github.io/knowcoder/>)

Recorded evaluation configuration: {"Model":"7B","Evaluation Setting":"supervised"}. This record does not assert independent reproduction.

### KnowCoder

Relation Strict F1: 66.3. Result ID: 6995bb823badfaffe6bd101c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72851e209131cea56fe5.md>)

[Implementation](<https://ict-goknow.github.io/knowcoder/>)

Recorded evaluation configuration: {"Evaluation Mode":"Supervised"}. This record does not assert independent reproduction.

### KnowCoder

Relation Strict F1: 66.3. Result ID: 69de0c9e47f34ce924c5e07c.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca187d0172140ec79a37.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72851e209131cea56fe5.md>)

[Implementation](<https://ict-goknow.github.io/knowcoder/>)

Recorded evaluation configuration: {"Parameters":"7B"}. This record does not assert independent reproduction.

### InstructUIE

Relation Strict F1: 65.8. Result ID: 69925a453a6c3148490e6096.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72851e209131cea56fe5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f151e209131cea43cef.md>)

[Implementation](<https://github.com/BeyonderXX/InstructUIE>)

Recorded evaluation configuration: {"Evaluation Setting":"supervised"}. This record does not assert independent reproduction.

### KnowCoder-X

Relation Strict F1: 64.79. Result ID: 6995bb823badfaffe6bd0f7b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Implementation](<https://github.com/ICT-GoKnow/KnowCoder>)

Recorded evaluation configuration: {"supervised evaluation":true}. This record does not assert independent reproduction.

### KnowCoder-X

Relation Strict F1: 64.79. Result ID: 6995bb823badfaffe6bd101d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Implementation](<https://github.com/ICT-GoKnow/KnowCoder>)

Recorded evaluation configuration: {"Evaluation Mode":"Supervised"}. This record does not assert independent reproduction.

### YAYI-UIE

Relation Strict F1: 61.02. Result ID: 6995bb823badfaffe6bd0f79.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72c11e209131cea58673.md>)

Recorded evaluation configuration: {"supervised evaluation":true}. This record does not assert independent reproduction.

### YAYI-UIE

Relation Strict F1: 61.02. Result ID: 6995bb823badfaffe6bd1019.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72c11e209131cea58673.md>)

Recorded evaluation configuration: {"Evaluation Mode":"Supervised"}. This record does not assert independent reproduction.

### IEPILE

Relation Strict F1: 58.47. Result ID: 6995bb823badfaffe6bd0f7a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

Recorded evaluation configuration: {"supervised evaluation":true}. This record does not assert independent reproduction.

### IEPILE

Relation Strict F1: 58.47. Result ID: 6995bb823badfaffe6bd101a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79061e209131cea7bc57.md>)

Recorded evaluation configuration: {"Evaluation Mode":"Supervised"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
