# Relation Extraction on TACREV v1.0 (full)

Source: [Relation Extraction on TACREV v1.0 (full)](<https://www.sota2.com/research/sota/relation-extraction-on-tacrev-v1-0-full>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:52:42.106Z

Evaluation of model performance on the full set of the TACREV v1.0 dataset for Relation Extraction, typically measured using Micro F1 score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Relation Extraction |
| Dataset (including any stated split) | TACREV v1.0 (full) |
| Metric | Micro F1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Micro F1](<https://www.sota2.com/research/sota/relation-extraction-on-tacrev-v1-0-full.md?metric=Micro%20F1>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Micro F1 | Result date | Report paper |
| --- | --- | --- | --- |
| SURE-PEGASUS-large | 0.833 | Not recorded | 68fa6dbe1e209131cea3bcb4 |
| IRE-RoBERTa-large | 0.832 | Not recorded | 68fa6dbe1e209131cea3bcb4 |
| KnowPrompt | 0.824 | Not recorded | 68fa6dbe1e209131cea3bcb4 |
| SURE-BART-large-cnn | 0.81 | Not recorded | 68fa6dbe1e209131cea3bcb4 |
| SURE-BART-large-xsum | 0.81 | Not recorded | 68fa6dbe1e209131cea3bcb4 |
| LUKE | 0.806 | Not recorded | 68fa6dbe1e209131cea3bcb4 |
| KnowBERT | 0.793 | Not recorded | 68fa6dbe1e209131cea3bcb4 |
| SURE-BART-large | 0.792 | Not recorded | 68fa6dbe1e209131cea3bcb4 |
| SpanBERT | 0.78 | Not recorded | 68fa6dbe1e209131cea3bcb4 |

### SURE-PEGASUS-large

Micro F1: 0.833. Result ID: 698fe3793a6c314849fc9653.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Implementation](<https://github.com/luka-group/SuRE>)

Recorded evaluation configuration: {"Method paradigm":"Summarization-based","Backbone architecture":"PEGASUS-large"}. This record does not assert independent reproduction.

### IRE-RoBERTa-large

Micro F1: 0.832. Result ID: 698fe3793a6c314849fc964e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d881e209131cea3a6b1.md>)

[Implementation](<https://github.com/wzhouad/RE_improved_baseline>)

Recorded evaluation configuration: {"Method paradigm":"Classification-based","Backbone architecture":"RoBERTa-large"}. This record does not assert independent reproduction.

### KnowPrompt

Micro F1: 0.824. Result ID: 698fe3793a6c314849fc964f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70981e209131cea4c11a.md>)

[Implementation](<https://github.com/zjunlp/KnowPrompt>)

Recorded evaluation configuration: {"Method paradigm":"Indirect Supervision","Implementation":"Re-implemented"}. This record does not assert independent reproduction.

### SURE-BART-large-cnn

Micro F1: 0.81. Result ID: 698fe3793a6c314849fc9651.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Implementation](<https://github.com/luka-group/SuRE>)

Recorded evaluation configuration: {"Method paradigm":"Summarization-based","Backbone architecture":"BART-large-cnn"}. This record does not assert independent reproduction.

### SURE-BART-large-xsum

Micro F1: 0.81. Result ID: 698fe3793a6c314849fc9652.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Implementation](<https://github.com/luka-group/SuRE>)

Recorded evaluation configuration: {"Method paradigm":"Summarization-based","Backbone architecture":"BART-large-xsum"}. This record does not assert independent reproduction.

### LUKE

Micro F1: 0.806. Result ID: 698fe3793a6c314849fc964d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa686f1e209131cea1c2db.md>)

[Implementation](<https://github.com/studio-ousia/luke>)

Recorded evaluation configuration: {"Method paradigm":"Classification-based"}. This record does not assert independent reproduction.

### KnowBERT

Micro F1: 0.793. Result ID: 698fe3793a6c314849fc964c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66991e209131cea1144d.md>)

Recorded evaluation configuration: {"Method paradigm":"Classification-based"}. This record does not assert independent reproduction.

### SURE-BART-large

Micro F1: 0.792. Result ID: 698fe3793a6c314849fc9650.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Implementation](<https://github.com/luka-group/SuRE>)

Recorded evaluation configuration: {"Method paradigm":"Summarization-based","Backbone architecture":"BART-large"}. This record does not assert independent reproduction.

### SpanBERT

Micro F1: 0.78. Result ID: 698fe3793a6c314849fc964b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6dbe1e209131cea3bcb4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66ee1e209131cea13573.md>)

[Implementation](<https://github.com/facebookresearch/SpanBERT>)

Recorded evaluation configuration: {"Method paradigm":"Classification-based"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.