# Relation Extraction on ChemDisGene All relationships (test)

Source: [Relation Extraction on ChemDisGene All relationships (test)](<https://www.sota2.com/research/sota/relation-extraction-on-chemdisgene-all-relationships-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:43:11.402Z

Evaluation of Relation Extraction performance on the test split of the ChemDisGene dataset, reporting Precision, Recall, and F1 scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Relation Extraction |
| Dataset (including any stated split) | ChemDisGene All relationships (test) |
| Metric | F1 Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [F1 Score](<https://www.sota2.com/research/sota/relation-extraction-on-chemdisgene-all-relationships-test.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

- [Precision](<https://www.sota2.com/research/sota/relation-extraction-on-chemdisgene-all-relationships-test.md?metric=Precision>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/relation-extraction-on-chemdisgene-all-relationships-test.md?metric=Recall>): Higher is better; unit: PERCENT.

## Recorded results

| Method | F1 Score | Result date | Report paper |
| --- | --- | --- | --- |
| SSR-PU+ATLOP+PubmedBert | 48.56 | Not recorded | 68fa6db81e209131cea3b7ef |
| S-PU+ATLOP+PubmedBert | 46.73 | Not recorded | 68fa6db81e209131cea3b7ef |
| SR-PN+ATLOP+PubmedBert | 46.56 | Not recorded | 68fa6db81e209131cea3b7ef |
| SR-PU+ATLOP+PubmedBert | 45.86 | Not recorded | 68fa6db81e209131cea3b7ef |
| PU+ATLOP+PubmedBert | 44.6 | Not recorded | 68fa6db81e209131cea3b7ef |
| PN+ATLOP+PubmedBert | 44.25 | Not recorded | 68fa6db81e209131cea3b7ef |
| BRAN+PubmedBert | 43.8 | Not recorded | 68fa6db81e209131cea3b7ef |
| ATLOP+PubmedBert | 42.73 | Not recorded | 68fa6db81e209131cea3b7ef |
| PubmedBert | 42.1 | Not recorded | 68fa6db81e209131cea3b7ef |
| BRAN | 32.5 | Not recorded | 68fa6db81e209131cea3b7ef |

### SSR-PU+ATLOP+PubmedBert

F1 Score: 48.56. Result ID: 698fd4db3a6c314849fc2d4a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db81e209131cea3b7ef.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6db81e209131cea3b7ef.md>)

[Implementation](<https://github.com/www-Ye/SSR-PU>)

Recorded evaluation configuration: {"Loss Function":"SSR-PU","Backbone":"PubmedBert"}. This record does not assert independent reproduction.

### S-PU+ATLOP+PubmedBert

F1 Score: 46.73. Result ID: 698fd4db3a6c314849fc2d49.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db81e209131cea3b7ef.md>)

Recorded evaluation configuration: {"Loss Function":"S-PU learning (prior shift)","Backbone":"PubmedBert"}. This record does not assert independent reproduction.

### SR-PN+ATLOP+PubmedBert

F1 Score: 46.56. Result ID: 698fd4db3a6c314849fc2d46.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db81e209131cea3b7ef.md>)

Recorded evaluation configuration: {"Loss Function":"Squared ranking loss PN learning (SR-PN)","Backbone":"PubmedBert"}. This record does not assert independent reproduction.

### SR-PU+ATLOP+PubmedBert

F1 Score: 45.86. Result ID: 698fd4db3a6c314849fc2d48.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db81e209131cea3b7ef.md>)

Recorded evaluation configuration: {"Loss Function":"Squared ranking loss PU learning (SR-PU)","Backbone":"PubmedBert"}. This record does not assert independent reproduction.

### PU+ATLOP+PubmedBert

F1 Score: 44.6. Result ID: 698fd4db3a6c314849fc2d47.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db81e209131cea3b7ef.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68db1e209131cea1eb83.md>)

[Implementation](<https://github.com/wzhouad/ATLOP>)

Recorded evaluation configuration: {"Loss Function":"PU learning","Backbone":"PubmedBert"}. This record does not assert independent reproduction.

### PN+ATLOP+PubmedBert

F1 Score: 44.25. Result ID: 698fd4db3a6c314849fc2d45.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db81e209131cea3b7ef.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68db1e209131cea1eb83.md>)

[Implementation](<https://github.com/wzhouad/ATLOP>)

Recorded evaluation configuration: {"Loss Function":"PN learning","Backbone":"PubmedBert"}. This record does not assert independent reproduction.

### BRAN+PubmedBert

F1 Score: 43.8. Result ID: 698fd4db3a6c314849fc2d43.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db81e209131cea3b7ef.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c3c1e209131cea32f1c.md>)

Recorded evaluation configuration: {"Source":"Reported"}. This record does not assert independent reproduction.

### ATLOP+PubmedBert

F1 Score: 42.73. Result ID: 698fd4db3a6c314849fc2d44.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db81e209131cea3b7ef.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68db1e209131cea1eb83.md>)

[Implementation](<https://github.com/wzhouad/ATLOP>)

Recorded evaluation configuration: {"Implementation":"Our implementation","Backbone":"PubmedBert"}. This record does not assert independent reproduction.

### PubmedBert

F1 Score: 42.1. Result ID: 698fd4db3a6c314849fc2d42.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db81e209131cea3b7ef.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ac91e209131cea2a34b.md>)

[Implementation](<https://aka.ms/BLURB>)

Recorded evaluation configuration: {"Source":"Reported"}. This record does not assert independent reproduction.

### BRAN

F1 Score: 32.5. Result ID: 698fd4db3a6c314849fc2d41.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db81e209131cea3b7ef.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa640e1e209131cea0267e.md>)

Recorded evaluation configuration: {"Source":"Reported"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.