# Entity Matching on Toner 1% labeled train data (test)

Source: [Entity Matching on Toner 1% labeled train data (test)](<https://www.sota2.com/research/sota/entity-matching-on-toner-1-percent-labeled-train-data-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:43:06.188Z

Evaluation of Entity Matching performance on the Toner dataset, specifically using the 1% labeled training subset designated as the test split, reporting F1 score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Entity Matching |
| Dataset (including any stated split) | Toner 1% labeled train data (test) |
| Metric | F1 Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 13 of 13 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [F1 Score](<https://www.sota2.com/research/sota/entity-matching-on-toner-1-percent-labeled-train-data-test.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | F1 Score | Result date | Report paper |
| --- | --- | --- | --- |
| Magellan | 97.2 | Not recorded | 68fa6a1c1e209131cea25f28 |
| HIF+DT | 97.2 | Not recorded | 68fa6a1c1e209131cea25f28 |
| HIF+KATID3 | 97.2 | Not recorded | 68fa6a1c1e209131cea25f28 |
| HIF+KATXGB | 97.2 | Not recorded | 68fa6a1c1e209131cea25f28 |
| HIF+LN | 86 | Not recorded | 68fa6a1c1e209131cea25f28 |
| HIF-EMB | 79.8 | Not recorded | 68fa6a1c1e209131cea25f28 |
| HIF-WBOW | 74 | Not recorded | 68fa6a1c1e209131cea25f28 |
| HIF-ALONE | 72.9 | Not recorded | 68fa6a1c1e209131cea25f28 |
| DM-RNN | 68.6 | Not recorded | 68fa6a1c1e209131cea25f28 |
| DM-HYB | 67.4 | Not recorded | 68fa6a1c1e209131cea25f28 |
| HIF+LR | 62 | Not recorded | 68fa6a1c1e209131cea25f28 |
| HierMatcher | 55.2 | Not recorded | 68fa6a1c1e209131cea25f28 |
| DM-ATT | 48.8 | Not recorded | 68fa6a1c1e209131cea25f28 |

### Magellan

F1 Score: 97.2. Result ID: 698e0bedffc3901de09a5eda.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HIF+DT

F1 Score: 97.2. Result ID: 698e0bedffc3901de09a5edb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Implementation](<https://github.com/THU-KEG/HIF-KAT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HIF+KATID3

F1 Score: 97.2. Result ID: 698e0bedffc3901de09a5edc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Implementation](<https://github.com/THU-KEG/HIF-KAT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HIF+KATXGB

F1 Score: 97.2. Result ID: 698e0bedffc3901de09a5edd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Implementation](<https://github.com/THU-KEG/HIF-KAT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HIF+LN

F1 Score: 86. Result ID: 698e0bedffc3901de09a5ede.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Implementation](<https://github.com/THU-KEG/HIF-KAT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HIF-EMB

F1 Score: 79.8. Result ID: 698e0bedffc3901de09a5ee1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Implementation](<https://github.com/THU-KEG/HIF-KAT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HIF-WBOW

F1 Score: 74. Result ID: 698e0bedffc3901de09a5ee0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Implementation](<https://github.com/THU-KEG/HIF-KAT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HIF-ALONE

F1 Score: 72.9. Result ID: 698e0bedffc3901de09a5ee2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Implementation](<https://github.com/THU-KEG/HIF-KAT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DM-RNN

F1 Score: 68.6. Result ID: 698e0bedffc3901de09a5ed6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DM-HYB

F1 Score: 67.4. Result ID: 698e0bedffc3901de09a5ed8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HIF+LR

F1 Score: 62. Result ID: 698e0bedffc3901de09a5edf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

[Implementation](<https://github.com/THU-KEG/HIF-KAT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HierMatcher

F1 Score: 55.2. Result ID: 698e0bedffc3901de09a5ed9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DM-ATT

F1 Score: 48.8. Result ID: 698e0bedffc3901de09a5ed7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a1c1e209131cea25f28.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
