# Entity Typing on JW44K-6K

Source: [Entity Typing on JW44K-6K](<https://www.sota2.com/research/sota/entity-typing-on-jw44k-6k>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:50:23.856Z

Evaluation of Entity Typing performance on the JW44K-6K dataset, reporting metrics such as MRR and Hit Rates (H@1, H@3, H@10).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Entity Typing |
| Dataset (including any stated split) | JW44K-6K |
| Metric | MRR |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 13 of 13 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MRR](<https://www.sota2.com/research/sota/entity-typing-on-jw44k-6k.md?metric=MRR>): Higher is better; unit: PERCENT.

- [H@1](<https://www.sota2.com/research/sota/entity-typing-on-jw44k-6k.md?metric=H%401>): Higher is better; unit: PERCENT.

- [H@3](<https://www.sota2.com/research/sota/entity-typing-on-jw44k-6k.md?metric=H%403>): Higher is better; unit: PERCENT.

- [H@10](<https://www.sota2.com/research/sota/entity-typing-on-jw44k-6k.md?metric=H%4010>): Higher is better; unit: PERCENT.

## Recorded results

| Method | MRR | Result date | Report paper |
| --- | --- | --- | --- |
| HyperKA | 69.2 | Not recorded | 68fa70eb1e209131cea4dffe |
| DHGE | 69 | Not recorded | 68fa70eb1e209131cea4dffe |
| DHGE w/o HGA | 66.2 | Not recorded | 68fa70eb1e209131cea4dffe |
| JOIE | 60.3 | Not recorded | 68fa70eb1e209131cea4dffe |
| DHGE w/o GE | 49.2 | Not recorded | 68fa70eb1e209131cea4dffe |
| DHGE w/o JL | 42.8 | Not recorded | 68fa70eb1e209131cea4dffe |
| GRAN | 42.2 | Not recorded | 68fa70eb1e209131cea4dffe |
| AttH | 41.6 | Not recorded | 68fa70eb1e209131cea4dffe |
| TuckER | 40.5 | Not recorded | 68fa70eb1e209131cea4dffe |
| StarE | 38 | Not recorded | 68fa70eb1e209131cea4dffe |
| RotatE | 36.2 | Not recorded | 68fa70eb1e209131cea4dffe |
| HINGE | 10.9 | Not recorded | 68fa70eb1e209131cea4dffe |
| TransE | 8.5 | Not recorded | 68fa70eb1e209131cea4dffe |

### HyperKA

MRR: 69.2. Result ID: 699162473a6c31484907c754.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa686a1e209131cea1bfb7.md>)

[Implementation](<https://github.com/nju-websoft/HyperKA>)

Recorded evaluation configuration: {"Category":"DT-KGE"}. This record does not assert independent reproduction.

### DHGE

MRR: 69. Result ID: 699162473a6c31484907c758.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Implementation](<https://github.com/LHRLAB/DHGE>)

Recorded evaluation configuration: {"Category":"DH-KGE"}. This record does not assert independent reproduction.

### DHGE w/o HGA

MRR: 66.2. Result ID: 699162473a6c31484907c756.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Implementation](<https://github.com/LHRLAB/DHGE>)

Recorded evaluation configuration: {"Category":"DH-KGE"}. This record does not assert independent reproduction.

### JOIE

MRR: 60.3. Result ID: 699162473a6c31484907c753.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa697b1e209131cea2255a.md>)

Recorded evaluation configuration: {"Category":"DT-KGE"}. This record does not assert independent reproduction.

### DHGE w/o GE

MRR: 49.2. Result ID: 699162473a6c31484907c755.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Implementation](<https://github.com/LHRLAB/DHGE>)

Recorded evaluation configuration: {"Category":"DH-KGE"}. This record does not assert independent reproduction.

### DHGE w/o JL

MRR: 42.8. Result ID: 699162473a6c31484907c757.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Implementation](<https://github.com/LHRLAB/DHGE>)

Recorded evaluation configuration: {"Category":"DH-KGE"}. This record does not assert independent reproduction.

### GRAN

MRR: 42.2. Result ID: 699162473a6c31484907c752.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ef1e209131cea25097.md>)

Recorded evaluation configuration: {"Category":"SH-KGE"}. This record does not assert independent reproduction.

### AttH

MRR: 41.6. Result ID: 699162473a6c31484907c74f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67781e209131cea168a8.md>)

[Implementation](<https://github.com/tensorflow/neural-structured-learning/tree/master/research/kg_hyp_emb>)

Recorded evaluation configuration: {"Category":"ST-KGE"}. This record does not assert independent reproduction.

### TuckER

MRR: 40.5. Result ID: 699162473a6c31484907c74e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa669d1e209131cea11703.md>)

[Implementation](<https://github.com/ibalazevic/TuckER>)

Recorded evaluation configuration: {"Category":"ST-KGE"}. This record does not assert independent reproduction.

### StarE

MRR: 38. Result ID: 699162473a6c31484907c751.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68681e209131cea1beca.md>)

[Implementation](<https://github.com/migalkin/StarE>)

Recorded evaluation configuration: {"Category":"SH-KGE"}. This record does not assert independent reproduction.

### RotatE

MRR: 36.2. Result ID: 699162473a6c31484907c74d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65671e209131cea0a144.md>)

[Implementation](<https://github.com/DeepGraphLearning/KnowledgeGraphEmbedding>)

Recorded evaluation configuration: {"Category":"ST-KGE"}. This record does not assert independent reproduction.

### HINGE

MRR: 10.9. Result ID: 699162473a6c31484907c750.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

Recorded evaluation configuration: {"Category":"SH-KGE"}. This record does not assert independent reproduction.

### TransE

MRR: 8.5. Result ID: 699162473a6c31484907c74c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70eb1e209131cea4dffe.md>)

Recorded evaluation configuration: {"Category":"ST-KGE"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
