# Fine-grained Entity Typing on FGN (test) Source: [Fine-grained Entity Typing on FGN (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:42:58.648Z Evaluation of Fine-grained Entity Typing performance on the test split of the FGN dataset, reporting F1 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Fine-grained Entity Typing | | Dataset (including any stated split) | FGN (test) | | Metric | F1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 19 of 19 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | F1 Score | Result date | Report paper | | --- | --- | --- | --- | | CVT + Multi-Task + Large | 88.81 | Not recorded | 68fa64da1e209131cea06bba | | CVT + Multi-task + Large | 88.8 | Not recorded | 68fa64da1e209131cea06bba | | CVT | 88.7 | Not recorded | 68fa64da1e209131cea06bba | | CVT | 88.68 | Not recorded | 68fa64da1e209131cea06bba | | ELMo (our implementation) | 88.5 | Not recorded | 68fa64da1e209131cea06bba | | ELMo | 88.49 | Not recorded | 68fa64da1e209131cea06bba | | CVT + Multi-Task | 88.42 | Not recorded | 68fa64da1e209131cea06bba | | ELMo + Multi-task | 88.4 | Not recorded | 68fa64da1e209131cea06bba | | CVT + Multi-task | 88.4 | Not recorded | 68fa64da1e209131cea06bba | | ELMo + Multi-task | 88.37 | Not recorded | 68fa64da1e209131cea06bba | | Word Dropout | 88.1 | Not recorded | 68fa64da1e209131cea06bba | | Word Dropout | 88.06 | Not recorded | 68fa64da1e209131cea06bba | | Virtual Adversarial Training | 87.91 | Not recorded | 68fa64da1e209131cea06bba | | Virtual Adversarial Training | 87.9 | Not recorded | 68fa64da1e209131cea06bba | | Supervised | 87.5 | Not recorded | 68fa64da1e209131cea06bba | | Supervised | 87.48 | Not recorded | 68fa64da1e209131cea06bba | | ID-CNN-CRF | 86.84 | Not recorded | 68fa64da1e209131cea06bba | | ID-CNN-CRF | 86.8 | Not recorded | 68fa64da1e209131cea06bba | | LSTM-CNN | 86.28 | Not recorded | 68fa64da1e209131cea06bba | ### CVT + Multi-Task + Large F1 Score: 88.81. Result ID: 698c8f600b614d12cff196b5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision Type":"Semi-supervised","Learning Paradigm":"Multi-task","Model Scale":"Large"}. This record does not assert independent reproduction. ### CVT + Multi-task + Large F1 Score: 88.8. Result ID: 698c8f600b614d12cff1966d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Semi-supervised":true,"Multi-task":true,"Model Size":"Large"}. This record does not assert independent reproduction. ### CVT F1 Score: 88.7. Result ID: 698c8f600b614d12cff1966b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Semi-supervised":true,"Multi-task":false}. This record does not assert independent reproduction. ### CVT F1 Score: 88.68. Result ID: 698c8f600b614d12cff196b3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision Type":"Semi-supervised","Learning Paradigm":"Single-task","Model Scale":"Standard"}. This record does not assert independent reproduction. ### ELMo (our implementation) F1 Score: 88.5. Result ID: 698c8f600b614d12cff19669. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Semi-supervised":true,"Multi-task":false}. This record does not assert independent reproduction. ### ELMo F1 Score: 88.49. Result ID: 698c8f600b614d12cff196b1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision Type":"Semi-supervised","Learning Paradigm":"Single-task","Model Scale":"Standard"}. This record does not assert independent reproduction. ### CVT + Multi-Task F1 Score: 88.42. Result ID: 698c8f600b614d12cff196b4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision Type":"Semi-supervised","Learning Paradigm":"Multi-task","Model Scale":"Standard"}. This record does not assert independent reproduction. ### ELMo + Multi-task F1 Score: 88.4. Result ID: 698c8f600b614d12cff1966a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Semi-supervised":true,"Multi-task":true}. This record does not assert independent reproduction. ### CVT + Multi-task F1 Score: 88.4. Result ID: 698c8f600b614d12cff1966c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Semi-supervised":true,"Multi-task":true}. This record does not assert independent reproduction. ### ELMo + Multi-task F1 Score: 88.37. Result ID: 698c8f600b614d12cff196b2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Supervision Type":"Semi-supervised","Learning Paradigm":"Multi-task","Model Scale":"Standard"}. This record does not assert independent reproduction. ### Word Dropout F1 Score: 88.1. Result ID: 698c8f600b614d12cff19668. [Reporting paper]() Recorded evaluation configuration: {"Semi-supervised":true,"Multi-task":false}. This record does not assert independent reproduction. ### Word Dropout F1 Score: 88.06. Result ID: 698c8f600b614d12cff196b0. [Reporting paper]() Recorded evaluation configuration: {"Supervision Type":"Semi-supervised","Learning Paradigm":"Single-task","Model Scale":"Standard"}. This record does not assert independent reproduction. ### Virtual Adversarial Training F1 Score: 87.91. Result ID: 698c8f600b614d12cff196af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision Type":"Semi-supervised","Learning Paradigm":"Single-task","Model Scale":"Standard"}. This record does not assert independent reproduction. ### Virtual Adversarial Training F1 Score: 87.9. Result ID: 698c8f600b614d12cff19667. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Semi-supervised":true,"Multi-task":false}. This record does not assert independent reproduction. ### Supervised F1 Score: 87.5. Result ID: 698c8f600b614d12cff19666. [Reporting paper]() Recorded evaluation configuration: {"Semi-supervised":false,"Multi-task":false}. This record does not assert independent reproduction. ### Supervised F1 Score: 87.48. Result ID: 698c8f600b614d12cff196ae. [Reporting paper]() Recorded evaluation configuration: {"Supervision Type":"Supervised","Learning Paradigm":"Single-task","Model Scale":"Standard"}. This record does not assert independent reproduction. ### ID-CNN-CRF F1 Score: 86.84. Result ID: 698c8f600b614d12cff196ad. [Reporting paper]() Recorded evaluation configuration: {"Supervision Type":"Supervised"}. This record does not assert independent reproduction. ### ID-CNN-CRF F1 Score: 86.8. Result ID: 698c8f600b614d12cff19665. [Reporting paper]() Recorded evaluation configuration: {"Semi-supervised":false,"Multi-task":false}. This record does not assert independent reproduction. ### LSTM-CNN F1 Score: 86.28. Result ID: 698c8f600b614d12cff196ac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision Type":"Supervised"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.