# Word Sense Disambiguation on SemEval Task 12 2013 Source: [Word Sense Disambiguation on SemEval Task 12 2013]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:42:58.393Z Evaluation of Word Sense Disambiguation performance on the SemEval Task 12 2013 dataset, typically measured using F1-score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Word Sense Disambiguation | | Dataset (including any stated split) | SemEval Task 12 2013 | | Metric | F1 Score | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [F1 Score](): Higher is better; unit: SCALAR. ## Recorded results | Method | F1 Score | Result date | Report paper | | --- | --- | --- | --- | | GASext | 0.672 | Not recorded | 68fa649e1e209131cea05a04 | | GASext | 0.671 | Not recorded | 68fa649e1e209131cea05a04 | | GAS | 0.67 | Not recorded | 68fa649e1e209131cea05a04 | | Bi-LSTM+att.+LEX+POS | 0.669 | Not recorded | 68fa649e1e209131cea05a04 | | GAS | 0.667 | Not recorded | 68fa649e1e209131cea05a04 | | Babelfy | 0.664 | Not recorded | 68fa649e1e209131cea05a04 | | Bi-LSTM+att.+LEX | 0.664 | Not recorded | 68fa649e1e209131cea05a04 | | Leskext+emb | 0.662 | Not recorded | 68fa649e1e209131cea05a04 | | IMS+emb | 0.659 | Not recorded | 68fa649e1e209131cea05a04 | | IMS | 0.653 | Not recorded | 68fa649e1e209131cea05a04 | | Bi-LSTM | 0.648 | Not recorded | 68fa649e1e209131cea05a04 | | MFS baseline | 0.638 | Not recorded | 68fa649e1e209131cea05a04 | ### GASext F1 Score: 0.672. Result ID: 698c4f1b37894ef7d9cd6929. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Composition method":"Concatenation","External Knowledge":true}. This record does not assert independent reproduction. ### GASext F1 Score: 0.671. Result ID: 698c4f1b37894ef7d9cd6928. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Composition method":"Linear","External Knowledge":true}. This record does not assert independent reproduction. ### GAS F1 Score: 0.67. Result ID: 698c4f1b37894ef7d9cd6927. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Composition method":"Concatenation","External Knowledge":true}. This record does not assert independent reproduction. ### Bi-LSTM+att.+LEX+POS F1 Score: 0.669. Result ID: 698c4f1b37894ef7d9cd6925. [Reporting paper]() Recorded evaluation configuration: {"External Knowledge":true}. This record does not assert independent reproduction. ### GAS F1 Score: 0.667. Result ID: 698c4f1b37894ef7d9cd6926. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Composition method":"Linear","External Knowledge":true}. This record does not assert independent reproduction. ### Babelfy F1 Score: 0.664. Result ID: 698c4f1b37894ef7d9cd6920. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Bi-LSTM+att.+LEX F1 Score: 0.664. Result ID: 698c4f1b37894ef7d9cd6924. [Reporting paper]() Recorded evaluation configuration: {"External Knowledge":true}. This record does not assert independent reproduction. ### Leskext+emb F1 Score: 0.662. Result ID: 698c4f1b37894ef7d9cd691f. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### IMS+emb F1 Score: 0.659. Result ID: 698c4f1b37894ef7d9cd6922. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### IMS F1 Score: 0.653. Result ID: 698c4f1b37894ef7d9cd6921. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Bi-LSTM F1 Score: 0.648. Result ID: 698c4f1b37894ef7d9cd6923. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MFS baseline F1 Score: 0.638. Result ID: 698c4f1b37894ef7d9cd691e. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.