# Opinion Role Labeling on MPQA Target 2.0 (test) Source: [Opinion Role Labeling on MPQA Target 2.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:54:00.825Z Evaluation of Opinion Role Labeling performance on the test split of the MPQA Target 2.0 dataset, typically measured using Binary-F1 and Prop-F1 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Opinion Role Labeling | | Dataset (including any stated split) | MPQA Target 2.0 (test) | | Metric | O-R F1 (hd) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 23 of 23 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [O-R F1 (hd)](): Higher is better; unit: PERCENT. - [Binary F1](): Higher is better; unit: PERCENT. - [Prop F1](): Higher is better; unit: PERCENT. - [O F1](): Higher is better; unit: PERCENT. - [O-R F1](): Higher is better; unit: PERCENT. - [O-R F1 (tg)](): Higher is better; unit: PERCENT. - [Binary F1 (O-R(hd))](): Higher is better; unit: PERCENT. - [Binary F1 (O-R(tg))](): Higher is better; unit: PERCENT. ## Recorded results | Method | O-R F1 (hd) | Result date | Report paper | | --- | --- | --- | --- | | SyPtrTrans | 62.34 | Not recorded | 68fa6b6a1e209131cea2e34f | | PtrTrans | 61.65 | Not recorded | 68fa6b6a1e209131cea2e34f | | SPANOM | 61.2 | Not recorded | 68fa6b6a1e209131cea2e34f | | SyPtrTrans | 59.48 | Not recorded | 68fa6b6a1e209131cea2e34f | | SPANOM+Synt | 58.46 | Not recorded | 68fa6b6a1e209131cea2e34f | | PtrTrans | 58.28 | Not recorded | 68fa6b6a1e209131cea2e34f | | SPANOM | 58.24 | Not recorded | 68fa6b6a1e209131cea2e34f | | SyPtrTrans | 57.12 | Not recorded | 68fa6b6a1e209131cea2e34f | | PtrTrans | 56.88 | Not recorded | 68fa6b6a1e209131cea2e34f | | SPANOM | 55.62 | Not recorded | 68fa6b6a1e209131cea2e34f | | SyPtrTrans | 54.67 | Not recorded | 68fa6b6a1e209131cea2e34f | | PtrTrans | 53.19 | Not recorded | 68fa6b6a1e209131cea2e34f | | SPANOM | 52.9 | Not recorded | 68fa6b6a1e209131cea2e34f | | Transition | 47.02 | Not recorded | 68fa6b6a1e209131cea2e34f | | BiLSTM+CRF | 46.72 | Not recorded | 68fa6b6a1e209131cea2e34f | | BERT+CRF | 46.62 | Not recorded | 68fa6b6a1e209131cea2e34f | ### SyPtrTrans O-R F1 (hd): 62.34. Result ID: 698e8a60ffc3901de09e7cf1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"BERT":"Yes"}. This record does not assert independent reproduction. ### PtrTrans O-R F1 (hd): 61.65. Result ID: 698e8a60ffc3901de09e7cf0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"BERT":"Yes"}. This record does not assert independent reproduction. ### SPANOM O-R F1 (hd): 61.2. Result ID: 698e8a60ffc3901de09e7cef. [Reporting paper]() Recorded evaluation configuration: {"BERT":"Yes"}. This record does not assert independent reproduction. ### SyPtrTrans O-R F1 (hd): 59.48. Result ID: 698e8a60ffc3901de09e7ce8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Pre-trained Embeddings":"w/ BERT"}. This record does not assert independent reproduction. ### SPANOM+Synt O-R F1 (hd): 58.46. Result ID: 698e8a60ffc3901de09e7ce6. [Reporting paper]() Recorded evaluation configuration: {"Pre-trained Embeddings":"w/ BERT","Syntax Integration":true}. This record does not assert independent reproduction. ### PtrTrans O-R F1 (hd): 58.28. Result ID: 698e8a60ffc3901de09e7ce7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Pre-trained Embeddings":"w/ BERT"}. This record does not assert independent reproduction. ### SPANOM O-R F1 (hd): 58.24. Result ID: 698e8a60ffc3901de09e7ce5. [Reporting paper]() Recorded evaluation configuration: {"Pre-trained Embeddings":"w/ BERT"}. This record does not assert independent reproduction. ### SyPtrTrans O-R F1 (hd): 57.12. Result ID: 698e8a60ffc3901de09e7ced. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"BERT":"No"}. This record does not assert independent reproduction. ### PtrTrans O-R F1 (hd): 56.88. Result ID: 698e8a60ffc3901de09e7cec. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"BERT":"No"}. This record does not assert independent reproduction. ### SPANOM O-R F1 (hd): 55.62. Result ID: 698e8a60ffc3901de09e7ceb. [Reporting paper]() Recorded evaluation configuration: {"BERT":"No"}. This record does not assert independent reproduction. ### SyPtrTrans O-R F1 (hd): 54.67. Result ID: 698e8a60ffc3901de09e7ce4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Pre-trained Embeddings":"w/o BERT"}. This record does not assert independent reproduction. ### PtrTrans O-R F1 (hd): 53.19. Result ID: 698e8a60ffc3901de09e7ce3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Pre-trained Embeddings":"w/o BERT"}. This record does not assert independent reproduction. ### SPANOM O-R F1 (hd): 52.9. Result ID: 698e8a60ffc3901de09e7ce2. [Reporting paper]() Recorded evaluation configuration: {"Pre-trained Embeddings":"w/o BERT"}. This record does not assert independent reproduction. ### Transition O-R F1 (hd): 47.02. Result ID: 698e8a60ffc3901de09e7ce1. [Reporting paper]() Recorded evaluation configuration: {"Pre-trained Embeddings":"w/o BERT"}. This record does not assert independent reproduction. ### BiLSTM+CRF O-R F1 (hd): 46.72. Result ID: 698e8a60ffc3901de09e7ce0. [Reporting paper]() Recorded evaluation configuration: {"Pre-trained Embeddings":"w/o BERT"}. This record does not assert independent reproduction. ### BERT+CRF O-R F1 (hd): 46.62. Result ID: 698e8a60ffc3901de09e7cee. [Reporting paper]() Recorded evaluation configuration: {"BERT":"Yes"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.