# Text Classification on EDOS (test) Source: [Text Classification on EDOS (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:51:31.661Z Evaluation of Text Classification performance on the test split of the EDOS dataset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Text Classification | | Dataset (including any stated split) | EDOS (test) | | Metric | Macro F1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 21 of 21 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Macro F1 Score](): Higher is better; unit: PERCENT. - [% Improvement](): Higher is better; unit: PERCENT. - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Macro F1 Score | Result date | Report paper | | --- | --- | --- | --- | | DeBERTa-v3-base | 82.35 | Not recorded | 68fa738a1e209131cea5d162 | | SPIN | 81.48 | Not recorded | 68fa738a1e209131cea5d162 | | SPIN | 78.04 | Not recorded | 68fa738a1e209131cea5d162 | | SPIN | 76.79 | Not recorded | 68fa738a1e209131cea5d162 | | SPIN | 76.08 | Not recorded | 68fa738a1e209131cea5d162 | | SPIN | 75.79 | Not recorded | 68fa738a1e209131cea5d162 | | SPIN | 75.74 | Not recorded | 68fa738a1e209131cea5d162 | | SPIN | 74.51 | Not recorded | 68fa738a1e209131cea5d162 | | SPIN | 73.5 | Not recorded | 68fa738a1e209131cea5d162 | | GPT2-XL | 72.56 | Not recorded | 68fa738a1e209131cea5d162 | | GPT2-M | 71.17 | Not recorded | 68fa738a1e209131cea5d162 | | Flan-T5-XL | 70.08 | Not recorded | 68fa738a1e209131cea5d162 | | RoBERTa | 68.81 | Not recorded | 68fa738a1e209131cea5d162 | | GPT2 | 68.57 | Not recorded | 68fa738a1e209131cea5d162 | | Flan-T5 | 66.64 | Not recorded | 68fa738a1e209131cea5d162 | | DistilBERT | 65.09 | Not recorded | 68fa738a1e209131cea5d162 | | Flan-T5-S | 59.62 | Not recorded | 68fa738a1e209131cea5d162 | ### DeBERTa-v3-base Macro F1 Score: 82.35. Result ID: 6992e8433a6c3148491249d4. [Reporting paper]() Recorded evaluation configuration: {"Type":"SOTA","Training":"Full fine-tuning"}. This record does not assert independent reproduction. ### SPIN Macro F1 Score: 81.48. Result ID: 6992e8433a6c3148491249d3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Flan-T5-XL","Variant":"SPIN"}. This record does not assert independent reproduction. ### SPIN Macro F1 Score: 78.04. Result ID: 6992e8433a6c3148491249d1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Flan-T5","Variant":"SPIN"}. This record does not assert independent reproduction. ### SPIN Macro F1 Score: 76.79. Result ID: 6992e8433a6c3148491249cd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"GPT2-XL","Variant":"SPIN"}. This record does not assert independent reproduction. ### SPIN Macro F1 Score: 76.08. Result ID: 6992e8433a6c3148491249c9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"GPT2","Variant":"SPIN"}. This record does not assert independent reproduction. ### SPIN Macro F1 Score: 75.79. Result ID: 6992e8433a6c3148491249c5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"DistilBERT","Variant":"SPIN"}. This record does not assert independent reproduction. ### SPIN Macro F1 Score: 75.74. Result ID: 6992e8433a6c3148491249cb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"GPT2-M","Variant":"SPIN"}. This record does not assert independent reproduction. ### SPIN Macro F1 Score: 74.51. Result ID: 6992e8433a6c3148491249cf. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Flan-T5-S","Variant":"SPIN"}. This record does not assert independent reproduction. ### SPIN Macro F1 Score: 73.5. Result ID: 6992e8433a6c3148491249c7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"RoBERTa","Variant":"SPIN"}. This record does not assert independent reproduction. ### GPT2-XL Macro F1 Score: 72.56. Result ID: 6992e8433a6c3148491249cc. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"GPT2-XL","Variant":"Base"}. This record does not assert independent reproduction. ### GPT2-M Macro F1 Score: 71.17. Result ID: 6992e8433a6c3148491249ca. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"GPT2-M","Variant":"Base"}. This record does not assert independent reproduction. ### Flan-T5-XL Macro F1 Score: 70.08. Result ID: 6992e8433a6c3148491249d2. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Flan-T5-XL","Variant":"Base"}. This record does not assert independent reproduction. ### RoBERTa Macro F1 Score: 68.81. Result ID: 6992e8433a6c3148491249c6. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"RoBERTa","Variant":"Base"}. This record does not assert independent reproduction. ### GPT2 Macro F1 Score: 68.57. Result ID: 6992e8433a6c3148491249c8. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"GPT2","Variant":"Base"}. This record does not assert independent reproduction. ### Flan-T5 Macro F1 Score: 66.64. Result ID: 6992e8433a6c3148491249d0. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Flan-T5","Variant":"Base"}. This record does not assert independent reproduction. ### DistilBERT Macro F1 Score: 65.09. Result ID: 6992e8433a6c3148491249c4. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"DistilBERT","Variant":"Base"}. This record does not assert independent reproduction. ### Flan-T5-S Macro F1 Score: 59.62. Result ID: 6992e8433a6c3148491249ce. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Flan-T5-S","Variant":"Base"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.