# Text Classification on AGNEWS (Accuracy and F1) Source: [Text Classification on AGNEWS (Accuracy and F1)]() Collection index: [llms.txt]() Data updated: 2026-06-04T08:58:24.745Z Standard evaluation of Text Classification performance on the AGNews dataset, reporting both overall Accuracy and F1 score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Text Classification | | Dataset (including any stated split) | AGNEWS | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 34 of 34 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | true-base | 92.9 | Not recorded | 68fa73141e209131cea5a5f9 | | true-base | 92.8 | Not recorded | 68fa73141e209131cea5a5f9 | | DECA | 92.79 | Not recorded | 6a21065fc10484bac23efec9 | | Dec-LoRA | 90.76 | Not recorded | 6a21065fc10484bac23efec9 | | DECA | 88.84 | Not recorded | 6a21065fc10484bac23efec9 | | geo-reg-f | 87.4 | Not recorded | 68fa73141e209131cea5a5f9 | | Dec-LoRA | 87.3 | Not recorded | 6a21065fc10484bac23efec9 | | union-net | 87.1 | Not recorded | 68fa73141e209131cea5a5f9 | | annot-mix | 87 | Not recorded | 68fa73141e209131cea5a5f9 | | trace-reg | 86.7 | Not recorded | 68fa73141e209131cea5a5f9 | | geo-reg-f | 86.7 | Not recorded | 68fa73141e209131cea5a5f9 | | union-net | 86.2 | Not recorded | 68fa73141e209131cea5a5f9 | | annot-mix | 86.2 | Not recorded | 68fa73141e209131cea5a5f9 | | crowd-layer | 86.2 | Not recorded | 68fa73141e209131cea5a5f9 | | trace-reg | 86.2 | Not recorded | 68fa73141e209131cea5a5f9 | | crowd-layer | 85.6 | Not recorded | 68fa73141e209131cea5a5f9 | | Dec-Adapter | 83.82 | Not recorded | 6a21065fc10484bac23efec9 | | geo-reg-w | 83.1 | Not recorded | 68fa73141e209131cea5a5f9 | | geo-reg-w | 82.1 | Not recorded | 68fa73141e209131cea5a5f9 | | conal | 79.3 | Not recorded | 68fa73141e209131cea5a5f9 | | madl | 78 | Not recorded | 68fa73141e209131cea5a5f9 | | mv-base | 77.1 | Not recorded | 68fa73141e209131cea5a5f9 | | mv-mixup | 76.6 | Not recorded | 68fa73141e209131cea5a5f9 | | ds-mixup | 76.6 | Not recorded | 68fa73141e209131cea5a5f9 | | crowd-ar | 76.3 | Not recorded | 68fa73141e209131cea5a5f9 | | conal | 76.1 | Not recorded | 68fa73141e209131cea5a5f9 | | madl | 76 | Not recorded | 68fa73141e209131cea5a5f9 | | mv-mixup | 74.4 | Not recorded | 68fa73141e209131cea5a5f9 | | ds-mixup | 74.4 | Not recorded | 68fa73141e209131cea5a5f9 | | mv-base | 74.3 | Not recorded | 68fa73141e209131cea5a5f9 | | crowd-ar | 72.4 | Not recorded | 68fa73141e209131cea5a5f9 | | DeCAF | 70.74 | Not recorded | 6a21065fc10484bac23efec9 | | DeCAF | 67.45 | Not recorded | 6a21065fc10484bac23efec9 | | Dec-Adapter | 24.66 | Not recorded | 6a21065fc10484bac23efec9 | ### true-base Accuracy: 92.9. Result ID: 6a213e27fbc373592c1cf42b. [Reporting paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### true-base Accuracy: 92.8. Result ID: 6a213e27fbc373592c1cf438. [Reporting paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### DECA Accuracy: 92.79. Result ID: 6a2133aafbc373592c1ca66e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### Dec-LoRA Accuracy: 90.76. Result ID: 6a2133aafbc373592c1ca66c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### DECA Accuracy: 88.84. Result ID: 6a2133aafbc373592c1ca66a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B"}. This record does not assert independent reproduction. ### geo-reg-f Accuracy: 87.4. Result ID: 6a213e27fbc373592c1cf441. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### Dec-LoRA Accuracy: 87.3. Result ID: 6a2133aafbc373592c1ca668. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B"}. This record does not assert independent reproduction. ### union-net Accuracy: 87.1. Result ID: 6a213e27fbc373592c1cf43f. [Reporting paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### annot-mix Accuracy: 87. Result ID: 6a213e27fbc373592c1cf444. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### trace-reg Accuracy: 86.7. Result ID: 6a213e27fbc373592c1cf430. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### geo-reg-f Accuracy: 86.7. Result ID: 6a213e27fbc373592c1cf434. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### union-net Accuracy: 86.2. Result ID: 6a213e27fbc373592c1cf432. [Reporting paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### annot-mix Accuracy: 86.2. Result ID: 6a213e27fbc373592c1cf437. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### crowd-layer Accuracy: 86.2. Result ID: 6a213e27fbc373592c1cf43c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### trace-reg Accuracy: 86.2. Result ID: 6a213e27fbc373592c1cf43d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### crowd-layer Accuracy: 85.6. Result ID: 6a213e27fbc373592c1cf42f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### Dec-Adapter Accuracy: 83.82. Result ID: 6a2133aafbc373592c1ca667. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B"}. This record does not assert independent reproduction. ### geo-reg-w Accuracy: 83.1. Result ID: 6a213e27fbc373592c1cf442. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### geo-reg-w Accuracy: 82.1. Result ID: 6a213e27fbc373592c1cf435. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### conal Accuracy: 79.3. Result ID: 6a213e27fbc373592c1cf43e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### madl Accuracy: 78. Result ID: 6a213e27fbc373592c1cf440. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### mv-base Accuracy: 77.1. Result ID: 6a213e27fbc373592c1cf439. [Reporting paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### mv-mixup Accuracy: 76.6. Result ID: 6a213e27fbc373592c1cf43a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### ds-mixup Accuracy: 76.6. Result ID: 6a213e27fbc373592c1cf43b. [Reporting paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### crowd-ar Accuracy: 76.3. Result ID: 6a213e27fbc373592c1cf443. [Reporting paper]() Recorded evaluation configuration: {"Epoch Selection":"Best Epoch"}. This record does not assert independent reproduction. ### conal Accuracy: 76.1. Result ID: 6a213e27fbc373592c1cf431. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### madl Accuracy: 76. Result ID: 6a213e27fbc373592c1cf433. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### mv-mixup Accuracy: 74.4. Result ID: 6a213e27fbc373592c1cf42d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### ds-mixup Accuracy: 74.4. Result ID: 6a213e27fbc373592c1cf42e. [Reporting paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### mv-base Accuracy: 74.3. Result ID: 6a213e27fbc373592c1cf42c. [Reporting paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### crowd-ar Accuracy: 72.4. Result ID: 6a213e27fbc373592c1cf436. [Reporting paper]() Recorded evaluation configuration: {"Epoch Selection":"Last Epoch"}. This record does not assert independent reproduction. ### DeCAF Accuracy: 70.74. Result ID: 6a2133aafbc373592c1ca66d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### DeCAF Accuracy: 67.45. Result ID: 6a2133aafbc373592c1ca669. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-3B"}. This record does not assert independent reproduction. ### Dec-Adapter Accuracy: 24.66. Result ID: 6a2133aafbc373592c1ca66b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.