# Multi-class Text Classification on AG News Source: [Multi-class Text Classification on AG News]() Collection index: [llms.txt]() Data updated: 2026-03-24T14:38:18.048Z Evaluation of multi-class text classification performance on the AG News dataset, measured using Micro-F1 and Macro-F1 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Multi-class text classification | | Dataset (including any stated split) | AG News | | Metric | Micro-F1 | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 33 of 33 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Micro-F1](): Higher is better; unit: SCALAR. - [Macro-F1](): Higher is better; unit: SCALAR. ## Recorded results | Method | Micro-F1 | Result date | Report paper | | --- | --- | --- | --- | | S2TC-BDD-F | 0.917 | Not recorded | 69c21ab80636e5bf4afc4afc | | FreeMatch | 0.915 | Not recorded | 69c21ab80636e5bf4afc4afc | | MetaExpert | 0.914 | Not recorded | 69c21ab80636e5bf4afc4afc | | S2TC-BDD-S | 0.907 | Not recorded | 69c21ab80636e5bf4afc4afc | | UDA | 0.906 | Not recorded | 69c21ab80636e5bf4afc4afc | | BERT+CE | 0.905 | Not recorded | 69c21ab80636e5bf4afc4afc | | BERT+AM-F | 0.903 | Not recorded | 69c21ab80636e5bf4afc4afc | | BERT+AM-S | 0.901 | Not recorded | 69c21ab80636e5bf4afc4afc | | VAT | 0.898 | Not recorded | 69c21ab80636e5bf4afc4afc | | S2TC-BDD-S | 0.889 | Not recorded | 69c21ab80636e5bf4afc4afc | | S2TC-BDD-F | 0.889 | Not recorded | 69c21ab80636e5bf4afc4afc | | BERT+AM-F | 0.886 | Not recorded | 69c21ab80636e5bf4afc4afc | | VAT | 0.886 | Not recorded | 69c21ab80636e5bf4afc4afc | | MetaExpert | 0.884 | Not recorded | 69c21ab80636e5bf4afc4afc | | UDA | 0.883 | Not recorded | 69c21ab80636e5bf4afc4afc | | FreeMatch | 0.882 | Not recorded | 69c21ab80636e5bf4afc4afc | | BERT+AM-S | 0.879 | Not recorded | 69c21ab80636e5bf4afc4afc | | BERT+CE | 0.878 | Not recorded | 69c21ab80636e5bf4afc4afc | | S2TC-BDD-F | 0.876 | Not recorded | 69c21ab80636e5bf4afc4afc | | VAMPIRE | 0.876 | Not recorded | 69c21ab80636e5bf4afc4afc | | NB+EM | 0.874 | Not recorded | 69c21ab80636e5bf4afc4afc | | S2TC-BDD-S | 0.872 | Not recorded | 69c21ab80636e5bf4afc4afc | | BERT+AM-F | 0.87 | Not recorded | 69c21ab80636e5bf4afc4afc | | VAT | 0.868 | Not recorded | 69c21ab80636e5bf4afc4afc | | MetaExpert | 0.867 | Not recorded | 69c21ab80636e5bf4afc4afc | | FreeMatch | 0.862 | Not recorded | 69c21ab80636e5bf4afc4afc | | BERT+AM-S | 0.856 | Not recorded | 69c21ab80636e5bf4afc4afc | | UDA | 0.855 | Not recorded | 69c21ab80636e5bf4afc4afc | | NB+EM | 0.855 | Not recorded | 69c21ab80636e5bf4afc4afc | | BERT+CE | 0.839 | Not recorded | 69c21ab80636e5bf4afc4afc | | NB+EM | 0.834 | Not recorded | 69c21ab80636e5bf4afc4afc | | VAMPIRE | 0.833 | Not recorded | 69c21ab80636e5bf4afc4afc | | VAMPIRE | 0.705 | Not recorded | 69c21ab80636e5bf4afc4afc | ### S2TC-BDD-F Micro-F1: 0.917. Result ID: 69c2a1ce47f34ce924ab578a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"10,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### FreeMatch Micro-F1: 0.915. Result ID: 69c2a1ce47f34ce924ab5787. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"10,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### MetaExpert Micro-F1: 0.914. Result ID: 69c2a1ce47f34ce924ab5788. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"10,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### S2TC-BDD-S Micro-F1: 0.907. Result ID: 69c2a1ce47f34ce924ab5789. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"10,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### UDA Micro-F1: 0.906. Result ID: 69c2a1ce47f34ce924ab5786. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"10,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### BERT+CE Micro-F1: 0.905. Result ID: 69c2a1ce47f34ce924ab5781. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"10,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### BERT+AM-F Micro-F1: 0.903. Result ID: 69c2a1ce47f34ce924ab5783. [Reporting paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"10,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### BERT+AM-S Micro-F1: 0.901. Result ID: 69c2a1ce47f34ce924ab5782. [Reporting paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"10,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### VAT Micro-F1: 0.898. Result ID: 69c2a1ce47f34ce924ab5785. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"10,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### S2TC-BDD-S Micro-F1: 0.889. Result ID: 69c2a1ce47f34ce924ab577e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"1,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### S2TC-BDD-F Micro-F1: 0.889. Result ID: 69c2a1ce47f34ce924ab577f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"1,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### BERT+AM-F Micro-F1: 0.886. Result ID: 69c2a1ce47f34ce924ab5778. [Reporting paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"1,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### VAT Micro-F1: 0.886. Result ID: 69c2a1ce47f34ce924ab577a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"1,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### MetaExpert Micro-F1: 0.884. Result ID: 69c2a1ce47f34ce924ab577d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"1,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### UDA Micro-F1: 0.883. Result ID: 69c2a1ce47f34ce924ab577b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"1,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### FreeMatch Micro-F1: 0.882. Result ID: 69c2a1ce47f34ce924ab577c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"1,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### BERT+AM-S Micro-F1: 0.879. Result ID: 69c2a1ce47f34ce924ab5777. [Reporting paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"1,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### BERT+CE Micro-F1: 0.878. Result ID: 69c2a1ce47f34ce924ab5776. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"1,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### S2TC-BDD-F Micro-F1: 0.876. Result ID: 69c2a1ce47f34ce924ab5774. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"100","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### VAMPIRE Micro-F1: 0.876. Result ID: 69c2a1ce47f34ce924ab5784. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"10,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### NB+EM Micro-F1: 0.874. Result ID: 69c2a1ce47f34ce924ab5780. [Reporting paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"10,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### S2TC-BDD-S Micro-F1: 0.872. Result ID: 69c2a1ce47f34ce924ab5773. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"100","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### BERT+AM-F Micro-F1: 0.87. Result ID: 69c2a1ce47f34ce924ab576d. [Reporting paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"100","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### VAT Micro-F1: 0.868. Result ID: 69c2a1ce47f34ce924ab576f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"100","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### MetaExpert Micro-F1: 0.867. Result ID: 69c2a1ce47f34ce924ab5772. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"100","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### FreeMatch Micro-F1: 0.862. Result ID: 69c2a1ce47f34ce924ab5771. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"100","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### BERT+AM-S Micro-F1: 0.856. Result ID: 69c2a1ce47f34ce924ab576c. [Reporting paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"100","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### UDA Micro-F1: 0.855. Result ID: 69c2a1ce47f34ce924ab5770. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"100","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### NB+EM Micro-F1: 0.855. Result ID: 69c2a1ce47f34ce924ab5775. [Reporting paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"1,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### BERT+CE Micro-F1: 0.839. Result ID: 69c2a1ce47f34ce924ab576b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"100","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### NB+EM Micro-F1: 0.834. Result ID: 69c2a1ce47f34ce924ab576a. [Reporting paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"100","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### VAMPIRE Micro-F1: 0.833. Result ID: 69c2a1ce47f34ce924ab5779. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"1,000","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. ### VAMPIRE Micro-F1: 0.705. Result ID: 69c2a1ce47f34ce924ab576e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Nl (Number of labeled texts)":"100","Max sentence length":"256","Backbone":"BERT-based-uncased"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.