# Text Classification on 20 Newsgroups Dir(0.5) (test)

Source: [Text Classification on 20 Newsgroups Dir(0.5) (test)](<https://www.sota2.com/research/sota/text-classification-on-20-newsgroups-dir-0-5-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:30:34.183Z

Evaluation of Text Classification performance on the specific 'Dir(0.5)' subset of the 20 Newsgroups test split, measured using Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Text Classification |
| Dataset (including any stated split) | 20 Newsgroups Dir(0.5) (test) |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 17 of 17 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/text-classification-on-20-newsgroups-dir-0-5-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| FL (w/o LoRA) | 70.93 | Not recorded | 68fa78f21e209131cea7b5fa |
| FlexLoRA | 70.59 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 70.44 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 70.33 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 70.31 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 70.28 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 70.26 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 70.14 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 70.12 | Not recorded | 68fa78f21e209131cea7b5fa |
| FlexLoRA | 70.05 | Not recorded | 68fa78f21e209131cea7b5fa |
| FlexLoRA | 70.03 | Not recorded | 68fa78f21e209131cea7b5fa |
| FlexLoRA | 69.53 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 69.4 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 68.12 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 67.75 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 67.73 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 67 | Not recorded | 68fa78f21e209131cea7b5fa |

### FL (w/o LoRA)

Accuracy: 70.93. Result ID: 6995b20b3badfaffe6b1cc5b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","Communicated Parameters":"186B"}. This record does not assert independent reproduction.

### FlexLoRA

Accuracy: 70.59. Result ID: 6995b20b3badfaffe6b1cc5e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"1.99B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 70.44. Result ID: 6995b20b3badfaffe6b1cc5c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"1.99B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 70.33. Result ID: 6995b20b3badfaffe6b1cc60.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.991B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 70.31. Result ID: 6995b20b3badfaffe6b1cc6b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.270B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 70.28. Result ID: 6995b20b3badfaffe6b1cc63.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.888B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 70.26. Result ID: 6995b20b3badfaffe6b1cc5f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"1.31B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 70.14. Result ID: 6995b20b3badfaffe6b1cc64.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.497B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 70.12. Result ID: 6995b20b3badfaffe6b1cc67.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.528B"}. This record does not assert independent reproduction.

### FlexLoRA

Accuracy: 70.05. Result ID: 6995b20b3badfaffe6b1cc62.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.991B"}. This record does not assert independent reproduction.

### FlexLoRA

Accuracy: 70.03. Result ID: 6995b20b3badfaffe6b1cc66.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.497B"}. This record does not assert independent reproduction.

### FlexLoRA

Accuracy: 69.53. Result ID: 6995b20b3badfaffe6b1cc6a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.249B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 69.4. Result ID: 6995b20b3badfaffe6b1cc68.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.249B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 68.12. Result ID: 6995b20b3badfaffe6b1cc65.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.249B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 67.75. Result ID: 6995b20b3badfaffe6b1cc61.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.497B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 67.73. Result ID: 6995b20b3badfaffe6b1cc69.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.124B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 67. Result ID: 6995b20b3badfaffe6b1cc5d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"0.991B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
