# Text Classification on 20 Newsgroups Dir(0.01) (test)

Source: [Text Classification on 20 Newsgroups Dir(0.01) (test)](<https://www.sota2.com/research/sota/text-classification-on-20-newsgroups-dir-0-01-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:30:34.216Z

Evaluation of Text Classification performance on the specific 'Dir(0.01)' subset of the 20 Newsgroups test split, measured using Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Text Classification |
| Dataset (including any stated split) | 20 Newsgroups Dir(0.01) (test) |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 17 of 17 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/text-classification-on-20-newsgroups-dir-0-01-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| FL (w/o LoRA) | 0.6441 | Not recorded | 68fa78f21e209131cea7b5fa |
| FlexLoRA | 0.6041 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 0.5484 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 0.545 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 0.5304 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 0.5299 | Not recorded | 68fa78f21e209131cea7b5fa |
| FlexLoRA | 0.505 | Not recorded | 68fa78f21e209131cea7b5fa |
| FlexLoRA | 0.4823 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 0.439 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 0.4312 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 0.3907 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 0.3734 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 0.3665 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 0.3658 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 0.3604 | Not recorded | 68fa78f21e209131cea7b5fa |
| FlexLoRA | 0.3554 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 0.3444 | Not recorded | 68fa78f21e209131cea7b5fa |

### FL (w/o LoRA)

Accuracy: 0.6441. Result ID: 6995b20b3badfaffe6b1cc7d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","Communicated Parameters":"186B"}. This record does not assert independent reproduction.

### FlexLoRA

Accuracy: 0.6041. Result ID: 6995b20b3badfaffe6b1cc80.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"1.99B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 0.5484. Result ID: 6995b20b3badfaffe6b1cc8d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.270B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 0.545. Result ID: 6995b20b3badfaffe6b1cc81.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"1.31B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 0.5304. Result ID: 6995b20b3badfaffe6b1cc85.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.888B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 0.5299. Result ID: 6995b20b3badfaffe6b1cc89.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.528B"}. This record does not assert independent reproduction.

### FlexLoRA

Accuracy: 0.505. Result ID: 6995b20b3badfaffe6b1cc84.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.991B"}. This record does not assert independent reproduction.

### FlexLoRA

Accuracy: 0.4823. Result ID: 6995b20b3badfaffe6b1cc88.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.497B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 0.439. Result ID: 6995b20b3badfaffe6b1cc7e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"1.99B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 0.4312. Result ID: 6995b20b3badfaffe6b1cc82.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.991B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 0.3907. Result ID: 6995b20b3badfaffe6b1cc86.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.497B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 0.3734. Result ID: 6995b20b3badfaffe6b1cc7f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"0.991B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 0.3665. Result ID: 6995b20b3badfaffe6b1cc87.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.249B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 0.3658. Result ID: 6995b20b3badfaffe6b1cc8a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.249B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 0.3604. Result ID: 6995b20b3badfaffe6b1cc83.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.497B"}. This record does not assert independent reproduction.

### FlexLoRA

Accuracy: 0.3554. Result ID: 6995b20b3badfaffe6b1cc8c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.249B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 0.3444. Result ID: 6995b20b3badfaffe6b1cc8b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.124B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
