# Text Classification on BANKING77 Dir(0.1) (test)

Source: [Text Classification on BANKING77 Dir(0.1) (test)](<https://www.sota2.com/research/sota/text-classification-on-banking77-dir-0-1-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:30:34.167Z

Evaluation of Text Classification performance on the test split of the BANKING77 dataset configured with Dir(0.1), measured using Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Text Classification |
| Dataset (including any stated split) | BANKING77 Dir(0.1) (test) |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 17 of 17 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/text-classification-on-banking77-dir-0-1-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| FlexLoRA | 92.14 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 92.02 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 91.87 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 91.61 | Not recorded | 68fa78f21e209131cea7b5fa |
| LoRA-A2 | 91.43 | Not recorded | 68fa78f21e209131cea7b5fa |
| FlexLoRA | 90.53 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 90.47 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL (w/o LoRA) | 90.29 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 88.11 | Not recorded | 68fa78f21e209131cea7b5fa |
| FlexLoRA | 87.31 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 85.59 | Not recorded | 68fa78f21e209131cea7b5fa |
| FL + LoRA | 82.24 | Not recorded | 68fa78f21e209131cea7b5fa |
| FlexLoRA | 82.2 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 77.44 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 76.38 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 73.44 | Not recorded | 68fa78f21e209131cea7b5fa |
| FFA-LoRA | 72.96 | Not recorded | 68fa78f21e209131cea7b5fa |

### FlexLoRA

Accuracy: 92.14. Result ID: 6995b20b3badfaffe6b1cc3c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"1.99B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 92.02. Result ID: 6995b20b3badfaffe6b1cc45.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.528B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 91.87. Result ID: 6995b20b3badfaffe6b1cc49.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.270B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 91.61. Result ID: 6995b20b3badfaffe6b1cc3d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"1.31B"}. This record does not assert independent reproduction.

### LoRA-A2

Accuracy: 91.43. Result ID: 6995b20b3badfaffe6b1cc41.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.888B"}. This record does not assert independent reproduction.

### FlexLoRA

Accuracy: 90.53. Result ID: 6995b20b3badfaffe6b1cc40.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.991B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 90.47. Result ID: 6995b20b3badfaffe6b1cc3a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"1.99B"}. This record does not assert independent reproduction.

### FL (w/o LoRA)

Accuracy: 90.29. Result ID: 6995b20b3badfaffe6b1cc39.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","Communicated Parameters":"186B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 88.11. Result ID: 6995b20b3badfaffe6b1cc3e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.991B"}. This record does not assert independent reproduction.

### FlexLoRA

Accuracy: 87.31. Result ID: 6995b20b3badfaffe6b1cc44.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.497B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 85.59. Result ID: 6995b20b3badfaffe6b1cc42.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.497B"}. This record does not assert independent reproduction.

### FL + LoRA

Accuracy: 82.24. Result ID: 6995b20b3badfaffe6b1cc46.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e761e209131cea40072.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.249B"}. This record does not assert independent reproduction.

### FlexLoRA

Accuracy: 82.2. Result ID: 6995b20b3badfaffe6b1cc48.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa736c1e209131cea5c671.md>)

[Implementation](<https://github.com/alibaba/FederatedScope/tree/FlexLoRA>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.249B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 77.44. Result ID: 6995b20b3badfaffe6b1cc3b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":8,"Communicated Parameters":"0.991B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 76.38. Result ID: 6995b20b3badfaffe6b1cc3f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":4,"Communicated Parameters":"0.497B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 73.44. Result ID: 6995b20b3badfaffe6b1cc43.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":2,"Communicated Parameters":"0.249B"}. This record does not assert independent reproduction.

### FFA-LoRA

Accuracy: 72.96. Result ID: 6995b20b3badfaffe6b1cc47.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78f21e209131cea7b5fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72481e209131cea5586e.md>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base","LoRA Rank":1,"Communicated Parameters":"0.124B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
