# Text Classification on THUCNews syntactically perturbed

Source: [Text Classification on THUCNews syntactically perturbed](<https://www.sota2.com/research/sota/text-classification-on-thucnews-syntactically-perturbed>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-02T09:43:28.515Z

Evaluation of Text Classification performance on the syntactically perturbed version of the THUCNews dataset, measured by Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Text Classification |
| Dataset (including any stated split) | THUCNews syntactically perturbed |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 17 of 17 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/text-classification-on-thucnews-syntactically-perturbed.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| SyCo | 95.39 | Not recorded | 69cdf8400636e5bf4afcccaf |
| POEM+TA-LoRA | 94.83 | Not recorded | 69cdf8400636e5bf4afcccaf |
| T2ARD+TA-LoRA | 94.31 | Not recorded | 69cdf8400636e5bf4afcccaf |
| POEM+MPT | 93.57 | Not recorded | 69cdf8400636e5bf4afcccaf |
| ClusT3+ATTEMPT | 93.46 | Not recorded | 69cdf8400636e5bf4afcccaf |
| TA-LoRA | 92.85 | Not recorded | 69cdf8400636e5bf4afcccaf |
| ATTEMPT | 91.59 | Not recorded | 69cdf8400636e5bf4afcccaf |
| MPT | 91.57 | Not recorded | 69cdf8400636e5bf4afcccaf |
| T2ARD+MPT | 90.11 | Not recorded | 69cdf8400636e5bf4afcccaf |
| TENT+SPoT | 87.78 | Not recorded | 69cdf8400636e5bf4afcccaf |
| SPoT | 86.72 | Not recorded | 69cdf8400636e5bf4afcccaf |
| T2ARD | 86.35 | Not recorded | 69cdf8400636e5bf4afcccaf |
| POEM | 84.28 | Not recorded | 69cdf8400636e5bf4afcccaf |
| FOA | 82.2 | Not recorded | 69cdf8400636e5bf4afcccaf |
| ClusT3 | 80.13 | Not recorded | 69cdf8400636e5bf4afcccaf |
| TENT | 78.05 | Not recorded | 69cdf8400636e5bf4afcccaf |
| PT | 76.8 | Not recorded | 69cdf8400636e5bf4afcccaf |

### SyCo

Accuracy: 95.39. Result ID: 69ce3a2747f34ce924b7c925.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

Recorded evaluation configuration: {"Paradigm":"MOA"}. This record does not assert independent reproduction.

### POEM+TA-LoRA

Accuracy: 94.83. Result ID: 69ce3a2747f34ce924b7c923.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

Recorded evaluation configuration: {"Paradigm":"MOA"}. This record does not assert independent reproduction.

### T2ARD+TA-LoRA

Accuracy: 94.31. Result ID: 69ce3a2747f34ce924b7c924.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

Recorded evaluation configuration: {"Paradigm":"MOA"}. This record does not assert independent reproduction.

### POEM+MPT

Accuracy: 93.57. Result ID: 69ce3a2747f34ce924b7c921.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

Recorded evaluation configuration: {"Paradigm":"MOA"}. This record does not assert independent reproduction.

### ClusT3+ATTEMPT

Accuracy: 93.46. Result ID: 69ce3a2747f34ce924b7c920.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

Recorded evaluation configuration: {"Paradigm":"MOA"}. This record does not assert independent reproduction.

### TA-LoRA

Accuracy: 92.85. Result ID: 69ce3a2747f34ce924b7c91e.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78601e209131cea78125.md>)

Recorded evaluation configuration: {"Paradigm":"MTL"}. This record does not assert independent reproduction.

### ATTEMPT

Accuracy: 91.59. Result ID: 69ce3a2747f34ce924b7c91c.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e221e209131cea3e0f3.md>)

Recorded evaluation configuration: {"Paradigm":"MTL"}. This record does not assert independent reproduction.

### MPT

Accuracy: 91.57. Result ID: 69ce3a2747f34ce924b7c91d.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb51e209131cea41a8d.md>)

Recorded evaluation configuration: {"Paradigm":"MTL"}. This record does not assert independent reproduction.

### T2ARD+MPT

Accuracy: 90.11. Result ID: 69ce3a2747f34ce924b7c922.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

Recorded evaluation configuration: {"Paradigm":"MOA"}. This record does not assert independent reproduction.

### TENT+SPoT

Accuracy: 87.78. Result ID: 69ce3a2747f34ce924b7c91f.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

Recorded evaluation configuration: {"Paradigm":"MOA"}. This record does not assert independent reproduction.

### SPoT

Accuracy: 86.72. Result ID: 69ce3a2747f34ce924b7c91b.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bfd1e209131cea31722.md>)

[Implementation](<https://github.com/google-research/prompt-tuning/tree/main/prompt_tuning/spot>)

Recorded evaluation configuration: {"Paradigm":"MTL"}. This record does not assert independent reproduction.

### T2ARD

Accuracy: 86.35. Result ID: 69ce3a2747f34ce924b7c91a.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

Recorded evaluation configuration: {"Paradigm":"TTA"}. This record does not assert independent reproduction.

### POEM

Accuracy: 84.28. Result ID: 69ce3a2747f34ce924b7c919.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa767c1e209131cea6d56b.md>)

Recorded evaluation configuration: {"Paradigm":"TTA"}. This record does not assert independent reproduction.

### FOA

Accuracy: 82.2. Result ID: 69ce3a2747f34ce924b7c918.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73691e209131cea5c4c4.md>)

Recorded evaluation configuration: {"Paradigm":"TTA"}. This record does not assert independent reproduction.

### ClusT3

Accuracy: 80.13. Result ID: 69ce3a2747f34ce924b7c917.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e71e209131cea4dd71.md>)

Recorded evaluation configuration: {"Paradigm":"TTA"}. This record does not assert independent reproduction.

### TENT

Accuracy: 78.05. Result ID: 69ce3a2747f34ce924b7c916.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69941e209131cea22d2b.md>)

Recorded evaluation configuration: {"Paradigm":"TTA"}. This record does not assert independent reproduction.

### PT

Accuracy: 76.8. Result ID: 69ce3a2747f34ce924b7c915.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf8400636e5bf4afcccaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa690f1e209131cea1fe0e.md>)

Recorded evaluation configuration: {"Paradigm":"Vanilla"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
