# Aggregate Performance on ACE, Casie, AgNews, SST5, CB, R8 (test)

Source: [Aggregate Performance on ACE, Casie, AgNews, SST5, CB, R8 (test)](<https://www.sota2.com/research/sota/aggregate-performance-on-ace-casie-agnews-sst5-cb-r8-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-20T08:03:08.172Z

Evaluation reporting aggregate performance across several distinct NLP tasks including Event Extraction (ACE, Casie), Sentiment Analysis (SST5), Natural Language Inference (CB), News Classification (AgNews), and R8.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Text understanding and information extraction |
| Dataset (including any stated split) | ACE, Casie, AgNews, SST5, CB, R8 (test) |
| Metric | ACE Performance |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 4 of 4 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ACE Performance](<https://www.sota2.com/research/sota/aggregate-performance-on-ace-casie-agnews-sst5-cb-r8-test.md?metric=ACE%20Performance>): Higher is better; unit: PERCENT.

- [Casie Performance](<https://www.sota2.com/research/sota/aggregate-performance-on-ace-casie-agnews-sst5-cb-r8-test.md?metric=Casie%20Performance>): Higher is better; unit: PERCENT.

- [AgNews Performance](<https://www.sota2.com/research/sota/aggregate-performance-on-ace-casie-agnews-sst5-cb-r8-test.md?metric=AgNews%20Performance>): Higher is better; unit: PERCENT.

- [SST5 Performance](<https://www.sota2.com/research/sota/aggregate-performance-on-ace-casie-agnews-sst5-cb-r8-test.md?metric=SST5%20Performance>): Higher is better; unit: PERCENT.

- [CB Performance](<https://www.sota2.com/research/sota/aggregate-performance-on-ace-casie-agnews-sst5-cb-r8-test.md?metric=CB%20Performance>): Higher is better; unit: PERCENT.

- [R8 Performance](<https://www.sota2.com/research/sota/aggregate-performance-on-ace-casie-agnews-sst5-cb-r8-test.md?metric=R8%20Performance>): Higher is better; unit: PERCENT.

- [Average Performance](<https://www.sota2.com/research/sota/aggregate-performance-on-ace-casie-agnews-sst5-cb-r8-test.md?metric=Average%20Performance>): Higher is better; unit: PERCENT.

## Recorded results

| Method | ACE Performance | Result date | Report paper |
| --- | --- | --- | --- |
| UCPOF | 66.97 | Not recorded | 69bcd4870636e5bf4afc29a3 |
| Full RAG | 65.44 | Not recorded | 69bcd4870636e5bf4afc29a3 |
| baseline | 52.6 | Not recorded | 69bcd4870636e5bf4afc29a3 |
| gold shot | 47.09 | Not recorded | 69bcd4870636e5bf4afc29a3 |

### UCPOF

ACE Performance: 66.97. Result ID: 69bcfef947f34ce924a6d9ca.

[Reporting paper](<https://www.sota2.com/research/paper/69bcd4870636e5bf4afc29a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69bcd4870636e5bf4afc29a3.md>)

Recorded evaluation configuration: {"model":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction.

### Full RAG

ACE Performance: 65.44. Result ID: 69bcfef947f34ce924a6d9c9.

[Reporting paper](<https://www.sota2.com/research/paper/69bcd4870636e5bf4afc29a3.md>)

Recorded evaluation configuration: {"model":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction.

### baseline

ACE Performance: 52.6. Result ID: 69bcfef947f34ce924a6d9c7.

[Reporting paper](<https://www.sota2.com/research/paper/69bcd4870636e5bf4afc29a3.md>)

Recorded evaluation configuration: {"model":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction.

### gold shot

ACE Performance: 47.09. Result ID: 69bcfef947f34ce924a6d9c8.

[Reporting paper](<https://www.sota2.com/research/paper/69bcd4870636e5bf4afc29a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69bcd4870636e5bf4afc29a3.md>)

Recorded evaluation configuration: {"model":"Qwen2.5-14B-Instruct"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
