# Open-ended Generation on Finance

Source: [Open-ended Generation on Finance](<https://www.sota2.com/research/sota/open-ended-generation-on-finance>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-16T07:43:17.694Z

Evaluation of open-ended text generation performance on the Finance dataset, measured using ROUGE-Lsum.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Open-ended Generation |
| Dataset (including any stated split) | Finance |
| Metric | ROUGE-Lsum |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ROUGE-Lsum](<https://www.sota2.com/research/sota/open-ended-generation-on-finance.md?metric=ROUGE-Lsum>): Higher is better; unit: PERCENT.

## Recorded results

| Method | ROUGE-Lsum | Result date | Report paper |
| --- | --- | --- | --- |
| TF-TTCL | 29.19 | Not recorded | 69e06d257d0172140ec7cb83 |
| TF-TTCL | 28.31 | Not recorded | 69e06d257d0172140ec7cb83 |
| Base LLM | 26.47 | Not recorded | 69e06d257d0172140ec7cb83 |
| TF-GRPO | 25.8 | Not recorded | 69e06d257d0172140ec7cb83 |
| Base LLM | 25.78 | Not recorded | 69e06d257d0172140ec7cb83 |
| TF-GRPO | 25 | Not recorded | 69e06d257d0172140ec7cb83 |
| Chain-of-Thought | 24.28 | Not recorded | 69e06d257d0172140ec7cb83 |
| Chain-of-Thought | 22.97 | Not recorded | 69e06d257d0172140ec7cb83 |

### TF-TTCL

ROUGE-Lsum: 29.19. Result ID: 69e0928747f34ce924c98a6e.

[Reporting paper](<https://www.sota2.com/research/paper/69e06d257d0172140ec7cb83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e06d257d0172140ec7cb83.md>)

Recorded evaluation configuration: {"Model":"DeepSeek-V3.2"}. This record does not assert independent reproduction.

### TF-TTCL

ROUGE-Lsum: 28.31. Result ID: 69e0928747f34ce924c98a6d.

[Reporting paper](<https://www.sota2.com/research/paper/69e06d257d0172140ec7cb83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e06d257d0172140ec7cb83.md>)

Recorded evaluation configuration: {"Model":"Qwen-Plus"}. This record does not assert independent reproduction.

### Base LLM

ROUGE-Lsum: 26.47. Result ID: 69e0928747f34ce924c98a67.

[Reporting paper](<https://www.sota2.com/research/paper/69e06d257d0172140ec7cb83.md>)

Recorded evaluation configuration: {"Model":"Qwen-Plus"}. This record does not assert independent reproduction.

### TF-GRPO

ROUGE-Lsum: 25.8. Result ID: 69e0928747f34ce924c98a6c.

[Reporting paper](<https://www.sota2.com/research/paper/69e06d257d0172140ec7cb83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c071e209131cea8bf94.md>)

[Implementation](<https://github.com/TencentCloudADP/youtu-agent/tree/training_free_GRPO>)

Recorded evaluation configuration: {"Model":"DeepSeek-V3.2"}. This record does not assert independent reproduction.

### Base LLM

ROUGE-Lsum: 25.78. Result ID: 69e0928747f34ce924c98a68.

[Reporting paper](<https://www.sota2.com/research/paper/69e06d257d0172140ec7cb83.md>)

Recorded evaluation configuration: {"Model":"DeepSeek-V3.2"}. This record does not assert independent reproduction.

### TF-GRPO

ROUGE-Lsum: 25. Result ID: 69e0928747f34ce924c98a6b.

[Reporting paper](<https://www.sota2.com/research/paper/69e06d257d0172140ec7cb83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c071e209131cea8bf94.md>)

[Implementation](<https://github.com/TencentCloudADP/youtu-agent/tree/training_free_GRPO>)

Recorded evaluation configuration: {"Model":"Qwen-Plus"}. This record does not assert independent reproduction.

### Chain-of-Thought

ROUGE-Lsum: 24.28. Result ID: 69e0928747f34ce924c98a6a.

[Reporting paper](<https://www.sota2.com/research/paper/69e06d257d0172140ec7cb83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"DeepSeek-V3.2"}. This record does not assert independent reproduction.

### Chain-of-Thought

ROUGE-Lsum: 22.97. Result ID: 69e0928747f34ce924c98a69.

[Reporting paper](<https://www.sota2.com/research/paper/69e06d257d0172140ec7cb83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Model":"Qwen-Plus"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
