# Topic Modeling on NYT corpus

Source: [Topic Modeling on NYT corpus](<https://www.sota2.com/research/sota/topic-modeling-on-nyt-corpus>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-15T07:22:11.316Z

Evaluation of Topic Modeling performance on the NYT corpus, measured using NPMI, Diversity, Coherence, Conciseness, Informativeness, and Assignment Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Topic Modeling |
| Dataset (including any stated split) | NYT corpus |
| Metric | NPMI |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [NPMI](<https://www.sota2.com/research/sota/topic-modeling-on-nyt-corpus.md?metric=NPMI>): Higher is better; unit: SCALAR.

- [Diversity](<https://www.sota2.com/research/sota/topic-modeling-on-nyt-corpus.md?metric=Diversity>): Higher is better; unit: SCALAR.

- [Coherence](<https://www.sota2.com/research/sota/topic-modeling-on-nyt-corpus.md?metric=Coherence>): Higher is better; unit: SCALAR.

- [Conciseness](<https://www.sota2.com/research/sota/topic-modeling-on-nyt-corpus.md?metric=Conciseness>): Higher is better; unit: SCALAR.

- [Informativeness](<https://www.sota2.com/research/sota/topic-modeling-on-nyt-corpus.md?metric=Informativeness>): Higher is better; unit: SCALAR.

- [Assignment Accuracy](<https://www.sota2.com/research/sota/topic-modeling-on-nyt-corpus.md?metric=Assignment%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | NPMI | Result date | Report paper |
| --- | --- | --- | --- |
| ECRTM | 0.611 | Not recorded | 68fa7be71e209131cea8b335 |
| DecTM | 0.5542 | Not recorded | 68fa7be71e209131cea8b335 |
| TSCTM | 0.5364 | Not recorded | 68fa7be71e209131cea8b335 |
| CombinedTM | 0.4853 | Not recorded | 68fa7be71e209131cea8b335 |
| FASTopic | 0.2831 | Not recorded | 68fa7be71e209131cea8b335 |
| BERTopic | 0.238 | Not recorded | 68fa7be71e209131cea8b335 |
| Claude-sonnet-4 | 0.1886 | Not recorded | 68fa7be71e209131cea8b335 |
| ETM | 0.1758 | Not recorded | 68fa7be71e209131cea8b335 |
| Gemini-3.1 | 0.1634 | Not recorded | 68fa7be71e209131cea8b335 |
| NSTM | 0.1509 | Not recorded | 68fa7be71e209131cea8b335 |
| Deepseek-v3.1 | 0.1417 | Not recorded | 68fa7be71e209131cea8b335 |
| Llama-4 | 0.1403 | Not recorded | 68fa7be71e209131cea8b335 |
| GPT-5.3 | 0.1221 | Not recorded | 68fa7be71e209131cea8b335 |
| Qwen3.5 | 0.1113 | Not recorded | 68fa7be71e209131cea8b335 |

### ECRTM

NPMI: 0.611. Result ID: 69df3b8a47f34ce924c79746.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f9c1e209131cea469b1.md>)

Recorded evaluation configuration: {"Category":"NTMs"}. This record does not assert independent reproduction.

### DecTM

NPMI: 0.5542. Result ID: 69df3b8a47f34ce924c79742.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

Recorded evaluation configuration: {"Category":"NTMs"}. This record does not assert independent reproduction.

### TSCTM

NPMI: 0.5364. Result ID: 69df3b8a47f34ce924c79743.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e0b1e209131cea3da55.md>)

Recorded evaluation configuration: {"Category":"NTMs"}. This record does not assert independent reproduction.

### CombinedTM

NPMI: 0.4853. Result ID: 69df3b8a47f34ce924c79744.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a261e209131cea2660b.md>)

Recorded evaluation configuration: {"Category":"NTMs"}. This record does not assert independent reproduction.

### FASTopic

NPMI: 0.2831. Result ID: 69df3b8a47f34ce924c79748.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa756f1e209131cea67dfd.md>)

Recorded evaluation configuration: {"Category":"Others"}. This record does not assert independent reproduction.

### BERTopic

NPMI: 0.238. Result ID: 69df3b8a47f34ce924c79747.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bfd1e209131cea31795.md>)

Recorded evaluation configuration: {"Category":"Others"}. This record does not assert independent reproduction.

### Claude-sonnet-4

NPMI: 0.1886. Result ID: 69df3b8a47f34ce924c7974d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

Recorded evaluation configuration: {"Category":"LLMs","Context Window":"200k","Zero-shot":true}. This record does not assert independent reproduction.

### ETM

NPMI: 0.1758. Result ID: 69df3b8a47f34ce924c79741.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65fb1e209131cea0dac4.md>)

[Implementation](<https://github.com/adjidieng/ETM>)

Recorded evaluation configuration: {"Category":"NTMs"}. This record does not assert independent reproduction.

### Gemini-3.1

NPMI: 0.1634. Result ID: 69df3b8a47f34ce924c7974e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

Recorded evaluation configuration: {"Category":"LLMs","Context Window":"1M","Zero-shot":true}. This record does not assert independent reproduction.

### NSTM

NPMI: 0.1509. Result ID: 69df3b8a47f34ce924c79745.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ca11e209131cea350dc.md>)

Recorded evaluation configuration: {"Category":"NTMs"}. This record does not assert independent reproduction.

### Deepseek-v3.1

NPMI: 0.1417. Result ID: 69df3b8a47f34ce924c79749.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

Recorded evaluation configuration: {"Category":"LLMs","Context Window":"128k","Zero-shot":true}. This record does not assert independent reproduction.

### Llama-4

NPMI: 0.1403. Result ID: 69df3b8a47f34ce924c7974b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

Recorded evaluation configuration: {"Category":"LLMs","Context Window":"1M","Zero-shot":true}. This record does not assert independent reproduction.

### GPT-5.3

NPMI: 0.1221. Result ID: 69df3b8a47f34ce924c7974c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

Recorded evaluation configuration: {"Category":"LLMs","Context Window":"400k","Zero-shot":true}. This record does not assert independent reproduction.

### Qwen3.5

NPMI: 0.1113. Result ID: 69df3b8a47f34ce924c7974a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7be71e209131cea8b335.md>)

Recorded evaluation configuration: {"Category":"LLMs","Context Window":"262k","Zero-shot":true}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
