Topic Modeling on SemEval-STM Restaurant (Label-Free Evaluation)
-0.1622NPMIBERTopic
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| BERTopic2026.05 | -0.1622 | -13.6309 | -8.1259 | 0.3107 | 3.9735 | 6.7305 | 0.0116 | 0.1027 | 3.614 | 4.0662 | |
| gpt-4osegment-based topic allocation=true2026.05 | -0.1909 | -11.0746 | -6.9674 | 0.3076 | 5.63 | 8.7456 | 0.0054 | 0.0221 | 7.9977 | 9.1804 | |
| gemini-2.5-flash-preview-04-17segment-based topic allocation=true2026.05 | -0.1933 | -11.1135 | -6.9446 | 0.3252 | 5.1914 | 9.1775 | 0.0055 | 0.0256 | 6.3861 | 7.3846 | |
| llama-3.2-3b-instruct-turbosegment-based topic allocation=true2026.05 | -0.1981 | -11.6759 | -7.2913 | 0.3152 | 5.9292 | 6.1641 | 0.0117 | 0.0339 | 8.2703 | 9.5635 | |
| claude-3.7-sonnet-20250219segment-based topic allocation=true2026.05 | -0.2154 | -11.7673 | -7.5305 | 0.3233 | 5.2393 | 9.7834 | 0.0059 | 0.03 | 5.962 | 7.1544 | |
| o4-minisegment-based topic allocation=true2026.05 | -0.2271 | -12.4864 | -8.0232 | 0.3451 | 5.3975 | 8.8302 | 0.0054 | 0.0239 | 7.4767 | 8.3782 | |
| LDA2026.05 | -0.2512 | -13.9977 | -9.2477 | 0.3385 | 7.7317 | 3.3516 | 0.002 | -0.0072 | 14.8073 | 15.9644 |