Community-conditioned Language Generation on RedditPersona (test)
38.29PerplexityS1 subreddit
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| S1 subredditK=10, Backbone=IBM Granite 4.1-3B2026.06 | 38.29 | 0.083 | 0.296 | 0.216 | 0.104 | 0.067 | 0.792 | 0.079 | 0.262 | |
| S2 graphK=10, Backbone=IBM Granite 4.1-3B2026.06 | 40.6 | 0.097 | 0.318 | 0.217 | 0.055 | 0.078 | 0.79 | 0.105 | 0.239 | |
| S4 hybridK=10, Backbone=IBM Granite 4.1-3B2026.06 | 42.58 | 0.106 | 0.334 | 0.228 | 0.058 | 0.113 | 0.799 | 0.157 | 0.224 | |
| S5 interactionK=10, Backbone=IBM Granite 4.1-3B2026.06 | 43.52 | 0.113 | 0.346 | 0.216 | 0.048 | 0.113 | 0.795 | 0.164 | 0.167 | |
| baseline_allK=1, Backbone=IBM Granite 4.1-3B2026.06 | 45.09 | 0.107 | 0.329 | 0.212 | 0.043 | 0.09 | 0.787 | 0.239 | — | |
| S3 semanticK=10, Backbone=IBM Granite 4.1-3B2026.06 | 48.95 | 0.117 | 0.346 | 0.189 | 0.055 | 0.073 | 0.803 | 0.205 | 0.132 | |
| zero_shotK=5, Backbone=IBM Granite 4.1-3B2026.06 | 57.99 | 0.263 | 0.734 | 0.192 | 0.065 | 0.302 | 0.829 | 0.025 | — |