Multi-turn Dialogue Generation on REALTALK (per-session)
9.754PPLC-DIC
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| C-DICGeneration mode=closed-loop, Setting=per-session2026.06 | 9.754 | 3.4 | 13.3 | 17.3 | 3.1 | |
| C-DICsetting=per-session, seeds=42/43/442026.06 | 9.764 | 0.034 | 0.136 | 0.177 | 0.032 | |
| AutoCompressorsetting=per-session, seeds=42/43/442026.06 | 12.283 | 0.02 | 0.09 | 0.138 | 0.02 | |
| AutoCompressorGeneration mode=closed-loop, Setting=per-session2026.06 | 13.111 | 2 | 11.1 | 14.4 | 2.1 | |
| ICAE (one-shot)Generation mode=closed-loop, Setting=per-session2026.06 | 17.364 | 2.4 | 10.9 | 15.2 | 2.3 | |
| ICAE (one-shot)setting=per-session, seeds=42/43/442026.06 | 25.115 | 0.025 | 0.113 | 0.159 | 0.024 | |
| In-Session RAGGeneration mode=closed-loop, Setting=per-session2026.06 | 26.789 | 2 | 10.3 | 14.9 | 1.5 | |
| SummarizationGeneration mode=closed-loop, Setting=per-session2026.06 | 27.977 | 2.2 | 11 | 16.2 | 2.1 | |
| TruncationGeneration mode=closed-loop, Setting=per-session2026.06 | 28.174 | 2.1 | 10.9 | 15.6 | 1.9 | |
| Full promptingGeneration mode=closed-loop, Setting=per-session2026.06 | 29.666 | 2 | 10.6 | 15 | 1.7 | |
| ICAE (incremental)Generation mode=closed-loop, Setting=per-session2026.06 | 124.024 | 2 | 6.8 | 8.8 | 1.2 | |
| ICAE (incremental)setting=per-session, seeds=42/43/442026.06 | 135.827 | 0.019 | 0.071 | 0.089 | 0.013 |