Multi-Turn Dialogue Generation on MSC (test)
8.431PPLC-DIC
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| C-DICBackbone=Llama-2-Chat-7B2026.06 | 8.431 | 2.3 | 16 | 20.5 | 3.7 | |
| AutoCompressorBackbone=Llama-2-Chat-7B2026.06 | 9.285 | 1.2 | 12.1 | 14.5 | 1.9 | |
| Full promptingBackbone=Llama3.1-8B2026.06 | 24.244 | 1.5 | 11.6 | 15.7 | 1.7 | |
| InfLLMBackbone=Llama-2-Chat-7B2026.06 | 27.329 | 1.6 | 11.8 | 16.1 | 1.9 | |
| ICAEBackbone=Llama-2-Chat-7B, Compression strategy=one-shot2026.06 | 27.656 | 1.7 | 13.3 | 19 | 2.7 | |
| TruncationBackbone=Llama-2-Chat-7B2026.06 | 30.89 | 1.2 | 12.8 | 18.4 | 2.4 | |
| RAGBackbone=Llama-2-Chat-7B, RAG top-k=202026.06 | 31.179 | 1.3 | 11.1 | 15.6 | 1.4 | |
| RAGBackbone=Llama-2-Chat-7B, RAG top-k=102026.06 | 34.63 | 1.1 | 11 | 15.7 | 1.4 | |
| RAGBackbone=Llama-2-Chat-7B, RAG top-k=52026.06 | 35.53 | 0.8 | 11 | 14.8 | 1.4 | |
| LLMLinguaBackbone=Llama-2-Chat-7B2026.06 | 36.211 | 1.2 | 10.5 | 15.7 | 1.1 | |
| RAG-thresholdBackbone=Llama-2-Chat-7B2026.06 | 40.057 | 1.1 | 10.9 | 15.7 | 1.3 | |
| Full promptingBackbone=Llama-2-Chat-7B2026.06 | 41.245 | 0.8 | 11 | 15.7 | 1.5 | |
| SummarizationBackbone=Llama-2-Chat-7B2026.06 | 41.849 | 1.3 | 12.8 | 17.2 | 2.4 | |
| ICAEBackbone=Llama-2-Chat-7B, Compression strategy=incremental2026.06 | 513.774 | 0.6 | 5.7 | 6.9 | 0.5 |