Multi-party dialogue generation on Ubuntu IRC-16
16.04BLEU-1Qwen3-8B+DRCR
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Qwen3-8B+DRCRModel Category=LLM-based MDG, Backbone=Qwen3-8B, Training Protocol=DRCR2026.04 | 16.04 | 7.19 | 5.27 | 4.03 | 8.16 | 13.32 | |
| Qwen3-4B+DRCRModel Category=LLM-based MDG, Backbone=Qwen3-4B, Training Protocol=DRCR2026.04 | 14.93 | 6.51 | 4.45 | 3.18 | 7.89 | 12.41 | |
| Llama3.2-3B+DRCRModel Category=LLM-based MDG, Backbone=Llama3.2-3B, Training Protocol=DRCR2026.04 | 14.51 | 6.23 | 4.12 | 2.97 | 7.64 | 12.27 | |
| SS-MPCModel Category=SLM-based MDG2026.04 | 13.4 | 5.87 | 3.6 | 2.65 | 6.97 | 11.14 | |
| Qwen3-8B+SFTModel Category=LLM-based MDG, Backbone=Qwen3-8B, Training Protocol=SFT2026.04 | 13.07 | 5.38 | 3.24 | 2.41 | 5.39 | 11.53 | |
| RL-TRCModel Category=SLM-based MDG2026.04 | 12.52 | 5.41 | 3.34 | 2.45 | 5.45 | 11.31 | |
| Qwen3-4B+SFTModel Category=LLM-based MDG, Backbone=Qwen3-4B, Training Protocol=SFT2026.04 | 12.34 | 5.07 | 2.94 | 2.19 | 5.18 | 11.22 | |
| Llama3.2-3B+SFTModel Category=LLM-based MDG, Backbone=Llama3.2-3B, Training Protocol=SFT2026.04 | 12.02 | 4.75 | 2.78 | 2.03 | 5.01 | 11.25 | |
| MADNetModel Category=SLM-based MDG2026.04 | 11.82 | 4.58 | 2.65 | 1.91 | 4.9 | 10.74 | |
| EMMDGModel Category=SLM-based MDG2026.04 | 11.67 | 4.73 | 2.64 | 1.81 | 5.12 | 10.43 | |
| HeterMPCModel Category=SLM-based MDG2026.04 | 11.4 | 4.29 | 2.43 | 1.74 | 4.57 | 10.44 | |
| GSNModel Category=SLM-based MDG2026.04 | 6.32 | 2.28 | 1.1 | 0.61 | 3.27 | 7.39 |