Conversational Performance on REDIAL (test)
122.7Distinct-3HyFairCRS
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| HyFairCRS2025.07 | 122.7 | 60.22 | 2.33 | 0.98 | — | — | — | — | — | — | |
| HiCore2025.07 | 111.7 | 58.71 | 2.31 | 0.93 | — | — | — | — | — | — | |
| CoMoRec2025.07 | 64.8 | 34.92 | 2.3 | 0.89 | — | — | — | — | — | — | |
| HyCoRec2025.07 | 64.34 | 36.61 | 2.28 | 0.92 | — | — | — | — | — | — | |
| GPT-32025.07 | 63.99 | 36.04 | 2.25 | 0.9 | — | — | — | — | — | — | |
| DialoGPT2025.07 | 62.09 | 35.42 | 2.2 | 0.85 | — | — | — | — | — | — | |
| MHIM2025.07 | 62.04 | 32.78 | 2.26 | 0.89 | — | — | — | — | — | — | |
| LOT-CRS2025.07 | 61.55 | 33.12 | 2.22 | 0.85 | — | — | — | — | — | — | |
| KGSFknowledge_sources=word-oriented and entity-oriented KGs, fusion_method=Mutual Information Maximization (MIM)2020.07 | 43.4 | 28.9 | — | — | — | 51.9 | — | 32.5 | — | — | |
| UniCRS2025.07 | 42.73 | 24.64 | 2.18 | 0.8 | — | — | — | — | — | — | |
| C2-CRS2025.07 | 38.91 | 26.23 | 2.23 | 0.88 | — | — | — | — | — | — | |
| KBRDfeatures=external KG information2020.07 | 36.8 | 26.3 | — | — | — | 42.3 | — | 29.6 | — | — | |
| KBRD2025.07 | 33.44 | 7.65 | 2.03 | 0.61 | — | — | — | — | — | — | |
| UCCRmode=full2022.04 | 32.89 | 8.18 | 2.57 | 1.06 | 53.24 | 56.35 | — | — | 106 | 122 | |
| UCCRablation=w/o It2022.04 | 32.55 | 8.15 | 2.55 | 1.03 | 53.56 | 55.61 | — | — | 103 | 118 | |
| UCCRablation=w/o Wo2022.04 | 31.95 | 8.01 | 2.53 | 0.97 | 54.01 | 54.93 | — | — | 100 | 118 | |
| RevCore2022.04 | 30.65 | 7.69 | 2.52 | 0.98 | 54.43 | 52.83 | — | — | 98 | 115 | |
| KGSF2022.04 | 30.24 | 7.56 | 2.49 | 0.91 | 54.75 | 51.77 | — | — | 95 | 114 | |
| UCCRablation=w/o En2022.04 | 30.01 | 7.29 | 2.45 | 0.89 | 54.95 | 50.82 | — | — | 96 | 112 | |
| KBRD2019.08 | 30 | — | — | — | 17.9 | 45 | 1.99 | — | — | — | |
| C2-CRS2022.01 | 29.1 | 16.3 | — | — | — | 41.7 | — | — | — | — | |
| KBRD2022.04 | 28.83 | 7.12 | 2.38 | 0.88 | 54.89 | 48.93 | — | — | 82 | 100 | |
| Transformermodel_base=Vaswani et al., 20172019.08 | 27 | — | — | — | 18 | 39 | — | — | — | — | |
| ReDial2022.04 | 26.97 | 6.89 | 2.17 | 0.78 | 56.21 | 46.38 | — | — | 73 | 91 | |
| KGSF2025.07 | 24.83 | 5.72 | 2.11 | 0.67 | — | — | — | — | — | — | |
| ReDialmodel=pre-training RNN2020.07 | 23.6 | 22.5 | — | — | — | 22.8 | — | 15.8 | — | — | |
| KGSF2022.01 | 20.4 | 11.4 | — | — | — | 28.2 | — | — | — | — | |
| RevCore2022.01 | 16.3 | 9.2 | — | — | — | 22.1 | — | — | — | — | |
| Trans.2025.07 | 15.74 | 5.38 | 1.64 | 0.27 | — | — | — | — | — | — | |
| KECRS2022.04 | 15.32 | 4.73 | 1.33 | 0.51 | 59.35 | 31.88 | — | — | 59 | 71 | |
| KBRD2022.01 | 15.3 | 8.6 | — | — | — | 26.5 | — | — | — | — | |
| Transformermechanism=self-attention2020.07 | 15.1 | 14.8 | — | — | — | 13.7 | — | 19.4 | — | — | |
| ReDial2022.01 | 14.3 | 8.2 | — | — | — | 24.5 | — | — | — | — | |
| Transffull_name=Transformer2022.01 | 13.9 | 6.7 | — | — | — | 22.7 | — | — | — | — | |
| REDIAL2019.08 | 11 | — | — | — | 28.1 | 13 | 1.73 | — | — | — | |
| KECRS2022.01 | 9 | 4 | — | — | — | 14.9 | — | — | — | — | |
| ReDial2025.07 | 6.59 | 2.14 | 1.98 | 0.54 | — | — | — | — | — | — |