Dialogue Generation on ConvAI2 (test)
3.38BLEUTeRA
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| TeRAModel=Llama-3-8B, Params (%)=0.00212025.09 | 3.38 | — | — | — | 85.03 | 84.53 | 85.57 | 15.32 | 14.59 | 48.07 | |
| HiRAModel=Llama-3-8B, Params (%)=0.0053, r=12025.09 | 3.36 | — | — | — | 84.81 | 84.4 | 85.26 | 15.12 | 14.19 | 47.86 | |
| LoRAModel=Llama-3-8B, Params (%)=0.16952025.09 | 3.24 | — | — | — | 85.02 | 84.49 | 85.6 | 15.16 | 14.14 | 47.94 | |
| HiRAModel=Llama-3-8B, Params (%)=0.1695, r=322025.09 | 3.22 | — | — | — | 84.58 | 84.35 | 84.87 | 14.9 | 13.72 | 47.61 | |
| VeRAModel=Llama-3-8B, Params (%)=0.00222025.09 | 3.12 | — | — | — | 84.61 | 84.27 | 85.01 | 14.56 | 13.72 | 47.55 | |
| QuanTAModel=Llama-3-8B, Params (%)=0.03432025.09 | 3.04 | — | — | — | 84.55 | 84.19 | 84.97 | 13.9 | 13.08 | 47.29 | |
| LoRETTAModel=Llama-3-8B, Params (%)=0.00452025.09 | 2.97 | — | — | — | 84.77 | 84.26 | 85.31 | 13.78 | 13.15 | 47.37 | |
| HiRAModel=Llama-2-7B, Params (%)=0.2484, r=322025.09 | 2.67 | — | — | — | 85.26 | 85.37 | 85.17 | 13.94 | 13.19 | 47.6 | |
| QuanTAModel=Llama-2-7B, Params (%)=0.04082025.09 | 2.65 | — | — | — | 85.14 | 85.32 | 85 | 14.19 | 13.32 | 47.6 | |
| TeRAModel=Llama-2-7B, Params (%)=0.00392025.09 | 2.62 | — | — | — | 85.28 | 85.4 | 85.19 | 14.26 | 13.39 | 47.69 | |
| LoRAModel=Llama-2-7B, Params (%)=0.24842025.09 | 2.59 | — | — | — | 85.25 | 85.31 | 85.21 | 14.14 | 13.28 | 47.63 | |
| HiRAModel=Llama-2-7B, Params (%)=0.0078, r=12025.09 | 2.39 | — | — | — | 84.84 | 84.93 | 84.78 | 13.35 | 12.6 | 47.15 | |
| MoRAModel=Llama-3-8B, Params (%)=0.1692, r=322025.09 | 2.35 | — | — | — | 84.2 | 83.79 | 84.67 | 11.96 | 11.51 | 46.41 | |
| VeRAModel=Llama-2-7B, Params (%)=0.00412025.09 | 2.27 | — | — | — | 85.01 | 85.04 | 85.02 | 12.64 | 12.55 | 47.09 | |
| LoRETTAModel=Llama-2-7B, Params (%)=0.00522025.09 | 2.22 | — | — | — | 84.99 | 84.97 | 85.03 | 12.37 | 11.85 | 46.91 | |
| MoRAModel=Llama-2-7B, Params (%)=0.2484, r=322025.09 | 1.91 | — | — | — | 84.85 | 84.91 | 84.83 | 11.8 | 11.59 | 46.65 | |
| P-TuningModel=Llama-3-8B, Params (%)=0.62402025.09 | 1.5 | — | — | — | 81.52 | 81.07 | 82.01 | 15.49 | 13.55 | 45.86 | |
| Prompt TuningModel=Llama-3-8B, Params (%)=0.00102025.09 | 1.45 | — | — | — | 82.99 | 82.99 | 83.05 | 14.72 | 13.13 | 46.39 | |
| P-TuningModel=Llama-2-7B, Params (%)=0.74282025.09 | 0.6 | — | — | — | 83.29 | 83.33 | 83.28 | 15.11 | 12.36 | 46.33 | |
| Prompt TuningModel=Llama-2-7B, Params (%)=0.00122025.09 | 0.04 | — | — | — | 72.44 | 77.38 | 68.23 | 0.8 | 0.8 | 36.62 | |
| Llama2-7B-PTModel=Llama2-7B, Method=Prompt Tuning (PT)2024.06 | — | 1.33 | 1.13 | 1.25 | — | — | — | — | — | — | |
| Llama2-7B-SPTModel=Llama2-7B, Method=Selective Prompt Tuning (SPT)2024.06 | — | 1.89 | 1.29 | 1.34 | — | — | — | — | — | — |