Dialogue Generation on CONVAI2
3.77BLEUSMoA
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SMoABackbone=Llama-3-8B, rank=32, K=2, Params(%)=0.70022026.05 | 3.77 | 85.25 | 85.39 | 84.78 | 16.55 | 14.78 | 48.42 | |
| SMoA(r=32,n=2)Model=Llama-3-8B, Params(%)=0.70022026.01 | 3.68 | 84.86 | 85.79 | 84.89 | 16.47 | 14.85 | 48.42 | |
| SMoA(r=16,n=2)Model=Llama-3-8B, Params(%)=0.35132026.01 | 3.43 | 84.53 | 84.73 | 85.42 | 15.42 | 14.03 | 47.93 | |
| HiRA(r=32)Model=Llama-3-8B, Params(%)=0.70022026.01 | 3.41 | 84.81 | 84.4 | 85.25 | 14.87 | 14.05 | 47.8 | |
| HiRABackbone=Llama-3-8B, rank=32, Params(%)=0.70022026.05 | 3.41 | 84.81 | 84.4 | 85.25 | 14.87 | 14.05 | 47.8 | |
| SMoABackbone=Llama-3-8B, rank=16, K=2, Params(%)=0.35132026.05 | 3.37 | 84.55 | 84.67 | 85.54 | 15.37 | 13.89 | 47.89 | |
| HiRA(r=16)Model=Llama-3-8B, Params(%)=0.35132026.01 | 3.32 | 84.84 | 84.41 | 85.3 | 14.93 | 13.94 | 47.79 | |
| HiRABackbone=Llama-3-8B, rank=16, Params(%)=0.35132026.05 | 3.32 | 84.84 | 84.41 | 85.3 | 14.93 | 13.94 | 47.79 | |
| SMoABackbone=Llama-2-7B, rank=32, K=2, Params(%)=0.82562026.05 | 2.94 | 86.35 | 85.55 | 85.63 | 14.26 | 13.65 | 48.06 | |
| SMoA(r=32,n=2)Model=Llama-2-7B, Params(%)=0.82562026.01 | 2.88 | 85.57 | 85.47 | 85.26 | 14.18 | 13.52 | 47.81 | |
| MeLoRA(r=32,n=2)Model=Llama-3-8B, Params(%)=0.70022026.01 | 2.87 | 84.15 | 85.65 | 85.37 | 13.77 | 13.87 | 47.61 | |
| MeLoRABackbone=Llama-3-8B, rank=32, K=2, Params(%)=0.70022026.05 | 2.87 | 84.15 | 85.65 | 85.37 | 13.77 | 13.87 | 47.61 | |
| HiRA(r=32)Model=Llama-2-7B, Params(%)=0.82562026.01 | 2.7 | 84.86 | 84.98 | 84.77 | 13.56 | 12.8 | 47.28 | |
| HiRABackbone=Llama-2-7B, rank=32, Params(%)=0.82562026.05 | 2.7 | 84.86 | 84.98 | 84.77 | 13.56 | 12.8 | 47.28 | |
| SMoA(r=16,n=2)Model=Llama-2-7B, Params(%)=0.41282026.01 | 2.68 | 83.88 | 84.22 | 84.02 | 13.44 | 12.49 | 46.79 | |
| SMoABackbone=Llama-2-7B, rank=16, K=2, Params(%)=0.41282026.05 | 2.58 | 83.25 | 83.53 | 83.37 | 13.15 | 12.35 | 46.42 | |
| HiRA(r=16)Model=Llama-2-7B, Params(%)=0.41282026.01 | 2.56 | 83.97 | 84.12 | 83.86 | 13.35 | 12.58 | 46.74 | |
| HiRABackbone=Llama-2-7B, rank=16, Params(%)=0.41282026.05 | 2.56 | 83.97 | 84.12 | 83.86 | 13.35 | 12.58 | 46.74 | |
| MeLoRA(r=32,n=2)Model=Llama-2-7B, Params(%)=0.82562026.01 | 2.55 | 84.77 | 84.08 | 84.58 | 13.27 | 11.87 | 46.85 | |
| MeLoRABackbone=Llama-2-7B, rank=32, K=2, Params(%)=0.82562026.05 | 2.55 | 84.77 | 84.08 | 84.58 | 13.27 | 11.87 | 46.85 | |
| MeLoRA(r=16,n=2)Model=Llama-2-7B, Params(%)=0.41282026.01 | 2.46 | 83.32 | 83.33 | 82.72 | 12.37 | 10.65 | 45.81 | |
| MeLoRABackbone=Llama-2-7B, rank=16, K=2, Params(%)=0.41282026.05 | 2.46 | 83.32 | 83.33 | 82.72 | 12.37 | 10.65 | 45.81 | |
| SSMLoRA(r=32)Model=Llama-3-8B, Params(%)=0.68132026.01 | 2.45 | 84.37 | 84.05 | 84.57 | 12.36 | 11.15 | 46.49 | |
| SSMLoRABackbone=Llama-3-8B, rank=32, Params(%)=0.68132026.05 | 2.45 | 84.37 | 84.05 | 84.57 | 12.36 | 11.15 | 46.49 | |
| DoRA(r=32)Model=Llama-3-8B, Params(%)=0.70022026.01 | 2.29 | 84.32 | 84.06 | 84.62 | 12.63 | 11.78 | 46.62 | |
| DoRABackbone=Llama-3-8B, rank=32, Params(%)=0.70022026.05 | 2.29 | 84.32 | 84.06 | 84.62 | 12.63 | 11.78 | 46.62 | |
| LoRA(r=32)Model=Llama-3-8B, Params(%)=0.70022026.01 | 2.26 | 84.32 | 84 | 84.67 | 12.51 | 11.77 | 46.59 | |
| LoRABackbone=Llama-3-8B, rank=32, Params(%)=0.70022026.05 | 2.26 | 84.32 | 84 | 84.67 | 12.51 | 11.77 | 46.59 | |
| MeLoRA(r=16,n=2)Model=Llama-3-8B, Params(%)=0.35132026.01 | 1.87 | 82.36 | 83.55 | 84.67 | 12.39 | 11.54 | 46.06 | |
| MeLoRABackbone=Llama-3-8B, rank=16, K=2, Params(%)=0.35132026.05 | 1.87 | 82.36 | 83.55 | 84.67 | 12.39 | 11.54 | 46.06 | |
| LoRA(r=32)Model=Llama-2-7B, Params(%)=0.82562026.01 | 1.82 | 84.41 | 84.71 | 84.16 | 11.38 | 10.55 | 46.17 | |
| LoRABackbone=Llama-2-7B, rank=32, Params(%)=0.82562026.05 | 1.82 | 84.41 | 84.71 | 84.16 | 11.38 | 10.55 | 46.17 | |
| DoRA(r=32)Model=Llama-2-7B, Params(%)=0.82562026.01 | 1.73 | 84.18 | 84.61 | 83.81 | 11.25 | 10.41 | 46 | |
| DoRABackbone=Llama-2-7B, rank=32, Params(%)=0.82562026.05 | 1.73 | 84.18 | 84.61 | 83.81 | 11.25 | 10.41 | 46 | |
| MoRA(r=32)Model=Llama-3-8B, Params(%)=0.69972026.01 | 1.6 | 84.22 | 84.06 | 84.43 | 12.37 | 11.19 | 46.31 | |
| MoRABackbone=Llama-3-8B, rank=32, Params(%)=0.69972026.05 | 1.6 | 84.22 | 84.06 | 84.43 | 12.37 | 11.19 | 46.31 | |
| SSMLoRA(r=32)Model=Llama-2-7B, Params(%)=0.80242026.01 | 1.56 | 84.36 | 84.28 | 83.56 | 10.67 | 10.44 | 45.81 | |
| SSMLoRABackbone=Llama-2-7B, rank=32, Params(%)=0.80242026.05 | 1.56 | 84.36 | 84.28 | 83.56 | 10.67 | 10.44 | 45.81 | |
| P-TuningModel=Llama-3-8B, Params(%)=0.62402026.01 | 1.5 | 81.52 | 81.07 | 82.01 | 15.49 | 13.55 | 45.86 | |
| P-TuningBackbone=Llama-3-8B, Params(%)=0.62402026.05 | 1.5 | 81.52 | 81.07 | 82.01 | 15.49 | 13.55 | 45.86 | |
| PromptTuningModel=Llama-3-8B, Params(%)=0.00102026.01 | 1.45 | 82.99 | 82.99 | 83.05 | 14.72 | 13.13 | 46.39 | |
| PromptTuningBackbone=Llama-3-8B, Params(%)=0.00102026.05 | 1.45 | 82.99 | 82.99 | 83.05 | 14.72 | 13.13 | 46.39 | |
| MoRA(r=32)Model=Llama-2-7B, Params(%)=0.82412026.01 | 1.09 | 84.09 | 84.65 | 83.59 | 10.97 | 9.57 | 45.66 | |
| MoRABackbone=Llama-2-7B, rank=32, Params(%)=0.82412026.05 | 1.09 | 84.09 | 84.65 | 83.59 | 10.97 | 9.57 | 45.66 | |
| P-TuningModel=Llama-2-7B, Params(%)=0.74282026.01 | 0.6 | 83.29 | 83.33 | 83.28 | 15.11 | 12.36 | 46.33 | |
| P-TuningBackbone=Llama-2-7B, Params(%)=0.74282026.05 | 0.6 | 83.29 | 83.33 | 83.28 | 15.11 | 12.36 | 46.33 | |
| PromptTuningModel=Llama-2-7B, Params(%)=0.00122026.01 | 0.04 | 72.44 | 77.38 | 68.23 | 0.8 | 0.8 | 36.62 | |
| PromptTuningBackbone=Llama-2-7B, Params(%)=0.00122026.05 | 0.04 | 72.44 | 77.38 | 68.23 | 0.8 | 0.8 | 36.62 |