Code Generation on MBPP (pass@1, Avg)
25.64Pass@1Full fine-tuning
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Full fine-tuningnumber of parameters=6738M, backbone=LLaMA-2-7B, adaptation mode=instruction-previewed adaptation mode2024.06 | 25.64 | 22.46 | |
| CorDAnumber of parameters=320M, backbone=LLaMA-2-7B, adaptation mode=instruction-previewed adaptation mode, rank=1282024.06 | 24.15 | 22.55 | |
| PiSSAnumber of parameters=320M, backbone=LLaMA-2-7B, adaptation mode=instruction-previewed adaptation mode, rank=1282024.06 | 23.84 | 21.46 | |
| DoRAnumber of parameters=321M, backbone=LLaMA-2-7B, adaptation mode=instruction-previewed adaptation mode, rank=1282024.06 | 21.6 | 18.18 | |
| LoRAnumber of parameters=320M, backbone=LLaMA-2-7B, adaptation mode=instruction-previewed adaptation mode, rank=1282024.06 | 21.51 | 18.3 |