Question Answering on WebQS
8.56AccuracyCorDA
Evaluation results
| Method | Links | |
|---|---|---|
| CorDA#Params=320M, Fine-tuning Task=Code, Rank (r)=1282024.06 | 8.56 | |
| LoRA#Params=320M, Fine-tuning Task=Code, Rank (r)=1282024.06 | 8.46 | |
| PiSSA#Params=320M, Fine-tuning Task=Code, Rank (r)=1282024.06 | 8.14 | |
| CorDABackbone=LLaMA-2-7B, #Params=320M, rank=128, Fine-tuning task=Math2024.06 | 7.14 | |
| LoRABackbone=LLaMA-2-7B, #Params=320M, rank=128, Fine-tuning task=Math2024.06 | 6.64 | |
| Full fine-tuningBackbone=LLaMA-2-7B, #Params=6738M, Fine-tuning task=Math2024.06 | 6.35 | |
| PiSSABackbone=LLaMA-2-7B, #Params=320M, rank=128, Fine-tuning task=Math2024.06 | 6.3 | |
| LLaMA-2-7BStatus=Original pre-trained model2024.06 | 5.86 | |
| LLaMA-2-7Bstatus=original pre-trained model2024.06 | 5.86 | |
| Full fine-tuning#Params=6738M, Fine-tuning Task=Code2024.06 | 3.44 |