Abstractive Summarization on XSum (ROUGE-L, Avg)
18.87ROUGE-LLoRA FP16
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LoRA FP16Base Model=LLaMA-2-7B, Rank=r=16, BPW=16.0, Size (MB)=76.3, Size Tier=Full-size reference2026.05 | 18.87 | 28.81 | |
| QAT Full (Ours)Base Model=LLaMA-2-7B, Rank=r=64, BPW=1.0, Size (MB)=19.1, Size Tier=~19 MB tier2026.05 | 18.6 | 28.08 | |
| QAT Full (Ours)Base Model=LLaMA-2-7B, Rank=r=16, BPW=2.0, Size (MB)=9.5, Size Tier=~9.5 MB tier2026.05 | 18.49 | 25.59 | |
| QAT Full (Ours)Base Model=LLaMA-2-7B, Rank=r=16, BPW=4.0, Size (MB)=19.1, Size Tier=~19 MB tier2026.05 | 18.49 | 28.07 | |
| QAT Full (Ours)Base Model=LLaMA-2-7B, Rank=r=16, BPW=1.0, Size (MB)=7.2, Size Tier=~7 MB tier2026.05 | 18.32 | 24.14 | |
| LoRAQuant ρ=0.9Base Model=LLaMA-2-7B, Rank=r=16, BPW=1.68, Size (MB)=8.0, Size Tier=~7 MB tier2026.05 | 18.27 | 23.17 | |
| LoRA FP16 (same-size ref.)Base Model=LLaMA-2-7B, Rank=r=4, BPW=4.0, Size (MB)=19.1, Size Tier=~19 MB tier2026.05 | 18.23 | 25.53 | |
| LoRA FP16 (same-size ref.)Base Model=LLaMA-2-7B, Rank=r=2, BPW=2.0, Size (MB)=9.5, Size Tier=~7 MB tier2026.05 | 17.85 | 23.21 | |
| LoRA FP16 (same-size ref.)Base Model=LLaMA-2-7B, Rank=r=2, BPW=2.0, Size (MB)=9.5, Size Tier=~9.5 MB tier2026.05 | 17.85 | 23.21 | |
| LoRAQuant ρ=0.5Base Model=LLaMA-2-7B, Rank=r=16, BPW=1.20, Size (MB)=5.7, Size Tier=~7 MB tier2026.05 | 17.67 | 20.31 |