Text Generation on Standard NLP Benchmarks
25.3BLEUChunkWise LoRA
Evaluation results
| Method | Links | |
|---|---|---|
| ChunkWise LoRALatency=14.9, Memory=9.12026.01 | 25.3 | |
| AdaLoRALatency=17.8, Memory=10.52026.01 | 24.9 | |
| Vanilla LLaMA-7BLatency=22.5, Memory=14.62026.01 | 24.7 | |
| LoRArank=32, Latency=21.7, Memory=13.92026.01 | 24.6 | |
| LoRArank=16, Latency=20.1, Memory=12.72026.01 | 24.5 | |
| LoRArank=8, Latency=19.3, Memory=11.22026.01 | 24.1 |