Sequence Scheduling on Instruction-in-Wild
1.24Throughput (samples/s)Instruction Tuning
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Instruction TuningModel=Vicuna-7B, Configuration=Length perception with instruction tuning2023.05 | 1.24 | 299 | — | 43 | 68 | 139 | |
| Estimation OnlyModel=Vicuna-7B, Configuration=Length perception without instruction tuning2023.05 | 1.07 | 422 | — | 20 | 38 | 358 | |
| VanillaModel=Vicuna-7B2023.05 | 0.78 | 475 | — | — | — | — |