Instruction Tuning on Dolly-15K alpha=0.5
35.48Rouge-LCoreset-Cent
Evaluation Results
| Method | Links | |
|---|---|---|
| Coreset-CentBackbone=LLaMA-3B, Data Sample Ratio=1.00%2024.10 | 35.48 | |
| FedHDSBackbone=LLaMA-3B, Data Sample Ratio=1.18%2024.10 | 35.4 | |
| FedHDS-TurboBackbone=LLaMA-3B, Data Sample Ratio=0.65%2024.10 | 35.01 | |
| FedAvgBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 34.27 | |
| RandomBackbone=LLaMA-3B, Data Sample Ratio=1.50%2024.10 | 33.82 | |
| PerplexityBackbone=LLaMA-3B, Data Sample Ratio=1.50%2024.10 | 33.71 | |
| FedHDSBackbone=DataJuicer-1.3B, Data Sample Ratio=0.82%2024.10 | 33.38 | |
| FedHDS-TurboBackbone=DataJuicer-1.3B, Data Sample Ratio=1.31%2024.10 | 33.28 | |
| Coreset-CentBackbone=DataJuicer-1.3B, Data Sample Ratio=0.50%2024.10 | 33.27 | |
| FedITBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 33.23 | |
| FlexLoRABackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 32.84 | |
| FedPromptBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 32.73 | |
| PerplexityBackbone=DataJuicer-1.3B, Data Sample Ratio=1.50%2024.10 | 32.73 | |
| RandomBackbone=DataJuicer-1.3B, Data Sample Ratio=1.50%2024.10 | 32.59 | |
| FedAvgBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 32.3 | |
| FedITBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 30.8 | |
| FedPTuningBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 30.3 | |
| FlexLoRABackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 29.81 | |
| FedIT-SGDBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 29.28 | |
| FedIT-SGDBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 27.23 | |
| FedPromptBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 24.5 | |
| FedPTuningBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 23.98 |