Instruction Tuning on Dolly-15K alpha=5.0
35.79Rouge-LFedHDS
Evaluation Results
| Method | Links | |
|---|---|---|
| FedHDSBackbone=LLaMA-3B, Data Sample Ratio=1.34%2024.10 | 35.79 | |
| Coreset-CentBackbone=LLaMA-3B, Data Sample Ratio=1.00%2024.10 | 35.48 | |
| FedHDS-TurboBackbone=LLaMA-3B, Data Sample Ratio=1.28%2024.10 | 35.42 | |
| RandomBackbone=LLaMA-3B, Data Sample Ratio=5.00%2024.10 | 34.29 | |
| FedAvgBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 33.95 | |
| PerplexityBackbone=LLaMA-3B, Data Sample Ratio=5.00%2024.10 | 33.88 | |
| FedHDSBackbone=DataJuicer-1.3B, Data Sample Ratio=0.88%2024.10 | 33.7 | |
| FedITBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 33.68 | |
| FedHDS-TurboBackbone=DataJuicer-1.3B, Data Sample Ratio=1.19%2024.10 | 33.52 | |
| FedAvgBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 33.38 | |
| Coreset-CentBackbone=DataJuicer-1.3B, Data Sample Ratio=0.50%2024.10 | 33.27 | |
| FedPromptBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 32.51 | |
| RandomBackbone=DataJuicer-1.3B, Data Sample Ratio=1.50%2024.10 | 32.24 | |
| PerplexityBackbone=DataJuicer-1.3B, Data Sample Ratio=1.50%2024.10 | 32.24 | |
| FlexLoRABackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 32.18 | |
| FedITBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 30.97 | |
| FedIT-SGDBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 29.19 | |
| FlexLoRABackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 29.17 | |
| FedPTuningBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 29.08 | |
| FedIT-SGDBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 27.28 | |
| FedPTuningBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 25.33 | |
| FedPromptBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 23.94 |