Instruction Tuning on Natural Instructions Meta Non-IID
34.81Rouge-LCoreset-Cent
Evaluation Results
| Method | Links | |
|---|---|---|
| Coreset-CentBackbone=LLaMA-3B, Data Sample Ratio=0.01%2024.10 | 34.81 | |
| FedHDS-TurboBackbone=LLaMA-3B, Data Sample Ratio=0.22%2024.10 | 32.93 | |
| FedHDSBackbone=LLaMA-3B, Data Sample Ratio=0.15%2024.10 | 32.32 | |
| Coreset-CentBackbone=DataJuicer-1.3B, Data Sample Ratio=1.00%2024.10 | 31.36 | |
| RandomBackbone=LLaMA-3B, Data Sample Ratio=2.00%2024.10 | 31.23 | |
| PerplexityBackbone=LLaMA-3B, Data Sample Ratio=5.00%2024.10 | 30.49 | |
| FlexLoRABackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 28.86 | |
| FedIT-SGDBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 28.14 | |
| FedITBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 28.13 | |
| FedAvgBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 27.88 | |
| FedHDSBackbone=DataJuicer-1.3B, Data Sample Ratio=0.20%2024.10 | 26.64 | |
| RandomBackbone=DataJuicer-1.3B, Data Sample Ratio=0.20%2024.10 | 26.2 | |
| FedHDS-TurboBackbone=DataJuicer-1.3B, Data Sample Ratio=0.23%2024.10 | 25.93 | |
| FedPTuningBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 25.41 | |
| PerplexityBackbone=DataJuicer-1.3B, Data Sample Ratio=5.00%2024.10 | 24.45 | |
| FlexLoRABackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 23.19 | |
| FedITBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 22.3 | |
| FedAvgBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 22.08 | |
| FedPTuningBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 19.61 | |
| FedIT-SGDBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 19.4 | |
| FedPromptBackbone=LLaMA-3B, Data Sample Ratio=100%2024.10 | 8.95 | |
| FedPromptBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.10 | 6.04 |