Federated Learning on Natural Instructions (NI)
48.8SpeedupFedHDS-Turbo
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FedHDS-TurboBackbone=DataJuicer-1.3B2024.10 | 48.8 | — | — | |
| FedHDS-TurboBackbone=LLaMA-3B2024.10 | 40.4 | — | — | |
| RandomBackbone=DataJuicer-1.3B2024.10 | 37.2 | — | — | |
| RandomBackbone=LLaMA-3B2024.10 | 23 | — | — | |
| FedHDSBackbone=LLaMA-3B2024.10 | 19.9 | — | — | |
| FedHDSBackbone=DataJuicer-1.3B2024.10 | 17.8 | — | — | |
| PerplexityBackbone=DataJuicer-1.3B2024.10 | 10.5 | — | — | |
| PerplexityBackbone=LLaMA-3B2024.10 | 9.51 | — | — | |
| FedITBackbone=DataJuicer-1.3B2024.10 | 1 | — | — | |
| FedITBackbone=LLaMA-3B2024.10 | 1 | — | — |