List your company
ResearchFormerly WizWand

Instruction Tuning on Dolly-15K alpha=5.0

35.79Rouge-LFedHDS
23.46626.665529.86533.0645Oct 14, 2024
Updated 8mo ago

Evaluation results

MethodLinks
FedHDSBackbone=LLaMA-3B, Data Sample Ratio=1.34%2024.1035.79
Coreset-CentBackbone=LLaMA-3B, Data Sample Ratio=1.00%2024.1035.48
FedHDS-TurboBackbone=LLaMA-3B, Data Sample Ratio=1.28%2024.1035.42
RandomBackbone=LLaMA-3B, Data Sample Ratio=5.00%2024.1034.29
FedAvgBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1033.95
PerplexityBackbone=LLaMA-3B, Data Sample Ratio=5.00%2024.1033.88
FedHDSBackbone=DataJuicer-1.3B, Data Sample Ratio=0.88%2024.1033.7
FedITBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1033.68
FedHDS-TurboBackbone=DataJuicer-1.3B, Data Sample Ratio=1.19%2024.1033.52
FedAvgBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1033.38
Coreset-CentBackbone=DataJuicer-1.3B, Data Sample Ratio=0.50%2024.1033.27
FedPromptBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1032.51
RandomBackbone=DataJuicer-1.3B, Data Sample Ratio=1.50%2024.1032.24
PerplexityBackbone=DataJuicer-1.3B, Data Sample Ratio=1.50%2024.1032.24
FlexLoRABackbone=LLaMA-3B, Data Sample Ratio=100%2024.1032.18
FedITBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1030.97
FedIT-SGDBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1029.19
FlexLoRABackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1029.17
FedPTuningBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1029.08
FedIT-SGDBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1027.28
FedPTuningBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1025.33
FedPromptBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1023.94