List your company
ResearchFormerly WizWand

Instruction Tuning on Dolly-15K alpha=0.5

35.48Rouge-LCoreset-Cent
23.5226.62529.7332.835Oct 14, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Coreset-CentBackbone=LLaMA-3B, Data Sample Ratio=1.00%2024.1035.48
FedHDSBackbone=LLaMA-3B, Data Sample Ratio=1.18%2024.1035.4
FedHDS-TurboBackbone=LLaMA-3B, Data Sample Ratio=0.65%2024.1035.01
FedAvgBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1034.27
RandomBackbone=LLaMA-3B, Data Sample Ratio=1.50%2024.1033.82
PerplexityBackbone=LLaMA-3B, Data Sample Ratio=1.50%2024.1033.71
FedHDSBackbone=DataJuicer-1.3B, Data Sample Ratio=0.82%2024.1033.38
FedHDS-TurboBackbone=DataJuicer-1.3B, Data Sample Ratio=1.31%2024.1033.28
Coreset-CentBackbone=DataJuicer-1.3B, Data Sample Ratio=0.50%2024.1033.27
FedITBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1033.23
FlexLoRABackbone=LLaMA-3B, Data Sample Ratio=100%2024.1032.84
FedPromptBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1032.73
PerplexityBackbone=DataJuicer-1.3B, Data Sample Ratio=1.50%2024.1032.73
RandomBackbone=DataJuicer-1.3B, Data Sample Ratio=1.50%2024.1032.59
FedAvgBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1032.3
FedITBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1030.8
FedPTuningBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1030.3
FlexLoRABackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1029.81
FedIT-SGDBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1029.28
FedIT-SGDBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1027.23
FedPromptBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1024.5
FedPTuningBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1023.98