List your company
ResearchFormerly WizWand

Instruction Tuning on Natural Instructions Meta Non-IID

34.81Rouge-LCoreset-Cent
4.889212.657120.42528.1929Oct 14, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Coreset-CentBackbone=LLaMA-3B, Data Sample Ratio=0.01%2024.1034.81
FedHDS-TurboBackbone=LLaMA-3B, Data Sample Ratio=0.22%2024.1032.93
FedHDSBackbone=LLaMA-3B, Data Sample Ratio=0.15%2024.1032.32
Coreset-CentBackbone=DataJuicer-1.3B, Data Sample Ratio=1.00%2024.1031.36
RandomBackbone=LLaMA-3B, Data Sample Ratio=2.00%2024.1031.23
PerplexityBackbone=LLaMA-3B, Data Sample Ratio=5.00%2024.1030.49
FlexLoRABackbone=LLaMA-3B, Data Sample Ratio=100%2024.1028.86
FedIT-SGDBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1028.14
FedITBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1028.13
FedAvgBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1027.88
FedHDSBackbone=DataJuicer-1.3B, Data Sample Ratio=0.20%2024.1026.64
RandomBackbone=DataJuicer-1.3B, Data Sample Ratio=0.20%2024.1026.2
FedHDS-TurboBackbone=DataJuicer-1.3B, Data Sample Ratio=0.23%2024.1025.93
FedPTuningBackbone=LLaMA-3B, Data Sample Ratio=100%2024.1025.41
PerplexityBackbone=DataJuicer-1.3B, Data Sample Ratio=5.00%2024.1024.45
FlexLoRABackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1023.19
FedITBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1022.3
FedAvgBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1022.08
FedPTuningBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1019.61
FedIT-SGDBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.1019.4
FedPromptBackbone=LLaMA-3B, Data Sample Ratio=100%2024.108.95
FedPromptBackbone=DataJuicer-1.3B, Data Sample Ratio=100%2024.106.04