Molecular Science Instructions on Mol-Instructions Synthetic NIID 1.0 (test)
0.824BertScoreFedDQC
Evaluation results
| Method | Links | |
|---|---|---|
| FedDQCBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 0.824 | |
| FedAvg+IFDBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 0.815 | |
| FedAvg+NUGGETSBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 0.814 | |
| FedAvg (oracle)Backbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 0.812 | |
| FedAvgBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 0.809 | |
| FedAvg+DataInfBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 0.807 | |
| FedAvg+PPLBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 0.804 |