Financial Question Answering on FIQA Synthetic NIID 1.0 (test)
82.1Win RateFedDQC
Evaluation results
| Method | Links | |
|---|---|---|
| FedDQCBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 82.1 | |
| FedAvg+IFDBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 66.4 | |
| FedAvg+NUGGETSBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 56.6 | |
| FedAvg+PPLBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 54.4 | |
| FedAvg+DataInfBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 46.4 | |
| FedAvgBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=NIID2024.10 | 35.4 |