Financial Question Answering on FIQA Synthetic IID 1.0 (test)
72.1Win RateFedDQC
Evaluation Results
| Method | Links | |
|---|---|---|
| FedDQCBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 72.1 | |
| FedAvg+IFDBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 62.2 | |
| FedAvg+NUGGETSBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 56.5 | |
| FedAvg+DataInfBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 45.7 | |
| FedAvg+PPLBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 43.7 | |
| FedAvgBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 26.6 |