Algebraic Question Answering on AQUA-RAT Synthetic IID 1.0 (test)
29.9AccuracyFedAvg (oracle)
Evaluation results
| Method | Links | |
|---|---|---|
| FedAvg (oracle)Backbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 29.9 | |
| FedDQCBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 29 | |
| FedAvg+IFDBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 24.4 | |
| FedAvg+NUGGETSBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 24 | |
| FedAvg+PPLBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 22.4 | |
| FedAvg+DataInfBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 22.4 | |
| FedAvgBackbone=LLama2-7b, Fine-tuning=LoRA, Data Distribution=IID2024.10 | 20.5 |