Reading Comprehension on ReCoRD (test)
83.7F1 ScoreFedTT+
Evaluation results
| Method | Links | |
|---|---|---|
| FedTT+Federated Setting=cross-silo FL, Backbone=LLaMA2-13B, Number of Parameters=0.18M2024.10 | 83.7 | |
| LoRAFederated Setting=cross-silo FL, Backbone=LLaMA2-13B, Number of Parameters=6.55M, Rank=82024.10 | 83.6 | |
| FedTTFederated Setting=cross-silo FL, Backbone=LLaMA2-13B, Number of Parameters=0.64M2024.10 | 83.5 | |
| LoRAFederated Setting=large-scale FL, Backbone=LLaMA2-7B, Number of Parameters=4.19M, Rank=82024.10 | 81 | |
| FedTTFederated Setting=large-scale FL, Backbone=LLaMA2-7B, Number of Parameters=0.52M2024.10 | 80.1 |