Text Generation on MMLU (test)
57.83BS ScoreTAP
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TAPModel=ViLT2025.09 | 57.83 | 40.74 | |
| DisentAFL + Post-trainModel=ViLT2025.09 | 55.16 | 40.78 | |
| LocalModel=ViLT2025.09 | 54.87 | 39.46 | |
| DisentAFLModel=ViLT2025.09 | 54.67 | 39.94 | |
| TAPModel=FLAVA2025.09 | 46.75 | 21.93 | |
| FedAvg + Post-trainModel=ViLT2025.09 | 46.71 | 13.5 | |
| FedDAT + Post-trainModel=ViLT2025.09 | 46.16 | 13 | |
| Per-FedAvg + Post-trainModel=ViLT2025.09 | 45.79 | 13.02 | |
| FedDATModel=ViLT2025.09 | 45.58 | 13.37 | |
| FedAvgModel=ViLT2025.09 | 44 | 11.93 | |
| Per-FedAvgModel=ViLT2025.09 | 43.95 | 12.53 | |
| FedDAT + Post-trainModel=FLAVA2025.09 | 41.8 | 10.81 | |
| FedDATModel=FLAVA2025.09 | 41.67 | 7.04 | |
| LocalModel=FLAVA2025.09 | 41.63 | 20.89 | |
| DisentAFL + Post-trainModel=FLAVA2025.09 | 40.29 | 20.37 | |
| DisentAFLModel=FLAVA2025.09 | 40.1 | 19.54 | |
| Per-FedAvgModel=FLAVA2025.09 | 39.88 | 8.91 | |
| Per-FedAvg + Post-trainModel=FLAVA2025.09 | 39.37 | 11.05 | |
| FedAvg + Post-trainModel=FLAVA2025.09 | 38.34 | 8.35 | |
| FedAvgModel=FLAVA2025.09 | 37.38 | 6.22 |