List your company
ResearchFormerly WizWand

Text Generation on MMLU (test)

57.83BS ScoreTAP
36.56242.083547.60553.1265Sep 30, 2025
Updated 5mo ago

Evaluation results

MethodLinks
TAPModel=ViLT2025.0957.8340.74
DisentAFL + Post-trainModel=ViLT2025.0955.1640.78
LocalModel=ViLT2025.0954.8739.46
DisentAFLModel=ViLT2025.0954.6739.94
TAPModel=FLAVA2025.0946.7521.93
FedAvg + Post-trainModel=ViLT2025.0946.7113.5
FedDAT + Post-trainModel=ViLT2025.0946.1613
Per-FedAvg + Post-trainModel=ViLT2025.0945.7913.02
FedDATModel=ViLT2025.0945.5813.37
FedAvgModel=ViLT2025.094411.93
Per-FedAvgModel=ViLT2025.0943.9512.53
FedDAT + Post-trainModel=FLAVA2025.0941.810.81
FedDATModel=FLAVA2025.0941.677.04
LocalModel=FLAVA2025.0941.6320.89
DisentAFL + Post-trainModel=FLAVA2025.0940.2920.37
DisentAFLModel=FLAVA2025.0940.119.54
Per-FedAvgModel=FLAVA2025.0939.888.91
Per-FedAvg + Post-trainModel=FLAVA2025.0939.3711.05
FedAvg + Post-trainModel=FLAVA2025.0938.348.35
FedAvgModel=FLAVA2025.0937.386.22