Medical Multi-choice Question Answering on MMedBench (test)
0.1494Token Perplexity (log)OFA-KD
Evaluation results
| Method | Links | |
|---|---|---|
| OFA-KDNumber of participating edge devices (N)=1282026.02 | 0.1494 | |
| DEEPFUSIONNumber of participating edge devices (N)=1282026.02 | 0.1494 | |
| OFA-KDNumber of participating edge devices (N)=642026.02 | 0.151 | |
| FedKMTNumber of participating edge devices (N)=642026.02 | 0.1526 | |
| OFA-KDNumber of participating edge devices (N)=322026.02 | 0.1535 | |
| FedKMTNumber of participating edge devices (N)=1282026.02 | 0.1546 | |
| DEEPFUSIONNumber of participating edge devices (N)=642026.02 | 0.1551 | |
| FedJETSNumber of participating edge devices (N)=642026.02 | 0.1557 | |
| DEEPFUSIONNumber of participating edge devices (N)=322026.02 | 0.1569 | |
| FedJETSNumber of participating edge devices (N)=1282026.02 | 0.1571 | |
| OFA-KDNumber of participating edge devices (N)=162026.02 | 0.1573 | |
| FedKMTNumber of participating edge devices (N)=322026.02 | 0.1574 | |
| FedJETSNumber of participating edge devices (N)=322026.02 | 0.1588 | |
| DEEPFUSIONNumber of participating edge devices (N)=162026.02 | 0.1603 | |
| FedKMTNumber of participating edge devices (N)=162026.02 | 0.1609 | |
| FedJETSNumber of participating edge devices (N)=162026.02 | 0.1639 |