Visual Question Answering on Ultra-MedVQA Task 1
42.37AccuracyF3OCUS
Evaluation Results
| Method | Links | |
|---|---|---|
| F3OCUSBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 42.37 | |
| F3OCUSBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 40.85 | |
| LNTKBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 39.22 | |
| FedselectBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 38 | |
| GraSPBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 37.87 | |
| SPTBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 37.78 | |
| SynflowBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 37.39 | |
| LNTKBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 37.32 | |
| GradFlowBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 37.29 | |
| FishMaskBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 36.82 | |
| FishMaskBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 36.35 | |
| RGNBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 36.21 | |
| GradFlowBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 36.2 | |
| FedselectBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 35.79 | |
| GraSPBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 35.36 | |
| SNIPBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 35.23 | |
| SynflowBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 34.99 | |
| SPTBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 34.33 | |
| LastBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 34.31 | |
| FDBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 33.07 | |
| RGNBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 32.89 | |
| LastBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 32.75 | |
| FDBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 31.91 | |
| MagnitudeBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 31.35 | |
| MagnitudeBackbone=BLIP, Heterogeneous Resource Allocation=true2024.11 | 30.96 | |
| SNIPBackbone=VILT, Heterogeneous Resource Allocation=true2024.11 | 29.65 |