Average across datasets
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Average across datasets (PQA, SA, SQA, HE, MMLU, SQ, MT, UM, AC, SG)
0.85cMFG*
27
Average across datasets
89.05Base Score
15
Average across datasets
89.11AUC
15
Average across 11 datasets CLIP ViT-B/16 features (test)
85.6Accuracy
9
Average across 11 datasets (Aircraft, CIFAR10, CIFAR100, CUB200, DTD, Flower102, Food101, HAM10000, ImageNet, Resisc45, UCF101)
87.4Avg ACC
9
Average Across Datasets Scenario 3
0.057RMSE
8
Average Across Datasets Scenario 2
0.08RMSE
8
Average Across Datasets Scenario 1
0.046RMSE
8
Average across 13 datasets (test)
75.8Avg. Accuracy
8
Average across datasets
3.5Speedup
5
Average across datasets Hole
1AbsREL
4