TALENT
Benchmarks
TaskDatasetSOTA resultTrendResults
TALENT (test)
80.9Top-1 Accuracy
113
TALENT
32.6SGMε
42
TALENT
3.58Average Rank
32
TALENT Multiclass (> 10 classes) Full (avg across datasets)
3.75Rank
31
TALENT Tiny
88.9Mean Accuracy
28
TALENT 100 datasets
4.7Rank
28
TALENT
0.35Mean
16
TALENT classification subset (170 datasets, <= 10 classes)
3.83Mean Rank
11
TALENT Remaining
0.102Shifted Geometric Mean Error
10
TALENT TabArena
0.149Shifted Geometric Mean Error (SGME)
10
TALENT Remaining (test)
0.319Shifted Geometric Mean Error
10
TALENT TabArena (test)
0.238Shifted Geometric Mean Error
10
TALENT datasets not included in TabArena (Remaining)
0.11SGM Error
10
TALENT Tiny
85.8R2
9
Talent CLS
89.78AUC
9
Talent-REG
0.463RMSE
9
TALENT large-N subset (>20,000 samples)
9.31Average Rank
8
TALENT 100 regression tasks
0.515RMSE (Mean)
8