MAG
Benchmarks
TaskDatasetSOTA resultTrendResults
MAG
97Fidelity
64
MAG (test)
82.8H@1
33
MAG
0.1Average Runtime (s)
24
MAG
98.37Mic-F1
24
mag-year
46.11Accuracy / F1 Score
19
MAG CN -> US (test)
45.48Accuracy
19
MAG US -> DE (test)
0.461Accuracy
19
MAG US -> CN (test)
41.61Accuracy
19
MAG
40.77US→CN Accuracy
14
MAG (test)
34.99Macro F1 Score
14
MAG
81.2BACC
14
MAG Toys benchmark
87.4R@1
13
MAG (test)
41.7kNN Accuracy (MAG Test)
12
MAG
53.6Spearman Correlation
12
MAG
30.9Top-10 2-hop Recall
12
MAG
1AUC (MAG)
12
MAG (random)
34.2Accuracy
12
MAG CN→FR
32.03Accuracy
11
MAG CN→RU
45.95Accuracy
11
MAG CN→JP
47.45Accuracy
11
MAG CN→DE
40.11Accuracy
11
MAG US→FR
42.98Accuracy
11
MAG US→RU
48.87Accuracy
11
MAG US→JP
51.81Accuracy
11
MAG
89Neighbor Recall
10