PathMMU
Benchmarks
TaskDatasetSOTA resultTrendResults
PathMMU (val)
80.1Overall Accuracy
45
PathMMU Tiny 1.0 (test)
72.4Overall Accuracy
42
PathMMU 1.0 (ALL test)
72.2Overall Score
22
PathMMU
71.45Accuracy
19
PathMMU (test-all)
77.1Overall Score
19
PathMMU tiny (test)
79.6Overall Score
19
PathMMU (test)
75.34Accuracy (Atlas)
18
PathMMU ALL (test)
72.9PubMed Accuracy
16
PathMMU (test)
72.9PubMed (Tiny) Score
15
PathMMU Tiny (test)
74.5PubMed Score
15
PathMMU (val)
62.4Overall Accuracy
14
PathMMU PubMed (test-tiny)
77.6Accuracy
13
PathMMU SocialPath tiny n=229 (test)
75.1Accuracy
13
PathMMU EduContent n=255 (test-tiny)
76.9Accuracy
13
PathMMU All-tiny (test)
77.1Accuracy
13
PathMMU PathCLS n = 177 (test-tiny)
78.9Accuracy
13
PathMMU (test)
70.9ACS
13
PathMMU PubMed (test-all)
75.3Accuracy
12
PathMMU SocialPath n=1,796 (test)
71.7Accuracy
12
PathMMU EduContent n=1,938 (test-all)
73.5Accuracy
12
PathMMU Atlas (test)
84Accuracy
12
PathMMU All (test)
75.1Accuracy
12
PathMMU All (val)
72Accuracy
12
PathMMU PathCLS (test-all)
74.8Accuracy
12
PathMMU tiny (test)
81.73Atlas Score
9