ArXiv
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
arXiv
99Accuracy
8
arXiv DPO-optimized adversarial (test)
90.68Accuracy
7
arXiv Paraphrased
81.97AUROC (GPT-5)
7
arXiv (December 2024)
60Top-5 Accuracy
7
arXiv June 2024 - November 2024 Average
64.4Top-5 Accuracy
7
arXiv (November 2024)
53.3Top-5 Accuracy
7
arXiv (October 2024)
60Top-5 Accuracy
7
arXiv September 2024
60Top-5 Accuracy
7
arXiv August 2024
73.3Top-5 Accuracy
7
arXiv July 2024
80Top-5 Accuracy
7
arXiv June 2024
60Top-5 Accuracy
7
ArXiv
77.07Accuracy / ROC-AUC
7
arXiv Theorem-level (val)
18.9P@1
7
arXiv
72.67Accuracy
7
Arxiv high-degree nodes, upper 33%
80.77Accuracy
7
Arxiv low-degree nodes, lower 33%
64.01Accuracy
7
Arxiv Sure and Possible (S + P) (test)
91.9F1 Score
7
Arxiv Sure Only (S) (test)
91.7F1 Score
7
ArXiv Bernoulli shift
20.58Average Error
7
ArXiv Linear shift
21.04Average Error
7
ArXiv Square shift (test)
20.8Average Error
7
ArXiv Sine shift (test)
0.251Average Error (%)
7
Arxiv-year homophily: 0.27 (test)
51.59Accuracy
7
arXiv
44.41ROUGE-1
7
arXiv
0.007TC
7