Finance
Benchmarks
TaskDatasetSOTA resultTrendResults
finance MNAR
0.174Wasserstein Distance
63
finance MCAR
0.151Wasserstein Distance
63
finance MNAR
0.027RMSE
63
finance (MAR)
0.02RMSE
63
finance MCAR
0.018RMSE
63
Finance
0.004JSR
44
Finance (Fin)
0PPL Change (%)
28
Finance
49.1SacreBLEU
26
Finance
0.998AUC
24
Finance 30 days
0.812MSE
21
Finance 7 days
0.174MSE
21
finance
76.7Accuracy
21
Finance
39.6SacreBLEU
20
Finance (test)
63.1F1 Score
19
Finance 30 days
60.23-way Accuracy
18
Finance 7 days
70.43-way Accuracy
18
Finance (test)
87.25F1 Score
14
Finance
76.9EM-F1
12
Finance Llama-3-70B-Instruct (test)
0.995AUC
12
Finance GPT-3.5 Turbo
98.7AUC
12
Finance D2
47.6Match Ratio (Mean)
11
Finance
52.45Accuracy
11
Finance (test)
90.8Accuracy
11
Finance
89.41F1 Score
11
Finance
0.65AUC
9