ACE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ACE05-EN+ (test)
55F1 Score
6
ACE
76.27ARI
5
ACE05 (351/80/80)
75.73MUC
5
ACE 2005
74.7Precision
5
ACE Forecaster-level Season 4 1.0
0.4Human Rating Correlation Coefficient
4
ACE
62.08Accuracy
4
ACE
60.55Accuracy
4
ACE05
82.49MUC
4
ACE-2005 (test)
81.1Entity F1
4
ACE04 5-fold cross-validation (test)
64.7Precision
4
ACE 2005 (out-of-domain average)
58.26Avg F1
4
ACE Chinese (test)
73.5Entity F1
3
ACE Arabic (test)
74Entity Score
3
ACE2005 Chinese (test)
88.81F1 Score
3
ACE2004 Chinese (test)
88F1 Score
3
ACE O 2005 (test)
82.9Entity F1
3
ACE O 2004 (test)
84.7Entity F1
3
ACE Forecast-level Season 4 1.0
0.07Human Rating r
2
ACE Forecaster Level (main analysis sample)
0.39Pre-LLM Correlation (r)
2
ACE Forecast Level (main analysis sample)
0.06Pre-LLM Correlation (r)
2
ACE05-E
51.91F1 Score
2
ACE05-EN+ (test)
72.8F1 Score
2
ACE05-E (test)
76.5Trigger ID F1
2
ACE05-E (test)
90.7F1 Score
2
ACE04
60.8Precision
2