MER
Benchmarks
TaskDatasetSOTA resultTrendResults
MER 2023
88.6Hit Rate
33
MER 2023
90.36F1 Score
30
MER 2024 (test)
82.39Weighted F1
25
MER 2023 (test)
80.92Weighted F1
25
MER24 (official)
93.13Hitrate
15
MER 24
93.13Overall Score
14
MER 2024
80.66HIT
14
MER 2024
76.47F1 Score
14
MER 2024
26.81R@1
10
MER English 2024
48.19BLEU-1
9
MER Chinese 2024
51.04BLEU-1
9
MER labeled ratio (1/4)
0.591mIoU
8
MER labeled ratio (1/8)
56.8mIoU
8
MER-MULTI
71.39F1-0.25MSE
5
MER-MULTI
70.05F1-0.25MSE
4
MER-MULTI (val)
70.05F1-0.25MSE
3
MER 2023 (test)
89.19ACC
2
MER-SEMI
90.36F1 Score
1