LV-Eval
Benchmarks
TaskDatasetSOTA resultTrendResults
LV-Eval (test)
14.5EM
19
LV-Eval (test)
12.9F1 Score
14
LV-Eval
14.81F1 Score
14
LV-Eval 128k
17.5SubEM
9
LV-Eval 64k
28.33SubEM
9
LV-Eval 32k
39.17SubEM
9
LV-Eval 16k
40SubEM
9
LV-Eval
51,066.2Average Token Count
7
LV-Eval
1.31Average Running Time (s)
6
LV-Eval
0.41Average Running Time (s)
5
LV-Eval
58.82Performance (16k Context)
5
LV-Eval
7.05CMRC (Mixup)
4
LV-Eval
10.5EM
3