QMSum
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
QMSum (test)
19.63ROUGE-2
34
QMSum
47Next Token Accuracy
32
QMSum
3.15Average Acceptance Length (τ)
25
QMSum (test)
38.67ROUGE-1
23
QMSum (val)
0.238ROUGE-L
17
QMSum
99Precision
13
QMSum Golden v1 (test)
40.85ROUGE-1
11
QMSum
6.75BLEU
11
QMSum
4.47Coherence
10
QMSum
35.8ROUGE-1
10
QMSum LongBench
99Precision
10
QMSum
52Mean Embedding Similarity
10
QMSum
14.734Overall Score
10
QMSum (test)
38.9ROUGE-1
10
QMSum LongEmbed
0.813nDCG@10
9
QMSum
15.47G-mean
9
QMSum
0.3Std Dev ROUGE-1
8
QMSum
81Precision (QMSum)
6
QMSum 50 samples
4.88Fluency
6
QMSum (test)
4.93Fluency
5
QMSum
58.82R@10
4
QMSum
32.82Acc (BERT-Small, Epsilon=Inf)
4
QMSum
1.67Coreference
4
QMSum (all turns)
34.03ROUGE-1
4
QMSum Golden (test)
65Best Score
3