MAGMaR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MAGMaR oracle (leaderboard snapshot)
3.833Human Preference Score
15
MAGMaR (test)
82.2Reference Precision (Ref-P)
11
MAGMaR Oracle Track 2026 (val)
3.833Human Evaluation Score
11
MAGMaR 2026
0.759nDCG@10
8
MAGMaR (test)
18.39ROUGE-L
5
MAGMaR (final)
75.9Average Score
5
MAGMaR Extrinsic Quality Judgment (EQJ)
65Information Preservation (Retrieval)
3