List your company

Multimodal RAG Evaluation on MAGMaR Extrinsic Quality Judgment (EQJ)

65Information Preservation (Retrieval)INFOF1
40.0446.525359.48Oct 28, 2025

Evaluation results

MethodLinks
INFOF1Judgment Type=EQJ, Annotator=22025.1065-1238—————
INFOF1Judgment Type=EQJ, Annotator=32025.10521425—————
INFOF1Judgment Type=EQJ, Annotator=12025.1041431—————
BERTScoreJudgment Type=EQJ, Annotator=12025.10———————9
BERTScoreJudgment Type=EQJ, Annotator=22025.10———————7
BERTScoreJudgment Type=EQJ, Annotator=32025.10———————15
CITEF1Judgment Type=EQJ, Annotator=12025.10———262628——
CITEF1Judgment Type=EQJ, Annotator=22025.10———50348——
CITEF1Judgment Type=EQJ, Annotator=32025.10———382218——
ROUGE-LJudgment Type=EQJ, Annotator=12025.10——————-4—
ROUGE-LJudgment Type=EQJ, Annotator=22025.10——————-1—
ROUGE-LJudgment Type=EQJ, Annotator=32025.10——————16—