Multiple-Choice Question Answering on QuALITY (test)
74.7AccuracyDTCRS + GPT-4o-mini
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DTCRS + GPT-4o-miniMethod=DTCRS, Language Model=GPT-4o-mini2026.04 | 74.7 | 63.7 | |
| RAPTOR + GPT-4o-miniRetriever=RAPTOR, Language Model=GPT-4o-mini2026.04 | 67.6 | 59 | |
| DPR + GPT-4o-miniRetriever=DPR, Language Model=GPT-4o-mini2026.04 | 62.8 | 52 | |
| CoLISA + DeBERTaV3-largeRetriever=CoLISA, Reader=DeBERTaV3-large2026.04 | 62.3 | 49.7 | |
| DPR + DeBERTaV3-largeRetriever=DPR, Reader=DeBERTaV3-large2026.04 | 55.4 | 40.5 | |
| Longformer-baseBackbone=Longformer-base2026.04 | 30.7 | 7.6 |