Question Answering on ASQA, HotpotQA, NQ, TriviaQA, POPQA, and BIOASQ benchmark leaderboard · SOTA2 Research

Question Answering on ASQA, HotpotQA, NQ, TriviaQA, POPQA, and BIOASQ

83ASQA ScoreOSCAR-llama

Evaluation Results

Method	Links
OSCAR-llama2025.03		83	64	80	91	66	80	77
RECOMP2025.03		83	61	78	89	58	83	75
OSCAR-8-Layers2025.03		82	64	81	91	64	79	77
OSCAR-10-Layers2025.03		82	64	81	91	64	80	77
No compression2025.03		82	62	80	90	61	82	76
Provence2025.03		82	60	80	89	58	85	76
OSCAR-llama2025.03		82	64	81	91	65	81	77
OSCAR-5-Layers2025.03		82	62	79	90	63	77	76
OSCAR-8-Layers2025.03		82	64	80	91	64	79	77
OSCAR-llama2025.03		82	62	79	90	65	81	76
No compression2025.03		82	71	80	92	70	85	80
OSCAR-llama2025.03		82	65	82	92	67	84	79
OSCAR-llama2025.03		81	63	79	91	66	80	77
OSCAR-8-Layers2025.03		81	63	79	90	64	78	76
OSCAR-10-Layers2025.03		81	65	82	91	66	78	77
PISCO2025.03		81	60	78	89	57	79	74
OSCAR-8-Layers2025.03		81	61	78	90	64	80	76
No compression2025.03		80	67	78	91	65	84	78
OSCAR-5-Layers2025.03		71	53	70	85	55	72	68
No compression2025.03		69	48	66	81	52	76	65