Question Answering on NQ (Natural Questions) (EM, F1) benchmark leaderboard · SOTA2 Research

Question Answering on NQ (Natural Questions) (EM, F1)

42.5EMEXIT

Evaluation Results

Method	Links
EXIT2024.12		42.5	55.3
Original Docs2024.12		42.1	55
RECOMP-Extr2024.12		40.1	50.9
Original Docs2024.12		39.5	51.8
EXIT2024.12		39.5	51.9
Original Docs2024.12		39.2	51.4
EXIT2024.12		38.8	50.8
RECOMP-Extr2024.12		38.6	49.1
Refiner2024.12		38.2	50.2
RECOMP-Abst2024.12		38.1	50.3
CompAct2024.12		37.9	49.7
CompAct2024.12		37.6	49.1
RECOMP-Abst2024.12		37.2	50
LongLLMLingua2024.12		37	49.1
Original Docs2024.12		36.9	48.8
Refiner2024.12		36.5	47.6
RECOMP-Extr2024.12		35.9	45.8
EXIT2024.12		35.8	47.4
CompAct2024.12		35.6	47
LongLLMLingua2024.12		35.2	47.2
CompAct2024.12		35	46.3
Refiner2024.12		34.4	46
RECOMP-Extr2024.12		34.2	43.7
RECOMP-Abst2024.12		33.9	45.1
LongLLMLingua2024.12		33.8	45.2
Refiner2024.12		32.2	43.1
LongLLMLingua2024.12		30.7	41.8
RECOMP-Abst2024.12		30.2	40.7