Dense Retrieval on BEIR zero-shot benchmark leaderboard · SOTA2 Research

Dense Retrieval on BEIR zero-shot

77.2TREC-COVIDRetroMAE

Evaluation Results

Method	Links
RetroMAE2022.05		77.2	42.1	30.8	51.8	63.5	31.6	26.5	42.8	44.7	43.3	23.7	31.7	84.7	39	15	77.4	23.2	65.3	45.2	—	—
Condenser2022.05		75	32.2	27.7	48.6	53.8	25.9	26.1	37.6	34.9	29.8	24.8	34.7	85.3	33.9	13.3	69.1	21.1	59.3	40.7	—	—
DeBERTa2022.05		68.8	29	23.8	45.2	47.4	29.9	24.3	37.8	37.8	29.7	27.1	27.9	84.6	27.1	10.6	59.4	16	54.3	37.8	—	—
BM252023.06		65.6	46.5	32.5	29.9	60.3	23.6	33	39.8	40.8	31.5	—	29.9	78.9	31.3	15.8	75.3	21.3	66.5	42.3	—	36.7
ROBERTa2022.05		64.9	27.9	24.3	41.3	44.8	29.1	22.9	38.5	38.4	39.5	29.9	27.8	50.9	27.5	11.1	68.3	22.2	53.9	36.8	—	—
SEED2022.05		62.7	30.8	27.8	44.6	54.1	25.9	25.6	35.8	36.5	38.9	22.5	29	85.2	33	12.4	64.1	17.6	57.5	39.1	—	—
BERT2022.05		61.5	25.3	26	46.7	48.8	25.2	20.4	36.2	35.1	26.5	25.9	28.2	78.7	31.4	11.3	68.2	18.7	53.3	37.1	—	—
SamToNe2023.06		61.2	39.7	36.5	47	66.4	42.6	31.1	48.4	55.5	39.8	—	41.4	88.7	45.9	22.4	70	32	67.7	48.3	—	32.4
SDE2023.06		53.1	40.2	37.2	42.9	66.9	41.8	31.8	49.2	53.5	40.2	—	40.7	88.8	45.7	22.3	68.3	31.1	68	46.9	—	22
GTR-XXL2023.06		50.1	32.4	34.2	56.8	59.9	46.7	27.3	34.6	50.6	54	—	39.9	89.2	40.8	15.9	74	26.7	66.2	45.8	—	25.6
DiffCSE2022.05		49.2	25.8	25.9	41.2	49.9	22.9	26	36.3	34.3	46.8	16.8	30.5	85	30.3	12.5	64.1	20	52.3	37.2	—	—
LaPraDoR2022.05		47.8	25.2	31	45.4	51.3	28.8	24.1	28.6	29.9	49.9	13.7	30.9	83.7	33.4	15	51.1	17.3	53.1	36.7	—	—
SimCSE2022.05		46	26.3	26	43.5	50.2	25	26.2	35.6	33	41.3	15.9	29	84.4	31.4	12.4	62.3	21.1	55.4	36.9	—	—