List your company

Medical Information Retrieval on R2MED (original queries)

43.18Average (nDCG@10)ReasonEmbed-Qwen3-8B
14.00821.581529.15536.7285Oct 9, 2025

Evaluation results

MethodLinks
ReasonEmbed-Qwen3-8BSize=8B, Training=Redapter (self-adaptive RI-InfoNCE loss)2025.1043.1854.0166.3367.6420.9327.9651.3833.7623.43
ReasonEmbed-Llama-3.1-8BSize=8B, Training=Redapter (self-adaptive RI-InfoNCE loss)2025.1042.7653.5264.3763.8220.429.6751.8634.5523.88
ReasonEmbed-Qwen3-8BSize=8B, Training=InfoNCE loss2025.1042.3651.6565.1765.8920.6727.9851.7133.7922.01
ReasonEmbed-Llama-3.1-8BSize=8B, Training=InfoNCE loss2025.1041.9853.0463.2463.8922.229.4351.932.919.2
ReasonEmbed-Qwen3-4BSize=4B, Training=Redapter (self-adaptive RI-InfoNCE loss)2025.1041.1652.4564.2862.5820.8326.2148.0332.522.38
ReasonEmbed-Qwen3-4BSize=4B, Training=InfoNCE loss2025.1039.9449.562.5960.2620.4324.7549.2730.422.32
RaDeR-gte-Qwen2-7BSize=7B2025.1035.1936.0253.5850.3215.4120.3149.9434.3121.83
Qwen3-Embedding-8BSize=8B2025.1034.2221.3750.1546.6518.9127.0648.7637.2923.6
gte-Qwen2-7B-instructSize=7B2025.1032.5633.1845.5349.9113.4117.148.1932.1321.07
DIVER-RetrieverSize=4B2025.1032.2339.2751.6850.8113.9416.138.5624.6922.81
Qwen3-Embedding-4BSize=4B2025.1031.7518.1647.7343.3717.2522.947.1933.6523.76
NV-Embed-v2Size=7B2025.1031.4327.1550.147.8110.916.7244.0539.9114.81
GritLM-7BSize=7B2025.1031.1224.9943.9845.9412.3219.8639.8837.0824.94
OpenAI-3-LargeSize=-2025.1028.5723.8240.5144.0511.7815.0147.4328.8717.12
ReasonIR-8BSize=8B2025.1027.9426.1644.8439.2811.2114.9236.5629.221.37
Qwen3-8B-msSize=8B, Status=reproduced2025.1024.1517.0238.1139.335.379.5131.8530.8821.11
Qwen3-4B-msSize=4B, Status=reproduced2025.1023.0916.0537.333.675.288.7931.5529.6322.43
Llama-3.1-8B-msSize=8B, Status=reproduced2025.1022.3413.1734.7634.35.648.8333.130.6818.23
BM25Size=-2025.1015.1319.1921.5519.680.662.5523.6921.6612.02