List your company

OOD Document Detection on BEIR (test)

1ArguAnaIPQ
0.8972480.9239240.95060.977276Jun 2, 2025

Evaluation results

MethodLinks
IPQRetriever=BGE2025.0610.74650.55020.81750.191110.82240.99720.15610.7281
GenQueryRetriever=BGE, Model=Llama3.1-8B2025.0610.86870.75480.7970.21420.98960.621310.15970.9740.7379
LayerwiseRetriever=E52025.0610.75460.47010.74380.19040.99650.55530.98430.15960.97810.6833
LayerwiseRetriever=GTE2025.0610.82810.56660.76170.21480.99870.66140.99470.14980.99820.7174
IPQRetriever=GTE2025.0610.84590.66260.75270.19820.99830.68450.9950.14810.99820.7284
GenQueryRetriever=GTE, Model=Llama3.1-8B2025.0610.8420.7680.70580.21330.98710.65950.99730.16160.99630.7331
Full Document SetRetriever=BGE, OOD Selection=None2025.060.99680.79960.59670.80250.21390.99680.73480.99760.16530.72330.7031
Full Document SetRetriever=E52025.060.99680.76420.55560.74850.18030.99670.61490.98490.15810.97750.7
Full Document SetRetriever=GTE2025.060.99680.80370.60850.75760.22480.99570.72660.99520.17530.99250.7355
GradNormIRRetriever=E52025.060.99450.69190.29740.74470.17020.99680.5550.98560.15850.96430.6559
LayerwiseRetriever=BGE2025.060.99010.86140.45480.79730.22350.99780.619510.15340.93330.7031
GradNormIRRetriever=BGE2025.060.99010.61140.31490.79160.18360.99710.569710.15220.89190.6503
IPQRetriever=E52025.060.98910.75960.49540.74610.18010.99830.58570.98450.15680.97240.6868
GenQueryRetriever=E5, Model=Llama3.1-8B2025.060.98910.80150.69330.74410.18540.99510.58050.98530.15790.98030.7113
Full Document SetRetriever=Contriever2025.060.96790.7240.56760.59830.18660.98830.55260.98250.09140.96140.6606
LayerwiseRetriever=Contriever2025.060.93830.68670.49140.56610.17850.9910.51750.98360.08260.95340.6389
IPQRetriever=Contriever2025.060.93830.69110.48370.57720.18110.99170.51390.9870.08250.94040.6387
GradNormIRRetriever=GTE2025.060.93750.70830.51240.71020.19220.9960.65220.98720.16560.96560.6862
GradNormIRRetriever=Contriever2025.060.91360.63920.40630.56120.17110.98750.50640.97780.08090.90170.6146
GenQueryRetriever=Contriever, Model=Llama3.1-8B2025.060.90120.72230.65870.54990.18530.97280.51170.98650.07450.93330.6496