OOD Document Detection on BEIR (test)
1ArguAnaIPQ
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| IPQRetriever=BGE2025.06 | 1 | 0.7465 | 0.5502 | 0.8175 | 0.1911 | 1 | 0.8224 | 0.9972 | 0.156 | 1 | 0.7281 | |
| GenQueryRetriever=BGE, Model=Llama3.1-8B2025.06 | 1 | 0.8687 | 0.7548 | 0.797 | 0.2142 | 0.9896 | 0.6213 | 1 | 0.1597 | 0.974 | 0.7379 | |
| LayerwiseRetriever=E52025.06 | 1 | 0.7546 | 0.4701 | 0.7438 | 0.1904 | 0.9965 | 0.5553 | 0.9843 | 0.1596 | 0.9781 | 0.6833 | |
| LayerwiseRetriever=GTE2025.06 | 1 | 0.8281 | 0.5666 | 0.7617 | 0.2148 | 0.9987 | 0.6614 | 0.9947 | 0.1498 | 0.9982 | 0.7174 | |
| IPQRetriever=GTE2025.06 | 1 | 0.8459 | 0.6626 | 0.7527 | 0.1982 | 0.9983 | 0.6845 | 0.995 | 0.1481 | 0.9982 | 0.7284 | |
| GenQueryRetriever=GTE, Model=Llama3.1-8B2025.06 | 1 | 0.842 | 0.768 | 0.7058 | 0.2133 | 0.9871 | 0.6595 | 0.9973 | 0.1616 | 0.9963 | 0.7331 | |
| Full Document SetRetriever=BGE, OOD Selection=None2025.06 | 0.9968 | 0.7996 | 0.5967 | 0.8025 | 0.2139 | 0.9968 | 0.7348 | 0.9976 | 0.1653 | 0.7233 | 0.7031 | |
| Full Document SetRetriever=E52025.06 | 0.9968 | 0.7642 | 0.5556 | 0.7485 | 0.1803 | 0.9967 | 0.6149 | 0.9849 | 0.1581 | 0.9775 | 0.7 | |
| Full Document SetRetriever=GTE2025.06 | 0.9968 | 0.8037 | 0.6085 | 0.7576 | 0.2248 | 0.9957 | 0.7266 | 0.9952 | 0.1753 | 0.9925 | 0.7355 | |
| GradNormIRRetriever=E52025.06 | 0.9945 | 0.6919 | 0.2974 | 0.7447 | 0.1702 | 0.9968 | 0.555 | 0.9856 | 0.1585 | 0.9643 | 0.6559 | |
| LayerwiseRetriever=BGE2025.06 | 0.9901 | 0.8614 | 0.4548 | 0.7973 | 0.2235 | 0.9978 | 0.6195 | 1 | 0.1534 | 0.9333 | 0.7031 | |
| GradNormIRRetriever=BGE2025.06 | 0.9901 | 0.6114 | 0.3149 | 0.7916 | 0.1836 | 0.9971 | 0.5697 | 1 | 0.1522 | 0.8919 | 0.6503 | |
| IPQRetriever=E52025.06 | 0.9891 | 0.7596 | 0.4954 | 0.7461 | 0.1801 | 0.9983 | 0.5857 | 0.9845 | 0.1568 | 0.9724 | 0.6868 | |
| GenQueryRetriever=E5, Model=Llama3.1-8B2025.06 | 0.9891 | 0.8015 | 0.6933 | 0.7441 | 0.1854 | 0.9951 | 0.5805 | 0.9853 | 0.1579 | 0.9803 | 0.7113 | |
| Full Document SetRetriever=Contriever2025.06 | 0.9679 | 0.724 | 0.5676 | 0.5983 | 0.1866 | 0.9883 | 0.5526 | 0.9825 | 0.0914 | 0.9614 | 0.6606 | |
| LayerwiseRetriever=Contriever2025.06 | 0.9383 | 0.6867 | 0.4914 | 0.5661 | 0.1785 | 0.991 | 0.5175 | 0.9836 | 0.0826 | 0.9534 | 0.6389 | |
| IPQRetriever=Contriever2025.06 | 0.9383 | 0.6911 | 0.4837 | 0.5772 | 0.1811 | 0.9917 | 0.5139 | 0.987 | 0.0825 | 0.9404 | 0.6387 | |
| GradNormIRRetriever=GTE2025.06 | 0.9375 | 0.7083 | 0.5124 | 0.7102 | 0.1922 | 0.996 | 0.6522 | 0.9872 | 0.1656 | 0.9656 | 0.6862 | |
| GradNormIRRetriever=Contriever2025.06 | 0.9136 | 0.6392 | 0.4063 | 0.5612 | 0.1711 | 0.9875 | 0.5064 | 0.9778 | 0.0809 | 0.9017 | 0.6146 | |
| GenQueryRetriever=Contriever, Model=Llama3.1-8B2025.06 | 0.9012 | 0.7223 | 0.6587 | 0.5499 | 0.1853 | 0.9728 | 0.5117 | 0.9865 | 0.0745 | 0.9333 | 0.6496 |