Temporal Information Retrieval on Temporal Nobel Prize (TNP)
82.55nDCG@10nomic (Mean-768)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| nomic (Mean-768)Train set=Our, Adaptation=LoRA2026.01 | 82.55 | 97.58 | |
| nomic (Mean-768)Train set=Original, Adaptation=LoRA2026.01 | 81.59 | 96.89 | |
| gte (Mean-768)Train set=Original, Adaptation=0-shot2026.01 | 80.47 | 97.56 | |
| gte (Mean-768)Train set=Our, Adaptation=LoRA2026.01 | 80.34 | 97.25 | |
| gte (Mean-768)Train set=Our, Adaptation=Matryoshka-Adaptor2026.01 | 78.72 | 97.52 | |
| gte (Mean-768)Train set=Original, Adaptation=Matryoshka-Adaptor2026.01 | 78.65 | 97.5 | |
| nomic (Mean-768)Train set=Original, Adaptation=0-shot2026.01 | 78.01 | 95.58 | |
| bge (CLS-768)Train set=Original, Adaptation=LoRA2026.01 | 77.77 | 97.5 | |
| bge (CLS-768)Train set=Our, Adaptation=LoRA2026.01 | 77.42 | 97.5 | |
| bge-m3 (CLS-1024)Train set=Our, Adaptation=LoRA2026.01 | 75.92 | 96.98 | |
| nomic (Mean-768)Train set=Our, Adaptation=Matryoshka-Adaptor2026.01 | 75.14 | 95.73 | |
| nomic (Mean-768)Train set=Original, Adaptation=Matryoshka-Adaptor2026.01 | 75.1 | 95.77 | |
| gte (Mean-768)Train set=Original, Adaptation=LoRA2026.01 | 75.09 | 96.13 | |
| bge-m3 (CLS-1024)Train set=Original, Adaptation=LoRA2026.01 | 74.69 | 96.61 | |
| bge (CLS-768)Train set=Original, Adaptation=0-shot2026.01 | 72.62 | 97.85 | |
| gte1.5 (CLS-768)Train set=Original, Adaptation=LoRA2026.01 | 72.31 | 96.26 | |
| bge (CLS-768)Train set=Our, Adaptation=Matryoshka-Adaptor2026.01 | 70.14 | 97.46 | |
| gte1.5 (CLS-768)Train set=Our, Adaptation=LoRA2026.01 | 69.9 | 96.19 | |
| bge (CLS-768)Train set=Original, Adaptation=Matryoshka-Adaptor2026.01 | 69.8 | 97.38 | |
| bge-m3 (CLS-1024)Train set=Our, Adaptation=Ts-Retriever2026.01 | 68.63 | 30.4 | |
| gte1.5 (CLS-768)Train set=Our, Adaptation=Ts-Retriever2026.01 | 67.09 | 95.51 | |
| Contriever (Mean-768)Train set=Our, Adaptation=TempRetriever2026.01 | 63.3 | 96.32 | |
| Contriever (Mean-768)Train set=Our, Adaptation=LoRA2026.01 | 61.26 | 97.08 | |
| Contriever (Mean-768)Train set=Original, Adaptation=Ts-Retriever2026.01 | 60.09 | 94.57 | |
| bge (CLS-768)Train set=Our, Adaptation=Ts-Retriever2026.01 | 59.87 | 94.27 | |
| bge-m3 (CLS-1024)Train set=Original, Adaptation=0-shot2026.01 | 59.64 | 96.97 | |
| bge-m3 (CLS-1024)Train set=Our, Adaptation=Matryoshka-Adaptor2026.01 | 57.83 | 96.56 | |
| bge-m3 (CLS-1024)Train set=Original, Adaptation=Matryoshka-Adaptor2026.01 | 57.65 | 96.55 | |
| Contriever (Mean-768)Train set=Original, Adaptation=LoRA2026.01 | 56.91 | 96.37 | |
| Contriever (Mean-768)Train set=Our, Adaptation=Ts-Retriever2026.01 | 53.64 | 95.52 | |
| gte1.5 (CLS-768)Train set=Original, Adaptation=Ts-Retriever2026.01 | 53.13 | 92.92 | |
| gte1.5 (CLS-768)Train set=Original, Adaptation=0-shot2026.01 | 52.17 | 94.69 | |
| Contriever (Mean-768)Train set=Original, Adaptation=TempRetriever2026.01 | 50.46 | 95.05 | |
| gte1.5 (CLS-768)Train set=Our, Adaptation=Matryoshka-Adaptor2026.01 | 50.29 | 94.2 | |
| gte1.5 (CLS-768)Train set=Original, Adaptation=Matryoshka-Adaptor2026.01 | 48.65 | 93.84 | |
| bge (CLS-768)Train set=Original, Adaptation=Ts-Retriever2026.01 | 44.76 | 89.47 | |
| nomic (Mean-768)Train set=Original, Adaptation=Ts-Retriever2026.01 | 44.6 | 91.32 | |
| nomic (Mean-768)Train set=Our, Adaptation=Ts-Retriever2026.01 | 42.92 | 86.86 | |
| bge-m3 (CLS-1024)Train set=Original, Adaptation=Ts-Retriever2026.01 | 38.98 | 89.23 | |
| BM25Adaptation=0-shot2026.01 | 34.58 | 76.61 | |
| Contriever (Mean-768)Train set=Original, Adaptation=0-shot2026.01 | 21.5 | 85.12 | |
| Contriever (Mean-768)Train set=Our, Adaptation=Matryoshka-Adaptor2026.01 | 20.87 | 84.24 | |
| Contriever (Mean-768)Train set=Original, Adaptation=Matryoshka-Adaptor2026.01 | 19.75 | 81.62 | |
| nomic (Mean-768)Train set=Original, Adaptation=TempRetriever2026.01 | 5.81 | 45.73 | |
| gte1.5 (CLS-768)Train set=Original, Adaptation=TempRetriever2026.01 | 4.34 | 46.3 | |
| bge-m3 (CLS-1024)Train set=Original, Adaptation=TempRetriever2026.01 | 4.29 | 55.94 | |
| nomic (Mean-768)Train set=Our, Adaptation=TempRetriever2026.01 | 3.73 | 44.32 | |
| gte1.5 (CLS-768)Train set=Our, Adaptation=TempRetriever2026.01 | 2.45 | 26.17 | |
| bge (CLS-768)Train set=Our, Adaptation=TempRetriever2026.01 | 2 | 25.08 | |
| bge-m3 (CLS-1024)Train set=Our, Adaptation=TempRetriever2026.01 | 1.85 | 30.4 | |
| bge (CLS-768)Train set=Original, Adaptation=TempRetriever2026.01 | 1.5 | 21.48 |