Information Retrieval on SciFact NanoBEIR (test)
81.7NDCG@10FT SciFact (KMeans, PF1-6)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| FT SciFact (KMeans, PF1-6)PF (Pool Factor)=1, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=SciFact2026.07 | 81.7 | 101 | 0.008 | |
| FT SciFact (KMeans, PF1-6)PF (Pool Factor)=2, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=SciFact2026.07 | 81.3 | 100.5 | 0.047 | |
| FT SciFact (KMeans, PF1-6)PF (Pool Factor)=4, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=SciFact2026.07 | 81 | 100.3 | 0.162 | |
| Baseline (KMeans)PF (Pool Factor)=1, Fine-tuning Protocol=None, Pooling Method=KMeans2026.07 | 80.8 | 100 | — | |
| FT FiQA (KMeans, PF1-6)PF (Pool Factor)=4, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=FiQA2026.07 | 80.8 | 99.9 | 0.159 | |
| FT FiQA (KMeans, PF1-6)PF (Pool Factor)=1, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=FiQA2026.07 | 80.2 | 99.3 | 0.006 | |
| FT SciFact (KMeans, PF1-6)PF (Pool Factor)=6, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=SciFact2026.07 | 79.5 | 98.3 | 0.185 | |
| FT FiQA (KMeans, PF1-6)PF (Pool Factor)=2, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=FiQA2026.07 | 77.4 | 95.8 | 0.009 | |
| Baseline (KMeans)PF (Pool Factor)=2, Fine-tuning Protocol=None, Pooling Method=KMeans2026.07 | 76.5 | 94.7 | — | |
| FT FiQA (KMeans, PF1-6)PF (Pool Factor)=6, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=FiQA2026.07 | 75.8 | 93.8 | 0.149 | |
| Baseline (KMeans)PF (Pool Factor)=4, Fine-tuning Protocol=None, Pooling Method=KMeans2026.07 | 64.9 | 80.2 | — | |
| Baseline (KMeans)PF (Pool Factor)=6, Fine-tuning Protocol=None, Pooling Method=KMeans2026.07 | 60.9 | 75.4 | — |