Information Retrieval on FiQA NanoBEIR (test)
0.528NDCG@10FT FiQA (KMeans, PF1-6)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| FT FiQA (KMeans, PF1-6)PF (Pool Factor)=1, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=FiQA2026.07 | 0.528 | 100.4 | 0.002 | |
| Baseline (KMeans)PF (Pool Factor)=1, Fine-tuning Protocol=None, Pooling Method=KMeans2026.07 | 0.526 | 100 | — | |
| FT SciFact (KMeans, PF1-6)PF (Pool Factor)=1, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=SciFact2026.07 | 0.523 | 99.6 | 0.002 | |
| FT SciFact (KMeans, PF1-6)PF (Pool Factor)=2, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=SciFact2026.07 | 0.519 | 98.8 | 0.031 | |
| FT FiQA (KMeans, PF1-6)PF (Pool Factor)=4, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=FiQA2026.07 | 0.513 | 97.6 | 0.043 | |
| FT FiQA (KMeans, PF1-6)PF (Pool Factor)=2, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=FiQA2026.07 | 0.505 | 96.1 | 0.016 | |
| FT SciFact (KMeans, PF1-6)PF (Pool Factor)=4, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=SciFact2026.07 | 0.49 | 93.3 | 0.021 | |
| Baseline (KMeans)PF (Pool Factor)=2, Fine-tuning Protocol=None, Pooling Method=KMeans2026.07 | 0.488 | 92.9 | — | |
| Baseline (KMeans)PF (Pool Factor)=4, Fine-tuning Protocol=None, Pooling Method=KMeans2026.07 | 0.47 | 89.4 | — | |
| FT FiQA (KMeans, PF1-6)PF (Pool Factor)=6, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=FiQA2026.07 | 0.467 | 88.9 | 0.036 | |
| FT SciFact (KMeans, PF1-6)PF (Pool Factor)=6, Fine-tuning Protocol=Multi-factor training (PF1-6), Pooling Method=KMeans, Fine-tuned On=SciFact2026.07 | 0.459 | 87.4 | 0.028 | |
| Baseline (KMeans)PF (Pool Factor)=6, Fine-tuning Protocol=None, Pooling Method=KMeans2026.07 | 0.431 | 82 | — |