Information Retrieval on MAIR 5% labeled query-document pairs (test)
58.53Average IR ScoreERA
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| ERAModel=Qwen3-8B2026.04 | 58.53 | 58.66 | 62.03 | 70.61 | 57.38 | 52.44 | 57.91 | |
| Zero-shotModel=Qwen3-8B2026.04 | 57.91 | 56.94 | 61.85 | 69.38 | 57.89 | 53.75 | 56.65 | |
| ERAModel=Qwen3-0.6B2026.04 | 51.38 | 48.96 | 57.35 | 62.46 | 49.67 | 45.38 | 50.93 | |
| Zero-shotModel=Qwen3-0.6B2026.04 | 50.37 | 48.48 | 58.34 | 60.56 | 48.58 | 44.55 | 49.17 | |
| ERAModel=OpenAI-large2026.04 | 49.14 | 47.9 | 53.04 | 58.9 | 38.4 | 44.07 | 50.72 | |
| Zero-shotModel=OpenAI-large2026.04 | 46.64 | 44.05 | 49.25 | 57.58 | 36.21 | 42.29 | 48.57 | |
| ERAModel=OpenAI-small2026.04 | 41.51 | 40.65 | 44.44 | 53.63 | 34.21 | 35.38 | 42.65 | |
| ERAModel=BGE-M32026.04 | 39.8 | 38.75 | 39.62 | 58.45 | 39.6 | 29.65 | 41.02 | |
| Zero-shotModel=OpenAI-small2026.04 | 36.74 | 35.62 | 41.35 | 50.36 | 31.77 | 30.64 | 36.67 | |
| Zero-shotModel=BGE-M32026.04 | 34.03 | 34.81 | 34.85 | 52.44 | 37.01 | 25.25 | 33.28 | |
| Emb. AdapterModel=Qwen3-8B2026.04 | 19.77 | 17.72 | 26.67 | 19.25 | 12.84 | 12.31 | 22.18 | |
| Emb. AdapterModel=Qwen3-0.6B2026.04 | 14.83 | 12.21 | 23.04 | 17.22 | 9.31 | 9.53 | 15.49 | |
| Emb. AdapterModel=OpenAI-large2026.04 | 9.74 | 9.22 | 16.95 | 7.3 | 4.82 | 6.41 | 10.03 | |
| Emb. AdapterModel=OpenAI-small2026.04 | 8.36 | 6.47 | 15.62 | 4.85 | 5.82 | 5.75 | 8.46 | |
| Emb. AdapterModel=BGE-M32026.04 | 7.48 | 6.59 | 14.36 | 8.92 | 6.65 | 4.04 | 6.6 |