Information Retrieval on CSFCube A2A
66.53nDCG@20COR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CORBackbone=Granite-Emb-Eng-R2, Retrieval Setup=COR w/ A2A, Query Optimizer=GPT-4.12025.07 | 66.53 | 35.55 | 43.57 | |
| CORBackbone=QWEN3-0.6B-Emb, Retrieval Setup=COR w/ A2A, Query Optimizer=GPT-4.12025.07 | 65.28 | 35.46 | 43.59 | |
| CORBackbone=Inf-Ret-v1-1.5B, Retrieval Setup=COR w/ A2A, Query Optimizer=GPT-4.12025.07 | 65.26 | 35.26 | 43.44 | |
| Granite-Emb-Eng-R2Retrieval Setup=A2A2025.07 | 64.37 | 33.52 | 41.98 | |
| QWEN3-0.6B-EmbRetrieval Setup=A2A2025.07 | 64.13 | 33.54 | 42.35 | |
| Inf-Ret-v1-1.5BRetrieval Setup=A2A2025.07 | 63.8 | 33.77 | 41.86 | |
| CORBackbone=Dewey-EN-Beta, Retrieval Setup=COR w/ A2A, Query Optimizer=GPT-4.12025.07 | 63.77 | 33.46 | 41.76 | |
| Dewey-EN-BetaRetrieval Setup=A2A2025.07 | 61.61 | 31.95 | 40.05 | |
| CORBackbone=JEmb-v2-Base-EN, Retrieval Setup=COR w/ A2A, Query Optimizer=GPT-4.12025.07 | 60.73 | 31.89 | 40.31 | |
| JEmb-v2-Base-ENRetrieval Setup=A2A2025.07 | 60.26 | 30.67 | 39.48 | |
| CORBackbone=BGE-M3, Retrieval Setup=COR w/ A2A, Query Optimizer=GPT-4.12025.07 | 59.07 | 30.37 | 38.96 | |
| BGE-M3Retrieval Setup=A2A2025.07 | 57.83 | 28.78 | 37.45 |