Information Retrieval on FinQuant
59nDCG@10DeepQuant
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DeepQuantCategory=Quantity-Aware Retrievers2026.05 | 59 | 73 | 32 | 88 | |
| NumColBERTCategory=Ours2026.05 | 59 | 71 | 31 | 87 | |
| QColBERTCategory=Quantity-Aware Retrievers, Source=reported2026.05 | 56 | 69 | 30 | 87 | |
| QSPLADECategory=Quantity-Aware Retrievers2026.05 | 53 | 67 | 29 | 83 | |
| QColBERTCategory=Quantity-Aware Retrievers, Source=reproduced2026.05 | 52 | 65 | 27 | 82 | |
| ColBERTftCategory=Dense Retriever2026.05 | 50 | 62 | 26 | 81 | |
| SPLADEftCategory=Sparse Retrievers2026.05 | 42 | 51 | 21 | 74 | |
| QBM25Category=Quantity-Aware Retrievers2026.05 | 41 | 53 | 21 | 55 | |
| GPT-4o-miniCategory=LLM-based Reranker2026.05 | 36 | 52 | 17 | 69 | |
| BM25Category=Sparse Retrievers2026.05 | 10 | 15 | 6 | 47 |