Tip-of-the-Tongue Retrieval on TREC Tip-of-the-Tongue 2025 (test)
43.41R@10gmn-rerank-500
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| gmn-rerank-500reranker=Gemini-2.5-flash, retrieval_strategy=Hybrid (20 LLM + 500 BM25 + 500 BGE-M3), reranked_documents=10202026.01 | 43.41 | 65.59 | 41.06 | |
| gm27q-comb-500reranker=Gemma-27B-quantized, retrieval_strategy=Limited Hybrid (LLM + 200 BM25 + 200 BGE-M3)2026.01 | 41.96 | 58.84 | 38.48 | |
| gm27q-LMART-1000reranker_stack=LambdaMART then Gemma-27B-quantized, retrieval_strategy=Hybrid, top_k_reranked=10002026.01 | 36.17 | 61.09 | 33.39 | |
| gemini-retrievalmodel=Gemini-2.5-flash, retrieval_type=LLM generation, titles_per_query=202026.01 | 34.57 | 35.05 | 29.62 | |
| top_model_densetechnique=topic-aware routing, indexes=24 topic-specific FAISS indexes, enhancement=multi-variant query expansion2026.01 | 17.2 | 50.96 | 16.2 | |
| lambdamart-rerankreranker=LambdaMART, retrieval_strategy=Hybrid (LLM, Pyterrier BM25, and BGE-M3)2026.01 | 15.59 | 61.09 | 14.52 | |
| bge-m3model=BGE-M3, retrieval_type=Dense retrieval baseline2026.01 | 14.47 | 54.98 | 14.92 |