List your company
ResearchFormerly WizWand

Document Reranking on FEVER

100NDCG@5MonoT5-3B
22.4804842.6057462.73182.85626May 6, 2026May 12, 2026May 19, 2026May 26, 2026Jun 2, 2026Jun 9, 2026Jun 16, 2026
Updated 4mo ago

Evaluation results

MethodLinks
MonoT5-3BThreshold (τ)=0.52026.06100—99.991.5
Qwen3-Reranker-8BThreshold (τ)=0.52026.06100—99.898.2
MonoT5-baseModel Parameters=0.2B, Threshold (τ)=0.52026.0699.9—99.891.3
LLM2Vec-GenBase Model=Qwen3-8B, Threshold (τ)=02026.0699.7—99.813.1
RSRankThreshold (τ)=02026.0699.2—99.783.4
RankT5Retriever=Contriever, Category=Supervised Neural Reranker2026.0581.556———
RankT5 + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.0581.5560——
Cross-EncoderRetriever=Contriever, Category=Supervised Neural Reranker2026.0578.457———
Cross-Encoder + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.0578.4570——
ColBERTRetriever=Contriever, Category=Supervised Neural Reranker2026.0576.169———
ColBERT + CARRetriever=Contriever, Category=Supervised Neural Reranker, Confidence-Aware Reranking=Enabled2026.0576.1690——
RankGPTLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.0574.268———
RankGPT + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.0574.2680——
ContrieverRetriever=Contriever, Category=Retriever Only2026.0574.253———
Contriever + CARRetriever=Contriever, Category=Retriever Only, Confidence-Aware Reranking=Enabled2026.0574.2530——
QLM + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.0557.823.8——
QLMLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.0555.687———
YesNo + CARLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker, Confidence-Aware Reranking=Enabled2026.0541.32662.3——
YesNoLLM=Qwen2.5-7B-Instruct, Retriever=Contriever, Category=LLM-based Reranker2026.0525.462———