List your company
ResearchFormerly WizWand

Question Answering on TriviaQA (ACC, ASR)

75ACCSDAG-D&A
35.4845.745666.26May 25, 2025Jul 6, 2025Aug 18, 2025Sep 29, 2025Nov 11, 2025Dec 23, 2025Feb 4, 2026
Updated 8mo ago

Evaluation results

MethodLinks
SDAG-D&A#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.027510
SDAG#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.027411
SDAG-D&A#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.027117
SDAG#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.026920
SDAG-RAGD#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.026911
RAGD#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.026822
RAGD#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.026726
SDAG-RAGD#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.026614
RAGD#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.026524
SDAG-RAGD#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.026518
RAGD#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.026425
SDAG-D&A#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.026328
D&A#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.026235
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=0.3, lambda (λ)=0.1, alpha (α)=22025.0560.5—
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=0.7, lambda (λ)=0.1, alpha (α)=22025.0560.5—
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=1, lambda (λ)=0.1, alpha (α)=22025.0560.5—
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=1.5, lambda (λ)=0.1, alpha (α)=22025.0560.5—
SDAG-RAGD#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.026023
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=0.3, lambda (λ)=0.1, alpha (α)=22025.0559.67—
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=0.3, lambda (λ)=0.01, alpha (α)=22025.0559.39—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=0.3, lambda (λ)=0.01, alpha (α)=1.52025.0559.33—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=0.3, lambda (λ)=0.01, alpha (α)=22025.0559.22—
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=0.3, lambda (λ)=0.01, alpha (α)=1.52025.0559.11—
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=0.3, lambda (λ)=0.1, alpha (α)=1.52025.0559.05—
D&A#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.025940
SDAG-RAGD#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.025925
SDAG#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.025929
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=0.3, lambda (λ)=0.1, alpha (α)=1.52025.0558.44—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=0.7, lambda (λ)=0.1, alpha (α)=22025.0558.22—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=1.5, lambda (λ)=0.1, alpha (α)=22025.0558.22—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=0.7, lambda (λ)=0.1, alpha (α)=1.52025.0557.44—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=1.5, lambda (λ)=0.1, alpha (α)=1.52025.0557.16—
CARG#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.025741
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=1, lambda (λ)=0.1, alpha (α)=22025.0556.94—
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=0.7, lambda (λ)=0.1, alpha (α)=1.52025.0556.77—
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=0.7, lambda (λ)=0.01, alpha (α)=22025.0556.77—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=1, lambda (λ)=0.1, alpha (α)=1.52025.0556.6—
D&A#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.025647
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=0.7, lambda (λ)=0.01, alpha (α)=22025.0555.88—
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=0.7, lambda (λ)=0.01, alpha (α)=1.52025.0555.54—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=0.7, lambda (λ)=0.01, alpha (α)=1.52025.0555.21—
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=1, lambda (λ)=0.1, alpha (α)=1.52025.0554.54—
CARG#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.025447
SDAG-D&A#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.025436
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=1, lambda (λ)=0.01, alpha (α)=22025.0552.37—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=1, lambda (λ)=0.01, alpha (α)=1.52025.0552.09—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=1, lambda (λ)=0.01, alpha (α)=22025.0551.75—
D&A#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.025152
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=1, lambda (λ)=0.01, alpha (α)=1.52025.0550.31—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=1.5, lambda (λ)=0.01, alpha (α)=22025.0550.19—
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=1.5, lambda (λ)=0.1, alpha (α)=1.52025.0550.14—
Bregman primal decodingModel=Phi-3-medium-4k-instruct, Temp=1.5, lambda (λ)=0.01, alpha (α)=1.52025.0549.47—
RAGD#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.024943
SDAG-D&A#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.024940
CARG#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.024755
D&A#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.024755
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=1.5, lambda (λ)=0.01, alpha (α)=22025.0545.29—
SDAG#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.024546
top-k decodingModel=Phi-3-medium-4k-instruct, Temp=1.5, lambda (λ)=0.01, alpha (α)=1.52025.0543.57—
CARG#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.024362
SDAG#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.024149
CARG#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.023766