List your company
ResearchFormerly WizWand

Question Answering on TriviaQA v1.0 (test)

0.6881A1 AccuracyEigV + MCH
0.16290.299250.43560.57195May 12, 2025
Updated 8mo ago

Evaluation results

MethodLinks
EigV + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.050.68810.45560.90950.53430.7581
ECC + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.050.68740.43190.90120.53080.7767
SE + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.050.65020.45560.8930.56160.7628
PEBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.050.63880.39050.87240.6130.7914
PE + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.050.63510.41380.87240.64380.8025
SEBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.050.61260.41380.91360.51710.7628
PE + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.050.51570.48520.86830.62670.8025
SE + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.050.51570.48520.86830.62670.7701
EigV + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.050.48640.50890.87240.60270.7448
ECC + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.050.48350.50290.84360.62320.7577
EigV + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.050.47930.47340.88890.60270.7479
ECC + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.050.47130.50290.82710.60950.7622
PE + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.050.45560.48520.86830.62670.7883
SE + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.050.45560.48520.86830.62670.7448
EigVBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.050.19240.23080.85190.41440.7225
ECCBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.050.18310.14790.7860.35620.7172