List your company
ResearchFormerly WizWand

Question Answering on PopQA v1.0 (test)

83.07A1EigV + MCH
38.92250.383561.84573.3065May 12, 2025
Updated 8mo ago

Evaluation results

MethodLinks
EigV + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.0583.0712.3596.3137.1870.39
ECC + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.0581.7711.1196.0836.5372.71
SE + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.0580.2112.3594.0142.3170.1
PE + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.0574.2324.6993.0946.868.65
PE + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.0574.2217.2891.0148.7268.63
SEBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.0574.2216.0595.3933.9768.53
PE + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.0572.9114.8289.6346.867.14
PEBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.0570.5722.2289.1744.2365.72
SE + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.0570.5712.3593.5537.1867.1
SE + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.0569.0125.9394.2439.7470.53
EigV + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.0568.2316.0593.5539.7465.23
ECC + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.0567.4518.5294.2437.8268.36
EigV + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.0565.8832.195.1639.168.4
ECC + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.0565.8829.6395.6236.5369.91
EigVBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.0541.156.1793.0826.9266.35
ECCBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.0540.624.9392.1623.0866.28