Question Answering on TriviaQA v1.0 (test)
0.6881A1 AccuracyEigV + MCH
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| EigV + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.05 | 0.6881 | 0.4556 | 0.9095 | 0.5343 | 0.7581 | |
| ECC + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.05 | 0.6874 | 0.4319 | 0.9012 | 0.5308 | 0.7767 | |
| SE + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.05 | 0.6502 | 0.4556 | 0.893 | 0.5616 | 0.7628 | |
| PEBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.05 | 0.6388 | 0.3905 | 0.8724 | 0.613 | 0.7914 | |
| PE + MCHBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=MCH2025.05 | 0.6351 | 0.4138 | 0.8724 | 0.6438 | 0.8025 | |
| SEBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.05 | 0.6126 | 0.4138 | 0.9136 | 0.5171 | 0.7628 | |
| PE + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.05 | 0.5157 | 0.4852 | 0.8683 | 0.6267 | 0.8025 | |
| SE + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.05 | 0.5157 | 0.4852 | 0.8683 | 0.6267 | 0.7701 | |
| EigV + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.05 | 0.4864 | 0.5089 | 0.8724 | 0.6027 | 0.7448 | |
| ECC + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.05 | 0.4835 | 0.5029 | 0.8436 | 0.6232 | 0.7577 | |
| EigV + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.05 | 0.4793 | 0.4734 | 0.8889 | 0.6027 | 0.7479 | |
| ECC + CTIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=CTI2025.05 | 0.4713 | 0.5029 | 0.8271 | 0.6095 | 0.7622 | |
| PE + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.05 | 0.4556 | 0.4852 | 0.8683 | 0.6267 | 0.7883 | |
| SE + NLIBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=NLI2025.05 | 0.4556 | 0.4852 | 0.8683 | 0.6267 | 0.7448 | |
| EigVBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.05 | 0.1924 | 0.2308 | 0.8519 | 0.4144 | 0.7225 | |
| ECCBackbone=Mistral-v0.3, Retriever=Contriver, Calibration=None2025.05 | 0.1831 | 0.1479 | 0.786 | 0.3562 | 0.7172 |