List your company
ResearchFormerly WizWand

Uncertainty Estimation on WebQA

73.57AUROCSE + MARS
61.651664.745867.8470.9342Feb 19, 2024
Updated 8mo ago

Evaluation results

MethodLinks
SE + MARSBackbone=Falcon-7b2024.0273.57
SEBackbone=Falcon-7b2024.0273.16
SE + MARSBackbone=Llama2-7b2024.0269.88
SE + MARSBackbone=Mistral-7b2024.0269.86
SEBackbone=Mistral-7b2024.0269.51
SEBackbone=Llama2-7b2024.0269.44
Entropy + MARSBackbone=Falcon-7b2024.0268.44
Confidence + MARSBackbone=Falcon-7b2024.0268.26
SE + MARSBackbone=Llama2-13b2024.0267.75
SEBackbone=Llama2-13b2024.0267.31
SE + MARSBackbone=Llama2-7b-chat2024.0267.27
Confidence + MARSBackbone=Mistral-7b2024.0267.16
SEBackbone=Llama2-7b-chat2024.0267.11
ConfidenceBackbone=Falcon-7b2024.0266.56
Confidence + MARSBackbone=Llama2-7b2024.0266.04
EntropyBackbone=Falcon-7b2024.0265.98
Entropy + MARSBackbone=Llama2-7b2024.0265.83
Entropy + MARSBackbone=Mistral-7b2024.0265.76
ConfidenceBackbone=Mistral-7b2024.0265.66
ConfidenceBackbone=Llama2-7b2024.0264.76
Entropy + MARSBackbone=Llama2-7b-chat2024.0264.69
Confidence + MARSBackbone=Llama2-7b-chat2024.0264.48
Confidence + MARSBackbone=Llama2-13b2024.0264.23
EntropyBackbone=Mistral-7b2024.0264.15
ConfidenceBackbone=Llama2-7b-chat2024.0264.06
EntropyBackbone=Llama2-7b2024.0264.04
Entropy + MARSBackbone=Llama2-13b2024.0264.02
EntropyBackbone=Llama2-7b-chat2024.0263.82
ConfidenceBackbone=Llama2-13b2024.0262.6
EntropyBackbone=Llama2-13b2024.0262.11