List your company
ResearchFormerly WizWand

Uncertainty estimation on CoQA (test)

77.3AUROCSAR
50.05257.12664.271.274Jul 3, 2023
Updated 8mo ago

Evaluation results

MethodLinks
SARModel=OPT-13b, Rouge-L threshold=0.32023.0777.3
SARModel=OPT-6.7b, Rouge-L threshold=0.32023.0776.8
SARModel=OPT-30b, Rouge-L threshold=0.32023.0776.7
TOKENSARModel=OPT-13b, Rouge-L threshold=0.32023.0775.2
SEModel=OPT-13b, Rouge-L threshold=0.32023.0775.1
SEModel=OPT-30b, Rouge-L threshold=0.32023.0775.1
LN-PEModel=OPT-13b, Rouge-L threshold=0.32023.0775
TOKENSARModel=OPT-6.7b, Rouge-L threshold=0.32023.0774.6
TOKENSARModel=OPT-30b, Rouge-L threshold=0.32023.0774.6
LN-PEModel=OPT-6.7b, Rouge-L threshold=0.32023.0774.5
SARModel=OPT-2.7b, Rouge-L threshold=0.32023.0774.2
LN-PEModel=OPT-30b, Rouge-L threshold=0.32023.0774.2
SEModel=OPT-6.7b, Rouge-L threshold=0.32023.0774.1
LN-PEModel=OPT-2.7b, Rouge-L threshold=0.32023.0771.9
TOKENSARModel=OPT-2.7b, Rouge-L threshold=0.32023.0771.9
SEModel=OPT-2.7b, Rouge-L threshold=0.32023.0771.2
SENTSARModel=OPT-30b, Rouge-L threshold=0.32023.0769.8
SENTSARModel=OPT-6.7b, Rouge-L threshold=0.32023.0769.6
SENTSARModel=OPT-13b, Rouge-L threshold=0.32023.0769
SENTSARModel=OPT-2.7b, Rouge-L threshold=0.32023.0768.9
SARModel=LLaMA-7b, Rouge-L threshold=0.32023.0768.6
LN-PEModel=LLaMA-7b, Rouge-L threshold=0.32023.0767.3
SEModel=LLaMA-7b, Rouge-L threshold=0.32023.0767.2
TOKENSARModel=LLaMA-7b, Rouge-L threshold=0.32023.0767.2
PEModel=OPT-6.7b, Rouge-L threshold=0.32023.0767.1
PEModel=OPT-30b, Rouge-L threshold=0.32023.0767.1
PEModel=OPT-2.7b, Rouge-L threshold=0.32023.0766.6
PEModel=OPT-13b, Rouge-L threshold=0.32023.0766.6
SARModel=LLaMA-13b, Rouge-L threshold=0.32023.0766.5
LN-PEModel=LLaMA-13b, Rouge-L threshold=0.32023.0765.3
TOKENSARModel=LLaMA-13b, Rouge-L threshold=0.32023.0765.3
SEModel=LLaMA-13b, Rouge-L threshold=0.32023.0765.2
PEModel=LLaMA-7b, Rouge-L threshold=0.32023.0764.6
SENTSARModel=LLaMA-7b, Rouge-L threshold=0.32023.0763.5
PEModel=LLaMA-13b, Rouge-L threshold=0.32023.0761.7
SENTSARModel=LLaMA-13b, Rouge-L threshold=0.32023.0761
LSModel=OPT-6.7b, Rouge-L threshold=0.32023.0758.8
LSModel=OPT-13b, Rouge-L threshold=0.32023.0758.8
LSModel=OPT-2.7b, Rouge-L threshold=0.32023.0757.3
LSModel=OPT-30b, Rouge-L threshold=0.32023.0755
LSModel=LLaMA-13b, Rouge-L threshold=0.32023.0752.2
LSModel=LLaMA-7b, Rouge-L threshold=0.32023.0751.1