List your company
ResearchFormerly WizWand

OOD Quality Estimation on Mathematical Reasoning Far-shift OOD

0.161Kendall's TauTV Score
0.018520.055510.09250.12949May 22, 2024
Updated 8mo ago

Evaluation results

MethodLinks
TV ScoreModel=Llama2-7B2024.050.1610.147
TV Score w/ DiSmoModel=GPT2-XL2024.050.1390.141
TV ScoreModel=GPT2-XL2024.050.1380.123
TV Score w/ DiSmoModel=Llama2-7B2024.050.1110.152
Input EmbeddingModel=Llama2-7B2024.050.0780.102
Max Softmax Prob.Model=GPT2-XL2024.050.0660.044
Output EmbeddingModel=Llama2-7B2024.050.0580.025
Input EmbeddingModel=GPT2-XL2024.050.0580.068
PerplexityModel=Llama2-7B2024.050.050.045
Output EmbeddingModel=GPT2-XL2024.050.050.016
PerplexityModel=GPT2-XL2024.050.0360.038
Max Softmax Prob.Model=Llama2-7B2024.050.0240.038