Offline OOD Detection on Mathematical Reasoning Near-shift OOD
98.76AUROCTV Score
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TV ScoreModel=Llama2-7B2024.05 | 98.76 | 5.21 | |
| TV ScoreModel=GPT2-XL2024.05 | 94.86 | 13.82 | |
| TV Score w/ DiSmoModel=GPT2-XL2024.05 | 94.19 | 13.66 | |
| TV Score w/ DiSmoModel=Llama2-7B2024.05 | 93.25 | 41.82 | |
| PerplexityModel=Llama2-7B2024.05 | 85.64 | 53.06 | |
| Input EmbeddingModel=GPT2-XL2024.05 | 83.22 | 52.9 | |
| Output EmbeddingModel=GPT2-XL2024.05 | 79.28 | 64.7 | |
| Max Softmax Prob.Model=Llama2-7B2024.05 | 78.66 | 81.44 | |
| Input EmbeddingModel=Llama2-7B2024.05 | 75.89 | 67.87 | |
| Output EmbeddingModel=Llama2-7B2024.05 | 74.86 | 75.21 | |
| PerplexityModel=GPT2-XL2024.05 | 73.74 | 72.39 | |
| Monte-Carlo DropoutModel=Llama2-7B2024.05 | 68.63 | 87.04 | |
| Max Softmax Prob.Model=GPT2-XL2024.05 | 67.12 | 76.27 | |
| Monte-Carlo DropoutModel=GPT2-XL2024.05 | 63.54 | 78.08 |