Uncertainty Quantification on NQ 4 additional samples (test)
85.3AUROCClustered Self-Assessment
Evaluation results
| Method | Links | |
|---|---|---|
| Clustered Self-AssessmentModel=Qwen3-14B2026.06 | 85.3 | |
| Clustered Self-AssessmentModel=Qwen2.5-7B2026.06 | 84.6 | |
| Clustered Self-AssessmentModel=Qwen2.5-32B2026.06 | 84.3 | |
| Clustered Self-AssessmentModel=Gemma-3-12B2026.06 | 84.2 | |
| Clustered Self-AssessmentModel=Qwen3-30B-A3B2026.06 | 83.9 | |
| Clustered Self-AssessmentModel=Qwen2.5-14B2026.06 | 83.6 | |
| Clustered Self-AssessmentModel=Gemma-3-27B2026.06 | 82.4 | |
| EigVModel=Qwen2.5-7B2026.06 | 80.8 | |
| EigVModel=Qwen3-14B2026.06 | 80.2 | |
| P(True)Model=Qwen3-14B2026.06 | 79.9 | |
| DegModel=Gemma-3-12B2026.06 | 79.9 | |
| Semantic EntropyModel=Qwen3-14B2026.06 | 79.4 | |
| EigVModel=Qwen2.5-32B2026.06 | 79.1 | |
| Semantic EntropyModel=Qwen2.5-7B2026.06 | 79 | |
| EigVModel=Qwen3-30B-A3B2026.06 | 78.6 | |
| P(True)Model=Qwen2.5-32B2026.06 | 78.5 | |
| P(True)Model=Qwen3-30B-A3B2026.06 | 78.3 | |
| DegModel=Gemma-3-27B2026.06 | 78.3 | |
| SARModel=Qwen2.5-7B2026.06 | 78.1 | |
| Semantic EntropyModel=Qwen2.5-32B2026.06 | 77.9 | |
| SARModel=Qwen3-14B2026.06 | 77.8 | |
| DegModel=Qwen2.5-7B2026.06 | 77.8 | |
| sentenceSARModel=Qwen2.5-7B2026.06 | 77.7 | |
| DegModel=Qwen3-14B2026.06 | 77.7 | |
| ProbabilityModel=Qwen2.5-7B2026.06 | 77.6 | |
| EigVModel=Qwen2.5-14B2026.06 | 77.6 | |
| ProbabilityModel=Qwen3-14B2026.06 | 77.4 | |
| Predictive EntropyModel=Qwen2.5-7B2026.06 | 77 | |
| sentenceSARModel=Qwen3-14B2026.06 | 77 | |
| Semantic EntropyModel=Qwen3-30B-A3B2026.06 | 76.6 | |
| SARModel=Qwen3-30B-A3B2026.06 | 76.5 | |
| DegModel=Qwen2.5-32B2026.06 | 76.5 | |
| ProbabilityModel=Qwen2.5-32B2026.06 | 76.3 | |
| Predictive EntropyModel=Qwen3-14B2026.06 | 76.3 | |
| SARModel=Qwen2.5-32B2026.06 | 76.3 | |
| EigVModel=Gemma-3-12B2026.06 | 76 | |
| sentenceSARModel=Qwen2.5-32B2026.06 | 75.7 | |
| SARModel=Qwen2.5-14B2026.06 | 75.6 | |
| DegModel=Qwen3-30B-A3B2026.06 | 75.6 | |
| ProbabilityModel=Gemma-3-27B2026.06 | 75.5 | |
| tokenSARModel=Gemma-3-12B2026.06 | 75.4 | |
| Semantic EntropyModel=Qwen2.5-14B2026.06 | 75.4 | |
| LN EntropyModel=Qwen2.5-7B2026.06 | 75.3 | |
| DegModel=Qwen2.5-14B2026.06 | 75.3 | |
| Predictive EntropyModel=Qwen2.5-32B2026.06 | 75 | |
| tokenSARModel=Gemma-3-27B2026.06 | 75 | |
| sentenceSARModel=Qwen2.5-14B2026.06 | 75 | |
| sentenceSARModel=Qwen3-30B-A3B2026.06 | 75 | |
| PerplexityModel=Gemma-3-27B2026.06 | 74.9 | |
| PerplexityModel=Qwen2.5-7B2026.06 | 74.8 | |
| ProbabilityModel=Qwen3-30B-A3B2026.06 | 74.8 | |
| ProbabilityModel=Qwen2.5-14B2026.06 | 74.7 | |
| LN EntropyModel=Qwen3-14B2026.06 | 74.7 | |
| PerplexityModel=Gemma-3-12B2026.06 | 74.5 | |
| EigVModel=Gemma-3-27B2026.06 | 74.5 | |
| Predictive EntropyModel=Qwen2.5-14B2026.06 | 74.4 | |
| SARModel=Gemma-3-12B2026.06 | 74.4 | |
| Predictive EntropyModel=Qwen3-30B-A3B2026.06 | 74.3 | |
| EccModel=Qwen3-14B2026.06 | 74 | |
| PerplexityModel=Qwen3-14B2026.06 | 73.7 | |
| Eigen ScoreModel=Qwen2.5-7B2026.06 | 73.7 | |
| LN EntropyModel=Qwen3-30B-A3B2026.06 | 73.6 | |
| EccModel=Qwen2.5-7B2026.06 | 73.5 | |
| LN EntropyModel=Qwen2.5-32B2026.06 | 73.2 | |
| tokenSARModel=Qwen2.5-7B2026.06 | 73.2 | |
| P(True)Model=Qwen2.5-14B2026.06 | 73.1 | |
| Eigen ScoreModel=Qwen3-14B2026.06 | 73 | |
| PerplexityModel=Qwen3-30B-A3B2026.06 | 72.9 | |
| ProbabilityModel=Gemma-3-12B2026.06 | 72.9 | |
| P(True)Model=Qwen2.5-7B2026.06 | 72.9 | |
| EccModel=Qwen2.5-32B2026.06 | 72.9 | |
| PerplexityModel=Qwen2.5-32B2026.06 | 72.8 | |
| tokenSARModel=Qwen3-14B2026.06 | 72.5 | |
| Eigen ScoreModel=Qwen2.5-32B2026.06 | 72.2 | |
| Semantic EntropyModel=Gemma-3-12B2026.06 | 72.1 | |
| EccModel=Qwen2.5-14B2026.06 | 72.1 | |
| LN EntropyModel=Qwen2.5-14B2026.06 | 72 | |
| sentenceSARModel=Gemma-3-12B2026.06 | 72 | |
| Semantic EntropyModel=Gemma-3-27B2026.06 | 71.5 | |
| tokenSARModel=Qwen2.5-32B2026.06 | 71.4 | |
| tokenSARModel=Qwen3-30B-A3B2026.06 | 71.4 | |
| EccModel=Qwen3-30B-A3B2026.06 | 71.4 | |
| Predictive EntropyModel=Gemma-3-12B2026.06 | 71.1 | |
| Eigen ScoreModel=Qwen2.5-14B2026.06 | 71 | |
| sentenceSARModel=Gemma-3-27B2026.06 | 70.7 | |
| PerplexityModel=Qwen2.5-14B2026.06 | 70.6 | |
| SARModel=Gemma-3-27B2026.06 | 70.6 | |
| Predictive EntropyModel=Gemma-3-27B2026.06 | 70.5 | |
| EccModel=Gemma-3-27B2026.06 | 70.5 | |
| LN EntropyModel=Gemma-3-12B2026.06 | 70.3 | |
| Eigen ScoreModel=Qwen3-30B-A3B2026.06 | 70.2 | |
| tokenSARModel=Qwen2.5-14B2026.06 | 70.1 | |
| EccModel=Gemma-3-12B2026.06 | 69.7 | |
| LN EntropyModel=Gemma-3-27B2026.06 | 67.3 | |
| P(True)Model=Gemma-3-27B2026.06 | 65.9 | |
| Eigen ScoreModel=Gemma-3-12B2026.06 | 64.5 | |
| Eigen ScoreModel=Gemma-3-27B2026.06 | 64.5 | |
| P(True)Model=Gemma-3-12B2026.06 | 60.9 |