Question Answering on NQ 8 additional samples
0.853AUROCClustered Self-Assessment
Evaluation Results
| Method | Links | |
|---|---|---|
| Clustered Self-AssessmentModel=Qwen3-14B2026.06 | 0.853 | |
| Clustered Self-AssessmentModel=Qwen2.5-32B2026.06 | 0.85 | |
| Clustered Self-AssessmentModel=Qwen2.5-7B2026.06 | 0.846 | |
| Clustered Self-AssessmentModel=Gemma-3-12B2026.06 | 0.843 | |
| Clustered Self-AssessmentModel=Qwen3-30B-A3B2026.06 | 0.84 | |
| Clustered Self-AssessmentModel=Qwen2.5-14B2026.06 | 0.837 | |
| EigVModel=Qwen2.5-7B2026.06 | 0.825 | |
| Clustered Self-AssessmentModel=Gemma-3-27B2026.06 | 0.821 | |
| EigVModel=Qwen3-14B2026.06 | 0.819 | |
| Semantic EntropyModel=Qwen3-14B2026.06 | 0.812 | |
| Semantic EntropyModel=Qwen2.5-7B2026.06 | 0.809 | |
| EigVModel=Qwen2.5-32B2026.06 | 0.806 | |
| DegModel=Gemma-3-12B2026.06 | 0.805 | |
| EigVModel=Qwen3-30B-A3B2026.06 | 0.804 | |
| P(True)Model=Qwen3-14B2026.06 | 0.799 | |
| Semantic EntropyModel=Qwen2.5-32B2026.06 | 0.799 | |
| Semantic EntropyModel=Qwen3-30B-A3B2026.06 | 0.793 | |
| EigVModel=Qwen2.5-14B2026.06 | 0.793 | |
| DegModel=Qwen2.5-7B2026.06 | 0.793 | |
| DegModel=Qwen3-14B2026.06 | 0.79 | |
| SARModel=Qwen2.5-7B2026.06 | 0.789 | |
| SARModel=Qwen3-14B2026.06 | 0.787 | |
| DegModel=Gemma-3-27B2026.06 | 0.786 | |
| P(True)Model=Qwen2.5-32B2026.06 | 0.785 | |
| P(True)Model=Qwen3-30B-A3B2026.06 | 0.783 | |
| Semantic EntropyModel=Qwen2.5-14B2026.06 | 0.779 | |
| sentenceSARModel=Qwen2.5-7B2026.06 | 0.778 | |
| DegModel=Qwen2.5-32B2026.06 | 0.777 | |
| ProbabilityModel=Qwen2.5-7B2026.06 | 0.776 | |
| ProbabilityModel=Qwen3-14B2026.06 | 0.774 | |
| SARModel=Qwen3-30B-A3B2026.06 | 0.773 | |
| Predictive EntropyModel=Qwen2.5-7B2026.06 | 0.77 | |
| sentenceSARModel=Qwen3-14B2026.06 | 0.77 | |
| SARModel=Qwen2.5-32B2026.06 | 0.769 | |
| DegModel=Qwen3-30B-A3B2026.06 | 0.769 | |
| ProbabilityModel=Qwen2.5-32B2026.06 | 0.763 | |
| Predictive EntropyModel=Qwen3-14B2026.06 | 0.763 | |
| DegModel=Qwen2.5-14B2026.06 | 0.763 | |
| Eigen ScoreModel=Qwen2.5-7B2026.06 | 0.76 | |
| SARModel=Qwen2.5-14B2026.06 | 0.76 | |
| sentenceSARModel=Qwen2.5-32B2026.06 | 0.759 | |
| LN EntropyModel=Qwen2.5-7B2026.06 | 0.757 | |
| EccModel=Qwen2.5-7B2026.06 | 0.757 | |
| ProbabilityModel=Gemma-3-27B2026.06 | 0.755 | |
| EccModel=Qwen3-14B2026.06 | 0.755 | |
| tokenSARModel=Gemma-3-12B2026.06 | 0.754 | |
| EigVModel=Gemma-3-12B2026.06 | 0.753 | |
| Predictive EntropyModel=Qwen2.5-32B2026.06 | 0.752 | |
| LN EntropyModel=Qwen3-14B2026.06 | 0.751 | |
| sentenceSARModel=Qwen2.5-14B2026.06 | 0.751 | |
| tokenSARModel=Gemma-3-27B2026.06 | 0.75 | |
| sentenceSARModel=Qwen3-30B-A3B2026.06 | 0.75 | |
| PerplexityModel=Gemma-3-27B2026.06 | 0.749 | |
| PerplexityModel=Qwen2.5-7B2026.06 | 0.748 | |
| ProbabilityModel=Qwen3-30B-A3B2026.06 | 0.748 | |
| Eigen ScoreModel=Qwen3-14B2026.06 | 0.748 | |
| ProbabilityModel=Qwen2.5-14B2026.06 | 0.747 | |
| EccModel=Qwen2.5-32B2026.06 | 0.747 | |
| PerplexityModel=Gemma-3-12B2026.06 | 0.745 | |
| Predictive EntropyModel=Qwen2.5-14B2026.06 | 0.745 | |
| EccModel=Gemma-3-27B2026.06 | 0.744 | |
| Predictive EntropyModel=Qwen3-30B-A3B2026.06 | 0.742 | |
| EccModel=Gemma-3-12B2026.06 | 0.741 | |
| LN EntropyModel=Qwen3-30B-A3B2026.06 | 0.739 | |
| Eigen ScoreModel=Qwen2.5-32B2026.06 | 0.739 | |
| EigVModel=Gemma-3-27B2026.06 | 0.738 | |
| PerplexityModel=Qwen3-14B2026.06 | 0.737 | |
| LN EntropyModel=Qwen2.5-32B2026.06 | 0.735 | |
| tokenSARModel=Qwen2.5-7B2026.06 | 0.732 | |
| EccModel=Qwen2.5-14B2026.06 | 0.732 | |
| P(True)Model=Qwen2.5-14B2026.06 | 0.731 | |
| EccModel=Qwen3-30B-A3B2026.06 | 0.731 | |
| PerplexityModel=Qwen3-30B-A3B2026.06 | 0.729 | |
| ProbabilityModel=Gemma-3-12B2026.06 | 0.729 | |
| P(True)Model=Qwen2.5-7B2026.06 | 0.729 | |
| Eigen ScoreModel=Qwen2.5-14B2026.06 | 0.729 | |
| PerplexityModel=Qwen2.5-32B2026.06 | 0.728 | |
| Semantic EntropyModel=Gemma-3-12B2026.06 | 0.726 | |
| tokenSARModel=Qwen3-14B2026.06 | 0.725 | |
| SARModel=Gemma-3-12B2026.06 | 0.724 | |
| Eigen ScoreModel=Qwen3-30B-A3B2026.06 | 0.723 | |
| LN EntropyModel=Qwen2.5-14B2026.06 | 0.72 | |
| tokenSARModel=Qwen2.5-32B2026.06 | 0.714 | |
| tokenSARModel=Qwen3-30B-A3B2026.06 | 0.714 | |
| Semantic EntropyModel=Gemma-3-27B2026.06 | 0.708 | |
| PerplexityModel=Qwen2.5-14B2026.06 | 0.706 | |
| sentenceSARModel=Gemma-3-12B2026.06 | 0.705 | |
| tokenSARModel=Qwen2.5-14B2026.06 | 0.701 | |
| Predictive EntropyModel=Gemma-3-12B2026.06 | 0.697 | |
| sentenceSARModel=Gemma-3-27B2026.06 | 0.692 | |
| Predictive EntropyModel=Gemma-3-27B2026.06 | 0.691 | |
| SARModel=Gemma-3-27B2026.06 | 0.688 | |
| LN EntropyModel=Gemma-3-12B2026.06 | 0.685 | |
| P(True)Model=Gemma-3-27B2026.06 | 0.659 | |
| LN EntropyModel=Gemma-3-27B2026.06 | 0.658 | |
| Eigen ScoreModel=Gemma-3-12B2026.06 | 0.654 | |
| Eigen ScoreModel=Gemma-3-27B2026.06 | 0.649 | |
| P(True)Model=Gemma-3-12B2026.06 | 0.609 |