Uncertainty Quantification on XSum
0.806AUROCClustered Self-Assessment
Evaluation results
| Method | Links | |
|---|---|---|
| Clustered Self-AssessmentModel=Qwen3-14B2026.06 | 0.806 | |
| Clustered Self-AssessmentModel=Qwen2.5-32B2026.06 | 0.797 | |
| Clustered Self-AssessmentModel=Qwen3-30B-A3B2026.06 | 0.781 | |
| Clustered Self-AssessmentModel=Qwen2.5-7B2026.06 | 0.751 | |
| Clustered Self-AssessmentModel=Qwen2.5-14B2026.06 | 0.739 | |
| Clustered Self-AssessmentModel=Gemma-3-12B2026.06 | 0.728 | |
| Clustered Self-AssessmentModel=Gemma-3-27B2026.06 | 0.713 | |
| P(True)Model=Qwen2.5-32B2026.06 | 0.709 | |
| EigVModel=Qwen3-30B-A3B2026.06 | 0.709 | |
| Semantic EntropyModel=Qwen3-30B-A3B2026.06 | 0.707 | |
| EigVModel=Qwen2.5-32B2026.06 | 0.706 | |
| SARModel=Qwen2.5-7B2026.06 | 0.698 | |
| Semantic EntropyModel=Qwen2.5-32B2026.06 | 0.697 | |
| P(True)Model=Qwen3-14B2026.06 | 0.696 | |
| SARModel=Qwen3-14B2026.06 | 0.692 | |
| EigVModel=Qwen3-14B2026.06 | 0.692 | |
| SARModel=Qwen2.5-32B2026.06 | 0.691 | |
| tokenSARModel=Qwen2.5-32B2026.06 | 0.69 | |
| PerplexityModel=Qwen3-14B2026.06 | 0.689 | |
| EigVModel=Qwen2.5-7B2026.06 | 0.688 | |
| tokenSARModel=Qwen3-14B2026.06 | 0.687 | |
| tokenSARModel=Qwen2.5-7B2026.06 | 0.684 | |
| PerplexityModel=Qwen2.5-7B2026.06 | 0.681 | |
| EigVModel=Qwen2.5-14B2026.06 | 0.681 | |
| Semantic EntropyModel=Qwen3-14B2026.06 | 0.679 | |
| Semantic EntropyModel=Qwen2.5-7B2026.06 | 0.677 | |
| SARModel=Qwen2.5-14B2026.06 | 0.676 | |
| PerplexityModel=Qwen2.5-32B2026.06 | 0.67 | |
| LN EntropyModel=Qwen3-14B2026.06 | 0.663 | |
| Semantic EntropyModel=Qwen2.5-14B2026.06 | 0.662 | |
| LN EntropyModel=Qwen2.5-7B2026.06 | 0.659 | |
| DegModel=Qwen3-30B-A3B2026.06 | 0.656 | |
| PerplexityModel=Gemma-3-12B2026.06 | 0.648 | |
| DegModel=Qwen2.5-32B2026.06 | 0.648 | |
| P(True)Model=Qwen2.5-14B2026.06 | 0.647 | |
| DegModel=Qwen3-14B2026.06 | 0.647 | |
| tokenSARModel=Qwen2.5-14B2026.06 | 0.646 | |
| tokenSARModel=Qwen3-30B-A3B2026.06 | 0.645 | |
| SARModel=Qwen3-30B-A3B2026.06 | 0.644 | |
| tokenSARModel=Gemma-3-12B2026.06 | 0.641 | |
| DegModel=Qwen2.5-7B2026.06 | 0.64 | |
| LN EntropyModel=Qwen2.5-32B2026.06 | 0.638 | |
| DegModel=Qwen2.5-14B2026.06 | 0.637 | |
| PerplexityModel=Qwen2.5-14B2026.06 | 0.633 | |
| PerplexityModel=Gemma-3-27B2026.06 | 0.632 | |
| EccModel=Qwen3-30B-A3B2026.06 | 0.632 | |
| tokenSARModel=Gemma-3-27B2026.06 | 0.628 | |
| LN EntropyModel=Qwen2.5-14B2026.06 | 0.627 | |
| ProbabilityModel=Gemma-3-12B2026.06 | 0.624 | |
| EccModel=Qwen2.5-7B2026.06 | 0.624 | |
| EccModel=Qwen3-14B2026.06 | 0.624 | |
| Eigen ScoreModel=Qwen3-14B2026.06 | 0.623 | |
| P(True)Model=Qwen2.5-7B2026.06 | 0.62 | |
| ProbabilityModel=Gemma-3-27B2026.06 | 0.616 | |
| EccModel=Qwen2.5-14B2026.06 | 0.616 | |
| EccModel=Qwen2.5-32B2026.06 | 0.615 | |
| P(True)Model=Gemma-3-27B2026.06 | 0.606 | |
| P(True)Model=Qwen3-30B-A3B2026.06 | 0.598 | |
| PerplexityModel=Qwen3-30B-A3B2026.06 | 0.596 | |
| SARModel=Gemma-3-12B2026.06 | 0.596 | |
| SARModel=Gemma-3-27B2026.06 | 0.594 | |
| DegModel=Gemma-3-27B2026.06 | 0.592 | |
| DegModel=Gemma-3-12B2026.06 | 0.591 | |
| EigVModel=Gemma-3-12B2026.06 | 0.588 | |
| EigVModel=Gemma-3-27B2026.06 | 0.585 | |
| EccModel=Gemma-3-27B2026.06 | 0.579 | |
| EccModel=Gemma-3-12B2026.06 | 0.576 | |
| ProbabilityModel=Qwen3-14B2026.06 | 0.572 | |
| LN EntropyModel=Gemma-3-27B2026.06 | 0.57 | |
| sentenceSARModel=Gemma-3-12B2026.06 | 0.569 | |
| LN EntropyModel=Gemma-3-12B2026.06 | 0.568 | |
| sentenceSARModel=Qwen3-14B2026.06 | 0.568 | |
| sentenceSARModel=Gemma-3-27B2026.06 | 0.567 | |
| Predictive EntropyModel=Gemma-3-12B2026.06 | 0.566 | |
| Semantic EntropyModel=Gemma-3-12B2026.06 | 0.564 | |
| Predictive EntropyModel=Qwen3-14B2026.06 | 0.563 | |
| Predictive EntropyModel=Gemma-3-27B2026.06 | 0.563 | |
| Semantic EntropyModel=Gemma-3-27B2026.06 | 0.563 | |
| P(True)Model=Gemma-3-12B2026.06 | 0.562 | |
| LN EntropyModel=Qwen3-30B-A3B2026.06 | 0.558 | |
| ProbabilityModel=Qwen2.5-7B2026.06 | 0.553 | |
| sentenceSARModel=Qwen2.5-7B2026.06 | 0.545 | |
| Predictive EntropyModel=Qwen2.5-7B2026.06 | 0.541 | |
| sentenceSARModel=Qwen2.5-14B2026.06 | 0.533 | |
| Predictive EntropyModel=Qwen2.5-14B2026.06 | 0.529 | |
| Eigen ScoreModel=Gemma-3-27B2026.06 | 0.529 | |
| Eigen ScoreModel=Gemma-3-12B2026.06 | 0.524 | |
| ProbabilityModel=Qwen2.5-14B2026.06 | 0.523 | |
| ProbabilityModel=Qwen3-30B-A3B2026.06 | 0.521 | |
| Eigen ScoreModel=Qwen2.5-7B2026.06 | 0.519 | |
| sentenceSARModel=Qwen3-30B-A3B2026.06 | 0.506 | |
| Predictive EntropyModel=Qwen3-30B-A3B2026.06 | 0.501 | |
| sentenceSARModel=Qwen2.5-32B2026.06 | 0.498 | |
| ProbabilityModel=Qwen2.5-32B2026.06 | 0.493 | |
| Predictive EntropyModel=Qwen2.5-32B2026.06 | 0.492 | |
| Eigen ScoreModel=Qwen2.5-32B2026.06 | 0.443 | |
| Eigen ScoreModel=Qwen2.5-14B2026.06 | 0.431 | |
| Eigen ScoreModel=Qwen3-30B-A3B2026.06 | 0.376 |