Open-domain task on Arena-Hard
5.17Error (%)C-PAC
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| C-PACUncertainty=Verbalized, Clustering type=Joint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 5.17 | 0 | 10.3 | |
| C-PACUncertainty=Verbalized, Clustering type=Disjoint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 5.27 | 0 | 10.91 | |
| C-PACUncertainty=Logits, Clustering type=Disjoint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 8.54 | 0 | 47.01 | |
| PACUncertainty=Verbalized, Clustering type=Disjoint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 8.63 | 3.68 | 30.07 | |
| PACUncertainty=Verbalized, Clustering type=Joint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 8.67 | 4.04 | 30.15 | |
| C-PACUncertainty=Logits, Clustering type=Joint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 8.69 | 0 | 49.32 | |
| C-PACUncertainty=Router, Clustering type=Joint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 8.77 | 0 | 42.02 | |
| PACUncertainty=Logits, Clustering type=Disjoint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 8.84 | 0 | 51.77 | |
| C-PACUncertainty=Router, Clustering type=Disjoint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 8.84 | 0 | 42.34 | |
| PACUncertainty=Router, Clustering type=Disjoint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 8.9 | 4.44 | 33.07 | |
| PACUncertainty=Logits, Clustering type=Joint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 8.94 | 0 | 52.25 | |
| PACUncertainty=Router, Clustering type=Joint clustering, Backbone=Qwen LLMs, Epsilon (ε)=0.12026.01 | 8.94 | 4.69 | 33.39 |