Ranking Uncertainty Quantification on Amazon Grocery
0.2661Tau@5EviRank
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| EviRankBackbone=Qwen2.52026.06 | 0.2661 | 0.6739 | 0.2301 | 0.6286 | |
| Semantic Unc.Backbone=Qwen2.52026.06 | 0.232 | 0.6542 | 0.1857 | 0.5991 | |
| Verb. 1S top-1Backbone=Qwen2.52026.06 | 0.2315 | 0.6539 | 0.1846 | 0.5987 | |
| Label Prob.Backbone=Qwen2.52026.06 | 0.2289 | 0.6453 | 0.1803 | 0.5979 | |
| Verb. 1S top-1Backbone=Llama32026.06 | 0.1914 | 0.629 | 0.164 | 0.5859 | |
| EviRankBackbone=Llama32026.06 | 0.1907 | 0.6279 | 0.1631 | 0.583 | |
| EviRankBackbone=Mistral2026.06 | 0.1658 | 0.6021 | 0.1435 | 0.5817 | |
| Semantic Unc.Backbone=Llama32026.06 | 0.1623 | 0.6137 | 0.1472 | 0.573 | |
| Label Prob.Backbone=Llama32026.06 | 0.141 | 0.6001 | 0.1328 | 0.5655 | |
| Semantic Unc.Backbone=Mistral2026.06 | 0.1146 | 0.5712 | 0.0901 | 0.5468 | |
| Verb. 1S top-1Backbone=Mistral2026.06 | 0.1023 | 0.5677 | 0.0818 | 0.5435 | |
| Label Prob.Backbone=Mistral2026.06 | 0.0993 | 0.5614 | 0.0781 | 0.5398 |