Uncertainty Quantification on PopQA 500 randomly sampled queries (test)
0.8709AUROCR2C
Evaluation Results
| Method | Links | |
|---|---|---|
| R2CFramework=Search-o12025.10 | 0.8709 | |
| R2CFramework=ReSearch2025.10 | 0.8602 | |
| R2CFramework=Search-R12025.10 | 0.8492 | |
| R2CFramework=ReAct2025.10 | 0.8475 | |
| P(true)Framework=ReSearch2025.10 | 0.8435 | |
| LARSFramework=Search-o12025.10 | 0.8379 | |
| ReaCFramework=ReSearch2025.10 | 0.825 | |
| SelfCFramework=ReSearch2025.10 | 0.8201 | |
| ECCFramework=Search-o12025.10 | 0.8198 | |
| ECCFramework=ReSearch2025.10 | 0.8185 | |
| DegFramework=ReSearch2025.10 | 0.8167 | |
| ReaCFramework=ReAct2025.10 | 0.8153 | |
| SelfCFramework=Search-o12025.10 | 0.8126 | |
| ReaCFramework=Search-o12025.10 | 0.8109 | |
| SelfCFramework=ReAct2025.10 | 0.8073 | |
| DegFramework=Search-o12025.10 | 0.8069 | |
| EigVFramework=ReSearch2025.10 | 0.8063 | |
| NumSSFramework=ReSearch2025.10 | 0.8042 | |
| ECCFramework=ReAct2025.10 | 0.8027 | |
| R2CFramework=SelfAsk2025.10 | 0.8008 | |
| LARSFramework=ReAct2025.10 | 0.7995 | |
| EigVFramework=Search-o12025.10 | 0.7972 | |
| NumSSFramework=Search-o12025.10 | 0.7888 | |
| P(true)Framework=Search-o12025.10 | 0.7857 | |
| ReaCFramework=SelfAsk2025.10 | 0.7702 | |
| LARSFramework=ReSearch2025.10 | 0.7695 | |
| DegFramework=ReAct2025.10 | 0.767 | |
| P(true)Framework=SelfAsk2025.10 | 0.7651 | |
| EigVFramework=ReAct2025.10 | 0.7648 | |
| P(true)Framework=Search-R12025.10 | 0.7573 | |
| P(true)Framework=ReAct2025.10 | 0.7507 | |
| NumSSFramework=ReAct2025.10 | 0.749 | |
| SelfCFramework=SelfAsk2025.10 | 0.7433 | |
| LARSFramework=SelfAsk2025.10 | 0.7397 | |
| ReaCFramework=Search-R12025.10 | 0.7322 | |
| ECCFramework=SelfAsk2025.10 | 0.7289 | |
| SelfCFramework=Search-R12025.10 | 0.7163 | |
| LARSFramework=Search-R12025.10 | 0.7154 | |
| NumSSFramework=SelfAsk2025.10 | 0.7131 | |
| RrrCFramework=SelfAsk2025.10 | 0.7114 | |
| ECCFramework=Search-R12025.10 | 0.7087 | |
| EigVFramework=SelfAsk2025.10 | 0.7053 | |
| DegFramework=SelfAsk2025.10 | 0.7053 | |
| NumSSFramework=Search-R12025.10 | 0.6976 | |
| DegFramework=Search-R12025.10 | 0.6951 | |
| EigVFramework=Search-R12025.10 | 0.6933 | |
| RrrCFramework=Search-R12025.10 | 0.6892 | |
| RrrCFramework=ReSearch2025.10 | 0.683 | |
| SEFramework=Search-o12025.10 | 0.6756 | |
| RrrCFramework=Search-o12025.10 | 0.6595 | |
| SEFramework=SelfAsk2025.10 | 0.6426 | |
| SEFramework=Search-R12025.10 | 0.5911 | |
| PEFramework=SelfAsk2025.10 | 0.5534 | |
| MARSFramework=SelfAsk2025.10 | 0.547 | |
| SEFramework=ReSearch2025.10 | 0.5388 | |
| SARFramework=SelfAsk2025.10 | 0.5165 | |
| SEFramework=ReAct2025.10 | 0.4973 | |
| PEFramework=Search-R12025.10 | 0.4849 | |
| MARSFramework=Search-R12025.10 | 0.4833 | |
| RrrCFramework=ReAct2025.10 | 0.4802 | |
| SARFramework=Search-R12025.10 | 0.4587 | |
| MARSFramework=Search-o12025.10 | 0.4328 | |
| SARFramework=ReSearch2025.10 | 0.4167 | |
| MARSFramework=ReAct2025.10 | 0.4129 | |
| PEFramework=ReSearch2025.10 | 0.4093 | |
| SARFramework=Search-o12025.10 | 0.4092 | |
| MARSFramework=ReSearch2025.10 | 0.4003 | |
| PEFramework=Search-o12025.10 | 0.3986 | |
| PEFramework=ReAct2025.10 | 0.3675 | |
| SARFramework=ReAct2025.10 | 0.2956 |