Question Answering on TriviaQA (ACE and AUROC metrics)
0.32ACEBase
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BaseModel=Qwen, SC Measure=IC-SC2026.04 | 0.32 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.761 | |
| BaseModel=Qwen, SC Measure=E-SC2026.04 | 0.308 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.763 | |
| BaseModel=Qwen, SC Measure=ML-SC2026.04 | 0.304 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.762 | |
| BaseModel=Qwen, SC Measure=L-SC2026.04 | 0.299 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.759 | |
| BaseModel=Qwen, SC Measure=G-SC2026.04 | 0.293 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.764 | |
| BaseModel=Qwen, SC Measure=B-SC2026.04 | 0.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.765 | |
| BaseModel=Qwen, SC Measure=T-SC2026.04 | 0.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.766 | |
| ATSModel=Qwen, SC Measure=IC-SC2026.04 | 0.219 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.833 | |
| ATSModel=Qwen, SC Measure=E-SC2026.04 | 0.204 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.841 | |
| PlattModel=Qwen, SC Measure=IC-SC2026.04 | 0.203 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.833 | |
| SEModel=Qwen, SC Measure=IC-SC2026.04 | 0.194 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.825 | |
| ATSModel=Qwen, SC Measure=G-SC2026.04 | 0.183 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.842 | |
| ATSModel=Qwen, SC Measure=ML-SC2026.04 | 0.178 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.84 | |
| PlattModel=Qwen, SC Measure=E-SC2026.04 | 0.17 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.837 | |
| PlattModel=Qwen, SC Measure=L-SC2026.04 | 0.168 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.839 | |
| ATSModel=Qwen, SC Measure=L-SC2026.04 | 0.168 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.839 | |
| SEModel=Qwen, SC Measure=E-SC2026.04 | 0.165 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.832 | |
| PlattModel=Qwen, SC Measure=ML-SC2026.04 | 0.163 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.834 | |
| SEModel=Qwen, SC Measure=L-SC2026.04 | 0.159 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.831 | |
| SEModel=Qwen, SC Measure=ML-SC2026.04 | 0.158 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.83 | |
| PlattModel=Qwen, SC Measure=G-SC2026.04 | 0.15 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.838 | |
| SEModel=Qwen, SC Measure=G-SC2026.04 | 0.145 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.833 | |
| ATSModel=Qwen, SC Measure=T-SC2026.04 | 0.133 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.843 | |
| ATSModel=Qwen, SC Measure=B-SC2026.04 | 0.132 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.842 | |
| PlattModel=Qwen, SC Measure=T-SC2026.04 | 0.101 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.839 | |
| PlattModel=Qwen, SC Measure=B-SC2026.04 | 0.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.838 | |
| SEModel=Qwen, SC Measure=T-SC2026.04 | 0.099 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.837 | |
| SEModel=Qwen, SC Measure=B-SC2026.04 | 0.097 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.836 | |
| TSModel=Qwen, SC Measure=IC-SC2026.04 | 0.085 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.864 | |
| TSModel=Qwen, SC Measure=B-SC2026.04 | 0.082 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.856 | |
| TSModel=Qwen, SC Measure=T-SC2026.04 | 0.081 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.855 | |
| TSModel=Qwen, SC Measure=E-SC2026.04 | 0.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.855 | |
| TSModel=Qwen, SC Measure=ML-SC2026.04 | 0.069 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.853 | |
| TSModel=Qwen, SC Measure=G-SC2026.04 | 0.067 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.855 | |
| TSModel=Qwen, SC Measure=L-SC2026.04 | 0.066 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.87 | |
| ATSModel=Llama2026.04 | — | 0.084 | 0.061 | 0.069 | 0.07 | 0.093 | 0.069 | 0.07 | 0.843 | 0.832 | 0.838 | 0.835 | 0.831 | 0.836 | 0.844 | — | |
| BaseModel=Llama2026.04 | — | 0.184 | 0.174 | 0.18 | 0.13 | 0.191 | 0.13 | 0.172 | 0.757 | 0.755 | 0.757 | 0.759 | 0.752 | 0.76 | 0.758 | — | |
| PlattModel=Llama2026.04 | — | 0.078 | 0.06 | 0.071 | 0.078 | 0.097 | 0.077 | 0.066 | 0.84 | 0.833 | 0.842 | 0.841 | 0.837 | 0.842 | 0.84 | — | |
| SEModel=Llama2026.04 | — | 0.07 | 0.056 | 0.064 | 0.082 | 0.092 | 0.082 | 0.066 | 0.832 | 0.832 | 0.832 | 0.831 | 0.829 | 0.83 | 0.833 | — | |
| TSModel=Llama2026.04 | — | 0.049 | 0.055 | 0.061 | 0.104 | 0.033 | 0.106 | 0.056 | 0.852 | 0.849 | 0.853 | 0.846 | 0.858 | 0.847 | 0.853 | — |