Question Answering on NQ (ACE/AUROC)
0.496ACE ScoreBase
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BaseModel=Qwen, SC Measure=IC-SC2026.04 | 0.496 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.688 | |
| BaseModel=Qwen, SC Measure=E-SC2026.04 | 0.487 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.69 | |
| BaseModel=Qwen, SC Measure=ML-SC2026.04 | 0.48 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.692 | |
| BaseModel=Qwen, SC Measure=L-SC2026.04 | 0.473 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.687 | |
| BaseModel=Qwen, SC Measure=G-SC2026.04 | 0.468 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.692 | |
| BaseModel=Qwen, SC Measure=B-SC2026.04 | 0.399 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.693 | |
| BaseModel=Qwen, SC Measure=T-SC2026.04 | 0.399 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.693 | |
| PlattModel=Qwen, SC Measure=IC-SC2026.04 | 0.357 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.747 | |
| SEModel=Qwen, SC Measure=IC-SC2026.04 | 0.354 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.738 | |
| ATSModel=Qwen, SC Measure=IC-SC2026.04 | 0.353 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.738 | |
| BaseBackbone=Mistral, SC Measure=IC-SC2026.04 | 0.348 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.705 | |
| SEModel=Qwen, SC Measure=E-SC2026.04 | 0.319 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.745 | |
| SEModel=Qwen, SC Measure=L-SC2026.04 | 0.318 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.747 | |
| PlattModel=Qwen, SC Measure=L-SC2026.04 | 0.318 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.751 | |
| ATSModel=Qwen, SC Measure=L-SC2026.04 | 0.318 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.75 | |
| ATSModel=Qwen, SC Measure=E-SC2026.04 | 0.315 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.756 | |
| PlattModel=Qwen, SC Measure=E-SC2026.04 | 0.314 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.745 | |
| BaseBackbone=Mistral, SC Measure=L-SC2026.04 | 0.313 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.715 | |
| SEModel=Qwen, SC Measure=ML-SC2026.04 | 0.311 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.744 | |
| PlattModel=Qwen, SC Measure=ML-SC2026.04 | 0.307 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.741 | |
| BaseBackbone=Mistral, SC Measure=E-SC2026.04 | 0.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.722 | |
| BaseBackbone=Mistral, SC Measure=ML-SC2026.04 | 0.297 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.72 | |
| ATSModel=Qwen, SC Measure=G-SC2026.04 | 0.295 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.757 | |
| SEModel=Qwen, SC Measure=G-SC2026.04 | 0.294 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.747 | |
| PlattModel=Qwen, SC Measure=G-SC2026.04 | 0.289 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.746 | |
| ATSModel=Qwen, SC Measure=ML-SC2026.04 | 0.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.754 | |
| BaseBackbone=Mistral, SC Measure=G-SC2026.04 | 0.274 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.724 | |
| ATSModel=Qwen, SC Measure=T-SC2026.04 | 0.237 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.755 | |
| ATSModel=Qwen, SC Measure=B-SC2026.04 | 0.236 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.755 | |
| PlattModel=Qwen, SC Measure=T-SC2026.04 | 0.232 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.749 | |
| PlattModel=Qwen, SC Measure=B-SC2026.04 | 0.231 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.748 | |
| SEModel=Qwen, SC Measure=B-SC2026.04 | 0.228 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.75 | |
| SEModel=Qwen, SC Measure=T-SC2026.04 | 0.228 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.751 | |
| BaseBackbone=Mistral, SC Measure=T-SC2026.04 | 0.198 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.722 | |
| BaseBackbone=Mistral, SC Measure=B-SC2026.04 | 0.197 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.722 | |
| TSModel=Qwen, SC Measure=IC-SC2026.04 | 0.192 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.784 | |
| ATSBackbone=Mistral, SC Measure=IC-SC2026.04 | 0.177 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.755 | |
| PlattBackbone=Mistral, SC Measure=IC-SC2026.04 | 0.169 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.756 | |
| SEBackbone=Mistral, SC Measure=IC-SC2026.04 | 0.166 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.755 | |
| TSModel=Qwen, SC Measure=E-SC2026.04 | 0.155 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.759 | |
| TSModel=Qwen, SC Measure=G-SC2026.04 | 0.155 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.74 | |
| ATSBackbone=Mistral, SC Measure=E-SC2026.04 | 0.139 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.752 | |
| PlattBackbone=Mistral, SC Measure=E-SC2026.04 | 0.112 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.749 | |
| ATSBackbone=Mistral, SC Measure=G-SC2026.04 | 0.111 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.754 | |
| TSBackbone=Mistral, SC Measure=IC-SC2026.04 | 0.102 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.745 | |
| SEBackbone=Mistral, SC Measure=L-SC2026.04 | 0.101 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.78 | |
| PlattBackbone=Mistral, SC Measure=L-SC2026.04 | 0.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.779 | |
| ATSBackbone=Mistral, SC Measure=L-SC2026.04 | 0.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.779 | |
| SEBackbone=Mistral, SC Measure=E-SC2026.04 | 0.087 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.748 | |
| PlattBackbone=Mistral, SC Measure=G-SC2026.04 | 0.086 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.752 | |
| TSModel=Qwen, SC Measure=ML-SC2026.04 | 0.085 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.753 | |
| TSModel=Qwen, SC Measure=B-SC2026.04 | 0.085 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.756 | |
| TSModel=Qwen, SC Measure=L-SC2026.04 | 0.084 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.799 | |
| TSModel=Qwen, SC Measure=T-SC2026.04 | 0.083 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.758 | |
| ATSBackbone=Mistral, SC Measure=ML-SC2026.04 | 0.081 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.767 | |
| PlattBackbone=Mistral, SC Measure=ML-SC2026.04 | 0.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.766 | |
| SEBackbone=Mistral, SC Measure=ML-SC2026.04 | 0.072 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.756 | |
| PlattBackbone=Mistral, SC Measure=T-SC2026.04 | 0.069 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.764 | |
| ATSBackbone=Mistral, SC Measure=T-SC2026.04 | 0.066 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.751 | |
| SEBackbone=Mistral, SC Measure=G-SC2026.04 | 0.065 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.752 | |
| ATSBackbone=Mistral, SC Measure=B-SC2026.04 | 0.065 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.752 | |
| PlattBackbone=Mistral, SC Measure=B-SC2026.04 | 0.061 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.751 | |
| SEBackbone=Mistral, SC Measure=B-SC2026.04 | 0.055 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.754 | |
| SEBackbone=Mistral, SC Measure=T-SC2026.04 | 0.055 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.754 | |
| TSBackbone=Mistral, SC Measure=E-SC2026.04 | 0.055 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.728 | |
| TSBackbone=Mistral, SC Measure=L-SC2026.04 | 0.053 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.798 | |
| TSBackbone=Mistral, SC Measure=ML-SC2026.04 | 0.045 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.76 | |
| TSBackbone=Mistral, SC Measure=T-SC2026.04 | 0.045 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.73 | |
| TSBackbone=Mistral, SC Measure=G-SC2026.04 | 0.043 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.732 | |
| TSBackbone=Mistral, SC Measure=B-SC2026.04 | 0.042 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.732 | |
| ATSModel=Llama2026.04 | — | 0.149 | 0.153 | 0.12 | 0.097 | 0.211 | 0.097 | 0.127 | 0.74 | 0.737 | 0.738 | 0.731 | 0.728 | 0.732 | 0.741 | — | |
| BaseModel=Llama2026.04 | — | 0.356 | 0.348 | 0.354 | 0.267 | 0.383 | 0.268 | 0.335 | 0.685 | 0.685 | 0.69 | 0.687 | 0.685 | 0.687 | 0.686 | — | |
| PlattModel=Llama2026.04 | — | 0.168 | 0.154 | 0.146 | 0.096 | 0.218 | 0.1 | 0.138 | 0.739 | 0.736 | 0.741 | 0.732 | 0.726 | 0.737 | 0.74 | — | |
| SEModel=Llama2026.04 | — | 0.158 | 0.156 | 0.142 | 0.093 | 0.217 | 0.093 | 0.135 | 0.737 | 0.741 | 0.741 | 0.732 | 0.728 | 0.731 | 0.739 | — | |
| TSModel=Llama2026.04 | — | 0.057 | 0.087 | 0.068 | 0.057 | 0.118 | 0.056 | 0.036 | 0.746 | 0.81 | 0.759 | 0.73 | 0.746 | 0.731 | 0.709 | — |