Short-form generation on NQ-Open
83AUROCSGD
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SGDModel=Qwen-2-7B2025.11 | 83 | 46 | |
| SeSEModel=Qwen-2-7B2025.11 | 81 | 44 | |
| SeSEModel=Llama-3.1-70B2025.11 | 80 | 70 | |
| P(True)Model=Qwen-2-7B2025.11 | 80 | 44 | |
| KLEModel=Qwen-2-7B2025.11 | 80 | 43 | |
| P(True)Model=Qwen-2-72B2025.11 | 80 | 57 | |
| SeSEModel=Qwen-2-72B2025.11 | 80 | 58 | |
| SEModel=Qwen-2-7B2025.11 | 79 | 43 | |
| KLEModel=Qwen-2-72B2025.11 | 79 | 56 | |
| SGDModel=Qwen-2-72B2025.11 | 78 | 54 | |
| SeSEModel=Llama-3.1-8B2025.11 | 77 | 46 | |
| LN-PEModel=Qwen-2-7B2025.11 | 77 | 42 | |
| SCModel=Qwen-2-72B2025.11 | 77 | 54 | |
| SCModel=Qwen-2-7B2025.11 | 76 | 40 | |
| SEModel=Qwen-2-72B2025.11 | 76 | 53 | |
| KLEModel=Llama-3.1-70B2025.11 | 75 | 66 | |
| LN-PEModel=Qwen-2-72B2025.11 | 75 | 53 | |
| SGDModel=Llama-3.1-70B2025.11 | 73 | 65 | |
| SEModel=Llama-3.1-70B2025.11 | 72 | 64 | |
| ERModel=Qwen-2-7B2025.11 | 72 | 35 | |
| KLEModel=Llama-3.1-8B2025.11 | 71 | 46 | |
| SGDModel=Llama-3.1-8B2025.11 | 70 | 45 | |
| LN-PEModel=Llama-3.1-70B2025.11 | 70 | 63 | |
| SCModel=Llama-3.1-8B2025.11 | 69 | 44 | |
| P(True)Model=Llama-3.1-70B2025.11 | 69 | 62 | |
| SCModel=Llama-3.1-70B2025.11 | 69 | 62 | |
| P(True)Model=Llama-3.1-8B2025.11 | 68 | 43 | |
| SEModel=Llama-3.1-8B2025.11 | 68 | 43 | |
| ERModel=Qwen-2-72B2025.11 | 67 | 54 | |
| LN-PEModel=Llama-3.1-8B2025.11 | 66 | 41 | |
| ERModel=Llama-3.1-8B2025.11 | 64 | 41 | |
| ERModel=Llama-3.1-70B2025.11 | 64 | 59 |