Short-form generation on SQuAD
83AUROCSeSE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SeSEModel=Llama-3.1-70B2025.11 | 83 | 57 | |
| SCModel=Llama-3.1-70B2025.11 | 81 | 56 | |
| SeSEModel=Qwen-2-7B2025.11 | 80 | 42 | |
| KLEModel=Llama-3.1-70B2025.11 | 79 | 54 | |
| KLEModel=Qwen-2-7B2025.11 | 79 | 40 | |
| SEModel=Llama-3.1-70B2025.11 | 78 | 53 | |
| SGDModel=Llama-3.1-70B2025.11 | 78 | 53 | |
| LN-PEModel=Qwen-2-7B2025.11 | 77 | 42 | |
| SEModel=Qwen-2-7B2025.11 | 77 | 41 | |
| SGDModel=Qwen-2-7B2025.11 | 77 | 42 | |
| KLEModel=Qwen-2-72B2025.11 | 76 | 47 | |
| SeSEModel=Qwen-2-72B2025.11 | 76 | 48 | |
| P(True)Model=Qwen-2-7B2025.11 | 75 | 39 | |
| SCModel=Qwen-2-7B2025.11 | 75 | 40 | |
| SEModel=Qwen-2-72B2025.11 | 75 | 46 | |
| SGDModel=Qwen-2-72B2025.11 | 75 | 49 | |
| P(True)Model=Llama-3.1-70B2025.11 | 72 | 50 | |
| LN-PEModel=Llama-3.1-70B2025.11 | 70 | 48 | |
| SeSEModel=Llama-3.1-8B2025.11 | 69 | 35 | |
| LN-PEModel=Qwen-2-72B2025.11 | 69 | 43 | |
| P(True)Model=Qwen-2-72B2025.11 | 68 | 43 | |
| SCModel=Qwen-2-72B2025.11 | 68 | 42 | |
| KLEModel=Llama-3.1-8B2025.11 | 67 | 30 | |
| LN-PEModel=Llama-3.1-8B2025.11 | 66 | 28 | |
| SEModel=Llama-3.1-8B2025.11 | 64 | 27 | |
| SGDModel=Llama-3.1-8B2025.11 | 64 | 28 | |
| ERModel=Qwen-2-7B2025.11 | 64 | 33 | |
| ERModel=Qwen-2-72B2025.11 | 64 | 48 | |
| P(True)Model=Llama-3.1-8B2025.11 | 63 | 27 | |
| SCModel=Llama-3.1-8B2025.11 | 63 | 26 | |
| ERModel=Llama-3.1-70B2025.11 | 63 | 51 | |
| ERModel=Llama-3.1-8B2025.11 | 59 | 24 |