Narrative Cloze on Narrative Cloze (val)
59.7AccuracyGPT-5-chat
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-5-chatEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 59.7 | |
| OLMo-2-7BEvent_Type Hint=With, Prompt Strategy=EA2025.11 | 58.8 | |
| GPT-5-chatEvent_Type Hint=With, Prompt Strategy=EA2025.11 | 58 | |
| GPT-5-chatEvent_Type Hint=No, Prompt Strategy=EA2025.11 | 57.4 | |
| GPT-5-chatEvent_Type Hint=No, Prompt Strategy=DS2025.11 | 57.3 | |
| GPT-5-chatEvent_Type Hint=With, Prompt Strategy=NS2025.11 | 57.1 | |
| Qwen3-4BEvent_Type Hint=With, Prompt Strategy=EA2025.11 | 56.8 | |
| GPT-5-chatEvent_Type Hint=With, Prompt Strategy=CF2025.11 | 56.1 | |
| GPT-5-chatEvent_Type Hint=No, Prompt Strategy=NS2025.11 | 56 | |
| GPT-5-chatEvent_Type Hint=With, Prompt Strategy=HH2025.11 | 55.9 | |
| GPT-5-chatEvent_Type Hint=With, Prompt Strategy=-2025.11 | 55.5 | |
| Qwen3-4BEvent_Type Hint=No, Prompt Strategy=EA2025.11 | 55 | |
| Qwen3-4B-0725Event_Type Hint=With, Prompt Strategy=HH2025.11 | 53.8 | |
| GPT-5-chatEvent_Type Hint=No, Prompt Strategy=CF2025.11 | 53.3 | |
| Qwen3-4B-0725Event_Type Hint=With, Prompt Strategy=NS2025.11 | 51.6 | |
| GPT-5-chatEvent_Type Hint=No, Prompt Strategy=HH2025.11 | 51.5 | |
| GPT-5-chatEvent_Type Hint=No, Prompt Strategy=-2025.11 | 51 | |
| Qwen3-4B-0725Event_Type Hint=No, Prompt Strategy=NS2025.11 | 50.9 | |
| OLMo-2-32BEvent_Type Hint=With, Prompt Strategy=NS2025.11 | 50.8 | |
| Qwen3-4B-0725Event_Type Hint=With, Prompt Strategy=CF2025.11 | 50.7 | |
| Qwen3-4B-0725Event_Type Hint=With, Prompt Strategy=-2025.11 | 50.2 | |
| Qwen2.5-32BEvent_Type Hint=With, Prompt Strategy=HH2025.11 | 49.6 | |
| OLMo-2-7BEvent_Type Hint=No, Prompt Strategy=EA2025.11 | 49.1 | |
| GPT-4oEvent_Type Hint=With, Prompt Strategy=CF2025.11 | 49.1 | |
| phi-4Event_Type Hint=With, Prompt Strategy=NS2025.11 | 48.5 | |
| OLMo-2-32BEvent_Type Hint=With, Prompt Strategy=-2025.11 | 48.4 | |
| Qwen2.5-32BEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 48.2 | |
| Qwen3-4B-0725Event_Type Hint=With, Prompt Strategy=DS2025.11 | 48.2 | |
| Qwen2.5-7BEvent_Type Hint=With, Prompt Strategy=NS2025.11 | 48 | |
| Qwen3-4BEvent_Type Hint=With, Prompt Strategy=NS2025.11 | 48 | |
| Qwen3-4B-0725Event_Type Hint=No, Prompt Strategy=DS2025.11 | 48 | |
| Qwen3-4BEvent_Type Hint=No, Prompt Strategy=NS2025.11 | 47.9 | |
| Llama-3.1-8BEvent_Type Hint=With, Prompt Strategy=CF2025.11 | 47.9 | |
| GPT-4oEvent_Type Hint=With, Prompt Strategy=NS2025.11 | 47.9 | |
| Qwen2.5-32BEvent_Type Hint=With, Prompt Strategy=CF2025.11 | 47.8 | |
| GPT-4o-miniEvent_Type Hint=With, Prompt Strategy=NS2025.11 | 47.7 | |
| OLMo-2-13BEvent_Type Hint=With, Prompt Strategy=HH2025.11 | 47.6 | |
| OLMo-2-13BEvent_Type Hint=With, Prompt Strategy=EA2025.11 | 47.4 | |
| Qwen3-4B-0725Event_Type Hint=No, Prompt Strategy=HH2025.11 | 47.3 | |
| Qwen2.5-14BEvent_Type Hint=With, Prompt Strategy=-2025.11 | 47.1 | |
| Qwen3-4B-0725Event_Type Hint=No, Prompt Strategy=-2025.11 | 47.1 | |
| phi-4Event_Type Hint=With, Prompt Strategy=-2025.11 | 47 | |
| GPT-4o-miniEvent_Type Hint=With, Prompt Strategy=-2025.11 | 46.9 | |
| Qwen2.5-7BEvent_Type Hint=With, Prompt Strategy=CF2025.11 | 46.7 | |
| Qwen2.5-32BEvent_Type Hint=No, Prompt Strategy=CF2025.11 | 46.7 | |
| Qwen3-4B-0725Event_Type Hint=No, Prompt Strategy=CF2025.11 | 46.7 | |
| Mistral-Small-24BEvent_Type Hint=With, Prompt Strategy=CF2025.11 | 46.6 | |
| gemma-2-27bEvent_Type Hint=No, Prompt Strategy=DS2025.11 | 46.6 | |
| OLMo-2-13BEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 46.5 | |
| Qwen3-4BEvent_Type Hint=With, Prompt Strategy=-2025.11 | 46.5 | |
| Qwen2.5-14BEvent_Type Hint=With, Prompt Strategy=HH2025.11 | 46.3 | |
| gemma-2-27bEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 46.1 | |
| OLMo-2-32BEvent_Type Hint=No, Prompt Strategy=NS2025.11 | 46 | |
| Qwen2.5-32BEvent_Type Hint=With, Prompt Strategy=NS2025.11 | 46 | |
| Llama-3.1-8BEvent_Type Hint=With, Prompt Strategy=NS2025.11 | 46 | |
| Llama-3.1-8BEvent_Type Hint=With, Prompt Strategy=HH2025.11 | 45.9 | |
| Qwen3-4BEvent_Type Hint=With, Prompt Strategy=CF2025.11 | 45.8 | |
| GPT-4o-miniEvent_Type Hint=No, Prompt Strategy=NS2025.11 | 45.8 | |
| GPT-4o-miniEvent_Type Hint=With, Prompt Strategy=CF2025.11 | 45.8 | |
| Mistral-Small-24BEvent_Type Hint=No, Prompt Strategy=HH2025.11 | 45.5 | |
| GPT-4oEvent_Type Hint=No, Prompt Strategy=CF2025.11 | 45.5 | |
| GPT-4oEvent_Type Hint=With, Prompt Strategy=-2025.11 | 45.4 | |
| OLMo-2-13BEvent_Type Hint=With, Prompt Strategy=CF2025.11 | 45.3 | |
| Qwen2.5-32BEvent_Type Hint=With, Prompt Strategy=-2025.11 | 45.3 | |
| Mistral-Small-24BEvent_Type Hint=No, Prompt Strategy=DS2025.11 | 45.2 | |
| OLMo-2-13BEvent_Type Hint=With, Prompt Strategy=-2025.11 | 45.1 | |
| Qwen2.5-7BEvent_Type Hint=With, Prompt Strategy=-2025.11 | 45.1 | |
| Qwen2.5-7BEvent_Type Hint=No, Prompt Strategy=DS2025.11 | 45 | |
| Qwen3-4BEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 45 | |
| Mistral-Small-24BEvent_Type Hint=With, Prompt Strategy=NS2025.11 | 45 | |
| GPT-4oEvent_Type Hint=With, Prompt Strategy=HH2025.11 | 45 | |
| OLMo-2-32BEvent_Type Hint=No, Prompt Strategy=-2025.11 | 44.9 | |
| Mistral-Small-24BEvent_Type Hint=With, Prompt Strategy=HH2025.11 | 44.9 | |
| phi-4Event_Type Hint=With, Prompt Strategy=HH2025.11 | 44.9 | |
| GPT-4o-miniEvent_Type Hint=With, Prompt Strategy=HH2025.11 | 44.9 | |
| OLMo-2-13BEvent_Type Hint=No, Prompt Strategy=EA2025.11 | 44.7 | |
| gemma-2-9bEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 44.7 | |
| Qwen2.5-32BEvent_Type Hint=No, Prompt Strategy=DS2025.11 | 44.6 | |
| Qwen3-4BEvent_Type Hint=No, Prompt Strategy=-2025.11 | 44.6 | |
| gemma-2-9bEvent_Type Hint=No, Prompt Strategy=DS2025.11 | 44.4 | |
| Qwen2.5-7BEvent_Type Hint=No, Prompt Strategy=CF2025.11 | 44.3 | |
| Qwen2.5-32BEvent_Type Hint=No, Prompt Strategy=NS2025.11 | 44.3 | |
| Qwen2.5-14BEvent_Type Hint=With, Prompt Strategy=NS2025.11 | 44.2 | |
| phi-4Event_Type Hint=No, Prompt Strategy=-2025.11 | 44.2 | |
| Qwen3-4BEvent_Type Hint=No, Prompt Strategy=DS2025.11 | 44.1 | |
| GPT-4oEvent_Type Hint=No, Prompt Strategy=NS2025.11 | 44.1 | |
| Qwen2.5-7BEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 44 | |
| Mistral-Small-24BEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 44 | |
| phi-4Event_Type Hint=No, Prompt Strategy=HH2025.11 | 44 | |
| GPT-4oEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 44 | |
| Qwen3-4BEvent_Type Hint=No, Prompt Strategy=CF2025.11 | 43.9 | |
| Qwen3-4BEvent_Type Hint=With, Prompt Strategy=HH2025.11 | 43.9 | |
| Qwen2.5-7BEvent_Type Hint=No, Prompt Strategy=NS2025.11 | 43.8 | |
| Qwen2.5-14BEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 43.8 | |
| OLMo-2-32BEvent_Type Hint=With, Prompt Strategy=CF2025.11 | 43.7 | |
| GPT-4o-miniEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 43.7 | |
| Llama-3.1-8BEvent_Type Hint=No, Prompt Strategy=DS2025.11 | 43.4 | |
| Llama-3.1-8BEvent_Type Hint=With, Prompt Strategy=-2025.11 | 43.4 | |
| Qwen2.5-14BEvent_Type Hint=With, Prompt Strategy=CF2025.11 | 43.3 | |
| Llama-3.1-8BEvent_Type Hint=With, Prompt Strategy=DS2025.11 | 43.3 |