Event Detection on MAVEN
56.82Macro PrecisionLlama 3
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Llama 3Size=8B, Temp=0.4, Shots=3%, Min Count=3, Shot Type=Few-shot2026.01 | 56.82 | 51.72 | 63.95 | 54.13 | |
| Qwen 2.5Size=7B, Temp=0.4, Shots=3%, Min Count=3, Shot Type=Few-shot2026.01 | 55.51 | 50.68 | 61.87 | 52.99 | |
| GemmaSize=8B, Temp=0.4, Shots=3%, Min Count=1, Shot Type=Few-shot2026.01 | 54.02 | 49.21 | 61.31 | 51.49 | |
| DeepSeekSize=7B, Temp=0.4, Shots=1%, Min Count=3, Shot Type=Few-shot2026.01 | 53.13 | 48.14 | 61.01 | 50.53 | |
| Llama 3Size=8B, Temp=0.4, Shots=0%, Min Count=0, Shot Type=Zero-shot2026.01 | 51.36 | 46.19 | 36.1 | 24.11 | |
| GemmaSize=8B, Temp=0.4, Shots=0%, Min Count=0, Shot Type=Zero-shot2026.01 | 51.24 | 46.29 | 34.76 | 22.95 | |
| Qwen 2.5Size=7B, Temp=0.4, Shots=0%, Min Count=0, Shot Type=Zero-shot2026.01 | 50.11 | 45.15 | 33.23 | 22.75 |