Issue Recognition on FaultyScience (test)
95PerformanceQwen2.5-72B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-72BPrompt style=discriminative (P^Dis)2026.03 | 95 | |
| Llama3.3 70BPrompt style=discriminative (P^Dis)2026.03 | 90.8 | |
| GPT4Prompt style=discriminative (P^Dis)2026.03 | 88.1 | |
| Mixtral-8x7BPrompt style=discriminative (P^Dis)2026.03 | 75.2 | |
| GPT4Prompt style=generative with hint (P^Gen_+hint)2026.03 | 48.6 | |
| Qwen2.5-72BPrompt style=generative with hint (P^Gen_+hint)2026.03 | 40.1 | |
| GPT4Prompt style=generative without hint (P^Gen_-hint)2026.03 | 34.9 | |
| Mixtral-8x7BPrompt style=generative with hint (P^Gen_+hint)2026.03 | 27.8 | |
| Llama3.3 70BPrompt style=generative with hint (P^Gen_+hint)2026.03 | 24.5 | |
| Llama3.3 70BPrompt style=generative without hint (P^Gen_-hint)2026.03 | 14 | |
| Qwen2.5-72BPrompt style=generative without hint (P^Gen_-hint)2026.03 | 10.8 | |
| Mixtral-8x7BPrompt style=generative without hint (P^Gen_-hint)2026.03 | 10.2 |