Question Answering on ConflictQA-TripleConf complementary setting 1.0 (test)
66.87F1 (Pos)GPT-5.1
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GPT-5.1Model Category=General LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 66.87 | 45.85 | 21.0231 | 58.14 | 33.72 | 24.4242 | |
| GPT-4oModel Category=General LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 65.63 | 50.97 | 14.6622 | 55.35 | 33.72 | 21.6339 | |
| Deepseek-V3.2-ThinkingModel Category=Reasoning LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 64.12 | 55.43 | 8.6914 | 54.88 | 36.98 | 17.9033 | |
| GPT-3.5-Turbo-0125Model Category=General LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 63.48 | 42.53 | 20.9533 | 50.93 | 30.7 | 20.234 | |
| Mistral-Large-2512Model Category=General LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 61.01 | 51.47 | 9.5416 | 47.91 | 29.77 | 18.1438 | |
| Deepseek-V3.2Model Category=General LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 59.31 | 36.83 | 22.4838 | 52.79 | 26.74 | 26.0549 | |
| o3-miniModel Category=Reasoning LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 58.87 | 46.11 | 12.7622 | 48.14 | 37.67 | 10.4722 | |
| Llama-3.1-70B-InstructModel Category=General LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 57.76 | 42.14 | 15.6227 | 46.74 | 31.16 | 15.5833 | |
| Qwen3-30B-A3B-ThinkingModel Category=Reasoning LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 53.55 | 44.84 | 8.7116 | 43.49 | 34.88 | 8.612 | |
| Qwen3-8BModel Category=General LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 53.26 | 26.26 | 27.0051 | 36.98 | 8.14 | 28.8478 | |
| Llama-3.1-8B-InstructModel Category=General LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 52.79 | 36.45 | 16.3431 | 38.37 | 17.67 | 20.7054 | |
| Open-Mistral-7BModel Category=General LLM, Protocol=Zero-shot, Prompting=Conflict-aware QA prompt2026.04 | 43.25 | 13.34 | 29.9169 | 30.7 | 6.51 | 24.1979 |