Context-faithful Reasoning on ConFiQA MC
38.8PcLLAMA2-7B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLAMA2-7BModel Version=chat2024.12 | 38.8 | 24.7 | 38.4 | 10 | |
| LLAMA2-13BModel Version=chat2024.12 | 35.3 | 28 | 44.2 | 0 | |
| LLAMA3-8BModel Version=instruct2024.12 | 21.7 | 33.4 | 60.7 | 0 | |
| GEMINI-1.5-PRO2024.12 | 21.1 | 52.3 | 70.9 | 450 | |
| MISTRAL-7BModel Version=instruct-v0.22024.12 | 14.1 | 29.8 | 67.9 | 0 | |
| QWEN2-7BModel Version=instruct2024.12 | 10 | 43.7 | 81.4 | 0 | |
| CHATGPT-42024.12 | 8.7 | 32.3 | 78.9 | 130 | |
| CHATGPT-4o2024.12 | 1.6 | 30.3 | 94.8 | 0 |