Faithfulness Evaluation on Faithfulness Baseline Narratives
92.2Rank Accuracy (RA)Coherent Design
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Coherent DesignLLM=DeepSeek-V3.2-Exp2026.03 | 92.2 | 95 | 99.2 | 96.7 | |
| Critic-Rule DesignLLM=DeepSeek-V3.2-Exp2026.03 | 91.2 | 96 | 99.2 | 98.6 | |
| Critic DesignLLM=DeepSeek-V3.2-Exp2026.03 | 91 | 95 | 99.5 | 99 | |
| Critic-Rule DesignLLM=Mistral Medium 3.12026.03 | 90.7 | 95.2 | 99 | 98.9 | |
| Coherent-Rule DesignLLM=DeepSeek-V3.2-Exp2026.03 | 90.7 | 95 | 99.2 | 94.2 | |
| Basic DesignLLM=Claude Sonnet 4.52026.03 | 90.5 | 95.7 | 99 | 99.6 | |
| Basic DesignLLM=DeepSeek-V3.2-Exp2026.03 | 90.5 | 96 | 99.2 | 97.1 | |
| Critic DesignLLM=Claude Sonnet 4.52026.03 | 90.5 | 96 | 99 | 98.3 | |
| Critic-Rule DesignLLM=Claude Sonnet 4.52026.03 | 90.5 | 95.7 | 99 | 98.5 | |
| Coherent DesignLLM=Claude Sonnet 4.52026.03 | 90.5 | 95.7 | 99 | 94.6 | |
| Coherent-Rule DesignLLM=Claude Sonnet 4.52026.03 | 90.5 | 95.7 | 99 | 95.3 | |
| Coherent-Rule DesignLLM=Mistral Medium 3.12026.03 | 90.3 | 95.2 | 98.8 | 91.6 | |
| Critic DesignLLM=GPT-52026.03 | 90.2 | 96.5 | 99.3 | 98.2 | |
| Basic DesignLLM=Mistral Medium 3.12026.03 | 89.8 | 95 | 99 | 95.1 | |
| Basic DesignLLM=GPT-52026.03 | 89.8 | 96.5 | 99.3 | 99 | |
| Critic DesignLLM=Mistral Medium 3.12026.03 | 89.7 | 95.2 | 99 | 98.8 | |
| Coherent DesignLLM=Mistral Medium 3.12026.03 | 89.7 | 95.2 | 99.3 | 90.7 | |
| Coherent DesignLLM=GPT-52026.03 | 89.3 | 96.3 | 99.3 | 95.4 | |
| Critic-Rule DesignLLM=GPT-52026.03 | 88.5 | 96.3 | 99.3 | 98.9 | |
| Coherent-Rule DesignLLM=GPT-52026.03 | 88.5 | 96.3 | 99.3 | 95.3 | |
| Critic DesignLLM=Llama 3.3 70B Instruct2026.03 | 87.5 | 95 | 99.3 | 96.8 | |
| Coherent DesignLLM=Llama 3.3 70B Instruct2026.03 | 87.2 | 95.3 | 99.3 | 92.7 | |
| Coherent-Rule DesignLLM=Llama 3.3 70B Instruct2026.03 | 86.5 | 95.2 | 99.3 | 89 | |
| Basic DesignLLM=Llama 3.3 70B Instruct2026.03 | 85.7 | 94 | 99.3 | 94.6 | |
| Critic-Rule DesignLLM=Llama 3.3 70B Instruct2026.03 | 84.7 | 94 | 99.3 | 97.3 |