Factuality Evaluation on Biography
29.4Correctness CountYi-1.5-9B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Yi-1.5-9BCategory=Open-source Models2024.06 | 29.4 | 56.9 | 100 | 0.34 | |
| DeepSeekV2-LiteCategory=Open-source Models2024.06 | 28 | 32.4 | 96 | 0.458 | |
| Ministral-8BCategory=Open-source Models2024.06 | 22.7 | 37.3 | 100 | 0.378 | |
| Qwen2.5-7BCategory=Open-source Models2024.06 | 20.9 | 23.1 | 73 | 0.467 | |
| ITIBase Model=Llama-3.1-8B-Instruct2024.06 | 19.1 | 16.1 | 90 | 0.512 | |
| FACTBase Model=Llama-3.1-8B-Instruct, Algorithm=DPO2024.06 | 18.1 | 12.3 | 85 | 0.506 | |
| Llama-3.1-8BCategory=Open-source Models2024.06 | 17.6 | 12.5 | 84 | 0.487 | |
| RLFHBase Model=Qwen2.5-7B-Instruct2024.06 | 17.5 | 15.5 | 59 | 0.523 | |
| RLFHBase Model=Llama-3.1-8B-Instruct2024.06 | 17.3 | 11 | 79 | 0.558 | |
| DOLABase Model=Llama-3.1-8B-Instruct2024.06 | 15.6 | 20.4 | 84 | 0.399 | |
| Falcon3-10BCategory=Open-source Models2024.06 | 13.5 | 22.6 | 100 | 0.357 | |
| FACTBase Model=Llama-3.1-8B-Instruct, Algorithm=SFT2024.06 | 5.7 | 4 | 99 | 0.541 |