Factuality Evaluation on FactScore (labeled)
64.8LS Score (%)PaCE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PaCETarget Model=LLaMA2-13B-Chat2024.06 | 64.8 | 53 | |
| PromptingTarget Model=LLaMA2-13B-Chat2024.06 | 61.6 | 24.5 | |
| OrthoProjTarget Model=LLaMA2-13B-Chat2024.06 | 59.3 | 52.8 | |
| VanillaTarget Model=LLaMA2-13B-Chat2024.06 | 44.1 | 39.6 | |
| PromptingTarget Model=LLaMA2-7B-Chat2024.06 | 28.6 | 40.6 | |
| PaCETarget Model=LLaMA2-7B-Chat2024.06 | 27.7 | 65.9 | |
| VecAddTarget Model=LLaMA2-13B-Chat2024.06 | 24.5 | 49.2 | |
| OrthoProjTarget Model=LLaMA2-7B-Chat2024.06 | 21.9 | 49.7 | |
| VanillaTarget Model=LLaMA2-7B-Chat2024.06 | 18.4 | 45.1 | |
| VecAddTarget Model=LLaMA2-7B-Chat2024.06 | 16.2 | 46.1 |