Veracity Inference on PRONTOQA (1,000 examples)
96.4Mean Hamming SimilarityVeracity Search (VS)
Evaluation Results
| Method | Links | |
|---|---|---|
| Veracity Search (VS)Base LM=Llama-8B2025.05 | 96.4 | |
| Veracity Search (VS)Base LM=Llama-3B2025.05 | 94.8 | |
| Veracity Search (VS)Base LM=Qwen-8B2025.05 | 94.5 | |
| Veracity Search (VS)Base LM=Qwen-4B2025.05 | 91 | |
| VotingBase LM=Qwen-8B2025.05 | 69.2 | |
| RecursiveBase LM=Qwen-4B2025.05 | 69.1 | |
| Many2ManyBase LM=Qwen-8B2025.05 | 68.3 | |
| RecursiveBase LM=Qwen-8B2025.05 | 66.7 | |
| VotingBase LM=Qwen-4B2025.05 | 60.3 | |
| CoTBase LM=Qwen-4B2025.05 | 59.1 | |
| Many2ManyBase LM=Qwen-4B2025.05 | 59 | |
| RecursiveBase LM=Llama-3B2025.05 | 53.8 | |
| VotingBase LM=Llama-8B2025.05 | 53.6 | |
| Many2ManyBase LM=Llama-8B2025.05 | 53 | |
| CoTBase LM=Llama-8B2025.05 | 51.5 | |
| VotingBase LM=Llama-3B2025.05 | 51.4 | |
| Many2ManyBase LM=Llama-3B2025.05 | 50.6 | |
| RecursiveBase LM=Llama-8B2025.05 | 47.1 | |
| CoTBase LM=Llama-3B2025.05 | 45.9 | |
| CoTBase LM=Qwen-8B2025.05 | 38.4 |