Veracity Inference on GSM8K 1,000 examples
75.1Mean Hamming SimilarityVeracity Search (VS)
Evaluation results
| Method | Links | |
|---|---|---|
| Veracity Search (VS)Base LM=Qwen-8B2025.05 | 75.1 | |
| Veracity Search (VS)Base LM=Qwen-4B2025.05 | 71.1 | |
| CoTBase LM=Qwen-8B2025.05 | 69.5 | |
| VotingBase LM=Qwen-8B2025.05 | 65.4 | |
| Many2ManyBase LM=Qwen-8B2025.05 | 65 | |
| Veracity Search (VS)Base LM=Llama-8B2025.05 | 64.6 | |
| VotingBase LM=Qwen-4B2025.05 | 62.3 | |
| Many2ManyBase LM=Qwen-4B2025.05 | 62 | |
| RecursiveBase LM=Qwen-8B2025.05 | 61.7 | |
| CoTBase LM=Qwen-4B2025.05 | 61.4 | |
| Veracity Search (VS)Base LM=Llama-3B2025.05 | 61.4 | |
| RecursiveBase LM=Llama-3B2025.05 | 56.8 | |
| RecursiveBase LM=Llama-8B2025.05 | 56.8 | |
| Many2ManyBase LM=Llama-8B2025.05 | 56.7 | |
| Many2ManyBase LM=Llama-3B2025.05 | 56.6 | |
| VotingBase LM=Llama-3B2025.05 | 56.6 | |
| VotingBase LM=Llama-8B2025.05 | 55.3 | |
| RecursiveBase LM=Qwen-4B2025.05 | 54 | |
| CoTBase LM=Llama-3B2025.05 | 49.6 | |
| CoTBase LM=Llama-8B2025.05 | 49.6 |