List your company

Claim Verification on ChatGPT (test)

82.4Verification ConfidenceDYDECOMP
41.52852.13962.7573.361Mar 19, 2025

Evaluation results

MethodLinks
DYDECOMPAtomicity=2, Decompose Policy=In-Context Example, Decomposition LLM=Llama3-Inst-70B, Verification LLM=Llama3-Inst-8B2025.0382.475
DYDECOMPAtomicity=1, Decompose Policy=In-Context Example, Decomposition LLM=Llama3-Inst-70B, Verification LLM=Llama3-Inst-8B2025.0380.960.9
DYDECOMPAtomicity=0, Decompose Policy=In-Context Example, Decomposition LLM=Llama3-Inst-70B, Verification LLM=Llama3-Inst-8B2025.0371.542.8
FActScoreAtomicity=0, Decompose Policy=In-Context Example, Decomposition LLM=Llama3-Inst-70B, Verification LLM=Llama3-Inst-8B2025.0367.745.4
DYDECOMPAtomicity=1, Decompose Policy=Retrieval, Decomposition LLM=Llama3-Inst-70B, Verification LLM=Llama3-Inst-8B2025.0365.475.8
DYDECOMPAtomicity=2, Decompose Policy=Retrieval, Decomposition LLM=Llama3-Inst-70B, Verification LLM=Llama3-Inst-8B2025.0364.465.2
FActScoreAtomicity=0, Decompose Policy=Retrieval, Decomposition LLM=Llama3-Inst-70B, Verification LLM=Llama3-Inst-8B2025.0362.766.6
FActScore AtomAtomicity=0, Decompose Policy=Retrieval, Decomposition LLM=Llama3-Inst-70B, Verification LLM=Llama3-Inst-8B2025.0361.879.6
DYDECOMPAtomicity=0, Decompose Policy=Retrieval, Decomposition LLM=Llama3-Inst-70B, Verification LLM=Llama3-Inst-8B2025.036078.9
R-NDAtomicity=0, Decompose Policy=Retrieval, Decomposition LLM=Llama3-Inst-70B, Verification LLM=Llama3-Inst-8B2025.0355.644.9
WICEAtomicity=0, Decompose Policy=Retrieval, Decomposition LLM=Llama3-Inst-70B, Verification LLM=Llama3-Inst-8B2025.0343.178.2