Claim Verification on Med Claim
85AccuracyDirect Question
Evaluation results
| Method | Links | |
|---|---|---|
| Direct QuestionBackbone=GPT-4o, Prompting Method=Direct Question2024.05 | 85 | |
| Chain-of-ThoughtBackbone=GPT-4o, Prompting Method=Chain-of-Thought2024.05 | 85 | |
| ArgLLMBackbone=GPT-4o, Base Score Type=Estimated, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 83 | |
| Est. ConfidenceBackbone=GPT-4o, Prompting Method=Est. Confidence2024.05 | 82 | |
| ArgLLMBackbone=GPT-4o, Base Score Type=Estimated, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 80 | |
| ArgLLMBackbone=GPT-4o, Base Score Type=0.5, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 76 | |
| Direct QuestionBackbone=GPT-4o mini, Prompting Method=Direct Question2024.05 | 74 | |
| ArgLLMBackbone=GPT-4o, Base Score Type=0.5, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 74 | |
| Chain-of-ThoughtBackbone=GPT-4o mini, Prompting Method=Chain-of-Thought2024.05 | 72 | |
| Est. ConfidenceBackbone=GPT-4o mini, Prompting Method=Est. Confidence2024.05 | 71 | |
| ArgLLMBackbone=GPT-4o mini, Base Score Type=Estimated, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 71 | |
| ArgLLMBackbone=GPT-4o mini, Base Score Type=Estimated, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 71 | |
| Direct QuestionBackbone=GPT-3.5-turbo, Prompting Method=Direct Question2024.05 | 67 | |
| Chain-of-ThoughtBackbone=GPT-3.5-turbo, Prompting Method=Chain-of-Thought2024.05 | 67 | |
| ArgLLMBackbone=GPT-4o mini, Base Score Type=0.5, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 65 | |
| ArgLLMBackbone=Mixtral, Base Score Type=Estimated, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 63 | |
| Est. ConfidenceBackbone=Mixtral, Prompting Method=Est. Confidence2024.05 | 62 | |
| Chain-of-ThoughtBackbone=Gemma 2 9B, Prompting Method=Chain-of-Thought2024.05 | 62 | |
| ArgLLMBackbone=GPT-4o mini, Base Score Type=0.5, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 62 | |
| Chain-of-ThoughtBackbone=Mistral, Prompting Method=Chain-of-Thought2024.05 | 61 | |
| Chain-of-ThoughtBackbone=Mixtral, Prompting Method=Chain-of-Thought2024.05 | 61 | |
| ArgLLMBackbone=Mixtral, Base Score Type=Estimated, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 61 | |
| Direct QuestionBackbone=Gemma 2 9B, Prompting Method=Direct Question2024.05 | 61 | |
| Direct QuestionBackbone=Mixtral, Prompting Method=Direct Question2024.05 | 60 | |
| ArgLLMBackbone=Gemma 2 9B, Base Score Type=Estimated, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 60 | |
| ArgLLMBackbone=Mixtral, Base Score Type=0.5, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 59 | |
| ArgLLMBackbone=Gemma 2 9B, Base Score Type=0.5, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 59 | |
| ArgLLMBackbone=Gemma 2 9B, Base Score Type=Estimated, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 59 | |
| Est. ConfidenceBackbone=Gemma 2 9B, Prompting Method=Est. Confidence2024.05 | 58 | |
| Chain-of-ThoughtBackbone=Llama 3 8B, Prompting Method=Chain-of-Thought2024.05 | 58 | |
| Est. ConfidenceBackbone=Mistral, Prompting Method=Est. Confidence2024.05 | 57 | |
| ArgLLMBackbone=Gemma 2 9B, Base Score Type=0.5, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 57 | |
| Est. ConfidenceBackbone=GPT-3.5-turbo, Prompting Method=Est. Confidence2024.05 | 57 | |
| ArgLLMBackbone=GPT-3.5-turbo, Base Score Type=Estimated, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 57 | |
| ArgLLMBackbone=GPT-3.5-turbo, Base Score Type=Estimated, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 57 | |
| ArgLLMBackbone=Mixtral, Base Score Type=0.5, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 56 | |
| Est. ConfidenceBackbone=Llama 3 8B, Prompting Method=Est. Confidence2024.05 | 56 | |
| ArgLLMBackbone=GPT-3.5-turbo, Base Score Type=0.5, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 56 | |
| Direct QuestionBackbone=Mistral, Prompting Method=Direct Question2024.05 | 55 | |
| Chain-of-ThoughtBackbone=Gemma 7B, Prompting Method=Chain-of-Thought2024.05 | 55 | |
| ArgLLMBackbone=GPT-3.5-turbo, Base Score Type=0.5, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 55 | |
| Direct QuestionBackbone=Llama 3 8B, Prompting Method=Direct Question2024.05 | 54 | |
| ArgLLMBackbone=Mistral, Base Score Type=Estimated, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 53 | |
| Est. ConfidenceBackbone=Gemma 7B, Prompting Method=Est. Confidence2024.05 | 53 | |
| ArgLLMBackbone=Llama 3 8B, Base Score Type=0.5, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 53 | |
| ArgLLMBackbone=Llama 3 8B, Base Score Type=Estimated, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 53 | |
| ArgLLMBackbone=Mistral, Base Score Type=Estimated, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 52 | |
| Direct QuestionBackbone=Gemma 7B, Prompting Method=Direct Question2024.05 | 52 | |
| ArgLLMBackbone=Gemma 7B, Base Score Type=0.5, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 52 | |
| ArgLLMBackbone=Gemma 7B, Base Score Type=Estimated, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 52 | |
| ArgLLMBackbone=Gemma 7B, Base Score Type=Estimated, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 52 | |
| ArgLLMBackbone=Llama 3 8B, Base Score Type=Estimated, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 52 | |
| ArgLLMBackbone=Mistral, Base Score Type=0.5, Argument Depth (D)=2, Gradual Semantics (sigma)=DF-QuAD2024.05 | 51 | |
| ArgLLMBackbone=Gemma 7B, Base Score Type=0.5, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 51 | |
| ArgLLMBackbone=Llama 3 8B, Base Score Type=0.5, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 51 | |
| ArgLLMBackbone=Mistral, Base Score Type=0.5, Argument Depth (D)=1, Gradual Semantics (sigma)=DF-QuAD2024.05 | 50 |