List your company

Veracity Prediction on VERITE

64Macro F1Llama-8BQwenVL
39.0445.525258.48May 21, 2025

Evaluation results

MethodLinks
Llama-8BQwenVLBackbone=Llama-8B, Justification Generator=QwenVL, Protocol=QLoRA2025.0564
Mistral-7BQwenVLBackbone=Mistral-7B, Justification Generator=QwenVL, Protocol=QLoRA2025.0564
Mistral-7BIdefics3Backbone=Mistral-7B, Justification Generator=Idefics3, Protocol=QLoRA2025.0561
Llama-8BIdefics3Backbone=Llama-8B, Justification Generator=Idefics3, Protocol=QLoRA2025.0559
RoBERTa-LQwenVLBackbone=RoBERTa-Large, Justification Generator=QwenVL, Protocol=Fine-tuning2025.0554
RoBERTa-LIdefics3Backbone=RoBERTa-Large, Justification Generator=Idefics3, Protocol=Fine-tuning2025.0550
Llama-8BPaligemmaBackbone=Llama-8B, Justification Generator=Paligemma, Protocol=QLoRA2025.0550
Mistral-7BPaligemmaBackbone=Mistral-7B, Justification Generator=Paligemma, Protocol=QLoRA2025.0550
XLNet-LQwenVLBackbone=XLNet-Large, Justification Generator=QwenVL, Protocol=Fine-tuning2025.0548
XLNet-LIdefics3Backbone=XLNet-Large, Justification Generator=Idefics3, Protocol=Fine-tuning2025.0548
Papadopoulos et al., 2025Protocol=Baseline2025.0547
RoBERTa-LPaligemmaBackbone=RoBERTa-Large, Justification Generator=Paligemma, Protocol=Fine-tuning2025.0540
XLNet-LPaligemmaBackbone=XLNet-Large, Justification Generator=Paligemma, Protocol=Fine-tuning2025.0540