List your company
ResearchFormerly WizWand

Question Answering on CausalQA Consumer Setup 1 (test)

85.84F1 ScorePrompt-based LP-FT
69.25273.558577.86582.1715May 14, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Consumer2023.0585.8460.64
Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Industrial2023.0585.7666.66
Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Industrial, Setup=12023.0580.5559.02
Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Technical2023.0580.2458.08
Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Consumer, Setup=12023.0578.3953.24
Fine-tuningBackbone=RoBERTa-base, Training Domain=Consumer, Setup=12023.0578.251.38
Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Technology, Setup=12023.0577.9355.05
Fine-tuningBackbone=RoBERTa-base, Training Domain=Industrial, Setup=12023.0577.8149.45
Fine-tuningBackbone=RoBERTa-base, Training Domain=Technology, Setup=12023.0575.5455.05
Prompt-based LP-FTBackbone=BART-base, Training Domain=Industrial, Setup=12023.0574.0636.06
Prompt-based LP-FTBackbone=BART-base, Training Domain=Technology, Setup=12023.0572.6733.33
Prompt-based LP-FTBackbone=BART-base, Training Domain=Consumer, Setup=12023.0570.6525
Fine-tuningBackbone=BART-base, Training Domain=Consumer, Setup=12023.0570.2924.53
Fine-tuningBackbone=BART-base, Training Domain=Industrial, Setup=12023.0570.1131.31
Fine-tuningBackbone=BART-base, Training Domain=Technology, Setup=12023.0569.8930.3