List your company
ResearchFormerly WizWand

Question Answering on CausalQA Technology Setup 1 (test)

85.54F1Prompt-based LP-FT
67.932872.503977.07581.6461May 14, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Consumer2023.0585.5455.09
Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Industrial2023.0585.3465.57
Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Technical2023.0581.9858.08
Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Industrial, Setup=12023.057957.37
Fine-tuningBackbone=RoBERTa-base, Training Domain=Industrial, Setup=12023.0577.9148.35
Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Consumer, Setup=12023.0577.4649.54
Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Technology, Setup=12023.0576.7653.54
Fine-tuningBackbone=RoBERTa-base, Training Domain=Technology, Setup=12023.0576.4954.04
Fine-tuningBackbone=RoBERTa-base, Training Domain=Consumer, Setup=12023.0574.6349.07
Prompt-based LP-FTBackbone=BART-base, Training Domain=Technology, Setup=12023.0574.0234.34
Prompt-based LP-FTBackbone=BART-base, Training Domain=Industrial, Setup=12023.0573.4737.2
Prompt-based LP-FTBackbone=BART-base, Training Domain=Consumer, Setup=12023.057228.24
Fine-tuningBackbone=BART-base, Training Domain=Technology, Setup=12023.0571.7933.83
Fine-tuningBackbone=BART-base, Training Domain=Industrial, Setup=12023.0569.6327.27
Fine-tuningBackbone=BART-base, Training Domain=Consumer, Setup=12023.0568.6123.61