List your company
ResearchFormerly WizWand

Question Answering on CausalQA Industrial domain (test)

85.84F1 ScorePrompt-based LP-FT
53.152861.638970.12578.6111May 14, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Industrial2023.0585.8467.21
Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Consumer2023.0584.856.01
Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Technical2023.0581.5158.58
Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Industrial2023.0580.760.66
Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Industrial2023.0580.0558.46
Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Technology2023.0576.756.06
Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Consumer2023.0575.0748.61
Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Technology2023.0573.9948.98
Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Consumer2023.0572.4947.68
Prompt-based LP-FTTraining Domain=Industrial, Backbone=T5-base2023.0561.4720.22
T5-baseTraining Domain=Industrial, Backbone=T5-base2023.0561.4124.03
Prompt-based LP-FTTraining Domain=Technology, Backbone=T5-base2023.0559.2422.22
Prompt-based LP-FTTraining Domain=Consumer, Backbone=T5-base2023.0558.4819.44
T5-baseTraining Domain=Consumer, Backbone=T5-base2023.0556.6918.6
T5-baseTraining Domain=Technology, Backbone=T5-base2023.0554.4116.83