Question Answering on CausalQA Consumer domain (test)
80.55F1Prompt-based LP-FT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Industrial2023.05 | 80.55 | 59.02 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Consumer2023.05 | 78.39 | 53.24 | |
| Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Consumer2023.05 | 78.2 | 51.38 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Technology2023.05 | 77.93 | 55.05 | |
| Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Industrial2023.05 | 77.81 | 49.45 | |
| Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Technology2023.05 | 75.54 | 55.05 | |
| Prompt-based LP-FTTraining Domain=Industrial, Backbone=T5-base2023.05 | 62.37 | 24.04 | |
| Prompt-based LP-FTTraining Domain=Consumer, Backbone=T5-base2023.05 | 61.49 | 19.61 | |
| T5-baseTraining Domain=Industrial, Backbone=T5-base2023.05 | 59.85 | 24.72 | |
| T5-baseTraining Domain=Consumer, Backbone=T5-base2023.05 | 59.3 | 15.74 | |
| Prompt-based LP-FTTraining Domain=Technology, Backbone=T5-base2023.05 | 59 | 23.23 | |
| T5-baseTraining Domain=Technology, Backbone=T5-base2023.05 | 55.3 | 17.85 |