Question Answering on CausalQA Technology domain (test)
79F1 ScorePrompt-based LP-FT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Industrial2023.05 | 79 | 57.37 | |
| Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Industrial2023.05 | 77.91 | 48.35 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Consumer2023.05 | 77.46 | 49.54 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Technology2023.05 | 76.76 | 53.54 | |
| Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Technology2023.05 | 76.49 | 54.04 | |
| Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Consumer2023.05 | 74.63 | 49.07 | |
| Prompt-based LP-FTTraining Domain=Industrial, Backbone=T5-base2023.05 | 61.58 | 20.76 | |
| T5-baseTraining Domain=Industrial, Backbone=T5-base2023.05 | 59.94 | 25.27 | |
| Prompt-based LP-FTTraining Domain=Technology, Backbone=T5-base2023.05 | 59.29 | 22.22 | |
| T5-baseTraining Domain=Technology, Backbone=T5-base2023.05 | 58.76 | 20.2 | |
| Prompt-based LP-FTTraining Domain=Consumer, Backbone=T5-base2023.05 | 58.37 | 19.44 | |
| T5-baseTraining Domain=Consumer, Backbone=T5-base2023.05 | 56.13 | 17.67 |