Question Answering on CausalQA Industrial domain (test)
85.84F1 ScorePrompt-based LP-FT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Industrial2023.05 | 85.84 | 67.21 | |
| Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Consumer2023.05 | 84.8 | 56.01 | |
| Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Technical2023.05 | 81.51 | 58.58 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Industrial2023.05 | 80.7 | 60.66 | |
| Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Industrial2023.05 | 80.05 | 58.46 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Technology2023.05 | 76.7 | 56.06 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Train Domain=Consumer2023.05 | 75.07 | 48.61 | |
| Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Technology2023.05 | 73.99 | 48.98 | |
| Original Fine-tuningBackbone=RoBERTa-base, Train Domain=Consumer2023.05 | 72.49 | 47.68 | |
| Prompt-based LP-FTTraining Domain=Industrial, Backbone=T5-base2023.05 | 61.47 | 20.22 | |
| T5-baseTraining Domain=Industrial, Backbone=T5-base2023.05 | 61.41 | 24.03 | |
| Prompt-based LP-FTTraining Domain=Technology, Backbone=T5-base2023.05 | 59.24 | 22.22 | |
| Prompt-based LP-FTTraining Domain=Consumer, Backbone=T5-base2023.05 | 58.48 | 19.44 | |
| T5-baseTraining Domain=Consumer, Backbone=T5-base2023.05 | 56.69 | 18.6 | |
| T5-baseTraining Domain=Technology, Backbone=T5-base2023.05 | 54.41 | 16.83 |