Question Answering on CausalQA Industrial Setup 1 (test)
80.7F1Prompt-based LP-FT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Industrial, Setup=12023.05 | 80.7 | 60.66 | |
| Fine-tuningBackbone=RoBERTa-base, Training Domain=Industrial, Setup=12023.05 | 80.05 | 58.46 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Technology, Setup=12023.05 | 76.7 | 56.06 | |
| Prompt-based LP-FTBackbone=BART-base, Training Domain=Industrial, Setup=12023.05 | 76.58 | 39.89 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Consumer, Setup=12023.05 | 75.07 | 48.61 | |
| Fine-tuningBackbone=RoBERTa-base, Training Domain=Technology, Setup=12023.05 | 73.99 | 48.98 | |
| Fine-tuningBackbone=BART-base, Training Domain=Industrial, Setup=12023.05 | 72.53 | 32.41 | |
| Prompt-based LP-FTBackbone=BART-base, Training Domain=Technology, Setup=12023.05 | 72.51 | 31.22 | |
| Fine-tuningBackbone=RoBERTa-base, Training Domain=Consumer, Setup=12023.05 | 72.49 | 47.68 | |
| Prompt-based LP-FTBackbone=BART-base, Training Domain=Consumer, Setup=12023.05 | 70.14 | 26.85 | |
| Fine-tuningBackbone=BART-base, Training Domain=Technology, Setup=12023.05 | 69.53 | 27.77 | |
| Fine-tuningBackbone=BART-base, Training Domain=Consumer, Setup=12023.05 | 68.44 | 24.07 |