Question Answering on CausalQA Consumer Setup 1 (test)
85.84F1 ScorePrompt-based LP-FT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Consumer2023.05 | 85.84 | 60.64 | |
| Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Industrial2023.05 | 85.76 | 66.66 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Industrial, Setup=12023.05 | 80.55 | 59.02 | |
| Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Technical2023.05 | 80.24 | 58.08 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Consumer, Setup=12023.05 | 78.39 | 53.24 | |
| Fine-tuningBackbone=RoBERTa-base, Training Domain=Consumer, Setup=12023.05 | 78.2 | 51.38 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Technology, Setup=12023.05 | 77.93 | 55.05 | |
| Fine-tuningBackbone=RoBERTa-base, Training Domain=Industrial, Setup=12023.05 | 77.81 | 49.45 | |
| Fine-tuningBackbone=RoBERTa-base, Training Domain=Technology, Setup=12023.05 | 75.54 | 55.05 | |
| Prompt-based LP-FTBackbone=BART-base, Training Domain=Industrial, Setup=12023.05 | 74.06 | 36.06 | |
| Prompt-based LP-FTBackbone=BART-base, Training Domain=Technology, Setup=12023.05 | 72.67 | 33.33 | |
| Prompt-based LP-FTBackbone=BART-base, Training Domain=Consumer, Setup=12023.05 | 70.65 | 25 | |
| Fine-tuningBackbone=BART-base, Training Domain=Consumer, Setup=12023.05 | 70.29 | 24.53 | |
| Fine-tuningBackbone=BART-base, Training Domain=Industrial, Setup=12023.05 | 70.11 | 31.31 | |
| Fine-tuningBackbone=BART-base, Training Domain=Technology, Setup=12023.05 | 69.89 | 30.3 |