Question Answering on CausalQA Technology Setup 1 (test)
85.54F1Prompt-based LP-FT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Consumer2023.05 | 85.54 | 55.09 | |
| Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Industrial2023.05 | 85.34 | 65.57 | |
| Prompt-based LP-FTBackbone=SpanBERT-base, Train Domain=Technical2023.05 | 81.98 | 58.08 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Industrial, Setup=12023.05 | 79 | 57.37 | |
| Fine-tuningBackbone=RoBERTa-base, Training Domain=Industrial, Setup=12023.05 | 77.91 | 48.35 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Consumer, Setup=12023.05 | 77.46 | 49.54 | |
| Prompt-based LP-FTBackbone=RoBERTa-base, Training Domain=Technology, Setup=12023.05 | 76.76 | 53.54 | |
| Fine-tuningBackbone=RoBERTa-base, Training Domain=Technology, Setup=12023.05 | 76.49 | 54.04 | |
| Fine-tuningBackbone=RoBERTa-base, Training Domain=Consumer, Setup=12023.05 | 74.63 | 49.07 | |
| Prompt-based LP-FTBackbone=BART-base, Training Domain=Technology, Setup=12023.05 | 74.02 | 34.34 | |
| Prompt-based LP-FTBackbone=BART-base, Training Domain=Industrial, Setup=12023.05 | 73.47 | 37.2 | |
| Prompt-based LP-FTBackbone=BART-base, Training Domain=Consumer, Setup=12023.05 | 72 | 28.24 | |
| Fine-tuningBackbone=BART-base, Training Domain=Technology, Setup=12023.05 | 71.79 | 33.83 | |
| Fine-tuningBackbone=BART-base, Training Domain=Industrial, Setup=12023.05 | 69.63 | 27.27 | |
| Fine-tuningBackbone=BART-base, Training Domain=Consumer, Setup=12023.05 | 68.61 | 23.61 |