Cause Span Extraction on RECCON-IEMO (Fold 3)
46.2EM (Positive)MuTECCSE
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MuTECCSETrain Fold=Fold3(DD), Conversational Context=With cc2022.11 | 46.2 | 22.66 | 76.64 | 97.08 | 92.42 | |
| MuTECCSETrain Fold=Fold2(DD), Conversational Context=With cc2022.11 | 43.52 | 19.55 | 77.71 | 96.63 | 91.91 | |
| Two StepTrain Fold=Fold3(DD), Conversational Context=With cc2022.11 | 36.48 | 27.12 | 59.05 | 97.64 | 93.61 | |
| MuTECCSETrain Fold=Fold3(DD), Conversational Context=Without cc2022.11 | 36.3 | 22.11 | 57.74 | 79.48 | 67.45 | |
| Two StepTrain Fold=Fold2(DD), Conversational Context=With cc2022.11 | 34.44 | 20.77 | 58.55 | 97.11 | 92.87 | |
| SpanBERTTrain Fold=Fold3(DD), Conversational Context=With cc2022.11 | 32.87 | — | 62.7 | 99.54 | 95.11 | |
| MuTECCSETrain Fold=Fold1 (DD), Causal Context=w/o CC2022.11 | 30.52 | 27.3 | 50.68 | 72.63 | 58.16 | |
| MuTECCSETrain Fold=Fold1 (DD), Causal Context=w/ CC2022.11 | 30.32 | 25.3 | 53.62 | 97.96 | 94.4 | |
| MuTECCSETrain Fold=Fold2(DD), Conversational Context=Without cc2022.11 | 30.28 | 22.29 | 50.68 | 81.26 | 69.42 | |
| MuTECE2ETrain Fold=Fold1 (DD), Causal Context=w/ CC2022.11 | 30.11 | 17.02 | 52.75 | 96.8 | 93.97 | |
| Two StepTrain Fold=Fold2(DD), Conversational Context=Without cc2022.11 | 28.98 | 23.67 | 51.5 | 81.91 | 74.7 | |
| MuTECE2ETrain Fold=Fold1 (DD), Causal Context=w/o CC2022.11 | 26.78 | 30.78 | 47.32 | 75.66 | 59.78 | |
| Two StepTrain Fold=Fold3(DD), Conversational Context=Without cc2022.11 | 26.3 | 24.64 | 44.71 | 88.27 | 79.84 | |
| RoBERTa-baseTrain Fold=Fold3(DD), Conversational Context=With cc2022.11 | 24.35 | — | 53.46 | 97.84 | 94.08 | |
| SpanBERTTrain Fold=Fold1 (DD), Causal Context=w/ CC2022.11 | 24.07 | — | 40.57 | 96.28 | 92.41 | |
| Two StepTrain Fold=Fold1 (DD), Causal Context=w/ CC2022.11 | 23.56 | 28.18 | 35.6 | 94.8 | 92.4 | |
| Two StepTrain Fold=Fold1 (DD), Causal Context=w/o CC2022.11 | 18.56 | 26.86 | 34.12 | 86.6 | 75.84 | |
| SpanBERTTrain Fold=Fold3(DD), Conversational Context=Without cc2022.11 | 17.41 | — | 31.75 | 91.85 | 84.86 | |
| SpanBERTTrain Fold=Fold1 (DD), Causal Context=w/o CC2022.11 | 16.2 | — | 30.22 | 86.95 | 77.25 | |
| RoBERTa-baseTrain Fold=Fold3(DD), Conversational Context=Without cc2022.11 | 14.54 | — | 26.51 | 93.68 | 87.79 | |
| RoBERTa-baseTrain Fold=Fold1 (DD), Causal Context=w/ CC2022.11 | 10.93 | — | 28.26 | 95.47 | 90.81 | |
| RoBERTa-baseTrain Fold=Fold1 (DD), Causal Context=w/o CC2022.11 | 9.81 | — | 18.59 | 91.82 | 84.83 |