List your company
ResearchFormerly WizWand

Question Answering on NewsQA trained on SQuAD OOD (test)

52.41F1 ScoreRoBERTa+P+LPFT
32.525237.687642.8548.0124May 14, 2023
Updated 8mo ago

Evaluation results

MethodLinks
RoBERTa+P+LPFTBackbone=RoBERTa, Prompting=true, LPFT=true, Domain Adaptation=false2023.0552.41
RoBERTa+PBackbone=RoBERTa, Prompting=true, LPFT=false, Domain Adaptation=false2023.0550.97
RoBERTa+DABackbone=RoBERTa, Prompting=false, LPFT=false, Domain Adaptation=true2023.0550.31
RoBERTa+LPFTBackbone=RoBERTa, Prompting=false, LPFT=true, Domain Adaptation=false2023.0550.28
RoBERTaBackbone=RoBERTa, Prompting=false, LPFT=false, Domain Adaptation=false2023.0549.87
BART+P+LPFTBackbone=BART, Prompting=true, LPFT=true, Domain Adaptation=false2023.0544.36
BART+DABackbone=BART, Prompting=false, LPFT=false, Domain Adaptation=true2023.0544.05
BART+LPFTBackbone=BART, Prompting=false, LPFT=true, Domain Adaptation=false2023.0544.05
BART+PBackbone=BART, Prompting=true, LPFT=false, Domain Adaptation=false2023.0543.61
BARTBackbone=BART, Prompting=false, LPFT=false, Domain Adaptation=false2023.0543.49
RoBERTa+P+LPFTBackbone=RoBERTa, Prompting=true, LPFT=true, Domain Adaptation=false2023.0538.76
RoBERTa+DABackbone=RoBERTa, Prompting=false, LPFT=false, Domain Adaptation=true2023.0538.26
RoBERTa+PBackbone=RoBERTa, Prompting=true, LPFT=false, Domain Adaptation=false2023.0538.17
RoBERTa+LPFTBackbone=RoBERTa, Prompting=false, LPFT=true, Domain Adaptation=false2023.0537.95
RoBERTaBackbone=RoBERTa, Prompting=false, LPFT=false, Domain Adaptation=false2023.0537.6
BART+PBackbone=BART, Prompting=true, LPFT=false, Domain Adaptation=false2023.0536.81
BART+P+LPFTBackbone=BART, Prompting=true, LPFT=true, Domain Adaptation=false2023.0535.23
BART+DABackbone=BART, Prompting=false, LPFT=false, Domain Adaptation=true2023.0535.09
BARTBackbone=BART, Prompting=false, LPFT=false, Domain Adaptation=false2023.0533.71
BART+LPFTBackbone=BART, Prompting=false, LPFT=true, Domain Adaptation=false2023.0533.29