List your company
ResearchFormerly WizWand

Machine Reading Comprehension on SQuAD 1.1 (test)

89.898EMXLNet
14.2920833.9205453.54973.17746May 8, 2017Mar 15, 2018Jan 21, 2019Nov 29, 2019Oct 5, 2020Aug 13, 2021Jun 21, 2022
Updated 8mo ago

Evaluation results

MethodLinks
XLNetModel Configuration=single model2019.0689.89895.08
XLNet+DSCBackbone=XLNet, Loss Function=DSC (Dice Soft Loss)2019.1189.7995.77
XLNet+DLBackbone=XLNet, Loss Function=Dice Loss2019.1189.1395.36
XLNetBackbone=XLNet2019.1188.9594.52
XLNet+FLBackbone=XLNet, Loss Function=Focal Loss2019.1188.994.55
BERTModel Configuration=ensemble2019.0687.43393.294
BERT+DSCBackbone=BERT, Loss Function=DSC (Dice Soft Loss)2019.1185.3491.97
BERTModel Configuration=single model2019.0685.08391.835
BERT+DLBackbone=BERT, Loss Function=Dice Loss2019.1184.8391.86
BERT+FLBackbone=BERT, Loss Function=Focal Loss2019.1184.6791.25
BERTBackbone=BERT2019.1184.190.9
R-net++Model Type=Ensemble Model2017.0582.688.5
Hybrid AoA Reader++Model Type=Ensemble Model2017.0582.589.3
QANetdata augmentation=true2018.0982.589.3
SLQA++Model Type=Ensemble Model2017.0582.488.6
R.M-ReaderModel Type=Ensemble Model2017.0582.388.5
HumanModel Type=Performance Benchmark2017.0582.391.2
AttentionReader++Model Type=Ensemble Model2017.0581.888.2
BSEModel Type=Ensemble Model2017.058187.4
SLQA++Model Type=Single Model2017.0580.487
Hybrid AoA Reader++Model Type=Single Model2017.058087.3
R-net++Model Type=Single Model2017.0579.986.5
SANModel Type=Ensemble Model2017.0579.686.5
R.M-ReaderModel Type=Single Model2017.0579.586.6
R.M-Reader2018.0979.586.6
FusionNetModel Type=Ensemble Model2017.057986
DCN+Model Type=Ensemble Model2017.0578.886
BSEModel Type=Single Model2017.0578.685.8
RaSoR+TR+LM2018.0977.684.2
Pre-trained_T5Backbone=T5-Small (T5_1.0)2022.0677.586
AttentionReader++Model Type=Single Model2017.0577.384.9
SANModel Type=Single Model2017.0576.884.4
SAN2018.0976.884.4
KAR2018.0976.183.5
FusionNetModel Type=Single Model2017.057683.9
FusionNet2018.097683.9
DCN+Model Type=Single Model2017.0575.183.1
QANetBackbone=QANet2019.1173.682.7
Wiki 10KBackbone=T5-Small2022.0667.176.9
LIMEBackbone=T5-Small2022.0650.462.1
DyckBackbone=T5-Small2022.0650.362.4
Nons_SummaryBackbone=T5-Small2022.0648.460.1
SetBackbone=T5-Small2022.0648.360
LR BaselineModel Type=Single Model2017.0540.451
IdentityBackbone=T5-Small2022.0626.135.4
Random_InitBackbone=T5-Small2022.0617.225.2