List your company
ResearchFormerly WizWand

QA Answer Selection on TREC Answer Selection (test)

0.875MAPComp-Clip + LM + LC + TL
0.377360.5065550.635750.764945Dec 4, 2014Sep 3, 2015Jun 2, 2016Mar 2, 2017Nov 30, 2017Aug 30, 2018May 30, 2019
Updated 8mo ago

Evaluation results

MethodLinks
Comp-Clip + LM + LC + TLLearning approach=Pointwise, Implementation=Ours2019.050.8750.94
Comp-Clip + LM + LCLearning approach=Pointwise, Implementation=Ours2019.050.8680.928
Question ClassificationImplementation=Reported2019.050.8650.904
Comp-Clip + LMLearning approach=Pointwise, Implementation=Ours2019.050.850.898
Comp-Clip + LM + LC + TLLearning approach=Listwise, Implementation=Ours2019.050.8480.902
MCANImplementation=Reported2019.050.8380.904
Comp-ClipLearning approach=Pointwise, Implementation=Ours2019.050.8350.877
Comp-Clip + LM + LCLearning approach=Listwise, Implementation=Ours2019.050.8320.88
IWAN + SCARNNImplementation=Reported2019.050.8290.875
Comp-Clip + LMLearning approach=Listwise, Implementation=Ours2019.050.8230.868
IWANImplementation=Reported2019.050.8220.899
Comp-ClipImplementation=Reported2019.050.8210.899
AP-CNNarchitecture=CNN, pooling=Attentive Pooling2016.020.7530.8511
Severyn & Moschitti (2015)2016.020.7460.808
Wang & Ittycheriah (2015)2016.020.7460.82
Comp-ClipLearning approach=Listwise, Implementation=Ours2019.050.7440.791
QA-CNNarchitecture=CNN2016.020.71470.807
Wang & Nyberg (2015)2016.020.71340.7913
AP-BILSTMarchitecture=biLSTM, pooling=Attentive Pooling2016.020.71320.8032
bigram + countTraining Set=TRAIN-ALL2014.120.71130.7846
Yih et al.Year=2013, Classifier=LCLR2014.120.70920.77
bigram + countTraining Set=TRAIN2014.120.70580.78
Yih et al.Year=2013, Classifier=BDT2014.120.6940.7894
Yih et al.Year=2013, Classifier=LR2014.120.68180.7616
Severyn and MoschittiYear=20132014.120.67810.7358
QA-BILSTMarchitecture=biLSTM2016.020.6750.7723
Yao et al.Year=20132014.120.63070.7477
Heilman and SmithYear=20102014.120.60910.6917
Wang et al.Year=20072014.120.60290.6852
Wgt Word Count2014.120.59610.6515
Wang and ManningYear=20102014.120.59510.6951
Word Count2014.120.57070.6266
Random2014.120.39650.4929