Question Answering on TrecQA clean (test)
87.7MRRRank MP-CNN
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Rank MP-CNNNumber of Parameters=10M, Training Time=130s2017.07 | 87.7 | 80.1 | — | |
| HyperQANumber of Parameters=90K, Training Time=12s2017.07 | 86.5 | 78.4 | — | |
| AP-CNN2017.07 | 85.1 | 75.3 | — | |
| MP-CNNNumber of Parameters=10M, Training Time=1412017.07 | 83.6 | 77.7 | — | |
| QA-LSTM/CNN2017.07 | 83.2 | 72.8 | — | |
| HD-LSTM2019.06 | 75.11 | 67.44 | — | |
| NLP-Capsule2019.06 | 74.16 | 77.73 | — | |
| Capsule-Zhao2019.06 | 70.12 | 73.63 | — | |
| CNTN2019.06 | 69.78 | 65.8 | — | |
| CNN2019.06 | 68.8 | 66.91 | — | |
| MV-LSTM2019.06 | 68.24 | 64.88 | — | |
| NTN-LSTM2019.06 | 67.72 | 63.4 | — | |
| LSTMNumber of layers=1 layer2019.06 | 66.85 | 62.04 | — | |
| CNN + LRn-gram features=bigram2019.06 | 66.13 | 56.93 | — | |
| LSTM2019.06 | 65.33 | 59.75 | — | |
| CNN + LRn-gram features=unigram2019.06 | 63.29 | 54.7 | — | |
| SPD_{Ref}^{F1}Manifold=SPD, Metric=F1 (Finsler), Transformation=Reflection, Dimensions=14x14 (105 free parameters)2021.10 | 59.6 | — | 42.1 | |
| SPD_{Sca}^RManifold=SPD, Metric=R (Riemannian), Transformation=Scaling, Dimensions=14x14 (105 free parameters)2021.10 | 58.7 | — | 41.4 | |
| SPD_{Rot}^RManifold=SPD, Metric=R (Riemannian), Transformation=Rotation, Dimensions=14x14 (105 free parameters)2021.10 | 58.1 | — | 43.6 | |
| HyperbolicManifold=Hyperbolic, Transformation=Tangent space projection, Dimensions=1052021.10 | 58 | — | 39.3 | |
| SPD_{Ref}^RManifold=SPD, Metric=R (Riemannian), Transformation=Reflection, Dimensions=14x14 (105 free parameters)2021.10 | 57.3 | — | 40.7 | |
| SPD_R^RManifold=SPD, Metric=R (Riemannian), Dimensions=14x14 (105 free parameters)2021.10 | 57.1 | — | 38.6 | |
| EuclideanManifold=Euclidean, Transformation=Linear, Dimensions=1052021.10 | 55.9 | — | 41 | |
| SPD_{F1}^RManifold=SPD, Metric=F1 (Finsler), Dimensions=14x14 (105 free parameters)2021.10 | 55.4 | — | 37.1 |