Question Answering on HotpotQA (CR, CP, CN)
4.4CR ScoreMGA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MGAModel=LAM82026.04 | 4.4 | 4.38 | 4.55 | |
| MLPModel=LAM82026.04 | 4.36 | 4.36 | 4.53 | |
| FullKVModel=GEM72026.04 | 4.16 | 4.37 | 4.8 | |
| MLMA-4LModel=LAM82026.04 | 3.78 | 3.83 | 4.08 | |
| MLMA-6LModel=LAM82026.04 | 3.74 | 3.81 | 4.03 | |
| MLMA-2LModel=LAM82026.04 | 3.73 | 3.76 | 4.03 | |
| w/o VModel=LAM82026.04 | 3.59 | 3.6 | 3.76 | |
| w/ V (ℓ2)Model=LAM82026.04 | 3.55 | 3.56 | 3.78 | |
| w/ V (ℓ1)Model=LAM82026.04 | 3.54 | 3.56 | 3.76 | |
| FullKVModel=LAM82026.04 | 3.39 | 3.74 | 4.8 | |
| MGAModel=GEM72026.04 | 2.67 | 2.63 | 2.61 | |
| MLPModel=GEM72026.04 | 2.44 | 2.44 | 2.56 | |
| MLMA-2LModel=GEM72026.04 | 1.7 | 1.71 | 1.89 | |
| w/ V (ℓ2)Model=GEM72026.04 | 1.65 | 1.69 | 1.76 | |
| w/ V (ℓ1)Model=GEM72026.04 | 1.64 | 1.67 | 1.79 | |
| w/o VModel=GEM72026.04 | 1.63 | 1.66 | 1.71 | |
| MLMA-4LModel=GEM72026.04 | 1.63 | 1.63 | 1.73 | |
| MLMA-6LModel=GEM72026.04 | 1.44 | 1.52 | 1.56 |