Exact Match (EM) on Question Answering on Qasper
65EM ScoreFullKV
Evaluation results
| Method | Links | |
|---|---|---|
| FullKVModel=LAM82026.04 | 65 | |
| MAML-6LModel=LAM82026.04 | 64 | |
| MGAModel=LAM82026.04 | 60 | |
| MLMA-2LModel=LAM82026.04 | 60 | |
| MLPModel=LAM82026.04 | 60 | |
| w/ V (ℓ1)Model=LAM82026.04 | 58 | |
| w/ V (ℓ2)Model=LAM82026.04 | 58 | |
| MLMA-4LModel=LAM82026.04 | 57 | |
| w/o VModel=LAM82026.04 | 54 | |
| FullKVModel=GEM72026.04 | 50 | |
| MAML-6LModel=GEM72026.04 | 40 | |
| MGAModel=GEM72026.04 | 38 | |
| MLMA-4LModel=GEM72026.04 | 32 | |
| MLPModel=GEM72026.04 | 28 | |
| MLMA-2LModel=GEM72026.04 | 27 | |
| w/o VModel=GEM72026.04 | 6 | |
| w/ V (ℓ1)Model=GEM72026.04 | 6 | |
| w/ V (ℓ2)Model=GEM72026.04 | 5 |