Question Answering on Qasper (Precision, Recall, F1)
84PrecisionFullKV
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FullKVModel=LAM82026.04 | 84 | 61 | 71 | |
| FullKVModel=GAM72026.04 | 83 | 35 | 49 | |
| MAML-6LModel=LAM82026.04 | 69 | 85 | 76 | |
| MLPModel=LAM82026.04 | 69 | 73 | 71 | |
| MLMA-2LModel=LAM82026.04 | 67 | 81 | 73 | |
| w/ V (ℓ1)Model=LAM82026.04 | 66 | 76 | 71 | |
| w/ V (ℓ2)Model=LAM82026.04 | 66 | 76 | 71 | |
| MGAModel=LAM82026.04 | 66 | 82 | 73 | |
| w/o VModel=LAM82026.04 | 64 | 72 | 68 | |
| MLMA-4LModel=LAM82026.04 | 64 | 81 | 72 | |
| MAML-6LModel=GAM72026.04 | 58 | 41 | 48 | |
| MGAModel=GAM72026.04 | 57 | 34 | 43 | |
| MLMA-4LModel=GAM72026.04 | 50 | 25 | 33 | |
| MLPModel=GAM72026.04 | 42 | 15 | 22 | |
| MLMA-2LModel=GAM72026.04 | 40 | 15 | 22 | |
| w/o VModel=GAM72026.04 | 12 | 6 | 8 | |
| w/ V (ℓ1)Model=GAM72026.04 | 12 | 6 | 8 | |
| w/ V (ℓ2)Model=GAM72026.04 | 9 | 4 | 6 |