Relation Alignment on LEAMR 1.0 (test)
0.8803Exact Alignment PGuided Cross-Attention
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Guided Cross-AttentionGuidance=Guided, Silver Source=LEAMR2022.06 | 0.8803 | 0.8818 | 0.8811 | 0.9108 | 0.9124 | 0.9116 | 0.9187 | 1 | |
| Unguided Cross-AttentionGuidance=Unguided2022.06 | 0.8714 | 0.8759 | 0.8736 | 0.8987 | 0.9033 | 0.901 | 0.9103 | 1 | |
| LEAMR2022.06 | 0.8567 | 0.8737 | 0.8552 | 0.8874 | 0.8844 | 0.8859 | 0.9541 | 1 | |
| LEAMRRe-implemented=true2022.06 | 0.8463 | 0.8485 | 0.8474 | 0.8777 | 0.8799 | 0.8788 | 0.9198 | 1 | |
| Guided Cross-AttentionGuidance=Guided, Silver Source=ISI2022.06 | 0.8382 | 0.8339 | 0.8361 | 0.8645 | 0.86 | 0.8622 | 0.873 | 1 | |
| ISI2022.06 | 0.5928 | 0.0851 | 0.1489 | 0.6632 | 0.0952 | 0.1665 | 0.8309 | 0.098 |