Reentrancy Alignment on LEAMR 1.0 (test)
56.9Exact Alignment PrecisionGuided Cross-Attention
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Guided Cross-AttentionGuidance=Guided, Silver Source=LEAMR2022.06 | 56.9 | 57.09 | 57 | 100 | |
| LEAMR2022.06 | 55.75 | 54.61 | 55.17 | 100 | |
| LEAMRRe-implemented=true2022.06 | 54.61 | 54.05 | 54.33 | 100 | |
| Unguided Cross-AttentionGuidance=Unguided2022.06 | 44.75 | 44.59 | 44.67 | 100 | |
| Guided Cross-AttentionGuidance=Guided, Silver Source=ISI2022.06 | 42.09 | 39.35 | 40.77 | 100 |