Compositional Reasoning on Compositional Reasoning Paraphrasing Input Ip
70.5Event Probability p(Ac) > p(Aw)CREME
Evaluation results
| Method | Links | |
|---|---|---|
| CREMEBackbone=OpenAlpaca-3B2024.02 | 70.5 | |
| CREMEBackbone=LLAMA-2-7B2024.02 | 52.9 | |
| Memory InjectionBackbone=OpenAlpaca-3B2024.02 | 43.8 | |
| OriginalBackbone=OpenAlpaca-3B2024.02 | 42.7 | |
| Memory InjectionBackbone=LLAMA-2-7B2024.02 | 40.3 | |
| OriginalBackbone=LLAMA-2-7B2024.02 | 35.7 |