Sentence-level attribution on ELI5 (test)
81.9Citation RecallATTNUNION
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ATTNUNIONBackbone=Qwen2 7B, Base generation method=ATTRFIRST2024.12 | 81.9 | 64.8 | 72.3 | |
| ATTRFIRSTBackbone=Qwen2 7B2024.12 | 69.3 | 69.1 | 69.2 | |
| ATTNUNIONBackbone=Qwen2 7B, Base generation method=SELFCITATION2024.12 | 39.4 | 29.3 | 33.6 | |
| CCIBackbone=Qwen2 7B, Base generation method=SELFCITATION2024.12 | 35.7 | 18.9 | 24.7 | |
| SELFCITATIONBackbone=Qwen2 7B2024.12 | 31.1 | 30.1 | 30.6 | |
| ATTNUNIONBackbone=Llama2 7B, Base generation method=SELFCITATION2024.12 | 28.1 | 26.9 | 27.5 | |
| CCIBackbone=Llama2 7B, Base generation method=SELFCITATION2024.12 | 26.2 | 29.1 | 27.6 | |
| HSSAVGBackbone=Qwen2 7B, Base generation method=SELFCITATION2024.12 | 24.5 | 22.4 | 23.4 | |
| SELFCITATIONBackbone=Llama2 7B2024.12 | 20.1 | 15.3 | 17.4 | |
| HSSAVGBackbone=Llama2 7B, Base generation method=SELFCITATION2024.12 | 18 | 16.1 | 17 |