Summarization on CNN-DM (ROUGE-L, BERTScore, Context Influence, FactKB)
149.33Context InfluenceCID (Gemma 2 9B IT)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CID (Gemma 2 9B IT)Decoding lambda=1.52024.10 | 149.33 | 21.6 | 75.22 | 96.31 | |
| CID (OPT 1.3B)Decoding lambda=1.52024.10 | 140 | 18.82 | 72.88 | 89.22 | |
| CID (LLaMA 3 8B IT)Decoding lambda=1.52024.10 | 134.23 | 23.53 | 75.44 | 97.95 | |
| CID (GPT-Neo 1.3B)Decoding lambda=1.52024.10 | 130.47 | 18.17 | 72.66 | 92.9 | |
| CID (LLaMA 3 8B)Decoding lambda=1.52024.10 | 98.99 | 19.22 | 72.89 | 87.86 | |
| CID (Gemma 2 9B IT)Decoding lambda=1.02024.10 | 93.17 | 21.18 | 75.09 | 96.3 | |
| CID (LLaMA 3 8B IT)Decoding lambda=1.02024.10 | 92.25 | 22.53 | 73.35 | 98.26 | |
| CID (OPT 1.3B)Decoding lambda=1.02024.10 | 85.23 | 16.84 | 72.09 | 88.24 | |
| CID (GPT-Neo 1.3B)Decoding lambda=1.02024.10 | 77.87 | 15.97 | 71.54 | 93.66 | |
| CID (LLaMA 3 8B)Decoding lambda=1.02024.10 | 64.61 | 17.42 | 72.17 | 85.6 | |
| CID (Gemma 2 9B IT)Decoding lambda=0.52024.10 | 41.76 | 14.49 | 71.73 | 87.56 | |
| CID (LLaMA 3 8B IT)Decoding lambda=0.52024.10 | 35 | 15.18 | 71.89 | 87.22 | |
| CID (OPT 1.3B)Decoding lambda=0.52024.10 | 17.5 | 9.73 | 68.06 | 75.28 | |
| CID (LLaMA 3 8B)Decoding lambda=0.52024.10 | 15.97 | 10.34 | 68.06 | 69.18 | |
| CID (GPT-Neo 1.3B)Decoding lambda=0.52024.10 | 15.16 | 9.73 | 68.06 | 75.28 |