Summarization on XSUM in-domain (test)
20D3 ScoreDrICL
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DrICLBackbone=Llama-2-7b-chat-hf, k=02025.01 | 20 | 22 | 33 | |
| DrICLBackbone=Llama-2-7b-chat-hf, k=32025.01 | 20 | 23 | 34 | |
| DrICLBackbone=Llama-2-7b-chat-hf, k=52025.01 | 20 | 22 | 33 | |
| ITBackbone=Llama-2-7b-chat-hf, k=02025.01 | 19 | 22 | 31 | |
| MetaICLBackbone=Llama-2-7b-chat-hf, k=02025.01 | 19 | 23 | 30 | |
| DrICLBackbone=Llama-2-7b-chat-hf, k=12025.01 | 19 | 21 | 32 | |
| ITBackbone=Llama-2-7b-chat-hf, k=12025.01 | 18 | 18 | 29 | |
| MetaICLBackbone=Llama-2-7b-chat-hf, k=32025.01 | 18 | 23 | 30 | |
| MetaICLBackbone=Llama-2-7b-chat-hf, k=52025.01 | 18 | 22 | 29 | |
| ITBackbone=Llama-2-7b-chat-hf, k=32025.01 | 17 | 18 | 27 | |
| ITBackbone=Llama-2-7b-chat-hf, k=52025.01 | 16 | 18 | 28 | |
| MetaICLBackbone=Llama-2-7b-chat-hf, k=12025.01 | 15 | 22 | 31 | |
| NFTBackbone=Llama-2-7b-chat-hf, k=02025.01 | 8 | 14 | 17 | |
| NFTBackbone=Llama-2-7b-chat-hf, k=12025.01 | 8 | 17 | 14 | |
| NFTBackbone=Llama-2-7b-chat-hf, k=32025.01 | 7 | 9 | 11 | |
| NFTBackbone=Llama-2-7b-chat-hf, k=52025.01 | 4 | 12 | 7 |