Text Style Transfer on Literary style domain
52.61BLEUSimilar 5-shot finetuning w/ terminology and name retrieval
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Similar 5-shot finetuning w/ terminology and name retrievalBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Retrieval strategy=Similar, Terminology and name retrieval=true2026.02 | 52.61 | 93.3 | |
| Similar 5-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Retrieval strategy=Similar2026.02 | 52.35 | 86.5 | |
| Similar 3-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=3, Retrieval strategy=Similar2026.02 | 48.83 | 81.2 | |
| Random 5-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Retrieval strategy=Random2026.02 | 41.42 | 72.1 | |
| Zero-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=02026.02 | 40.39 | 74.2 | |
| Random 3-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=3, Retrieval strategy=Random2026.02 | 39.96 | 73.2 | |
| APE with MarianBackbone=Marian2026.02 | 35.72 | 64.9 | |
| 5-shot ICL w/ terminology and name retrievalBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Terminology and name retrieval=true2026.02 | 26.25 | 66.9 | |
| 5-shot ICLBackbone=Llama-3.1-8B-Instruct, Number of shots=52026.02 | 25.9 | 61.3 |