Text Style Transfer on Treasury style domain
50.46BLEUSimilar 5-shot finetuning
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Similar 5-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Retrieval strategy=Similar2026.02 | 50.46 | 87.6 | |
| Similar 5-shot finetuning w/ terminology and name retrievalBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Retrieval strategy=Similar, Terminology and name retrieval=true2026.02 | 50.25 | 89.4 | |
| Similar 3-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=3, Retrieval strategy=Similar2026.02 | 47.79 | 82 | |
| Random 5-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Retrieval strategy=Random2026.02 | 45.22 | 81.2 | |
| Random 3-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=3, Retrieval strategy=Random2026.02 | 44.41 | 79.6 | |
| Zero-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=02026.02 | 41.43 | 82.6 | |
| APE with MarianBackbone=Marian2026.02 | 36.37 | 62.1 | |
| 5-shot ICL w/ terminology and name retrievalBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Terminology and name retrieval=true2026.02 | 26.69 | 72.9 | |
| 5-shot ICLBackbone=Llama-3.1-8B-Instruct, Number of shots=52026.02 | 24.72 | 54.1 |