Text Style Transfer on NCBI style domain
50.37BLEUSimilar 5-shot finetuning w/ terminology and name retrieval
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Similar 5-shot finetuning w/ terminology and name retrievalBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Retrieval strategy=Similar, Terminology and name retrieval=true2026.02 | 50.37 | 87.2 | |
| Similar 5-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Retrieval strategy=Similar2026.02 | 49.96 | 83.1 | |
| Similar 3-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=3, Retrieval strategy=Similar2026.02 | 49.01 | 77.6 | |
| Random 5-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Retrieval strategy=Random2026.02 | 46.3 | 89.6 | |
| Random 3-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=3, Retrieval strategy=Random2026.02 | 42.07 | 82.3 | |
| Zero-shot finetuningBackbone=Llama-3.1-8B-Instruct, Number of shots=02026.02 | 39.3 | 74.2 | |
| APE with MarianBackbone=Marian2026.02 | 35.95 | 65.9 | |
| 5-shot ICL w/ terminology and name retrievalBackbone=Llama-3.1-8B-Instruct, Number of shots=5, Terminology and name retrieval=true2026.02 | 29.31 | 58.6 | |
| 5-shot ICLBackbone=Llama-3.1-8B-Instruct, Number of shots=52026.02 | 27.87 | 46.2 |