Cross-Cultural Recipe Adaptation on RecetasDeLaAbuel@ 500 source recipes
74.2Lexical SimilarityJINA-ES
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| JINA-ESMethod Category=IR2025.07 | 74.2 | 93.7 | 45.9 | 51.1 | 29.5 | |
| CARROT-MMRMethod Category=IR2025.07 | 74.1 | 94.1 | 52.7 | 50.3 | 29.8 | |
| CARROTMethod Category=IR2025.07 | 73.5 | 92.5 | 46.2 | 51.2 | 30.1 | |
| CARRIAGE–QwenMethod Category=Ours2025.07 | 62.8 | 67.6 | 30.3 | 59 | 34.2 | |
| CARRIAGE–LLaMAMethod Category=Ours2025.07 | 57.7 | 73.9 | 26.9 | 46.3 | 44.2 | |
| Llama3.1-8BMethod Category=Closed-book LLMs2025.07 | 55.7 | 66.7 | 23.2 | 45.1 | 40.4 | |
| Qwen2.5-7BMethod Category=Closed-book LLMs2025.07 | 55.1 | 53.1 | 24.7 | 40.4 | 43.9 | |
| Gemma2-9BMethod Category=Closed-book LLMs2025.07 | 53.8 | 63.9 | 19.6 | 46.8 | 37 | |
| CARROT-MMR-Qwen RAGMethod Category=RAG2025.07 | 53.2 | 53.6 | 21.2 | 40.2 | 44.8 | |
| CARROT-LLaMA RAGMethod Category=RAG2025.07 | 52.5 | 76.5 | 15.2 | 38.5 | 54.5 | |
| CARROT-MMR-LLaMA RAGMethod Category=RAG2025.07 | 52 | 74.8 | 16.4 | 39.3 | 54.5 | |
| Vanilla-LLaMA RAGMethod Category=RAG2025.07 | 51.8 | 74.8 | 15.5 | 38.3 | 55.1 |