Recipe Recommendation on KGQA (test)
96PrecisionKERL-Recom
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| KERL-Recomstatus=fine-tuned, adapter=LoRA, base_llm=Phi-3-mini-128K2025.05 | 96 | 97.8 | 96.9 | 97.3 | |
| Llama-2status=pre-trained2025.05 | 55.7 | 82.5 | 62.7 | 71.3 | |
| Phi-3-mini-128Kstatus=pre-trained2025.05 | 27.5 | 77.8 | 27.8 | 41 | |
| Phi-2status=pre-trained2025.05 | 27.1 | 8.4 | 37.8 | 13.7 | |
| Mistralstatus=pre-trained2025.05 | 21.4 | 53.6 | 55.8 | 54.7 | |
| Llama-3.1status=pre-trained2025.05 | 14.6 | 28 | 40.6 | 33.2 | |
| internLM2status=pre-trained2025.05 | 6 | 2.4 | 5.5 | 3.4 | |
| Phi-3-mini-4Kstatus=pre-trained2025.05 | 4.7 | 19.2 | 4.4 | 7.1 |