Knowledge Graph Question Answering on CR-LT
72.12AccuracyFiDeLiS
Evaluation Results
| Method | Links | |
|---|---|---|
| FiDeLiSLLM Backbone=gpt-4-turbo, Category=Prompting - LLM + KG2024.05 | 72.12 | |
| FiDeLiSLLM Backbone=gpt-3.5-turbo, Category=Prompting - LLM + KG2024.05 | 67.34 | |
| TOGLLM Backbone=gpt-4-turbo, Category=Prompting - LLM + KG2024.05 | 67.24 | |
| TOGLLM Backbone=gpt-3.5-turbo, Category=Prompting - LLM + KG2024.05 | 62.48 | |
| RoGCategory=Finetuning - LLM + KG2024.05 | 60.32 | |
| COTLLM Backbone=gpt-4-turbo, Category=Prompting - LLM Only2024.05 | 45.42 | |
| Few-shotLLM Backbone=gpt-4-turbo, Category=Prompting - LLM Only2024.05 | 43.61 | |
| IOLLM Backbone=gpt-4-turbo, Category=Prompting - LLM Only2024.05 | 37.74 | |
| COTLLM Backbone=gpt-3.5-turbo, Category=Prompting - LLM Only2024.05 | 37.42 | |
| Few-shotLLM Backbone=gpt-3.5-turbo, Category=Prompting - LLM Only2024.05 | 36.61 | |
| Zero-shotLLM Backbone=gpt-3.5-turbo, Category=Prompting - LLM Only2024.05 | 32.74 |