Natural Language Explanation Generation on DBLP
0.95SimilarityGraphNarrator
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| GraphNarratorBackbone=LLaMA3.1 8B2024.10 | 0.95 | 0.155 | 0.108 | 0.085 | 0.354 | — | — | — | — | |
| GPT-4o2024.10 | 0.82 | 0.142 | 0.101 | 0.085 | 0.385 | — | — | — | — | |
| SMV2024.10 | 0.76 | 0.139 | 0.098 | 0.082 | 0.419 | — | — | — | — | |
| GPT-3.5 Turbo2024.10 | 0.71 | 0.136 | 0.11 | 0.084 | 0.402 | — | — | — | — | |
| LLaMA3.1 8B2024.10 | 0.63 | 0.139 | 0.109 | 0.077 | 0.381 | — | — | — | — | |
| GPT-4o2024.10 | — | — | — | — | — | 4.2 | 4.5 | 3.6 | 3.6 | |
| GraphNarratorBackbone=LLaMA-3.1-8B2024.10 | — | — | — | — | — | 4.5 | 4.8 | 5.4 | 4.3 | |
| SMV2024.10 | — | — | — | — | — | 3.8 | 4.1 | 3.4 | 3.7 |