Knowledge Graph Question Answering on WebQSP (Accuracy and Token Usage Reporting)
84.73Hits@1 AccuracyReknoS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ReknoSBase Model=Qwen 3-235B, Modules=32025.09 | 84.73 | 2,795.53 | 592.38 | |
| KG-R1Base Model=Qwen2.5-3B, Modules=12025.09 | 82.75 | 3,237.17 | 308.67 | |
| RoGBase Model=Qwen 3-235B, Modules=22025.09 | 81.68 | 960.58 | 254.31 | |
| RoGBase Model=Qwen 2.5-72B, Modules=22025.09 | 81.63 | 812.32 | 244.53 | |
| RoGBase Model=Qwen 2.5-7B, Modules=22025.09 | 79.89 | 814.61 | 246.95 | |
| PoGBase Model=Qwen 3-235B, Modules=52025.09 | 79.13 | 6,818.26 | 418.26 | |
| ToGBase Model=Qwen 3-235B, Modules=42025.09 | 75.67 | 6,831.66 | 996.12 | |
| ReknoSBase Model=Qwen 2.5-72B, Modules=32025.09 | 75.23 | 2,472.9 | 488.44 | |
| ToGBase Model=Qwen 2.5-72B, Modules=42025.09 | 74.47 | 6,810.27 | 942.91 | |
| PoGBase Model=Qwen 2.5-72B, Modules=52025.09 | 72.88 | 4,759.1 | 316.25 | |
| ToGBase Model=Qwen 2.5-7B, Modules=42025.09 | 65 | 6,455.04 | 941.52 | |
| PoGBase Model=Qwen 2.5-7B, Modules=52025.09 | 64.81 | 4,474.3 | 241.14 | |
| ReknoSBase Model=Qwen 2.5-7B, Modules=32025.09 | 61.22 | 2,822.34 | 558.43 | |
| SCBase Model=Qwen 3-235B, Modules=12025.09 | 27.6 | 2,200.2 | 677.79 | |
| CoTBase Model=Qwen 3-235B, Modules=12025.09 | 26.94 | 274.66 | 84.36 | |
| IOBase Model=Qwen 2.5-72B, Modules=12025.09 | 24.66 | 153.5 | 11.2 | |
| IOBase Model=Qwen 3-235B, Modules=12025.09 | 24.01 | 136.05 | 14.75 | |
| SCBase Model=Qwen 2.5-72B, Modules=12025.09 | 22.62 | 2,177.75 | 487.34 | |
| CoTBase Model=Qwen 2.5-72B, Modules=12025.09 | 21.84 | 271.46 | 60.16 | |
| IOBase Model=Qwen 2.5-7B, Modules=12025.09 | 21.37 | 151.59 | 9.29 | |
| SCBase Model=Qwen 2.5-7B, Modules=12025.09 | 19.26 | 2,098.01 | 407.6 | |
| CoTBase Model=Qwen 2.5-7B, Modules=12025.09 | 17.27 | 260.43 | 49.13 |