Knowledge grounding on ATLAS CC-QKV
100ACC@1AtlasKV (128-64-16)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AtlasKV (128-64-16)Steps=3e3, Number of KG Triples=10^12025.10 | 100 | 100 | |
| AtlasKV w/o HiKVPSteps=3e3, Number of KG Triples=10^12025.10 | 100 | 100 | |
| AtlasKV w/o HiKVPSteps=3e3, Number of KG Triples=10^22025.10 | 96.4 | 100 | |
| AtlasKV (128-64-16)Steps=3e3, Number of KG Triples=10^22025.10 | 89.1 | 90.9 | |
| AtlasKV w/o HiKVPSteps=3e3, Number of KG Triples=10^32025.10 | 83.6 | 96.4 | |
| AtlasKV (128-64-16)Steps=3e3, Number of KG Triples=10^32025.10 | 61.8 | 74.5 | |
| AtlasKV w/o HiKVPSteps=3e3, Number of KG Triples=10^42025.10 | 61.8 | 81.8 | |
| KBLaMSteps=3e3, Number of KG Triples=10^12025.10 | 60 | 90 | |
| KBLaMSteps=2e4, Number of KG Triples=10^12025.10 | 50 | 100 | |
| AtlasKV (128-64-16)Steps=3e3, Number of KG Triples=10^42025.10 | 40 | 54.5 | |
| KBLaMSteps=2e4, Number of KG Triples=10^22025.10 | 23.6 | 56.4 | |
| KBLaMSteps=3e3, Number of KG Triples=10^22025.10 | 21.8 | 38.2 | |
| KBLaMSteps=3e3, Number of KG Triples=10^32025.10 | 12.7 | 23.6 | |
| KBLaMSteps=2e4, Number of KG Triples=10^32025.10 | 10.9 | 21.8 | |
| KBLaMSteps=3e3, Number of KG Triples=10^42025.10 | 3.6 | 10.9 | |
| KBLaMSteps=2e4, Number of KG Triples=10^42025.10 | 3.6 | 10.9 |