Single-hop QA on Assembly Knowledge Graph QA (test)
82.1AccuracyAssemMate
Evaluation results
| Method | Links | |
|---|---|---|
| AssemMateIn-context Length=125, Infer Time (s)=0.482025.09 | 82.1 | |
| Text Triple + Fine-tuningIn-context Length=3510, Infer Time (s)=1.512025.09 | 78.4 | |
| Document + Fine-tuningIn-context Length=764, Infer Time (s)=0.832025.09 | 75.8 | |
| Text TripleIn-context Length=3510, Infer Time (s)=1.502025.09 | 75.7 | |
| DocumentIn-context Length=764, Infer Time (s)=0.852025.09 | 50 |