Tool Use on APIBench OOD TorchHub
5.91Hallucination RateGorilla
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GorillaTraining Setting=Retrieval-aware (RS), Retriever=BM252023.07 | 5.91 | 50 | |
| GorillaTraining Setting=Retrieval-aware (RS), Retriever=Oracle2023.07 | 6.99 | 93.01 | |
| ToolLLAMARetriever=Oracle2023.07 | 14.12 | 85.88 | |
| ToolLLAMARetriever=Our Retriever2023.07 | 15.7 | 51.16 | |
| GorillaTraining Setting=Zero-shot (ZS), Retriever=BM252023.07 | 17.2 | 44.62 | |
| GorillaTraining Setting=Zero-shot (ZS), Retriever=Oracle2023.07 | 39.25 | 59.14 |