Tool Use on APIBench OOD HuggingFace
0.0642Hallucination RateGorilla
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GorillaTraining Setting=Retrieval-aware (RS), Retriever=BM252023.07 | 0.0642 | 15.71 | |
| GorillaTraining Setting=Retrieval-aware (RS), Retriever=Oracle2023.07 | 0.0697 | 89.27 | |
| ToolLLAMARetriever=Oracle2023.07 | 0.0866 | 88.8 | |
| ToolLLAMARetriever=Our Retriever2023.07 | 0.106 | 16.77 | |
| GorillaTraining Setting=Zero-shot (ZS), Retriever=BM252023.07 | 0.469 | 10.51 | |
| GorillaTraining Setting=Zero-shot (ZS), Retriever=Oracle2023.07 | 0.5288 | 44.36 |