Knowledge Retrieval on STARK-PRIME official (test)
18.44Hit@1AVATAR
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AVATAR2024.06 | 18.44 | 36.73 | 39.31 | 26.73 | |
| ReAct2024.06 | 15.28 | 31.95 | 33.63 | 22.76 | |
| multi-ada-0022024.06 | 15.1 | 33.56 | 38.05 | 23.49 | |
| Reflexion2024.06 | 14.28 | 34.99 | 38.52 | 24.82 | |
| ada-0022024.06 | 12.63 | 31.49 | 36 | 21.41 | |
| QAGNN2024.06 | 8.85 | 21.35 | 29.63 | 14.73 | |
| AVATAR-CAblation=Removes the comparator2024.06 | 8.82 | 23.82 | 30.32 | 16.2 | |
| DPR2024.06 | 4.46 | 21.85 | 30.13 | 12.38 |