Semantic Retrieval on ABCD v1 (test)
0Avg Cost per QueryMIPS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MIPSCondition=account_access2024.06 | 0 | 96.1 | |
| MIPSCondition=single_item_query2024.06 | 0 | 26.6 | |
| UDFCondition=account_access2024.06 | 0.03 | — | |
| UDFCondition=single_item_query2024.06 | 0.03 | — | |
| UQECondition=account_access2024.06 | 0.03 | — | |
| UQECondition=single_item_query2024.06 | 0.03 | — | |
| lc-gpt-4-turboCondition=account_access2024.06 | 0.76 | — | |
| lc-gpt-4-turboCondition=single_item_query2024.06 | 0.76 | — | |
| lc-claude-3-opusCondition=account_access2024.06 | 1.23 | — | |
| lc-claude-3-opusCondition=single_item_query2024.06 | 1.23 | — |