Semantic Retrieval on Clevr v1 (test)
0Avg Cost per QueryMIPS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MIPSCondition=obj_count < 42024.06 | 0 | 2.3 | |
| MIPSCondition=# spheres > 32024.06 | 0 | 14.5 | |
| UDFCondition=obj_count < 42024.06 | 0.08 | — | |
| UDFCondition=# spheres > 32024.06 | 0.08 | — | |
| UQECondition=obj_count < 42024.06 | 0.08 | — | |
| UQECondition=# spheres > 32024.06 | 0.08 | — | |
| lc-claude-3-opusCondition=obj_count < 42024.06 | 0.21 | — | |
| lc-claude-3-opusCondition=# spheres > 32024.06 | 0.21 | — | |
| lc-gpt-4-turboCondition=obj_count < 42024.06 | 0.38 | — | |
| lc-gpt-4-turboCondition=# spheres > 32024.06 | 0.38 | — |