Structured Response Generation on PRISM-XR User Requests Refined Stage 1.0
97Object Success RateGPT-4o
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-4oDeployment Environment=Cloud2026.02 | 97 | 2.509 | 99 | 3.611 | |
| o1Deployment Environment=Cloud2026.02 | 96 | 20.285 | 100 | 9.708 | |
| o3-miniDeployment Environment=Cloud2026.02 | 85 | 9.832 | 100 | 9.929 | |
| Llama VDeployment Environment=Edge, Backbone=Llama 3.2 Vision 11B2026.02 | 29 | 3.835 | 1 | 4.469 | |
| LLaVADeployment Environment=Edge, Backbone=LLaVA 13B2026.02 | 1 | 7.192 | 0 | 10.345 |