Question Answering on HotPotQA (Hallucination and Accuracy)
97.8AccuracyCAROL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CAROLModel=GPT–5–nano, Latency (s)=2.858 ± 0.030, Cost ($)=0.0319 ± 0.0012026.05 | 97.8 | 59.1 | |
| CAROLModel=Llama–3.1–8B, Latency (s)=2.383 ± 0.0252026.05 | 96.2 | 49.7 | |
| RAGModel=GPT–5–nano, Latency (s)=1.518 ± 0.012, Cost ($)=0.1107 ± 0.0022026.05 | 86.5 | — | |
| RAGModel=Llama–3.1–8B, Latency (s)=1.281 ± 0.0112026.05 | 80.9 | — |