Inference Throughput on SQuAD (Hallucination Detection)
5,303Inference Throughput (Samples/sec)Max Pooling
Evaluation Results
| Method | Links | |
|---|---|---|
| Max PoolingModel=LLaMA-3.1-8B2026.05 | 5,303 | |
| Mean PoolingModel=LLaMA-3.1-8B2026.05 | 5,274 | |
| Max PoolingModel=Mistral-Nemo-Instruct (12B)2026.05 | 4,288 | |
| Mean PoolingModel=Mistral-Nemo-Instruct (12B)2026.05 | 4,237 | |
| HaMI (Original)Model=LLaMA-3.1-8B2026.05 | 3,402 | |
| HaMI (Original)Model=Mistral-Nemo-Instruct (12B)2026.05 | 3,092 | |
| Mean PoolingModel=LLaMA-3.3-Instruct-70B2026.05 | 2,637 | |
| Max PoolingModel=LLaMA-3.3-Instruct-70B2026.05 | 2,585 | |
| HaMI (Original)Model=LLaMA-3.3-Instruct-70B2026.05 | 2,436 | |
| HaMI (SP)Model=Mistral-Nemo-Instruct (12B)2026.05 | 0.12 | |
| HaMI (SP)Model=LLaMA-3.3-Instruct-70B2026.05 | 0.1 | |
| HaMI (SP)Model=LLaMA-3.1-8B2026.05 | 0.09 |