List your company
ResearchFormerly WizWand

Inference Throughput on BioASQ (Hallucination Detection)

5,351Inference Throughput (Samples/sec)Max Pooling
-213.90481,230.83012,675.5654,120.2999May 9, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Max PoolingModel=LLaMA-3.1-8B2026.055,351
Mean PoolingModel=LLaMA-3.1-8B2026.054,649
HaMI (Original)Model=LLaMA-3.1-8B2026.054,096
Mean PoolingModel=Mistral-Nemo-Instruct (12B)2026.053,657
Max PoolingModel=Mistral-Nemo-Instruct (12B)2026.053,512
Mean PoolingModel=LLaMA-3.3-Instruct-70B2026.052,402
HaMI (Original)Model=Mistral-Nemo-Instruct (12B)2026.052,378
Max PoolingModel=LLaMA-3.3-Instruct-70B2026.052,363
HaMI (Original)Model=LLaMA-3.3-Instruct-70B2026.052,208
HaMI (SP)Model=LLaMA-3.3-Instruct-70B2026.050.19
HaMI (SP)Model=LLaMA-3.1-8B2026.050.17
HaMI (SP)Model=Mistral-Nemo-Instruct (12B)2026.050.13