API Latency Measurement on Single 500 B / 1 KB message Round 1 1.0 (inference)
753Mean Latency (ms)Mistral 3B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Mistral 3BSecurity Protocol=Direct, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 753 | 55 | 1 | |
| Mistral 3BSecurity Protocol=TEE Proxy, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 756 | 52 | 1 | |
| Mistral 8BSecurity Protocol=Direct, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 901 | 46 | 1 | |
| Mistral 8BSecurity Protocol=TEE Proxy, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 1,060 | 123 | 1.18 | |
| Mistral 3BSecurity Protocol=TLS notary, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 1,330 | 110 | 1.77 | |
| Mistral 8BSecurity Protocol=TLS notary, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 1,590 | 135 | 1.77 | |
| Claude-Haiku-4.5Security Protocol=Direct, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 1,800 | 103 | 1 | |
| Claude-Haiku-4.5Security Protocol=TEE Proxy, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 1,970 | 177 | 1.09 | |
| OpenAI GPT-4oSecurity Protocol=Direct, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 2,180 | 96 | 1 | |
| OpenAI GPT-4oSecurity Protocol=TEE Proxy, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 2,290 | 89 | 1.05 | |
| Claude-Haiku-4.5Security Protocol=TLS notary, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 2,460 | 204 | 1.37 | |
| OpenAI GPT-4oSecurity Protocol=TLS notary, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 3,300 | 437 | 1.51 | |
| Claude-Sonnet-4.5Security Protocol=Direct, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 4,590 | 166 | 1 | |
| Claude-Sonnet-4.5Security Protocol=TEE Proxy, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 4,680 | 232 | 1.02 | |
| Claude-Sonnet-4.5Security Protocol=TLS notary, Prompt Size=500 B request / 1 KB response, Round=12025.12 | 5,340 | 155 | 1.16 |