Qwen3 Family Inference Performance (PyTorch Workflow)
1.16Model Load Time (s)CryptoTensors
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CryptoTensorsModel=Qwen3-0.6B, Configuration=CryptoTensors-Unencrypted2025.12 | 1.16 | 0.049 | 22.59 | 3,234.3 | 1.42 | |
| SafetensorsModel=Qwen3-0.6B, Configuration=Safetensors2025.12 | 1.169 | 0.05 | 23.19 | 3,228.3 | 1.42 | |
| CryptoTensorsModel=Qwen3-1.7B, Configuration=CryptoTensors-Unencrypted2025.12 | 1.699 | 0.05 | 22.77 | 5,761.57 | 3.25 | |
| SafetensorsModel=Qwen3-1.7B, Configuration=Safetensors2025.12 | 1.76 | 0.05 | 22.43 | 6,791.31 | 3.25 | |
| CryptoTensorsModel=Qwen3-4B, Configuration=CryptoTensors-Unencrypted2025.12 | 2.613 | 0.048 | 22.29 | 6,336.77 | 7.54 | |
| SafetensorsModel=Qwen3-4B, Configuration=Safetensors2025.12 | 2.649 | 0.05 | 21.89 | 6,145.21 | 7.54 | |
| CryptoTensorsModel=Qwen3-0.6B, Configuration=CryptoTensors-Encrypted2025.12 | 2.713 | 0.053 | 22.03 | 4,150.58 | 1.42 | |
| SafetensorsModel=Qwen3-8B, Configuration=Safetensors2025.12 | 4.563 | 0.049 | 22.01 | 5,415.5 | 15.31 | |
| CryptoTensorsModel=Qwen3-8B, Configuration=CryptoTensors-Unencrypted2025.12 | 4.674 | 0.051 | 22.01 | 5,401.36 | 15.31 | |
| CryptoTensorsModel=Qwen3-1.7B, Configuration=CryptoTensors-Encrypted2025.12 | 4.747 | 0.052 | 22.47 | 7,926.7 | 3.25 | |
| CryptoTensorsModel=Qwen3-14B, Configuration=CryptoTensors-Unencrypted2025.12 | 9.388 | 0.069 | 15.8 | 5,778.37 | 27.56 | |
| SafetensorsModel=Qwen3-14B, Configuration=Safetensors2025.12 | 9.558 | 0.072 | 15.63 | 5,768.52 | 27.56 | |
| CryptoTensorsModel=Qwen3-4B, Configuration=CryptoTensors-Encrypted2025.12 | 10.552 | 0.049 | 22.03 | 8,888.01 | 7.54 | |
| CryptoTensorsModel=Qwen3-32B, Configuration=CryptoTensors-Unencrypted2025.12 | 20.365 | 0.135 | 10.2 | 6,146.98 | 61.08 | |
| SafetensorsModel=Qwen3-32B, Configuration=Safetensors2025.12 | 21.227 | 0.136 | 10.29 | 6,138.77 | 61.08 | |
| CryptoTensorsModel=Qwen3-8B, Configuration=CryptoTensors-Encrypted2025.12 | 25.569 | 0.049 | 22.34 | 8,877.39 | 15.31 | |
| CryptoTensorsModel=Qwen3-14B, Configuration=CryptoTensors-Encrypted2025.12 | 50.171 | 0.069 | 16.08 | 9,341.28 | 27.56 | |
| CryptoTensorsModel=Qwen3-32B, Configuration=CryptoTensors-Encrypted2025.12 | 107.714 | 0.129 | 10.36 | 9,753.41 | 61.08 |