Information Retrieval on 18 datasets (BEIR, LoTTE, etc.)
-0.001P@1 Precision Loss MeanPRISM
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PRISMModel=Qwen3 4B, Baseline=HF2025.10 | -0.001 | — | — | -0.003 | — | — | -0.001 | -0.005 | — | — | 0 | -0.004 | |
| PRISMModel=Qwen3 4B, Baseline=HF Offload2025.10 | -0.001 | 12.8 | 38.2 | -0.003 | 10.7 | 37.7 | -0.001 | -0.005 | 6.2 | 35.3 | 0 | -0.004 | |
| PRISM QuantModel=Qwen3 4B, Baseline=HF Quant2025.10 | 0 | 5.1 | 18.7 | -0.001 | 5.2 | 17.9 | 0 | -0.003 | 5.7 | 17.1 | 0 | -0.004 | |
| PRISMModel=Bge M3, Baseline=HF2025.10 | 0 | 8.1 | 24.6 | -0.005 | 6.2 | 22.4 | 0 | -0.004 | 4.5 | 20.5 | 0.002 | -0.007 | |
| PRISMModel=Bge M3, Baseline=HF Offload2025.10 | 0 | 52.4 | 70.9 | -0.005 | 50.9 | 70.1 | 0 | -0.004 | 49.9 | 69.3 | 0.002 | -0.007 | |
| PRISMModel=Bge MiniCPM, Baseline=HF2025.10 | 0 | 9.2 | 44.3 | -0.003 | 6.1 | 35.5 | -0.003 | -0.006 | 5.6 | 29.6 | -0.002 | -0.005 | |
| PRISMModel=Bge MiniCPM, Baseline=HF Offload2025.10 | 0 | 13.7 | 56.7 | -0.003 | 14.2 | 50.7 | -0.003 | -0.006 | 15.4 | 47.6 | -0.002 | -0.005 | |
| PRISM QuantModel=Bge MiniCPM, Baseline=HF Quant2025.10 | 0 | 6.1 | 36.7 | -0.003 | 3.2 | 28.2 | -0.002 | -0.006 | 2.3 | 23.7 | -0.002 | -0.006 | |
| PRISM QuantModel=Qwen3 0.6B, Baseline=HF Quant2025.10 | 0.001 | 5.6 | 20.3 | -0.001 | 5.7 | 18.3 | 0.002 | -0.004 | 5.3 | 19.6 | 0 | -0.004 | |
| PRISM QuantModel=Bge M3, Baseline=HF Quant2025.10 | 0.002 | 4.3 | 25.6 | -0.006 | 1.3 | 22.5 | 0.004 | -0.006 | 0.5 | 21.1 | 0.003 | -0.006 | |
| PRISMModel=Qwen3 0.6B, Baseline=HF2025.10 | 0.003 | 10.5 | 33.1 | -0.003 | 9 | 32.9 | 0.002 | -0.003 | 8.5 | 32.2 | 0 | -0.003 | |
| PRISMModel=Qwen3 0.6B, Baseline=HF Offload2025.10 | 0.003 | 32.2 | 47.6 | -0.003 | 32.5 | 47.6 | 0.002 | -0.003 | 32 | 47.1 | 0 | -0.003 | |
| PRISMModel=Qwen3 8B, Baseline=HF2025.10 | 0.039 | — | — | -0.001 | — | — | 0.048 | -0.004 | — | — | 0.025 | -0.006 | |
| PRISMModel=Qwen3 8B, Baseline=HF Offload2025.10 | 0.039 | 23.2 | 54.6 | -0.001 | 23.4 | 53.6 | 0.048 | -0.004 | 23.5 | 53.3 | 0.025 | -0.006 | |
| PRISM QuantModel=Qwen3 8B, Baseline=HF Quant2025.10 | 0.04 | 6.5 | 36.8 | -0.006 | 7.1 | 36.1 | 0.056 | -0.001 | 9.6 | 36 | 0.031 | -0.008 |