Chunk-level retrieval on ConTEB
81.96Avg nDCG@10pplx-embed-context-v1-4B
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| pplx-embed-context-v1-4BQuantization=INT8, Contextualized=true2026.02 | 81.96 | 62.16 | 62.4 | 78.13 | 93.04 | 100 | 89.5 | 86.71 | 83.73 | |
| pplx-embed-context-v1-4BQuantization=BIN, Contextualized=true2026.02 | 80.46 | 59.6 | 58.14 | 76.49 | 92.56 | 99.69 | 88.9 | 85.87 | 82.67 | |
| voyage-context-3Contextualized=true2026.02 | 79.45 | 55.43 | 54 | 79.56 | 92.85 | 100 | 89.24 | 81.79 | 82.7 | |
| pplx-embed-context-v1-0.6BQuantization=INT8, Contextualized=true2026.02 | 76.53 | 56.21 | 46.92 | 71.43 | 89.38 | 99.28 | 85.99 | 84.13 | 78.91 | |
| modernBERT-LargeContextualized=true2026.02 | 75.6 | 56 | 43.1 | 63.9 | 90.7 | 100 | 88.7 | 81.3 | 80.9 | |
| anthropic contextualContextualized=true2026.02 | 72.4 | 60.7 | 34.8 | 53.9 | 89.4 | 100 | 85.4 | 77.7 | 77.1 | |
| pplx-embed-context-v1-0.6BQuantization=BIN, Contextualized=true2026.02 | 71.69 | 50.28 | 33.85 | 66.35 | 86.99 | 96.23 | 82.84 | 80.54 | 76.4 | |
| pplx-embed-v1-4BQuantization=INT8, Contextualized=false2026.02 | 58.83 | 63.81 | 47.23 | 34.26 | 73.57 | 14.96 | 79.76 | 81.66 | 75.38 | |
| pplx-embed-v1-4BQuantization=BIN, Contextualized=false2026.02 | 57.91 | 62.29 | 46.83 | 31.92 | 72.16 | 15.75 | 79.1 | 80.82 | 74.38 | |
| pplx-embed-v1-0.6BQuantization=INT8, Contextualized=false2026.02 | 55.32 | 63.44 | 42.01 | 29.29 | 63.6 | 10.13 | 79.84 | 80.71 | 73.5 | |
| qwen3-embed-4BContextualized=false2026.02 | 54.81 | 54.76 | 39.65 | 31.64 | 71.81 | 14.18 | 76.15 | 77.62 | 72.68 | |
| pplx-embed-v1-0.6BQuantization=BIN, Contextualized=false2026.02 | 53.29 | 59.59 | 40.13 | 25.96 | 60.83 | 11.09 | 78.95 | 78.63 | 71.12 | |
| qwen3-embed-0.6BContextualized=false2026.02 | 49.36 | 49.1 | 34.72 | 23.15 | 58.11 | 12.65 | 76.27 | 74.02 | 66.85 |