Conditional Semantic Textual Similarity on C-STS (official)
0.4818Spearman CorrelationPoLi-RL (Qwen3-8B)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PoLi-RL (Qwen3-8B)Training Paradigm=RL, Parameters=8B2025.10 | 0.4818 | 0.4827 | |
| PoLi-RL (Qwen3-4B)Training Paradigm=RL, Parameters=4B2025.10 | 0.4623 | 0.4619 | |
| PoLi-RL (Qwen3-0.6B)Training Paradigm=RL, Parameters=0.6B2025.10 | 0.4434 | 0.4436 | |
| GPT-4oTraining Paradigm=Few-shot2025.10 | 0.4423 | 0.4407 | |
| SEAVER SimCSELARGETraining Paradigm=SFT, Parameters=355M2025.10 | 0.4383 | 0.4381 | |
| GPT-4Training Paradigm=Few-shot2025.10 | 0.436 | — | |
| SimCSELARGETraining Paradigm=SFT, Parameters=355M2025.10 | 0.432 | 0.432 | |
| DeepSeek-R1Training Paradigm=Few-shot2025.10 | 0.4285 | 0.4236 | |
| RoBERTaLARGETraining Paradigm=SFT, Parameters=355M2025.10 | 0.407 | 0.408 | |
| Qwen3-8BTraining Paradigm=SFT, Parameters=8B2025.10 | 0.4042 | 0.4083 | |
| Qwen3-4BTraining Paradigm=SFT, Parameters=4B2025.10 | 0.3841 | 0.3945 | |
| Qwen3-4BTraining Paradigm=Few-shot, Parameters=4B2025.10 | 0.3797 | 0.3848 | |
| Qwen3-8BTraining Paradigm=Few-shot, Parameters=8B2025.10 | 0.379 | 0.3854 | |
| Qwen3-0.6BTraining Paradigm=SFT, Parameters=0.6B2025.10 | 0.3559 | 0.3683 | |
| Flan-T5XXLTraining Paradigm=Few-shot, Parameters=11B2025.10 | 0.306 | — | |
| Qwen3-0.6BTraining Paradigm=Few-shot, Parameters=0.6B2025.10 | 0.2525 | 0.2519 | |
| Flan-UL2Training Paradigm=Few-shot, Parameters=20B2025.10 | 0.235 | — | |
| Tk-InstructTraining Paradigm=Few-shot, Parameters=11B2025.10 | 0.178 | — | |
| GPT-3.5Training Paradigm=Few-shot, Parameters=175B2025.10 | 0.153 | — |