Response Selection on P-Soups Expertise
83.66AccuracyQwen3-32Bthinking
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-32BthinkingInference Setting=Full-history Preference Inference2026.01 | 83.66 | |
| Qwen3-8BthinkingInference Setting=Full-history Preference Inference2026.01 | 83.5 | |
| Qwen3-8BthinkingInference Setting=Streaming Preference Inference2026.01 | 82.66 | |
| ALIGNXPLORE+Inference Setting=Full-history Preference Inference2026.01 | 82.5 | |
| DeepSeek-R1-671BInference Setting=Full-history Preference Inference2026.01 | 82.33 | |
| Qwen3-32BthinkingInference Setting=Streaming Preference Inference2026.01 | 81.67 | |
| GPT-OSS-20BInference Setting=Full-history Preference Inference2026.01 | 81.66 | |
| DeepSeek-R1-671BInference Setting=Streaming Preference Inference2026.01 | 79 | |
| ALIGNXPLORE+Inference Setting=Streaming Preference Inference2026.01 | 78.5 | |
| GPT-OSS-20BInference Setting=Streaming Preference Inference2026.01 | 77.5 | |
| ALIGNXPLOREInference Setting=Full-history Preference Inference2026.01 | 72.66 | |
| ALIGNXPLOREInference Setting=Streaming Preference Inference2026.01 | 69.16 | |
| DS-R1-Distill-Qwen-7BInference Setting=Full-history Preference Inference2026.01 | 66 | |
| DS-R1-Distill-Qwen-7BInference Setting=Streaming Preference Inference2026.01 | 64.16 | |
| TALLRecInference Setting=Direct Full-history Sequence Models w/o Preference Inference2026.01 | 60.16 | |
| Qwen3-8Bnon-thinkingInference Setting=Direct Full-history Sequence Models w/o Preference Inference2026.01 | 38.33 |