Response Generation on HiCUPID
63.9AccuracyDeepSeek-R1-671B
Evaluation results
| Method | Links | |
|---|---|---|
| DeepSeek-R1-671BInference Setting=Full-history Preference Inference2026.01 | 63.9 | |
| Qwen3-32BthinkingInference Setting=Full-history Preference Inference2026.01 | 63.44 | |
| ALIGNXPLORE+Inference Setting=Full-history Preference Inference2026.01 | 62.42 | |
| GPT-OSS-20BInference Setting=Full-history Preference Inference2026.01 | 62 | |
| ALIGNXPLORE+Inference Setting=Streaming Preference Inference2026.01 | 60.51 | |
| DeepSeek-R1-671BInference Setting=Streaming Preference Inference2026.01 | 60.32 | |
| Qwen3-8BthinkingInference Setting=Full-history Preference Inference2026.01 | 60.05 | |
| DS-R1-Distill-Qwen-7BInference Setting=Full-history Preference Inference2026.01 | 60.01 | |
| GPT-OSS-20BInference Setting=Streaming Preference Inference2026.01 | 59.93 | |
| Qwen3-32BthinkingInference Setting=Streaming Preference Inference2026.01 | 59.83 | |
| DS-R1-Distill-Qwen-7BInference Setting=Streaming Preference Inference2026.01 | 59.29 | |
| Qwen3-8BthinkingInference Setting=Streaming Preference Inference2026.01 | 59.17 | |
| ALIGNXPLOREInference Setting=Full-history Preference Inference2026.01 | 53.5 | |
| ALIGNXPLOREInference Setting=Streaming Preference Inference2026.01 | 50.34 | |
| TALLRecInference Setting=Direct Full-history Sequence Models w/o Preference Inference2026.01 | 47.41 | |
| Qwen3-8Bnon-thinkingInference Setting=Direct Full-history Sequence Models w/o Preference Inference2026.01 | 47.02 |