Inbox Sorting on PMR-Reddit (test)
0.77T-NDCG@10Qwen32B_SFT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Qwen32B_SFTEvaluation Protocol=UrgentSFT Pairs2026.01 | 0.77 | 0.36 | |
| Reward-4B_UrgentEvaluation Protocol=UrgentReward Pairs2026.01 | 0.69 | 0.3 | |
| MedGem27B_SFTEvaluation Protocol=Multi-Class2026.01 | 0.62 | 0.32 | |
| MedGem27B_SFTEvaluation Protocol=UrgentSFT Pairs2026.01 | 0.61 | 0.29 | |
| Qwen32BEvaluation Protocol=Multi-Class2026.01 | 0.59 | 0.28 | |
| Reward-8B_UrgentEvaluation Protocol=UrgentReward Pairs2026.01 | 0.58 | 0.26 | |
| Qwen32BEvaluation Protocol=0-Shot Pairs2026.01 | 0.54 | 0.25 | |
| Qwen8B_SFTEvaluation Protocol=UrgentSFT Pairs2026.01 | 0.51 | 0.23 | |
| Qwen32B_SFTEvaluation Protocol=Multi-Class2026.01 | 0.5 | 0.24 | |
| MedGem27BEvaluation Protocol=Multi-Class2026.01 | 0.49 | 0.25 | |
| GPT-OSS*Evaluation Protocol=0-Shot Pairs, Parameters=120B2026.01 | 0.44 | 0.24 | |
| Qwen8BEvaluation Protocol=0-Shot Pairs2026.01 | 0.41 | 0.2 | |
| GPT-OSSEvaluation Protocol=Multi-Class2026.01 | 0.4 | 0.18 | |
| MedGem27BEvaluation Protocol=0-Shot Pairs2026.01 | 0.38 | 0.16 | |
| Reward-8B_BaseEvaluation Protocol=UrgentReward Pairs2026.01 | 0.33 | 0.14 | |
| Reward-4B_BaseEvaluation Protocol=UrgentReward Pairs2026.01 | 0.22 | 0.1 |