Irrelevant Classification on JD e-commerce search dataset
84.58PrecisionLLM-Base
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| LLM-Base2026.05 | 84.58 | 29.7 | 43.97 | |
| Graph-GRPOlearnable_coefficients=false2026.05 | 80.39 | 89.57 | 84.73 | |
| Graph-GRPO2026.05 | 80.11 | 89.95 | 84.75 | |
| LLM-GRPObase_model=LLM-SFT2026.05 | 79.76 | 89.9 | 84.53 | |
| LLM-SFT2026.05 | 77.95 | 90.94 | 83.94 | |
| LLM-SFTrandom_masking=false2026.05 | 76.61 | 90.71 | 83.06 |