Intent Reflection on Intent Reflection Benchmark (test)
67Qwen3 ScoreREVISION-R1
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| REVISION-R12025.10 | 67 | 91.7 | 53.1 | 30.3 | 61.9 | 75.2 | 58.1 | |
| OmniSearch2025.10 | 54.6 | 70.2 | 36 | 19.6 | 51.9 | 58.8 | 39.4 | |
| REVISION-RLTraining Strategy=RL2025.10 | 53.9 | 83.2 | 46 | 28.5 | 59.6 | 61 | 43.4 | |
| REVISION-SFTTraining Strategy=SFT2025.10 | 45.3 | 70.1 | 37.9 | 26 | 42.5 | 55.9 | 37.6 | |
| GPT-4o2025.10 | 45.1 | 56.8 | 26.5 | 16.7 | 32.8 | 45.3 | 24.7 | |
| Gemini 2.5 Pro2025.10 | 40.9 | 61.5 | 21.9 | 11.4 | 26.9 | 50.1 | 30.3 | |
| Seed-1.5VL2025.10 | 36 | 49.1 | 13.8 | 18.2 | 24.7 | 42.6 | 27.8 |