Holistic Technical Quality Evaluation on CVPR 2025
3.22OriginalityOriginal (GT)
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Original (GT)Reviewer Framework=ScholarPeer Reviewer, Setting=Sparse Idea Setting2026.04 | 3.22 | 3.02 | 3.54 | 3.63 | 2.87 | 3.39 | 3.42 | 7.07 | 86 | |
| SingleAgentReviewer Framework=ScholarPeer Reviewer, Setting=Sparse Idea Setting2026.04 | 3.22 | 2.79 | 3.46 | 3.48 | 2.72 | 3.34 | 3.29 | 6.35 | 71 | |
| PaperOrchestra (PlotOff)Reviewer Framework=ScholarPeer Reviewer, Setting=Sparse Idea Setting2026.04 | 3.13 | 2.95 | 3.75 | 3.56 | 2.91 | 3.64 | 3.34 | 6.93 | 84 | |
| AI Scientist-v2Reviewer Framework=ScholarPeer Reviewer, Setting=Sparse Idea Setting2026.04 | 3.11 | 2.71 | 3.44 | 3.39 | 2.64 | 3.37 | 3.22 | 6.3 | 70 | |
| SingleAgentReviewer Framework=AI Scientist-v2 Reviewer, Setting=Sparse Idea Setting2026.04 | 3.01 | 2.27 | 2.78 | 3.03 | 2.26 | 2.79 | 2.74 | 4.6 | 33 | |
| Original (GT)Reviewer Framework=AI Scientist-v2 Reviewer, Setting=Sparse Idea Setting2026.04 | 2.96 | 2.81 | 3.44 | 3.06 | 2.74 | 3.26 | 2.91 | 5.95 | 71 | |
| PaperOrchestra (PlotOff)Reviewer Framework=AI Scientist-v2 Reviewer, Setting=Sparse Idea Setting2026.04 | 2.95 | 2.43 | 3.4 | 2.97 | 2.42 | 3.22 | 2.74 | 5.12 | 48 | |
| AI Scientist-v2Reviewer Framework=AI Scientist-v2 Reviewer, Setting=Sparse Idea Setting2026.04 | 2.93 | 2.11 | 2.8 | 2.85 | 2.15 | 2.82 | 2.61 | 4.22 | 22 |