Comment Prediction on ExpertLongBench (test)
2.75Bio ScoreFeedback-to-Rubrics
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Feedback-to-RubricsMethod Type=Rubric-based (Comment-wise refinement), Backbone=Gemini 3.1 Pro preview2026.05 | 2.75 | 3.73 | 7.43 | 3.95 | 4.75 | 2.31 | |
| Initial rubricMethod Type=Rubric-based (Ablation), Backbone=Gemini 3.1 Pro preview2026.05 | 2.66 | 3.42 | 7.13 | 3.96 | 3.84 | 2.43 | |
| Iterative rubric refinementMethod Type=Rubric-based (Ablation), Backbone=Gemini 3.1 Pro preview2026.05 | 2.61 | 3.64 | 7 | 4.11 | 4.21 | 2.35 | |
| Top-3 RAG with LLMMethod Type=Retrieval-based, Backbone=Gemini 3.1 Pro preview2026.05 | 2.3 | 3.12 | 4.76 | 2.26 | 2.75 | 2.06 | |
| Top-1 retrievalMethod Type=Retrieval-based, Backbone=Gemini 3.1 Pro preview2026.05 | 1.68 | 1.56 | 3.34 | 2.05 | 1.39 | 0.28 | |
| No rubricMethod Type=Rubric-based (Ablation), Backbone=Gemini 3.1 Pro preview2026.05 | 0.56 | 1.76 | 1.18 | 1.37 | 1.82 | 1.79 |