# Rubric

Source: [Rubric](<https://www.sota2.com/research/dataset/rubric>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 1. This is an index page, not the full collection.

- [Research Idea Evaluation on ScholarIdeas-AI contribution rubrics](<https://www.sota2.com/research/sota/research-idea-evaluation-on-scholarideas-ai-contribution-rubrics.md>): Research Idea Evaluation; ScholarIdeas-AI contribution rubrics.

- [Research Evaluation on ResearchRubrics](<https://www.sota2.com/research/sota/research-evaluation-on-researchrubrics.md>): Research Evaluation; ResearchRubrics.

- [Accuracy Evaluation on ResearchRubrics](<https://www.sota2.com/research/sota/accuracy-evaluation-on-researchrubrics.md>): ResearchRubrics; ResearchRubrics.

- [Long-horizon agentic task on ResearchRubrics](<https://www.sota2.com/research/sota/long-horizon-agentic-task-on-researchrubrics.md>): Long-horizon agentic task; ResearchRubrics.

- [Language Agent Interaction on AgentWorldBench main results rubric mean](<https://www.sota2.com/research/sota/language-agent-interaction-on-agentworldbench-main-results-rubric-mean.md>): Language Agent Interaction; AgentWorldBench main results rubric mean.

- [Long-form research on ResearchRubrics](<https://www.sota2.com/research/sota/long-form-research-on-researchrubrics.md>): Long-form research; ResearchRubrics.

- [Pairwise Accuracy on RubricBench 1.0 (test)](<https://www.sota2.com/research/sota/pairwise-accuracy-on-rubricbench-1-0-test.md>): Pairwise Accuracy; RubricBench 1.0 (test).

- [Deep Research on ResearchRubrics](<https://www.sota2.com/research/sota/deep-research-on-researchrubrics.md>): Deep Research; ResearchRubrics.

- [Reward Modeling on RubricBench](<https://www.sota2.com/research/sota/reward-modeling-on-rubricbench.md>): Reward Modeling; RubricBench.

- [Video Object Segmentation on Rubric DAV/YTB (real-world)](<https://www.sota2.com/research/sota/video-object-segmentation-on-rubric-dav-ytb-real-world.md>): Video Object Segmentation; Rubric DAV/YTB (real-world).

- [Video Object Segmentation on Rubric Cup Games (real-world)](<https://www.sota2.com/research/sota/video-object-segmentation-on-rubric-cup-games-real-world.md>): Video Object Segmentation; Rubric Cup Games (real-world).

- [Video Object Segmentation on Rubric Office real-world](<https://www.sota2.com/research/sota/video-object-segmentation-on-rubric-office-real-world.md>): Video Object Segmentation; Rubric Office real-world.

- [Scientific Reasoning on RUBRICHUB (test)](<https://www.sota2.com/research/sota/scientific-reasoning-on-rubrichub-test.md>): Scientific Reasoning; RUBRICHUB (test).

- [Research Automation on RESEARCHRUBRICS](<https://www.sota2.com/research/sota/research-automation-on-researchrubrics.md>): Research Automation; RESEARCHRUBRICS.

- [Deep Research on Rubrics](<https://www.sota2.com/research/sota/deep-research-on-rubrics.md>): Deep Research; Rubrics.

- [Medical Consultation on Clinical Encounters Universal Rubrics](<https://www.sota2.com/research/sota/medical-consultation-on-clinical-encounters-universal-rubrics.md>): Medical Consultation; Clinical Encounters Universal Rubrics.

- [Medical Consultation on Clinical Encounters Case-specific Rubrics](<https://www.sota2.com/research/sota/medical-consultation-on-clinical-encounters-case-specific-rubrics.md>): Medical Consultation; Clinical Encounters Case-specific Rubrics.

- [Rubric Generation on Research Rubrics](<https://www.sota2.com/research/sota/rubric-generation-on-research-rubrics.md>): Rubric Generation; Research Rubrics.

- [Rubric Entailment on RiceChem rubric entailment (in-distribution)](<https://www.sota2.com/research/sota/rubric-entailment-on-ricechem-rubric-entailment-in-distribution.md>): Rubric Entailment; RiceChem rubric entailment (in-distribution).

- [Deep Research Evaluation on ResearchRubrics](<https://www.sota2.com/research/sota/deep-research-evaluation-on-researchrubrics.md>): Deep Research Evaluation; ResearchRubrics.