# scoring

Source: [scoring](<https://www.sota2.com/research/task/scoring>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.



## Benchmarks

Page 1 of 4. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/task/scoring.md?page=2>): Follow this link to discover more pages.

- [Sleep scoring on BOAS fixed (test)](<https://www.sota2.com/research/sota/sleep-scoring-on-boas-fixed-test.md>): Sleep scoring; BOAS fixed (test).

- [Automated Essay Scoring on ASAP 1.0 (test)](<https://www.sota2.com/research/sota/automated-essay-scoring-on-asap-1-0-test.md>): Automated Essay Scoring; ASAP 1.0 (test).

- [Linguistic Minimal Pair Scoring on BLiMP](<https://www.sota2.com/research/sota/linguistic-minimal-pair-scoring-on-blimp.md>): Linguistic Minimal Pair Scoring; BLiMP.

- [Sequence Scoring on Held-out text (G.4)](<https://www.sota2.com/research/sota/sequence-scoring-on-held-out-text-g-4.md>): Sequence Scoring; Held-out text (G.4).

- [Sleep Stage Scoring on Sleep (test)](<https://www.sota2.com/research/sota/sleep-stage-scoring-on-sleep-test.md>): Sleep Stage Scoring; Sleep (test).

- [ASR Rescoring on WSJ (test)](<https://www.sota2.com/research/sota/asr-rescoring-on-wsj-test.md>): ASR Rescoring; WSJ (test).

- [MaxSim scoring on MaxSim Synthetic Workload (Nq=32, d=128)](<https://www.sota2.com/research/sota/maxsim-scoring-on-maxsim-synthetic-workload-nq-32-d-128.md>): MaxSim scoring; MaxSim Synthetic Workload (Nq=32, d=128).

- [Reward Scoring on HHA benchmark](<https://www.sota2.com/research/sota/reward-scoring-on-hha-benchmark.md>): Reward Scoring; HHA benchmark.

- [Rubric-based scoring on NCTE 1-7 scoring scale (transcript segments)](<https://www.sota2.com/research/sota/rubric-based-scoring-on-ncte-1-7-scoring-scale-transcript-segments.md>): Rubric-based scoring; NCTE 1-7 scoring scale (transcript segments).

- [Automatic Essay Scoring on ASAP (prompt 7 to 8)](<https://www.sota2.com/research/sota/automatic-essay-scoring-on-asap-prompt-7-to-8.md>): Automatic Essay Scoring; ASAP (Automated Student Assessment Prize) prompt 7 to 8.

- [Automatic Essay Scoring on ASAP (prompt 5 to 6)](<https://www.sota2.com/research/sota/automatic-essay-scoring-on-asap-prompt-5-to-6.md>): Automatic Essay Scoring; ASAP (Automated Student Assessment Prize) prompt 5 to 6.

- [Automatic Essay Scoring on ASAP (prompt 3 to 4)](<https://www.sota2.com/research/sota/automatic-essay-scoring-on-asap-prompt-3-to-4.md>): Automatic Essay Scoring; ASAP (Automated Student Assessment Prize) prompt 3 to 4.

- [Automatic Essay Scoring on ASAP (prompt 1 to 2)](<https://www.sota2.com/research/sota/automatic-essay-scoring-on-asap-prompt-1-to-2.md>): Automatic Essay Scoring; ASAP (Automated Student Assessment Prize) prompt 1 to 2.

- [Automated Essay Scoring on IELTS Writing Task 2](<https://www.sota2.com/research/sota/automated-essay-scoring-on-ielts-writing-task-2.md>): Automated Essay Scoring; IELTS Writing Task 2.

- [LLM-judge preference scoring on PowerSeeking](<https://www.sota2.com/research/sota/llm-judge-preference-scoring-on-powerseeking.md>): LLM-judge preference scoring; PowerSeeking.

- [Sleep stage scoring on MASS (subject-wise)](<https://www.sota2.com/research/sota/sleep-stage-scoring-on-mass-subject-wise.md>): Sleep stage scoring; MASS (subject-wise).

- [ASR rescoring on LibriSpeech (test-other)](<https://www.sota2.com/research/sota/asr-rescoring-on-librispeech-test-other.md>): ASR rescoring; LibriSpeech (test-other).

- [ASR rescoring on LibriSpeech clean (test)](<https://www.sota2.com/research/sota/asr-rescoring-on-librispeech-clean-test.md>): ASR rescoring; LibriSpeech clean (test).

- [Credit Scoring on Credit scoring dataset](<https://www.sota2.com/research/sota/credit-scoring-on-credit-scoring-dataset.md>): Credit scoring; Credit scoring dataset.

- [Credit Scoring on Credit scoring (Protected attribute: Age)](<https://www.sota2.com/research/sota/credit-scoring-on-credit-scoring-protected-attribute-age.md>): Credit Scoring; Credit scoring (Protected attribute: Age).

- [MMI Scoring on MMI](<https://www.sota2.com/research/sota/mmi-scoring-on-mmi.md>): MMI Scoring; MMI.

- [Motivational Interviewing Global Scoring on MI Global Score Evaluation](<https://www.sota2.com/research/sota/motivational-interviewing-global-scoring-on-mi-global-score-evaluation.md>): Motivational Interviewing Global Scoring; MI Global Score Evaluation.

- [Aesthetic scoring on PPAINT](<https://www.sota2.com/research/sota/aesthetic-scoring-on-ppaint.md>): Aesthetic scoring; PPAINT.

- [MaxSim Scoring on L2-normalized FP16 embeddings Nq=32, d=128](<https://www.sota2.com/research/sota/maxsim-scoring-on-l2-normalized-fp16-embeddings-nq-32-d-128.md>): MaxSim Scoring; L2-normalized FP16 embeddings Nq=32, d=128.

- [Source Reliability Scoring on CTI Benchmark](<https://www.sota2.com/research/sota/source-reliability-scoring-on-cti-benchmark.md>): Source Reliability Scoring; CTI Benchmark.

- [Quality Scoring on Security Scenario](<https://www.sota2.com/research/sota/quality-scoring-on-security-scenario.md>): Quality Scoring; Security Scenario.

- [Quality Scoring on Science Scenario](<https://www.sota2.com/research/sota/quality-scoring-on-science-scenario.md>): Quality Scoring; Science Scenario.

- [Quality Scoring on Data Scenario](<https://www.sota2.com/research/sota/quality-scoring-on-data-scenario.md>): Quality Scoring; Data Scenario.

- [Quality Scoring on Software Scenario](<https://www.sota2.com/research/sota/quality-scoring-on-software-scenario.md>): Quality Scoring; Software Scenario.

- [Drug-resistance variant scoring on Kim EGFR](<https://www.sota2.com/research/sota/drug-resistance-variant-scoring-on-kim-egfr.md>): Drug-resistance variant scoring; Kim EGFR.

- [Drug-resistance variant scoring on Coelho 10g](<https://www.sota2.com/research/sota/drug-resistance-variant-scoring-on-coelho-10g.md>): Drug-resistance variant scoring; Coelho 10g.

- [Credit Scoring on PPDai](<https://www.sota2.com/research/sota/credit-scoring-on-ppdai.md>): Credit Scoring; PPDai.

- [Credit Scoring on LendingClub](<https://www.sota2.com/research/sota/credit-scoring-on-lendingclub.md>): Credit Scoring; LendingClub.

- [Credit Scoring on Default](<https://www.sota2.com/research/sota/credit-scoring-on-default.md>): Credit Scoring; Default.

- [Automated Essay Scoring on ELLIPSE](<https://www.sota2.com/research/sota/automated-essay-scoring-on-ellipse.md>): Automated Essay Scoring; ELLIPSE.

- [Clinical Summary Fact Scoring on Thoracic tumor board clinical cases](<https://www.sota2.com/research/sota/clinical-summary-fact-scoring-on-thoracic-tumor-board-clinical-cases.md>): Clinical Summary Fact Scoring; Thoracic tumor board clinical cases.

- [Sales Lead Scoring on Benchmark Dataset NEV retail system (test)](<https://www.sota2.com/research/sota/sales-lead-scoring-on-benchmark-dataset-nev-retail-system-test.md>): Sales Lead Scoring; Benchmark Dataset NEV retail system (test).

- [Automated Short Answer Scoring on ASAP-SAS (test)](<https://www.sota2.com/research/sota/automated-short-answer-scoring-on-asap-sas-test.md>): Automated Short Answer Scoring; ASAP-SAS (test).

- [Automated Essay Scoring on ASAP Kaggle 2.0 (test)](<https://www.sota2.com/research/sota/automated-essay-scoring-on-asap-kaggle-2-0-test.md>): Automated Essay Scoring; ASAP Kaggle 2.0 (test).

- [Credit Scoring on Financial Credit Scoring](<https://www.sota2.com/research/sota/credit-scoring-on-financial-credit-scoring.md>): Credit Scoring; Financial Credit Scoring.

- [Sleep stage scoring on Sleep-EDF Independent Training and Test Sets (subject-wise)](<https://www.sota2.com/research/sota/sleep-stage-scoring-on-sleep-edf-independent-training-and-test-sets-subject-wise.md>): Sleep stage scoring; Sleep-EDF Independent Training and Test Sets (subject-wise).

- [Aspect-based Review Scoring on NLPEER](<https://www.sota2.com/research/sota/aspect-based-review-scoring-on-nlpeer.md>): Aspect-based Review Scoring; NLPEER.

- [Aspect-based Review Scoring on ICLR-5k](<https://www.sota2.com/research/sota/aspect-based-review-scoring-on-iclr-5k.md>): Aspect-based Review Scoring; ICLR-5k.

- [Readability Scoring on German ESG reports (eval)](<https://www.sota2.com/research/sota/readability-scoring-on-german-esg-reports-eval.md>): Readability Scoring; German ESG reports (eval).

- [Video Quality Scoring on Maxwell intra-dataset](<https://www.sota2.com/research/sota/video-quality-scoring-on-maxwell-intra-dataset.md>): Video Quality Scoring; Maxwell intra-dataset.

- [Text-to-Image Alignment Scoring on LongT2IBench (test)](<https://www.sota2.com/research/sota/text-to-image-alignment-scoring-on-longt2ibench-test.md>): Text-to-Image Alignment Scoring; LongT2IBench (test).

- [Analytic Essay Scoring on ASAP Essay Set 7](<https://www.sota2.com/research/sota/analytic-essay-scoring-on-asap-essay-set-7.md>): Analytic Essay Scoring; ASAP Essay Set 7.

- [Trait-wise Automated Essay Scoring on ASAP and ASAP++ (five-fold cross-val)](<https://www.sota2.com/research/sota/trait-wise-automated-essay-scoring-on-asap-and-asap-plus-plus-five-fold-cross-val.md>): Trait-wise Automated Essay Scoring; ASAP and ASAP++ (five-fold cross-val).

- [Automated Essay Scoring on ASAP and ASAP++ (five-fold cross-validation)](<https://www.sota2.com/research/sota/automated-essay-scoring-on-asap-and-asap-plus-plus-five-fold-cross-validation.md>): Automated Essay Scoring; ASAP and ASAP++ (five-fold cross-validation).

- [ASR Rescoring on ATIS (test)](<https://www.sota2.com/research/sota/asr-rescoring-on-atis-test.md>): ASR Rescoring; ATIS (test).

- [ASR Rescoring on SLURP (test)](<https://www.sota2.com/research/sota/asr-rescoring-on-slurp-test.md>): ASR Rescoring; SLURP (test).

- [ASR Rescoring on ConvAI (test)](<https://www.sota2.com/research/sota/asr-rescoring-on-convai-test.md>): ASR Rescoring; ConvAI (test).

- [ASR Rescoring on Voxpopuli (test)](<https://www.sota2.com/research/sota/asr-rescoring-on-voxpopuli-test.md>): ASR Rescoring; Voxpopuli (test).

- [ASR Rescoring on MTDialogue (test)](<https://www.sota2.com/research/sota/asr-rescoring-on-mtdialogue-test.md>): ASR Rescoring; MTDialogue (test).

- [Automated Essay Scoring on ASAP++ (test)](<https://www.sota2.com/research/sota/automated-essay-scoring-on-asap-plus-plus-test.md>): Automated Essay Scoring; ASAP++ (test).

- [Analytic Essay Scoring on ASAP Essay Set 8](<https://www.sota2.com/research/sota/analytic-essay-scoring-on-asap-essay-set-8.md>): Analytic Essay Scoring; ASAP Essay Set 8.

- [Automated Essay Scoring on TCF generalization corpus](<https://www.sota2.com/research/sota/automated-essay-scoring-on-tcf-generalization-corpus.md>): Automated Essay Scoring; TCF generalization corpus.

- [Scientific Paper Scoring on Production Platform Papers April 2026](<https://www.sota2.com/research/sota/scientific-paper-scoring-on-production-platform-papers-april-2026.md>): Scientific Paper Scoring; Production Platform Papers April 2026.

- [Predictive scoring and calibration on Synthetic dataset](<https://www.sota2.com/research/sota/predictive-scoring-and-calibration-on-synthetic-dataset.md>): Predictive scoring and calibration; Synthetic dataset.

- [Essay Scoring on ASAP++ (five-fold averaged results)](<https://www.sota2.com/research/sota/essay-scoring-on-asap-plus-plus-five-fold-averaged-results.md>): Essay Scoring; ASAP++ five-fold averaged results.

- [Essay Scoring on ASAP-SAS (Prompts 3, 4, 7, 8, 9)](<https://www.sota2.com/research/sota/essay-scoring-on-asap-sas-prompts-3-4-7-8-9.md>): Essay Scoring; ASAP-SAS.

- [Automated Essay Scoring on ASAP++ full-data setting](<https://www.sota2.com/research/sota/automated-essay-scoring-on-asap-plus-plus-full-data-setting.md>): Automated Essay Scoring; ASAP++ full-data setting.

- [Multi-trait Automated Essay Scoring on ASAP++ (full-data)](<https://www.sota2.com/research/sota/multi-trait-automated-essay-scoring-on-asap-plus-plus-full-data.md>): Multi-trait Automated Essay Scoring; ASAP++ (full-data).

- [Severity Scoring on PFED5+](<https://www.sota2.com/research/sota/severity-scoring-on-pfed5-plus.md>): Severity Scoring; PFED5+.

- [VAEP Scoring on VAEP (test)](<https://www.sota2.com/research/sota/vaep-scoring-on-vaep-test.md>): VAEP Scoring; VAEP (test).

- [Fine-grained Speech Quality Scoring on UniSRM-BENCH T2](<https://www.sota2.com/research/sota/fine-grained-speech-quality-scoring-on-unisrm-bench-t2.md>): fine-grained speech quality scoring; UniSRM-BENCH T2.

- [Quality scoring on PANDABENCH (Hard set)](<https://www.sota2.com/research/sota/quality-scoring-on-pandabench-hard-set.md>): Quality scoring; PANDABENCH (Hard set).

- [Generation scoring on Gemma Scope SAE latents](<https://www.sota2.com/research/sota/generation-scoring-on-gemma-scope-sae-latents.md>): Generation scoring; Gemma Scope SAE latents.

- [Pointwise Scoring on MLLM-as-a-Judge in-domain v1.0 (test)](<https://www.sota2.com/research/sota/pointwise-scoring-on-mllm-as-a-judge-in-domain-v1-0-test.md>): Pointwise Scoring; MLLM-as-a-Judge in-domain v1.0 (test).

- [Pointwise Scoring on MMHal pointwise](<https://www.sota2.com/research/sota/pointwise-scoring-on-mmhal-pointwise.md>): Pointwise Scoring; MMHal pointwise.

- [Pointwise Scoring on L-Wilder pointwise](<https://www.sota2.com/research/sota/pointwise-scoring-on-l-wilder-pointwise.md>): Pointwise Scoring; L-Wilder pointwise.

- [Pointwise Scoring on LLaVA-W pointwise](<https://www.sota2.com/research/sota/pointwise-scoring-on-llava-w-pointwise.md>): Pointwise Scoring; LLaVA-W pointwise.

- [Pointwise Scoring on LLaVA-B pointwise](<https://www.sota2.com/research/sota/pointwise-scoring-on-llava-b-pointwise.md>): Pointwise Scoring; LLaVA-B pointwise.

- [Pointwise Scoring on WildVision (pointwise)](<https://www.sota2.com/research/sota/pointwise-scoring-on-wildvision-pointwise.md>): Pointwise Scoring; WildVision (pointwise).

- [Pointwise Scoring on MMVet pointwise](<https://www.sota2.com/research/sota/pointwise-scoring-on-mmvet-pointwise.md>): Pointwise Scoring; MMVet pointwise.

- [Pointwise Scoring on ImageDC pointwise](<https://www.sota2.com/research/sota/pointwise-scoring-on-imagedc-pointwise.md>): Pointwise Scoring; ImageDC pointwise.

- [ASR rescoring on LibriSpeech (dev-clean)](<https://www.sota2.com/research/sota/asr-rescoring-on-librispeech-dev-clean.md>): ASR rescoring; LibriSpeech (dev-clean).

- [Automatic Text Scoring on ASAP (test)](<https://www.sota2.com/research/sota/automatic-text-scoring-on-asap-test.md>): Automatic Text Scoring; ASAP (test).

- [Reason scoring on human labels (held-out)](<https://www.sota2.com/research/sota/reason-scoring-on-human-labels-held-out.md>): Reason scoring; human labels (held-out).

- [Automated Short Answer Scoring on ASAP-SAS Item 10 (test)](<https://www.sota2.com/research/sota/automated-short-answer-scoring-on-asap-sas-item-10-test.md>): Automated Short Answer Scoring; ASAP-SAS Item 10 (test).
