Automated Short Answer Scoring on ASAP-SAS Item 6 (test)
0.769QWKIterative Skill Optimization
Evaluation Results
| Method | Links | |
|---|---|---|
| Iterative Skill OptimizationRubric Condition=weak sbest, Initial Skill Variant=weak2026.05 | 0.769 | |
| Iterative Skill OptimizationRubric Condition=medium sbest, Initial Skill Variant=medium2026.05 | 0.756 | |
| Iterative Skill OptimizationRubric Condition=strong sbest, Initial Skill Variant=strong2026.05 | 0.728 | |
| Expert RubricRubric Condition=w/ expert2026.05 | 0.708 | |
| Initial Skill (s0)Rubric Condition=medium s0, Initial Skill Variant=medium2026.05 | 0.705 | |
| Initial Skill (s0)Rubric Condition=weak s0, Initial Skill Variant=weak2026.05 | 0.703 | |
| No RubricRubric Condition=w/o rubric2026.05 | 0.676 | |
| Initial Skill (s0)Rubric Condition=strong s0, Initial Skill Variant=strong2026.05 | 0.646 |