Essay Scoring on ASAP-SAS (Prompts 3, 4, 7, 8, 9)
0.661QWK (Prompt 3)Llama3-8B-Inst.
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Llama3-8B-Inst.Assessment=Score + Feedback, Feedback Quality=High Quality (FeedEval)2026.01 | 0.661 | 0.61 | 0.551 | 0.595 | 0.729 | 0.629 | 0.035 | |
| Llama3-8B-Inst.Assessment=Score + Feedback, Feedback Quality=High Quality (GPT-5.1)2026.01 | 0.636 | 0.589 | 0.536 | 0.546 | 0.705 | 0.602 | 0.03 | |
| Llama3-8B-Inst.Assessment=Score + Feedback, Feedback Quality=Low Quality (FeedEval)2026.01 | 0.617 | 0.604 | 0.521 | 0.563 | 0.704 | 0.602 | 0.03 | |
| Qwen3-8BAssessment=Score + Feedback, Feedback Quality=High Quality (FeedEval)2026.01 | 0.606 | 0.617 | 0.521 | 0.563 | 0.726 | 0.607 | 0.03 | |
| Llama3-8B-Inst.Assessment=Score + Feedback, Feedback Quality=Low Quality (GPT-5.1)2026.01 | 0.584 | 0.606 | 0.474 | 0.553 | 0.7 | 0.583 | 0.025 | |
| Qwen3-8BAssessment=Score + Feedback, Feedback Quality=Low Quality (FeedEval)2026.01 | 0.582 | 0.577 | 0.491 | 0.553 | 0.706 | 0.582 | 0.035 | |
| Qwen3-8BAssessment=Score + Feedback, Feedback Quality=High Quality (GPT-5.1)2026.01 | 0.573 | 0.575 | 0.475 | 0.547 | 0.668 | 0.568 | 0.04 | |
| Qwen3-8BAssessment=Score Only, Feedback Quality=N/A2026.01 | 0.57 | 0.585 | 0.483 | 0.542 | 0.691 | 0.574 | 0.027 | |
| Qwen3-8BAssessment=Score + Feedback, Feedback Quality=Low Quality (GPT-5.1)2026.01 | 0.568 | 0.577 | 0.458 | 0.54 | 0.684 | 0.565 | 0.034 | |
| Llama3-8B-Inst.Assessment=Score Only, Feedback Quality=N/A2026.01 | 0.556 | 0.551 | 0.534 | 0.527 | 0.634 | 0.56 | 0.037 |