# Taxonomy-Targeted Error Generation for Quantitative Reasoning

Source: [Taxonomy-Targeted Error Generation for Quantitative Reasoning](<https://www.sota2.com/research/paper/6a191d9edbd7150506f82806>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-07-22T05:00:13.060Z

Authors: Xinming Yang, Jun Li

Published: 2026-05-27T19:04:10.000Z

## Abstract

Personalized tutoring, teacher preparation, and education research can benefit from worked errors annotated by the mechanisms that produced them. Authentic student errors with such cognitive labels are costly to collect and share, motivating the study of whether LLMs can generate taxonomy-targeted synthetic errors as complementary candidate material. We present a task-specific framework that generates errors targeted to a five-class Bloom-informed student-error taxonomy. A Generation Agent (GA) drafts a candidate erroneous solution conditioned on a target class, and an Examination Agent (EA) judges whether the draft is incorrect and class-consistent. The framework yields a reusable recipe for building class-stratified synthetic error datasets where authentic student corpora are unavailable. As a secondary diagnostic, targeted error generation is substantially harder than free-form incorrect-answer generation, and answer-grounding contributes more than expanded examples or external textbook content.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Targeted error generation on TheoremQA Tier-1 (first-20 sweep)](<https://www.sota2.com/research/sota/targeted-error-generation-on-theoremqa-tier-1-first-20-sweep.md>): Targeted error generation; TheoremQA Tier-1 (first-20 sweep); Targeted Error Rate: 54.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2605.29007>)

[PDF](<https://arxiv.org/pdf/2605.29007.pdf>)
