# Unlocking UML Class Diagram Understanding in Vision Language Models

Source: [Unlocking UML Class Diagram Understanding in Vision Language Models](<https://www.sota2.com/research/paper/6a0405c3dbc836b87d82778e>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-14T05:00:05.131Z

Authors: Artem Naboichenko, Ren\\'e Peinl

Published: 2026-05-12T06:57:47.000Z

## Abstract

Although Vision Language Models (VLMs) have seen tremendous progress across all kinds of use cases, they still fall behind in answering questions regard-ing diagrams compared to photos. Although progress has been made in the area of bar charts, line charts and other diagrams like that there is still few research concerned with other types of diagrams, e.g. in the computer science domain. Our work presents a benchmark for visual question answering based on UML class diagrams which is both challenging and manageable. We further construct a large-scale training dataset with 16.000 image-question-answer triples and show that a LoRA-based finetune easily outperforms Qwen 3.5 27B, which is a recent and well-performing VLM in many other benchmarks.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2605.11634>)

[PDF](<https://arxiv.org/pdf/2605.11634.pdf>)
