Scopus

A Novel Pipeline for Automatic UML Sequence Diagram Synthesis and Multimodal Scoring

Năm XB 2025 Tạp chí / Hội thảo International Conference on Intelligent Systems and Data Science (ISDS2025) 473-485 Đơn vị CNTT DOI / Link https://doi.org/10.1007/978-981-95-3355-8_34 ↗

Tác giả

Van-Viet Nguyen ^✉ ; Huu-Khanh Nguyen ; Kim-Son Nguyen ; Thi Minh-Hue Luong ; The-Vinh Nguyen ; Duc-Quang Vu

Tóm tắt

The increasing complexity of modern software systems underscores the need for robust, automated modeling tools. Among Unified Modeling Language (UML) artifacts, Sequence Diagrams play a crucial role in depicting dynamic interactions between system components. However, their manual creation remains time-consuming and error-prone. This paper extends our framework, focusing specifically on the synthesis of Sequence Diagrams. We introduce a two-stage pipeline that combines a lightweight language model (LLaMA 3.2 1B-Instruct) for generating detailed technical specifications, with a reasoning-enhanced large language model (DeepSeek-R1-Distill-Qwen-32B) to produce corresponding PlantUML code. This approach yields a novel dataset of 1,000 high-quality samples, each containing a technical description, PlantUML code, and the resulting diagram. To validate semantic and structural fidelity, we …

Tài liệu tham khảo

[1] Booch, G.: The Unified Modeling Language User Guide. Pearson Education India (2005)

[2] Ambler, S.W.: The Object Primer: Agile Model-Driven Development with UML 2.0. Cambridge University Press (2004)

[3] Belady, L.A., Lehman, M.M.: Program Evolution: Processes of Software Change. Academic Press (1985)

[4] Tan, H., Bansal, M.: Lxmert: Learning cross-modality encoder representations from transformers. arXiv preprint arXiv:1908.07490 (2019)

[5] Chen, Y.-C., et al.: UNITER: universal image-text representation learning. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12375, pp. 104–120. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58577-8_7

[6] Zhang, P., et al.: Vinvl: revisiting visual representations in vision-language models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5579–5588 (2021)

[7] Lu, J., Batra, D., Parikh, D., Lee, S.: Vilbert: pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. In: Advances in Neural Information Processing Systems, vol. 32 (2019)

[8] Zhou, L., Palangi, H., Zhang, L., Houdong, H., Corso, J., Gao, J.: Unified vision-language pre-training for image captioning and VQA. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 13041–13049 (2020)

[9] Viet, N.V., Vinh, N.T.: Large language models in software engineering: a systematic review and vision. J. Educ. Sustain. Innov. 2(2), 146–156 (2024)

[10] Touvron, H., et al. Llama 2: open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288 (2023)

[11] Guo, D., et al. Deepseek-r1: incentivizing reasoning capability in LLMs via reinforcement learning. arXiv preprint arXiv:2501.12948 (2025)

[12] Conrardy, A., Cabot, J.: From image to UML: first results of image based UML diagram generation using LLMs. arXiv preprint arXiv:2404.11376 (2024)

[13] Viet, N.V.: Umlcode-classdiagram-deepseek-32b-scored (revision b93c8b0) (2025)

[14] Touvron, H., et al.: Llama: open and efficient foundation language models (2023)

[15] DeepSeek-AI. Deepseek-r1: Incentivizing reasoning capability in LLMs via reinforcement learning (2025)

[16] Wang, P., et al.: Qwen2-VL: enhancing vision-language model’s perception of the world at any resolution. arXiv preprint arXiv:2409.12191 (2024)

[17] Bai, J., et al.: Qwen-VL: a versatile vision-language model for understanding, localization, text reading, and beyond. arXiv preprint arXiv:2308.12966 (2023)

[18] Üstün, A., et al.: Aya model: an instruction finetuned open-access multilingual language model. arXiv preprint arXiv:2402.07827 (2024)

[19] Yue, X., et al.: Mmmu: a massive multi-discipline multimodal understanding and reasoning benchmark for expert AGI. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9556–9567 (2024)

← Quay lại danh sách bài báo