---
title: "New paper: (How) Do Large Language Models Understand High-Level Message Sequence Charts?"
description: "King's College London publishes \"(How) Do Large Language Models Understand High-Level Message Sequence Charts?\" in Leveraging Applications of Formal Methods, Verification and Validation."
url: https://greencode.ai/news/paper-how-do-large-language-models-understand-high-level-message-s/
---

# New paper: (How) Do Large Language Models Understand High-Level Message Sequence Charts?

- 01 October, 2026
- GreenCode

### New paper: (How) Do Large Language Models Understand High-Level Message Sequence Charts?

Large language models are now used across software development, but it is unclear whether they handle design artefacts in line with what those artefacts formally mean, and this has had little attention for architectural specifications. This paper tests the question on High-Level Message Sequence Charts, visual models with a rigorous formal semantics that underpin sequence diagrams in UML. Three models, Gemini-3, GPT-5.4 and Qwen-3.6, were set 129 semantic tasks: questions about events and their ordering, abstractions and compositions that should preserve meaning, and calculating sets of traces and equivalent labelled transition systems. Overall accuracy was modest, at about 52%. The models handled the basic concepts well, at about 88%, but reached only about 36% on abstraction and composition and about 42% on traces and transition systems. All three struggled with co-regions and explicit causal dependencies and never used them when transforming charts. The results argue for caution before relying on language models for tasks that depend on the precise meaning of design models.

**Authors:** [Mohammad Reza Mousavi](https://greencode.ai/researchers/mohammad-reza-mousavi/)

**Contributing partner:** [King's College London](https://greencode.ai/partners/king-s-college-london/)

[Publication page and citation](https://greencode.ai/publications/how-do-large-language-models-understand-high-level-message-sequence-charts/) [View at the publisher](https://doi.org/10.1007/978-3-032-40108-3_8)

#### Categories

- All news **(43)**
- Publications **(25)**
- Project news **(14)**
- Articles **(4)**

#### Recent Post

- #### [greenai.guide: plain-English help for using AI with less energy](https://greencode.ai/news/greenai-guide/)

  [Read more](https://greencode.ai/news/greenai-guide/)
- #### [New paper: IP-Preserving Enterprise System Modernization via LLM-Driven Specification Extraction and Multi-target Code Generation](https://greencode.ai/news/paper-ip-preserving-enterprise-system-modernization-via-llm-driven/)

  [Read more](https://greencode.ai/news/paper-ip-preserving-enterprise-system-modernization-via-llm-driven/)
- #### [New paper: (How) Do Large Language Models Understand High-Level Message Sequence Charts?](https://greencode.ai/news/paper-how-do-large-language-models-understand-high-level-message-s/)

  [Read more](https://greencode.ai/news/paper-how-do-large-language-models-understand-high-level-message-s/)
- #### [GreenCode is now on YouTube and TikTok](https://greencode.ai/news/greencode-on-youtube-and-tiktok/)

  [Read more](https://greencode.ai/news/greencode-on-youtube-and-tiktok/)
