Dalarna University's logo and link to the university's website

du.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • chicago-author-date
  • chicago-note-bibliography
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
How to systematically and quantifiably remove meaning?
Student Högskolan Dalarna.
Dalarna University, School of Information and Engineering, Computing. BEACON Center for the Study of Evolution in Action, Michigan State University, US..ORCID iD: 0000-0002-4872-1961
2026 (English)In: Frontiers in Artificial Intelligence, E-ISSN 2624-8212, Vol. 9, article id 1783410Article in journal (Refereed) Published
Abstract [en]

Large language models increasingly mediate real-world tasks, yet we lack systematic ways to quantify how their performance degrades when the meaning of their inputs is eroded. To bridge this gap, we developed a framework to semantically erode meaning and quantify its intensity, grounded in discourse analysis, psycholinguistics, and software engineering, comprising five theoretically motivated methods: omission of key information and context, lexical substitution with near-synonyms, increased abstraction, structural obfuscation and renaming, and injection of logical errors. We applied these erosion operators across five domains and quantified their effects on model performance using a publicly available language model. A two-way Analysis of Variance (ANOVA) revealed significant main effects of both domain and erosion method, as well as a significant interaction, indicating that the impact of semantic degradation depends jointly on how text is eroded and how domain-specific information is encoded. Logical error erosions proved especially damaging for code generation, whereas structural obfuscation most strongly impaired news and instruction tasks. Epistasis analysis of pairwise erosion unions showed that some combinations produced super-additive degradation while others exhibited compensatory effects. These domain-by-erosion profiles provide diagnostic insight into where multi-step large language model (LLM) pipelines are most likely to fail and suggest that robustness benchmarks should probe models along domain-specific vulnerability dimensions rather than relying on generic perturbations. Semantic erosion thus offers a principled tool for turning model failure into evidence about how language models structure and degrade meaning.

Place, publisher, year, edition, pages
2026. Vol. 9, article id 1783410
Keywords [en]
large language models; meaning and semantics; meaning degradation; robustness evaluation; semantic erosion.
National Category
Natural Language Processing Software Engineering
Identifiers
URN: urn:nbn:se:du-53781DOI: 10.3389/frai.2026.1783410ISI: 001776866800001PubMedID: 42211171Scopus ID: 2-s2.0-105041462539OAI: oai:DiVA.org:du-53781DiVA, id: diva2:2064669
Available from: 2026-06-02 Created: 2026-06-02 Last updated: 2026-06-23Bibliographically approved

Open Access in DiVA

fulltext(1403 kB)16 downloads
File information
File name FULLTEXT01.pdfFile size 1403 kBChecksum SHA-512
39d53c731d93a79f34fc1e2dddfc90cf1115f784b3d18eae166b04070cd7b7d8b287cc7f86e7bf2cc539f6b89c0c4c725f9034e7d2a7033b1c19494feaf3001b
Type fulltextMimetype application/pdf

Other links

Publisher's full textPubMedScopus

Authority records

Hintze, Arend

Search in DiVA

By author/editor
Hintze, Arend
By organisation
Computing
In the same journal
Frontiers in Artificial Intelligence
Natural Language ProcessingSoftware Engineering

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 260 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • chicago-author-date
  • chicago-note-bibliography
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf