<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.0 20120330//EN" "JATS-journalpublishing1.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">cndcgs</journal-id>
      <journal-title-group>
        <journal-title>Challenges to national defence in contemporary geopolitical situation</journal-title>
      </journal-title-group>
      <issn pub-type="epub">2538-8959</issn>
      <issn pub-type="ppub">2669-2023</issn>
      <publisher>
        <publisher-name>LKA</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id">71_DRAHOKOUPILOVA</article-id>
      <article-id pub-id-type="doi">10.47459/cndcgs.2026.71</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Article</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>A Multi-Criteria LLM-Based Framework for Automated Evaluation of Scientific Language Quality</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <name>
            <surname>DRAHOKOUPIL</surname>
            <given-names>Josef</given-names>
          </name>
          <xref ref-type="aff" rid="j_cndcgs_aff_000"/>
        </contrib>
        <aff id="j_cndcgs_aff_000">Language Centre, University of Defence, Czech Republic</aff>
        <contrib contrib-type="author">
          <name>
            <surname>DRAHOKOUPILOVÁ</surname>
            <given-names>Eva</given-names>
          </name>
          <email xlink:href="mailto:eva.drahokoupilova@unob.cz">eva.drahokoupilova@unob.cz</email>
          <xref ref-type="aff" rid="j_cndcgs_aff_001"/>
          <xref ref-type="corresp" rid="cor2">∗∗</xref>
        </contrib>
        <aff id="j_cndcgs_aff_001">Language Centre, University of Defence, Czech Republic</aff>
        <contrib contrib-type="author">
          <name>
            <surname>VAŇKOVÁ</surname>
            <given-names>Jana</given-names>
          </name>
          <xref ref-type="aff" rid="j_cndcgs_aff_002"/>
        </contrib>
        <aff id="j_cndcgs_aff_002">Language Centre, University of Defence, Czech Republic</aff>
        <contrib contrib-type="author">
          <name>
            <surname>FIALOVÁ</surname>
            <given-names>Dana</given-names>
          </name>
          <xref ref-type="aff" rid="j_cndcgs_aff_003"/>
        </contrib>
        <aff id="j_cndcgs_aff_003">Language Centre, University of Defence, Czech Republic</aff>
      </contrib-group>
      <author-notes>
        <corresp id="cor2"><label>∗∗</label>Corresponding author.</corresp>
      </author-notes>
      <volume>2026</volume>
      <issue>1</issue>
      <fpage>619</fpage>
      <lpage>623</lpage>
      <pub-date pub-type="epub">
        <day>09</day>
        <month>07</month>
        <year>2026</year>
      </pub-date>
      <permissions>
        <license license-type="open-access">
          <license-p>Creative Commons Attribution International License (CC BY)</license-p>
        </license>
      </permissions>
      <abstract>
        <p>This study proposes a multi-criteria framework for automated evaluation of scientific language quality using Large Language Models (LLMs). The approach models translation assessment as a structured decision process across semantic, grammatical, and terminological dimensions aligned with ISO 5060:2024. Validation on biomedical data shows strong agreement with expert judgment (κ = 0.81), while metric-based estimation demonstrates weak correlation. The results indicate that interpretable LLM-based evaluation can reliably replicate expert reasoning and support scalable, transparent language quality assessment.</p>
      </abstract>
      <kwd-group>
        <label>Keywords</label>
        <kwd>multi-criteria evaluation</kwd>
        <kwd>structured decision architecture</kwd>
        <kwd>Large Language Models</kwd>
        <kwd>editorial proofreading services</kwd>
        <kwd>inter-rater agreement</kwd>
        <kwd>prevalence-adjusted kappa</kwd>
        <kwd>scientific language assessment</kwd>
        <kwd>AI calibration</kwd>
      </kwd-group>
    </article-meta>
  </front>
</article>
