A Multi-Criteria LLM-Based Framework for Automated Evaluation of Scientific Language Quality
Volume 2026, Issue 1 (2026), pp. 619–623
Pub. online: 9 July 2026
Type: Article
Open Access
Published
9 July 2026
9 July 2026
Abstract
This study proposes a multi-criteria framework for automated evaluation of scientific language quality using Large Language Models (LLMs). The approach models translation assessment as a structured decision process across semantic, grammatical, and terminological dimensions aligned with ISO 5060:2024. Validation on biomedical data shows strong agreement with expert judgment (κ = 0.81), while metric-based estimation demonstrates weak correlation. The results indicate that interpretable LLM-based evaluation can reliably replicate expert reasoning and support scalable, transparent language quality assessment.