Charles University in Prague, Law Faculty
Question
Asked 24 May 2014
Can anyone suggest an objective way to measure comprehensibility of a text (to be read aloud)?
I want to measure how easy/difficult a legal translated text is to a defendant whose only medium of reception of the text is the auditory channel. I am familiar with the Flesch readability formula but I was wondering if there are better ways to do it?
All Answers (3)
All tests of readabiIity including Flesch Kincaid are intended to measure texts as they may be read/understood by native speakers of the language of the text.
I am afraid there might be no "objective" way to measure a (a) translated and (b) legal text. There are several variables impeding objectivity: 1. a defendant - (a) native or non-native speaker of the target language; (b) knowledgeable of law or absolute layperson; (c) knowledgeable of listening techniques, etc. 2. the translated text - quality of translation between legal systems and languages (text perceived as "strange" due to differences between legal systems /difficult to understand/, or the text reads smoothly but does not translate the source law properly /easy to understand but does not make sense, etc.).
And also what would be the purpose of measurement? To show that the defendant should understand because the translated text has a particular comprehensibility score? I don´t know ...
Inter American University of Puerto Rico, Ponce Campus
A readability formula is not designed to measure comprehension. Readability formulas are designed for writers who are attempting to reach a certain audience. The nature of legal documents, as Marta Chroma mentions makes comprehension a challenge even for native speakers. The easiest way to measure listening comprehension of this type of text (i.e. jury instructions or warnings) is to have the subject retell what he or she has understood, perhaps in his or her native language. You may want to design a rubric with essential elements of the text, and qualitatively determine to what degree the listener has included those elements in his or her retelling.
1 Recommendation

If you just want to measure effort, then referring to Grice's conversational maxims and the relevency theory of effort to continuance, you could do what my group did in multi-cultural workshop curricula to generate data. We measured length of time it took to read, how many times the reader had to start over, number of questions asked for clarity, and compared that to the readers fluent in the source language reading the same document before translation. Also, you note whether the reader gave up trying to interpret the text or not and at what point did they give up. Effort equates to work and can be quantitatively measured by time.
Similar questions and discussions
**Open Call for Contributions: Handbook of Teaching and Learning in Social Innovation**
Milica Marković
We are pleased to announce an open call for academics and researchers to contribute to the forthcoming Handbook of Teaching and Learning in Social Innovation, which will be published by Edward Elgar in 2025. This publication, led by Dr Erich J. Schwarz as the editor in collaboration with Dr David B. Audretsch and Milica Marković MSc as the co-editors, aims to explore the intersections of teaching, learning, and Social Innovation to address pressing global challenges.
If you are engaged in Social Innovation and its potential for transformative change through education, we invite you to submit a proposal of up to 1,000 words. Your proposal should emphasise its relevance to the scope and objectives of the handbook and be submitted by July 8, 2024. Please send your proposals to Milica.Markovic@aau.at or socialinnovation@aau.at.
Related Publications
IntroductionApplied Linguistics and the Precursors of Educational LinguisticsThe Emergence of Educational LinguisticsThe Nature of Educational LinguisticsThe Scope of Educational LinguisticsConclusion
يروم هذا البحث استثمار علم اللّغة الجنائي في إنصاف علَم من أعلام مدرسة البصرة المقدّمين، في الرّواية ألا وهو "خلف الأحمر"، الذي اتُهم بالنّحل والوضع والكذب، فيقدّم في البداية تعريفا لعلم اللغة الجنائي، ولمحة موجزة عن حياة خلف الأحمر، ثم يعرض الأخبار، والإفادات التّي تتهمه بالوضع والنّحل، والأخبار والإفادات التي توثّقه، وبعدها يناقش الإفادات الأولى،...
Forensic linguistics is an interdisciplinary field that applies linguistic concepts and methods to legal contexts, such as criminal investigations, court proceedings, and document analysis. This research paper explores the various techniques and methodologies used in forensic linguistics to analyze written and spoken evidence in criminal cases. The...