Question
Asked 24 May 2014

Can anyone suggest an objective way to measure comprehensibility of a text (to be read aloud)?

I want to measure how easy/difficult a legal translated text is to a defendant whose only medium of reception of the text is the auditory channel. I am familiar with the Flesch readability formula but I was wondering if there are better ways to do it?

All Answers (3)

Marta Chroma
Charles University in Prague, Law Faculty
All tests of readabiIity including Flesch Kincaid are intended to measure texts as they may be read/understood by native speakers of the language of the text.
I am afraid there might be no "objective" way to measure a (a) translated and (b) legal text. There are several variables impeding objectivity: 1. a defendant - (a) native or non-native speaker of the target language; (b) knowledgeable of law or absolute layperson; (c) knowledgeable of listening techniques, etc. 2. the translated text - quality of translation between legal systems and languages (text perceived as "strange" due to differences between legal systems /difficult to understand/, or the text reads smoothly but does not translate the source law properly /easy to understand but does not make sense, etc.).
And also what would be the purpose of measurement? To show that the defendant should understand because the translated text has a particular comprehensibility score? I don´t know ...
Sharon Clampitt
Inter American University of Puerto Rico, Ponce Campus
A readability formula is not designed to measure comprehension. Readability formulas are designed for writers who are attempting to reach a certain audience. The nature of legal documents, as Marta Chroma mentions makes comprehension a challenge even for native speakers. The easiest way to measure listening comprehension of this type of text (i.e. jury instructions or warnings) is to have the subject retell what he or she has understood, perhaps in his or her native language. You may want to design a rubric with essential elements of the text, and qualitatively determine to what degree the listener has included those elements in his or her retelling.
1 Recommendation
If you just want to measure effort, then referring to Grice's conversational maxims and the relevency theory of effort to continuance, you could do what my group did in multi-cultural workshop curricula to generate data. We measured length of time it took to read, how many times the reader had to start over, number of questions asked for clarity, and compared that to the readers fluent in the source language reading the same document before translation. Also, you note whether the reader gave up trying to interpret the text or not and at what point did they give up. Effort equates to work and can be quantitatively measured by time.

Similar questions and discussions

Related Publications

Chapter
IntroductionApplied Linguistics and the Precursors of Educational LinguisticsThe Emergence of Educational LinguisticsThe Nature of Educational LinguisticsThe Scope of Educational LinguisticsConclusion
Article
Full-text available
يروم هذا البحث استثمار علم اللّغة الجنائي في إنصاف علَم من أعلام مدرسة البصرة المقدّمين، في الرّواية ألا وهو "خلف الأحمر"، الذي اتُهم بالنّحل والوضع والكذب، فيقدّم في البداية تعريفا لعلم اللغة الجنائي، ولمحة موجزة عن حياة خلف الأحمر، ثم يعرض الأخبار، والإفادات التّي تتهمه بالوضع والنّحل، والأخبار والإفادات التي توثّقه، وبعدها يناقش الإفادات الأولى،...
Article
Full-text available
Forensic linguistics is an interdisciplinary field that applies linguistic concepts and methods to legal contexts, such as criminal investigations, court proceedings, and document analysis. This research paper explores the various techniques and methodologies used in forensic linguistics to analyze written and spoken evidence in criminal cases. The...
Got a technical question?
Get high-quality answers from experts.