About
64
Publications
116,820
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,988
Citations
Introduction
I am a psychologist and linguist with the role of Associate Professor in Linguistics, Interpreting, and Translation, and lead of the HAL Language Processing Research Lab. With a focus on the psychology of language and technology, my research investigates human and machine language processing using natural language processing techniques and combinations of online and offline methods, mainly eye tracking and psychometrics.
Current institution
Additional affiliations
January 2014 - present
Publications
Publications (64)
Technological advances have led to unprecedented changes in translation as a means of interlingual communication. This article discusses the impact of two major technological developments of contemporary translation: computer-assisted translation tools and machine translation. These technologies have increased productivity and quality in translatio...
This chapter charts the development of eye tracking in the context of empirical research on subtitling and captioning, including foreign and same-language variants. It forms a critique of the eye tracking measures and methodologies in this field of research. In doing so, we provide a contemporary and accessible critical overview of how individual e...
The use of video has become well established in education, from traditional courses to blended and online courses. It has grown both in its diversity of applications as well as its content. Such educational video however is not fully accessible to all students, particularly those who require additional visual support or students studying in a forei...
Eye tracking has been used successfully as a technique for measuring cognitive load in reading, psycholinguistics, writing, language acquisition etc. for some time now. Its application as a technique for measuring the reading ease of MT output has not yet, to our knowledge, been tested. We report here on a preliminary study testing the use and vali...
Background
Recent research has demonstrated the potential of mobile‐assisted learning to enhance learners' learning outcomes. In contrast, the learning processes in this regard are much less explored using eye tracking technology.
Objective
This systematic review study aims to synthesise the relevant work to reflect the current state of eye tracki...
The present study combines three influential and interwoven areas of research (MALL, SLA, and psycholinguistics) into a cohesive research framework to explore whether and how medium and word exposure influence L2 learners’ incidental acquisition and online processing of new words using eye tracking methodology. Seventy-seven L2 learners engaged in...
Mobile-assisted reading research has seen a growing trend in the use of eye tracking to explore readers’ performance traditionally examined by offline accuracy measures. Through its ability to provide detailed records of online processing behaviours at a high temporal resolution, eye tracking offers new insights into real-time cognitive processes a...
As the final phase of the translation process, self-revision has traditionally been a relatively neglected component despite it being widely acknowledged as critical to achieving high-quality translation and in translator training. To identify effective educational interventions for self-revision, the current paper reports on a study that collected...
Previous reading research on incidental word learning as product and process has largely employed computer- or paper-based delivery methods. The present study uses a novel combination of offline and online measures to examine the effects of mobile media (mobile phone and tablet) compared to traditional media (paper and computer) on incidental L2 wo...
The literature on the benefits of subtitles has yielded contradictory results largely due to inconsistencies in experimental design and the operationalisation of variables such as language proficiency, subtitle language, and subtitle characteristics. As a result, there is insufficient evidence on the cognitive processing and impact of subtitles as...
Remote interpreting via video-link is increasingly being employed in investigative interviews chiefly due to its apparent increased accessibility and efficiency. However, risks of miscommunication have been shown to be magnified in remote interpreting and empirical research specifically on video-link remote interpreting is in its infancy which grea...
Recent research on the processing effects of mobile media has incorporated offline research methods to demonstrate that reading on mobile media is as effective as reading on computers or paper in accuracy of text comprehension. The present study uses an eye-tracking methodology to compare the effects of reading on mobile media (mobile phone and tab...
The use of captions has grown in recent years in both traditional and new media, particularly in terms of the diversity of style, content, and function. Impact captions have emerged as a popular form of captions for hearing viewers and contain rich multimodal information which is employed to capture viewer attention and enhance engagement, particul...
This article reports on the eye-tracking data collected from 18 professional interpreters while they performed consecutive interpreting with notes. It is a pioneering study in its visualisation of the way in which note-reading occurs. Preliminary evidence suggests that note-reading proceeds in a nonlinear manner. The data collected in this study al...
This article uses statistical data gathered from digitized and indexed journals to quantify the identity, status, purpose, and impact of visitors to a series of Royal Commissions of Inquiry dispatched to the Cape and Mauritius from 1823. The 1819–38 Commissions of Inquiry were unprecedented in their scope and unparalleled in their impacts. They gen...
This study tested the effects of the consecutive and simultaneous interpreting modes in a simulated police interview, addressing four research questions: (1) Does the consecutive interpreting mode lead to more accurate interpreting than the simultaneous interpreting mode? (2) Do language combinations moderate the performance of similarly qualified...
Time-course data are temporal data that can be explored statically as an outcome measure of accuracy or dynamically from evolutionary and developmental perspectives. The present study examines the development and evolution of accuracy throughout the time-course of a pre-test/treatment/post-test study of instructed second language acquisition. The t...
The present study measured the effects of guided-inductive (GI) versus deductive computer-delivered instruction on the processing and retention of the Spanish true passive using a self-paced reading design. Fifty-four foreign language learners of Spanish participated in the study, which operationalised guided-inductive and deductive approaches usin...
Recent research on the effects of processing instruction (PI) have incorporated online research methods in order to demonstrate that PI has effects on cognitive processing behaviors as well as on accuracy (e.g. Lee & Doherty, 2019a). The present study uses self-paced reading and a moving windows technique to examine the effects of PI on second lang...
The addition of subtitles to videos has the potential to benefit students across the globe in a context where online video lectures have become a major channel for learning, particularly because, for many, language poses a barrier to learning. Automated subtitling, created with the use of speech-recognition software, may be a powerful way to make t...
With the proliferation and global dissemination of audiovisual products, subtitles have been widely used as a cost-effective tool to minimise language barriers for audiences of diverse cultural and linguistic backgrounds. However, the effectiveness of subtitles is still a topic of much debate and subject to various conditions, such as the context o...
We know from the literature that high cognitive load can impede performance and educational outcomes. Previous measures of cognitive load have largely relied on subjective scales but few have explored more objective measures. This paper aims to address this issue by examining the validity of electroencephalography (or EEG) as an objective measure o...
The present study compares native and nonnative processing of Spanish active and passive sentences. The nonnative speakers were tested before and after receiving processing instruction on the Spanish passive. The native speakers were tested once and provide a baseline for comparisons. We measured accuracy and response time to select the correct res...
Research materials for the journal article "Native and non-native processing of active and passive sentences: the effects of processing instruction on the allocation of visual attention". The attached file contains the pretest, treatment materials, explicit information and practice sentences, posttest, and sample images.
Eye tracking has become a central research method in quantitative approaches in Translation Studies over the past decade. While the number of such studies is growing, methodological limitations have arisen in the application of eye tracking to the study of translation processes and their products. This chapter discusses two interrelated limitations...
Experimental studies on AVT have grown incrementally over the past decade. This growing body of research has explored several aspects of AVT reception and production using behavioural measures such as eye tracking, as well as venturing into physiological measures such as electroencephalography (EEG), galvanic skin response, and heart rate. As a nov...
The continuing growth in digital content means that there is now significantly more linguistic content to translate using more diverse workflows and tools than ever before. This growth necessitates broader requirements for Translation Quality Assessment (TQA) that include appropriate methods for the domain, text type, workflow, and end-user.With th...
This is the first volume that brings together research and practice from academic and industry settings and a combination of human and machine translation evaluation. Its comprehensive collection of papers by leading experts in human and machine translation quality and evaluation who situate current developments and chart future trends fills a clea...
The depth, breadth, and complexity of audiovisual translation (AVT) are growing at a rapid rate. AVT is becoming increasingly merged with language technologies, including computer-assisted translation tools, machine translation, automated subtitling and captioning software, and automatic speech recognition systems. An essential component in this ex...
In this chapter, we argue that education and training in translation quality assessment (TQA)is being neglected for most, if not all, stakeholders of the translation process, from translators, post-editors, and reviewers to buyers and end-users of translation products and services. Within academia, there is a lack of education and training opportun...
In both research and practice, translation quality assessment is a complex task involving a range of linguistic and extra-linguistic factors. This chapter provides a critical overview of the established and developing approaches to the definition and measurement of translation quality in human and machine translation workflows across a range of res...
The coming of age of audiovisual translation studies has brought about a much-needed surge of studies focusing on the audience, their comprehension, appreciation or rejection of what reaches them through the medium of translation. Although complex to perform, studies on the reception of translated audiovisual texts offer a uniquely thorough picture...
This chapter presents the findings of a multimodal study that combines a suite of methods, namely, eye tracking, electroencephalography, and self-reported psychometrics, to investigate the impact of language and layout on cognitive load in the absence and presence of conventional same-language subtitles and integrated titles (a transcript of the sp...
All audiovisual translation (AVT) modes mediate the audiovisual text for the audience. For audiences excluded from all or part of a visual or an auditory channel, this has significant implications in terms of comprehension and enjoyment. With subtitling (SDH in particular), we want the audiences to have the same quality of access to the characters...
This study investigates the impact of same-language subtitles on the immersion into audiovisual narratives as a function of the viewer's language (native or foreigner). Students from two universities in Australia and one in Spain were assigned randomly to one of two experimental groups, in which they saw a drama with the original English soundtrack...
This study investigates the impact of same-language subtitles on the immersion into audiovisual narratives as a function of the viewer's language (native or foreigner). Students from two universities in Australia and one in Spain were assigned randomly to one of two experimental groups, in which they saw a drama with the original English soundtrack...
Japanese and other Asian TV producers have been deploying multi-colored, and highly visible, intra-lingual captions on TV programs to enhance their appeal and to influence their viewers’ interpretations. The practice of adding these captions is far from innocent and is prone to abuse and overuse due to the lack of official guidelines and an evidenc...
Having emerged in the early 80s mainly thanks to the works of Géry d’Ydewalle and his team, experimental research on Audiovisual Translation (AVT) has been quite active in the past decade. A number of studies have explored several aspects of AVT reception and production using behavioural and eye tracking measures, and sometimes also venturing into...
This chapter presents the findings of a study to investigate the impact of subtitles on the processing of audiovisual texts in terms of levels of self-reported engagement with the text. It also presents a methodology for investigating the neural processing of subtitles using electroencephalography (EEG) and psychometrics. By establishing the beta c...
The following paper has been prepared by two independent researchers – Dr Stephen Doherty (UNSW) and Dr Ignacio Garcia (UWS). It discusses options and alternatives for NAATI transitioning to Keyboarded Translator Assessment. NAATI commissioned this to support discussions with the broad group of stakeholders who engage with translator assessments –...
This paper describes a large-scale survey of machine translation (MT) competencies conducted by a non-commercial and publicly funded European research project. Firstly, we highlight the increased prevalence of translation technologies in the translation and localisation industry, and develop upon this by reporting on survey data derived from 438 va...
In this paper we argue that the time is ripe for translator educators to engage with Statistical Machine Translation (SMT) in more profound ways than they have done to date. We explain the basic principles of SMT and reflect on the role of humans in SMT workflows. Against a background of diverging opinions on the latter, we argue for a holistic app...
Despite the acknowledged importance of translation technology in translation studies programmes and the current ascendancy of Statistical Machine Translation (SMT), there has been little reflection to date on how SMT can or should be integrated into the translation studies curriculum. In a companion paper we set out a rationale for including a holi...
This paper aims to automatically identify which linguistic phenomena represent barriers to better MT quality. We focus on the translation of news data for two bidirectional language pairs: EN↔ES and EN↔DE. Using the diagnostic MT evaluation toolkit DELiC4MT and a set of human reference translations, we relate translation quality barriers to a selec...
This paper reports on the results of a project that aimed to investigate the usability of raw machine translated technical support documentation for a commercial online file storage service. Adopting a user-centred approach, we utilize the ISO/TR 16982 definition of usability - goal completion, satisfaction, effectiveness, and efficiency – and appl...
This short industry paper presents approaches to human evaluation, describes the advantages and shortcomings of each in relation to typical workflows, and highlights further materials and training resources.
This study compares consistency in target texts produced using translation memory (TM) with that of target texts produced using statistical machine translation (SMT), where the SMT engine is trained on the same texts as are reused in the TM workflow. These comparisons focus specifically on noun and verb inconsistencies, as such inconsistencies appe...
The aim of this report is to define the interfaces for the tools used in the MT development and
evaluation scenarios as included in the QTLaunchPad (QTLP) infrastructure. Specification of
the interfaces is important for the interaction and interoperability of the tools in the developed
QTLP infrastructure. In addressing this aim, the report provide...
This study investigates whether the use of controlled language (CL) improves the readability and comprehension of technical support documentation produced by a statistical machine translation system. Readability is operationalised here as the extent to which a text can be easily read in terms of formal linguistic elements; while comprehensibility i...
This article presents an on-going evaluation of translation technology lab sessions in a university setting. Lab sessions are practical supplements that allow student translators to develop upon what has already been learned in theory via traditional lectures. Both of these components develop the technical competencies required for professional wor...
Despite the growth of statistical machine translation (SMT) research and development in recent years, it remains somewhat out of reach for the translation community where programming expertise and knowledge of statistics tend not to be commonplace. While the concept of SMT is relatively straightforward, its implementation in functioning systems rem...
This paper reports on a preliminary study testing the use of eye tracking as a method for evaluating machine translation output. 50 French machine translated sentences, 25 rated as excellent and 25 rated as poor in an earlier human evaluation, were selected. 10 native speakers of French were in- structed to read the MT sentences for comprehen- sibi...
Questions
Questions (2)
Dear colleagues,
Our experiment is looking at the impact of the linguistic manipulation of evidential adverbs on the belief of declarative statements.
For example:
'Despite a lengthy divorce, they remain on good terms' [Control]
'Despite a lengthy divorce, they are evidently still on good terms' [Positive]
'Despite a lengthy divorce, they are allegedly still on good terms' [Negative]
I'm looking to add EEG to the existing setup of eye-tracking + subjective interpretation measures to investigate if participants question the truthfulness of the content of statements across different conditions of polarity - e.g. one would expect the use of 'allegedly' in our example above would cause the reader to pose such a question.
Which features of EEG could be used to ascertain one's questioning of the truthfulness of the content in a given statement?
Douglas et al. (2013) use sub-bands to distinguish between participants' belief and disbelief of given statements [http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3728485/#B19] and the approach of Reiser et al. (2012) to measure beta coherence between prefrontal and posterior cortical regions might be applicable in terms of incoherence signalling dissociation [http://www.ncbi.nlm.nih.gov/pubmed/22750775]. Or one could possibly look for N400 / P600 effects.
Any advice and references are greatly appreciated!
Stephen
The context is in a project examining how TV viewers multi-task and have their attention divided between tasks, then re-visit the TV screen for certain events while they have been visually attending to another task.
