About
133
Publications
33,782
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
3,592
Citations
Introduction
Additional affiliations
October 2013 - present
August 2013 - January 2016
August 2012 - October 2013
Publications
Publications (133)
Memory deficits are a hallmark of many different neurological and psychiatric conditions. The Rey–Osterrieth complex figure (ROCF) is the state-of-the-art assessment tool for neuropsychologists across the globe to assess the degree of non-verbal visual memory deterioration. To obtain a score, a trained clinician inspects a patient’s ROCF drawing an...
Autism spectrum disorder (“autism”) is a neurodevelopmental condition characterized by substantial behavioral and neuroanatomical heterogeneity. This poses significant challenges to understanding its neurobiological mechanisms and developing effective interventions. Identifying phenotypically more homogeneous subgroups and shifting the focus from a...
On the centenary of the first human EEG recording, more than 500 experts reflect on the impact that this discovery has had on our understanding of the brain and behaviour. We document their priorities and call for collective action focusing on validity, democratization and responsibility to realize the potential of EEG in science and society over t...
The capacity to learn is a key determinant for the quality of life but is known to decline to varying degrees with age. However, despite mounting evidence of memory deficits in older age, the neural mechanisms contributing to successful or impeded memory remain unclear. Previous research has primarily focused on memory formation through remembered...
Memory deficits are a hallmark of many different neurological and psychiatric conditions. The Rey-Osterrieth complex figure (ROCF) is the state–of-the-art assessment tool for neuropsychologists across the globe to assess the degree of non-verbal visual memory deterioration. To obtain a score, a trained clinician inspects a patient’s ROCF drawing an...
Memory deficits are a hallmark of many different neurological and psychiatric conditions. The Rey-Osterrieth complex figure (ROCF) is the state–of-the-art assessment tool for neuropsychologists across the globe to assess the degree of non-verbal visual memory deterioration. To obtain a score, a trained clinician inspects a patient’s ROCF drawing an...
Differences in face processing are commonly reported in case/control studies of autism. Their neural correlates have been explored extensively across single neuroimaging modalities within key regions of the face processing network, such as the fusiform gyrus (FFG). Nonetheless, it is poorly understood how different variation(s) in brain anatomy and...
Background
Differences in face processing are commonly reported in case/control studies of autism. Their neural correlates have been explored extensively across single neuroimaging modalities within key regions of the face processing network, such as the fusiform gyrus (FFG). Nonetheless, it is poorly understood how different variation(s) in brain...
Autism Spectrum Disorder (‘autism’) is a neurodevelopmental condition characterized by substantial behavioural and neuroanatomical heterogeneity. This poses significant challenges to understanding its neurobiological mechanisms and developing effective interventions. Identifying phenotypically more homogeneous subgroups and shifting the focus from...
Eye movements can reveal valuable insights into various aspects of human mental processes, physical well-being, and actions. Recently, several datasets have been made available that simultaneously record EEG activity and eye movements. This has triggered the development of various methods to predict gaze direction based on brain activity. However,...
Visual working memory (VWM) is a temporary storage system capable of retaining information that can be accessed and manipulated by higher cognitive processes, thereby facilitating a wide range of cognitive functions. Electroencephalography (EEG) is used to understand the neural correlates of VWM with high temporal precision, and one commonly used E...
Eye movements can reveal valuable insights into various aspects of human mental processes, physical well-being, and actions. Recently, several datasets have been made available that simultaneously record EEG activity and eye movements. This has triggered the development of various methods to predict gaze direction based on brain activity. However,...
The capacity to learn and memorize is a key determinant for the quality of life but is known to decline to varying degrees with age. However, neural correlates of memory formation and the critical features that determine the extent to which aging affects learning are still not well understood. By employing a visual sequence learning task, we were a...
Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder that is highly prevalent and requires clinical specialists to diagnose. It is known that an individual’s viewing behavior, reflected in their eye movements, is directly related to attentional mechanisms and higher-order cognitive processes. We therefore explore whether...
In this study, we validate the findings of previously published papers, showing the feasibility of an Electroencephalography (EEG) based gaze estimation. Moreover, we extend previous research by demonstrating that with only a slight drop in model performance, we can significantly reduce the number of electrodes, indicating that a high-density, expe...
Increasing life expectancy is prompting the need to understand how the brain changes during healthy aging. Research utilizing electroencephalography (EEG) has found that the power of alpha oscillations decrease from adulthood on. However, non-oscillatory (aperiodic) components in the data may confound results and thus require re-investigation of th...
We present a new machine learning benchmark for reading task classification with the goal of advancing EEG and eye-tracking research at the intersection between computational language processing and cognitive neuroscience. The benchmark task consists of a cross-subject classification to distinguish between two reading paradigms: normal reading and...
Attention-deficit/hyperactivity disorder (ADHD) is a common and debilitating neurodevelopmental disorder associated with various negative life impacts. The manifestation of ADHD is very heterogeneous, and previous investigations on neuroanatomical alterations in ADHD have yielded inconsistent results. We investigated the mediating effect of in-scan...
Previous literature has focused on predicting a diagnostic label from structural brain imaging. Since subtle changes in the brain precede cognitive decline in healthy and pathological aging, our study predicts future decline as a continuous trajectory instead. Here, we tested whether baseline multimodal neuroimaging data improve the prediction of f...
Childhood and adolescence are critical stages of the human lifespan, in which fundamental neural reorganizational processes take place. A substantial body of literature investigated accompanying neurophysiological changes, focusing on the most dominant feature of the human EEG signal: the alpha oscillation. Recent developments in EEG signal-process...
The capacity to learn and memorize is a key determinant for the quality of life, but is known to decline to varying degrees with age. Previous ERP research methods had the limitation that their design did not allow to track the gradual memory formation process. Thus, the neural mechanisms underlying memory formation and the critical features that d...
Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder that is highly prevalent and requires clinical specialists to diagnose. It is known that an individual's viewing behavior, reflected in their eye movements, is directly related to attentional mechanisms and higher-order cognitive processes. We therefore explore whether...
Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder that is highly prevalent and requires clinical specialists to diagnose. It is known that an individual's viewing behavior, reflected in their eye movements, is directly related to attentional mechanisms and higher-order cognitive processes. We therefore explore whether...
The collection of eye gaze information provides a window into many critical aspects of human cognition, health and behaviour. Additionally, many neuroscientific studies complement the behavioural information gained from eye tracking with the high temporal resolution and neurophysiological markers provided by electroencephalography (EEG). One of the...
Memory deficits are a hallmark of many different neurological and psychiatric conditions. The Rey-Osterrieth complex figure (ROCF) is the state–of-the-art assessment tool for neuropsychologists across the globe to assess the degree of non-verbal visual memory deterioration. To obtain a score, a trained clinician inspects a patient’s ROCF drawing an...
The collection of eye gaze information provides a window into many critical aspects of human cognition, health and behaviour. Additionally, many neuroscientific studies complement the behavioural information gained from eye tracking with the high temporal resolution and neurophysiological markers provided by electroencephalography (EEG). One of the...
Background
Memory deficits are a hallmark of many different neurological and psychiatric conditions. The Rey-Osterrieth complex figure (ROCF) is the state–of-the-art assessment tool for neuropsychologists across the globe to assess the degree of non-verbal visual memory deterioration. To obtain a score, a trained clinician inspects a patient’s ROCF...
Psychiatric disorders are among the most common and debilitating illnesses across the lifespan and begin usually during childhood and adolescence, which emphasizes the importance of studying the developing brain. Most of the previous pediatric neuroimaging studies employed traditional univariate statistics on relatively small samples. Multivariate...
This paper extends the frequency domain quantitative electroencephalography (qEEG) methods pursuing higher sensitivity to detect Brain Developmental Disorders. Prior qEEG work lacked integration of cross-spectral information omitting important functional connectivity descriptors. Lack of geographical diversity precluded accounting for site-specific...
We present a new machine learning benchmark for reading task classification with the goal of advancing EEG and eye-tracking research at the intersection between computational language processing and cognitive neuroscience. The benchmark task consists of a cross-subject classification to distinguish between two reading paradigms: normal reading and...
This paper extends our frequency domain quantitative electroencephalography (qEEG) methods pursuing higher sensitivity to detect Brain Developmental Disorders. Prior qEEG work lacked integration of cross-spectral information omitting important functional connectivity descriptors. Lack of geographical diversity precluded accounting for site-specific...
The Zurich Cognitive Language Processing Corpus (ZuCo) provides eye-tracking and EEG signals from two reading paradigms, normal reading and task-specific reading. We analyze whether machine learning methods are able to classify these two tasks using eye-tracking and EEG features. We implement models with aggregated sentence-level features as well a...
Developers proposing new machine learning for health (ML4H) tools often pledge to match or even surpass the performance of existing tools, yet the reality is usually more complicated. Reliable deployment of ML4H to the real world is challenging as examples from diabetic retinopathy or Covid-19 screening show. We envision an integrated framework of...
We present a new dataset and benchmark with the goal of advancing research in the intersection of brain activities and eye movements. Our dataset, EEGEyeNet, consists of simultaneous Electroencephalography (EEG) and Eye-tracking (ET) recordings from 356 different subjects collected from three different experimental paradigms. Using this dataset, we...
There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sci...
Power modulations in alpha oscillations (8-14Hz) have been associated with most human cognitive functions and psychopathological conditions studied. These reports are often inconsistent with the prevailing view of a specific relationship of alpha oscillations to attention and working memory (WM). We propose that conceptualizing the role of alpha os...
Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language processing tasks. Using EEG brain activity for this purpose is largely unexplored as of yet. In this paper, we...
Increasing life expectancy is prompting the need to understand how the brain changes during healthy aging. Research utilizing Electroencephalography (EEG) has found that the power of alpha oscillations decrease from adulthood on. However, non-oscillatory (aperiodic) components in the data may confound results and thus require re-investigation of th...
We present first insights into our project that aims to develop an Electroencephalography (EEG) based Eye-Tracker. Our approach is tested and validated on a large dataset of simultaneously recorded EEG and infrared video-based Eye-Tracking, serving as ground truth. We compared several state-of-the-art neural network ar-chitectures for time series c...
Objectives
Working memory is essential for daily life skills like reading comprehension, reasoning, and problem-solving. Healthy aging of the brain goes along with working memory decline that can affect older people’s independence in everyday life. Interventions in the form of cognitive training are a promising tool for delaying age-related working...
There is growing awareness across the neuroscience community that the replicability of findings on the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardized analysis pipelines. Inspired by efforts from the psychological sciences, and...
Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language processing tasks. Using EEG brain activity to this purpose is largely unexplored as of yet. In this paper, we...
The Zurich Cognitive Language Processing Corpus (ZuCo) provides eye-tracking and EEG signals from two reading paradigms, normal reading and task-specific reading. We analyze whether machine learning methods are able to classify these two tasks using eye-tracking and EEG features. We implement models with aggregated sentence-level features as well a...
The quantification of resting-state electroencephalography (EEG) is associated with a variety of measures. These include power estimates at different frequencies, microstate analysis, and frequency-resolved source power and connectivity analyses. Resting-state EEG metrics have been widely used to delineate the manifestation of cognition and to iden...
There is growing awareness across the neuroscience community that the replicability of findings on the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by efforts from the psychological sciences, and...
During childhood and adolescence, the human brain undergoes various micro- and macroscopic changes. Understanding the neurophysiological changes within this reorganizational process is crucial, as many major psychiatric disorders emerge during this critical phase of life. In electroencephalography (EEG), a widely studied signal component are alpha...
Neuropsychological studies indicate that healthy aging is associated with a decline of inhibitory control of at-tentional and behavioral systems. A widely accepted measure of inhibitory control is the antisaccade task that requires both the inhibition of a reflexive saccadic response toward a visual target and the initiation of a voluntary eye move...
Neuropsychological studies indicate that healthy aging is associated with a decline of inhibitory control of attentional and behavioral systems. A widely accepted measure of inhibitory control is the antisaccade task that requires both the inhibition of a reflexive saccadic response towards a visual target and the initiation of a voluntary eye move...
When we read, our eyes move through the text in a series of fixations and high-velocity saccades to extract visual information. This process allows the brain to obtain meaning, e.g., about sentiment, or the emotional valence, expressed in the written text. How exactly the brain extracts the sentiment of single words during naturalistic reading is l...
We recorded and preprocessed ZuCo 2.0, a new dataset of simultaneous eye-tracking and electroencephalography during natural reading and during annotation. This corpus contains gaze and brain activity data of 739 sentences, 349 in a normal reading paradigm and 390 in a task-specific paradigm, in which the 18 participants actively search for a semant...
An interesting method of evaluating word representations is by how much they reflect the semantic representations in the human brain. However, most, if not all, previous works only focus on small datasets and a single modality. In this paper, we present the first multi-modal framework for evaluating English word representations based on cognitive l...
Electroencephalography (EEG) recordings have been rarely included in large-scale studies. This is arguably not due to a lack of information that lies in EEG recordings but mainly on account of methodological issues. In many cases, particularly in clinical, pediatric and aging populations, the EEG has a high degree of artifact contamination and the...
Previous research showed associations between personality traits and eye movements of young adults in the laboratory. However, less is known about these associations in real life and in older age. Primarily, there seems to be no paradigm to assess eye movements of older adults in real life. The present feasibility study thus aimed to test grocery s...
When we read, our brain processes language and generates cognitive processing data such as gaze patterns and brain activity. These signals can be recorded while reading. Cognitive language processing data such as eye-tracking features have shown improvements on single NLP tasks. We analyze whether using such human features can show consistent impro...
Reading disabilities (RD) and attention‐deficit/hyperactivity disorder (ADHD) are two of the most common developmental disorders. RD and ADHD frequently co‐occur, which raises questions about how the disorders interact and to what extent they can be differentiated. To date, the underlying neural mechanisms leading to RD–ADHD comorbidity (COM) are n...
We present the Zurich Cognitive Language Processing Corpus (ZuCo), a dataset combining electroencephalography (EEG) and eye-tracking recordings from subjects reading natural sentences. ZuCo includes high-density EEG and eye-tracking data of 12 healthy adult native English speakers, each reading natural English text for 4–6 hours. The recordings spa...
Electroencephalography (EEG) recordings have been rarely included in large-scale neuropsychiatric biomarker studies. This is arguably not due to a lack of information that lies in EEG recordings but mainly on account of methodological issues. In many cases, particularly in clinical or pediatric populations, the EEG has a high degree of artifact con...
Neuropsychological tests inform about performance differences in cognitive functions but they typically tell little about the causes for these differences. Here, we propose a project which builds upon a recently developed novel multimodal neuroscientific approach of simultanous eye-tracking and EEG measurements to provide insights into diverse caus...
EEG microstate analysis offers a sparse characterisation of the spatio-temporal features of large-scale brain network activity. However, despite the concept of microstates is straight-forward and offers various quantifications of the EEG signal with a relatively clear neurophysiological interpretation, a few important aspects about the currently ap...
Neural development is generally marked by an increase in the efficiency and diversity of neural processes. In a large sample (n = 114) of human children and adults with ages ranging from 5 to 44 yr, we investigated the neural responses to naturalistic video stimuli. Videos from both real-life classroom settings and Hollywood feature films were used...
Electroencephalography (EEG) recordings have been rarely included in large-scale studies. This is arguably not due to a lack of information that lies in EEG recordings but mainly on account of methodological issues. In many cases, particularly in clinical, pediatric and aging populations, the EEG has a high degree of artifact contamination and the...
