ArticlePDF Available

Brain-Computer Interfaces for Communication: Preferences of Individuals With Locked-in Syndrome

Authors:
  • National program on Health care evaluation

Abstract and Figures

Background: Brain-computer interfaces (BCIs) have been proposed as an assistive technology (AT) allowing people with locked-in syndrome (LIS) to use neural signals to communicate. To design a communication BCI (cBCI) that is fully accepted by the users, their opinion should be taken into consideration during the research and development process. Objective: We assessed the preferences of prospective cBCI users regarding (1) the applications they would like to control with a cBCI, (2) the mental strategies they would prefer to use to control the cBCI, and (3) when during their clinical trajectory they would like to be informed about AT and cBCIs. Furthermore, we investigated if individuals diagnosed with progressive and sudden onset (SO) disorders differ in their opinion. Methods: We interviewed 28 Dutch individuals with LIS during a 3-hour home visit using multiple-choice, ranking, and open questions. During the interview, participants were informed about BCIs and the possible mental strategies. Results: Participants rated (in)direct forms of communication, computer use, and environmental control as the most desired cBCI applications. In addition, active cBCI control strategies were preferred over reactive strategies. Furthermore, individuals with progressive and SO disorders preferred to be informed about AT and cBCIs at the moment they would need it. Conclusions: We show that individuals diagnosed with progressive and SO disorders preferred, in general, the same applications, mental strategies, and time of information. By collecting the opinion of a large sample of individuals with LIS, this study provides valuable information to stakeholders in cBCI and other AT development.
Content may be subject to copyright.
Brain-Computer Interfaces for communication: preferences of
individuals with locked-in syndrome
Mariana P Branco1,#, Elmar GM Pels, MSc, PhD1,#, Ruben H Sars, MSc1,2, Erik J Aarnoutse,
PhD1, Nick F Ramsey, PhD1,+, Mariska J Vansteensel, PhD1, Femke Nijboer, PhD2,3
1UMC Utrecht Brain Center, Department of Neurology and Neurosurgery, University Medical
Center Utrecht, Utrecht, The Netherlands 2Health, Medical and Neuropsychology Unit, Faculty of
Social and Behavioral Sciences, Leiden University, Leiden, The Netherlands 3Biomedical Signals
and Systems Department, Faculty of Electrical Engineering, Mathematics and Computer Science,
University of Twente, Enschede, The Netherlands
Abstract
Background—Brain-Computer Interfaces have been proposed as an assistive technology (AT)
allowing people with locked-in syndrome (LIS) to use neural signals to communicate. To design a
communication BCI (cBCI) that is fully accepted by the users, their opinion should be taken into
consideration during the research and development process.
Objective—We assessed the preferences of prospective cBCI users regarding 1) the applications
they would like to control with a cBCI, 2) the mental strategies they would prefer to use to control
the cBCI and 3) when during their clinical trajectory they would like to be informed about AT and
cBCIs. Furthermore, we investigated if individuals diagnosed with progressive and sudden onset
disorders differ in their opinion.
Methods—We interviewed 28 Dutch individuals with LIS during a 3-hour home visit using
multiple choice, ranking and open questions. During the interview participants were informed
about BCIs and the possible mental strategies.
Results—Participants rated (in)direct forms of communication, computer use and environmental
control as the most desired cBCI applications. In addition, active cBCI control strategies were
preferred over reactive strategies. Furthermore, individuals with progressive and sudden onset
disorders preferred to be informed about AT and cBCIs at the moment they would need it.
Conclusions—We show that individuals diagnosed with progressive and sudden onset disorders
preferred in general the same applications, mental strategies and time of information. By
+Corresponding author: Nick F Ramsey, UMC Utrecht Brain Center, Department of Neurology and Neurosurgery, University
Medical Center Utrecht, P.O. Box 85500, 3508 GA, Utrecht, The Netherlands. N.F.Ramsey@umcutrecht.nl.
#These authors contributed equally to this article
Data Availability
Animation videos used in this questionnaire (Video 1 – Video 9; in English) are available at https://doi.org/10.5281/zenodo.3271440.
Questionnaire (Dutch only) and data can be made available upon reasonable request to the authors and after signing a data transfer
agreement.
HHS Public Access
Author manuscript
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Published in final edited form as:
Neurorehabil Neural Repair
. 2021 March ; 35(3): 267–279. doi:10.1177/1545968321989331.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
collecting the opinion of a large sample of individuals with LIS, this study provides valuable
information to stakeholders in cBCI and other AT development.
Keywords
Brain-Computer Interface; Communication; opinion; user-centered design; locked-in syndrome
1. Introduction
Stroke, trauma or neuromuscular diseases, such as Amyotrophic Lateral Sclerosis (ALS), are
merely a few examples of the causes that can lead to complete loss of voluntary muscle
control and subsequent loss of communication. When people have no means to
communicate other than eye movements, they are considered to be in a locked-in state
(locked-in syndrome; LIS) 1. LIS is characterized by aphonia or severe hypophonia,
preserved cognition and quadriplegia or quadriparesis and affects about 0.8 out of 100 000
people in Western Europe 2,3. Contrarily to what is generally expected, individuals with LIS
report a satisfactory quality-of-life, which mostly depends on their ability to communicate
and to be autonomous 4–6.
In the last decades, several communication BCIs (or cBCIs) have been developed as
alternative assistive technology (AT) and have been evaluated with individuals with LIS 7–12.
In order to develop functional and widely accepted cBCI technology, the user’s opinion and
participation throughout the research and development phases of the AT (User-Centered
Design, UCD) is crucial 13. For that reason, UCD has received increasing attention in the
BCI field with the goal to manage BCI users’ expectations and to prevent the abandonment
of technology by the end-user 7,14–23. These studies focused not only on the technical
specifications of the BCI system, such as the technique used for recording brain-signals
(internal or external electrodes; e.g., 24), general BCI applications (what a user would like to
control with a BCI and how well it should work; e.g., 15,20), but also on the subjective
acceptance of the technology 17,21. Although the opinion of prospective users about BCI
applications (beyond communication) has been investigated before 15,20, to our knowledge
no information has been collected about the user’s opinions on different mental strategies for
cBCI control, nor on when in the course of their medical condition users would like to be
informed about AT and cBCIs. The latter, especially when the user needs change due to
progression of the disease, may also affect the acceptance of AT.
In this study we investigated the opinion of prospective cBCI users in the Netherlands
regarding 1) which applications they would like to control with a cBCI, 2) which mental
strategies they would prefer to use to control the cBCI and 3) the time point during their
clinical trajectory at which they would like to be informed about ATs, including cBCIs.
Importantly, the nature of the underlying medical conditions (that is, progressive disease vs
stable condition after an event) may affect the preference of the user with respect to these
three research questions. Therefore, we compared participants with respect to the type of
condition underlying LIS, that is, neuromuscular disease (NMD) or sudden onset events
(SO). A better understanding of these preferences is fundamental for an efficient and
Branco et al. Page 2
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
effective development of cBCIs and for increasing the likelihood of adoption of this
technology for autonomous home-use.
2. Material and Methods
A questionnaire was administered to individuals with LIS who were making use of AT for
communication and who could potentially benefit from cBCIs. The questionnaire (in Dutch)
was completed by the participant during a 3-hour home visit with two researchers. One
researcher interviewed the participant, while the other researcher made observations and
confirmed the answers from the participants. The questionnaire was implemented on the
Qualtrics Survey platform (www.qualtrics.com/). The study was evaluated by the local ethics
board of the Utrecht Medical University Center, who determined it to be exempt from the
Medical Scientific Research Act. In accordance with the local ethics guidelines, GCP and
the GDPR, at the beginning of the home visit, participants or (when a participant was unable
to write) caregivers on behalf of the participant gave written informed consent to participate
in the study.
2.1 Participants
Forty participants living in the Netherlands were identified using databases obtained in
earlier studies and were invited to participate in this study 2,19. Candidates were approached
through email and received an information letter about the research. When interested in
participating in the study, the candidates were sent an online screening form, which was used
for participant characterization and demographics (see section 2.2.1). Inclusion criteria in
the study were: 1) (in)complete LIS, defined as in 1; 2) the ability to indicate yes and no
reliably, and to thereby give informed consent to participate in the study; and 3) the ability to
answer open questions, either with the help of a letter card or through an AT device. Eligible
candidates were subsequently contacted by a researcher to plan a 3-hour home-visit. In total,
29 participants enrolled in the study (73% response rate; BQ1-BQ29). One participant
(BQ4) was excluded from further analysis after the home-visit because of unreliable means
of communication, yielding 28 complete interviews (Supplementary Table 1). Of these, two
participants were at the time of the interview implanted with a cBCI 10,25.
The revised Amyotrophic Lateral Sclerosis Functional Rating Scale score (ALSFRS-r; 26)
was used to assess the level of paralysis and communication impairment of each participant.
Responses to each item of the ALSFRS-r were described by the participant and caregiver
and scored by both researchers independently. For comparison purposes, the participant
population was divided by type of disorder into one group with neuromuscular disorder
(NMD; such as amyotrophic lateral sclerosis, primary lateral sclerosis and – progressive –
spinal muscular atrophy) and one group with sudden onset (SO; such trauma or stroke).
There were in total 13 NMD and 15 SO participants.
2.2 Structure of the questionnaire
The questionnaire consisted of five sections: 1) demographics, 2) introduction to cBCIs, 3)
cBCI applications, 4) mental strategies and 5) time of information. Animation videos were
used to illustrate certain aspects of the questionnaire, more specifically to introduce the
Branco et al. Page 3
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
concept of cBCIs (Figure 1A) and each individual mental strategy (Figure 1B). The
animations were specifically designed for the purpose of this questionnaire and were
narrated in Dutch (see 27). The majority of the questions were either multiple-choice or
based on a 5-point Likert scale. Participants always had the opportunity to make remarks or
to skip a question. Family members/caregivers were often present during the interview, but
were asked not to answer questions on behalf of the participant. Each question and answer
option was read out aloud by the researcher. When an animation video was part of the
question, the question and answers were read first, after which the video was shown, and
then the question and answers were repeated. The answers were only registered once the
participant clearly understood the question and the answer options. Lastly, at the end of the
questionnaire, we asked the participants to rate their willingness to consider a cBCI for
communication using a 5-point Likert scale (1 = very unlikely, 5 = very likely). Ranking
questions, applications and mental strategies were randomly presented to prevent an order
effect.
2.2.1 Section 1 (Demographics)—Prior to the home visit, participants were asked to
fill out an online questionnaire on their demographic information. Questions were either
multiple-choice, yes/no or required a brief open answer. When applicable, more than one
choice could be selected and an item ‘Other’ was available (followed by a free-text field) in
order to accommodate other options.
2.2.2 Section 2 (Introduction)—An animation video (see Figure 1A for examples of
snapshots) was used to introduce the concept of BCIs in general and in particular BCIs for
communication (cBCIs). In this video we described the concept of an ideal cBCI that would
be 100% accurate and 100% accepted by the users, and we did not provide details about the
different signal acquisition, processing and classification methods. This choice allowed
participants to focus on the choice of applications and mental strategies rather than factors as
efficacy, speed or level of invasiveness.
2.2.3 Section 3 (cBCI applications)—In this section we asked questions about the AT
aids the participants used at the time of the visit at home for communication, what
applications they controlled with it and how often they used that functionality. Additionally,
we asked them to rank their preference with respect to 6 different cBCI applications:
private
conversation and writing
(e.g., email, chat, diary),
direct personal communication
(e.g.,
voice synthesis, direct conversation),
environmental control
(e.g., home appliances, alarm),
general computer use
(e.g., playing games, internet surfing, social media),
artistic expression
(e.g., painting, making music) and
emotions and facial expressions
(e.g., expressing feelings,
emoji’s). In this questionnaire we asked participants about their current AT applications and
did not ask about which applications they would like to be offered by a cBCI as the answer
would likely be ‘all applications’. However, we did ask the participants to rank the
application to be provided by a cBCI in order of preference.
2.2.4 Section 4 (Mental strategies)—We assessed the opinion of the participants
regarding 8 widely known mental strategies that can be used to generate brain signal
changes for cBCI 28–32, namely,
attempted hand movement, attempted body movement
Branco et al. Page 4
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
(other than hand),
attempted speech, counting backwards, visual imagery, visual P300,
auditory P300
and
steady-state visual evoked potentials (SSVEPs)
(Figure 1C). Each
strategy was presented (in random order) using a dedicated animation video (see Figure 1B
for examples of snapshots). Of note, in order to keep the explanation of all strategies
consistent, all were illustrated using the same output control: a one-dimensional control of a
button press that selects a letter on a spelling device (Figure 1B), thereby aiming to focus on
the concept behind the mental strategy and not the type, speed or accuracy of the system.
Participants were asked to imagine using a perfectly working cBCI. After each animation the
participant was asked to imagine using that particular strategy for about 10 seconds and then
rate it (using a 5-point Likert scale) on clarity, difficulty and enjoyability (i.e., how much fun
it was to perform the strategy) and lastly rank all strategies in order of preference.
2.2.5 Section 5 (Time of information)—In the last section of the questionnaire, we
asked the participants’ opinion about the best period to be informed about AT-aids in
general, including cBCIs. The participants could indicate at what time point during their
clinical trajectory they would prefer to have received detailed information about
communication aids. Answer options were: ‘as soon as possible’ after diagnosis/incident,
‘before rehabilitation’ (possible period between incident/hospitalization and start of for
example speech-language therapy, ergotherapy or other), ‘during rehabilitation’, ‘after
rehabilitation’, ‘when no residual movement/speech is available’ or an open field for another
timepoint.
2.3 Data analysis
2.3.1 Descriptive statistics and open answers—Descriptive statistics were used to
analyze the survey results. Frequencies, percentages or medians were used when
appropriate. The percentages were computed relative to the total number of participants (i.e.,
N=28) or, when applicable, to a subgroup of participants.
2.3.2 Ranking questions—To quantify the preference of the participants for specific
applications and mental strategies (ranking questions), we attributed a weight to each option
between 0 and 6 for the applications and between 0 and 4 for the mental strategies, where 0
represented ‘not chosen’, 1 ‘the least preferred’ and 4 or 6 ‘the most preferred’. The
different maximum weights related to the number of items ranked. Notably, the participants
ranked all 6 applications, as it can be assumed that all applications are (eventually) useful for
the user. In contrast, users typically only need one or a few mental strategies to control a
cBCI, and were therefore asked to rank the top 4 (out of 8) mental strategies. Subsequently,
we computed the center-of-mass score (COM) previously used in questionnaire analysis 33
in order to combine ranking scores across participants and to facilitate comparison between
options. The COM was computed per application or mental strategy by summing the product
of the number of subjects who assigned a certain rank to an application/mental strategy and
the weight given to that rank, and subsequently dividing this sum by the total number of
participants:
Branco et al. Page 5
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
COMi=k= 1
Nk· ∑s= 1
T[weights=k]
T(1)
where
i
represents an application or a mental strategy,
T
the total number of participants
(indexed by
s
),
k
the weight between 1 and
N
(i.e., the total number of ranked applications,
N
=6, or mental strategies,
N
=4), and [weights = k] is 1 if weights is equal to k and 0
otherwise. The COM score varied between 0 and the total number of ranked options (4 or 6),
and a larger COM value indicates a more preferred option. Statistical comparison between
COM scores is not possible as there is only one value per class. Nevertheless, meaningful
differences of COM values between applications and mental strategies were computed by
applying a Monte Carlo randomization method, where the ranking scores of each subject
were assigned randomly 1000 times. The expected chance variance was computed as the
standard deviation of the resulting COM distribution. Differences between COM values
larger than the expected variance were deemed meaningful.
2.3.3. Willingness to consider cBCI after the questionnaire—We tested whether
there was a relation between the current number of residual movements a participant had at
the time of the home-visit and their willingness to consider a cBCI after the home-visit. The
residual movements were grouped as ‘eyes’, ‘mouth/head’, ‘hand/arm’, ‘leg/feet/toes’ and
‘residual speech’. If the participant had one or more forms of residual movement pertaining
to one of the groups it would count as 1, otherwise 0. The total number of residual
movements varied between 0 (no residual movement at all) and 5 (able to control at least one
form of movement per group). Linear regression was computed between these factors for
both the NMD and SO groups, to assess if there was a different tendency between the two
groups. The coefficient of correlation (r2) for each regression model is reported.
3. Results
3.1 Demographics
We analyzed responses from 28 participants (median age 53 years old; range 29 to 76 years
old; 14 male). Of these, 13 (46%) were diagnosed with a progressive neuromuscular disease
(NMD, Figure 2A), whereas 15 (54%, Figure 2B) had a sudden onset (SO) event that led to
the locked-in state (see also Supplementary Table 1). In both groups, the number of male
and female participants was similar. The majority of the NMD participants (62%) was older
than 50 years, lived at home (92%) and had heard of or seen a BCI system in the past (85%).
In contrast, the majority of the SO participants (53%) were younger than 50 years old and
lived in a nursing home (53%). Similar to the NMD group, the majority of the SO
participants (87%) were familiar with the concept of a BCI.
Participants scored a median ALSFRS-r of 15 (on a scale from 0 to 48; Figure 2C) and there
was no significant difference in the ALSFRS-r scores between NMD and SO groups (NMD
median of 8; range 2-29; SO median of 16; range 8-22; unpaired two-samples Wilcoxon test,
z=−0.14, rank sum = 185, ns). The overall median duration since diagnosis was 16.5 years
(Figure 2D), and was not significantly different between NMD and SO groups (NMD
median of 14.3 years, range 6.3-49.4 years; SO median 16.8 years, range 2.7-29.5 years;
Branco et al. Page 6
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
unpaired two-samples Wilcoxon test, z=−1.38, rank sum = 158; ns). Of note, the duration
since diagnosis only corresponded with the exact duration of LIS for the SO group, as
individuals with NMD generally entered LIS several months to years after the first
diagnosis.
3.2 Residual movement and current communication channels
All participants had aphonia or severe hypophonia, and quadriplegia or quadriparesis.
Regarding residual movement (Figure 3A), all participants (for both NMD and SO groups)
had preserved sustained eye opening and eye movements. The majority of the participants
had residual movement of the head or mouth (92% and 93% for NMD and SO, respectively)
and/or residual movement of the arm or hand/fingers (54% and 53% for NMD and SO,
respectively). However, the NMD group showed higher counts of preserved leg, foot or toe
movement (46%) and residual forms of speech (e.g., making noises/sounds or saying short
words; 38%) when compared with the SO group (27% and 7%, respectively). The
participants reported using a variety of current communication channels (Figure 3B), from
eye movements to answer closed questions, to letter cards and more sophisticated hardware
switches and eye trackers. Interestingly, letter cards, button switches and head movements
were more used by the SO group than the NMD group. In contrast, NMD participants used
eye trackers and residual forms of speech more than the SO group. The latter is likely related
to the fact that the NMD group had considerably more individuals with preserved forms of
residual speech compared with the SO group (38% against 7%).
3.3 Preferred applications
Participants considered ‘direct personal communication’ the most important application to
be provided by a cBCI, followed by ‘private conversation and writing’ (Figure 4A). ‘General
computer use’ came third, followed by ‘environmental control’. ‘Emotions and facial
expressions’ and ‘artistic expression’ were the two least preferred applications, being
meaningfully inferior to the top 4 applications (difference larger than Monte Carlo variance
0.34). Although the SO group seemed to slightly prefer ‘artistic expression’ (e.g., painting or
making music) when compared to the NMD group, there was no meaningful difference
between the NMD and SO group ratings for any application. Participants were allowed to
suggest other applications besides the ones included in this questionnaire. Most of them gave
specific examples of environmental control (such as controlling a wheelchair, doors or DVD
player) and of specific computer programs (such as a text editor, e-books and games). In
addition, smartphone control (for example for video calls), speech synthesis and alarm
functionality were mentioned.
3.4 Preferred mental strategies
Attempted body movements (‘attempted speech’, ‘attempted hand movement’ and
‘attempted body movement’) were the top-rated mental strategies, whereas ‘counting
backwards’, ‘visual P300’, ‘SSVEPS’ and ‘auditory P300’ were the least preferred strategies
(Figure 4B). Interestingly, the NMD group rated ‘attempted speech’ and ‘attempted hand
movement’ meaningfully higher than the SO group (difference larger than the Monte Carlo
variance 0.28). In contrast, the SO group rated ‘counting backwards’ and ‘visual P300’
higher than the NMD group.
Branco et al. Page 7
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Regarding ‘attempted body movement’, we asked participants which body part they would
choose to control a cBCI (other than the hand). Toes (38% and 29% for NDM and SO,
respectively) and feet (31% and 22% for NDM and SO, respectively) were the most chosen
body parts (Figure 4C–D). Tongue was the third most chosen body part by both groups.
While the SO group suggested more alternative body parts (arm, head, eyes, hips and elbow)
to toes and feet, the NMD group only suggested one additional body part (arm). When asked
to suggest other mental strategies, the participants suggested visual letter imagination,
laughing, thinking of colors, tastes/smells and walking as mental strategies.
3.5 Time of information
Both groups preferred to learn about and receive ATs when they approach or enter the
locked-in state (Figure 5). While for the NMD group that moment coincides with later stages
of their disease (e.g., no speech and residual movement), for the SO group that is
immediately after onset or during the rehabilitation phase.
3.6 Willingness to consider cBCIs
Lower number of residual movements correlated moderately with an increased likelihood to
consider a cBCI for both NMD and SO groups (r2NMD=0.33; r2SO=0.30) (Figure 6). When
explaining their answer, the participants, most of whom had previous knowledge or
experience with cBCI technology, considered current BCIs to have limited benefit over
current ATs. The majority of these participants reported that they would consider cBCI if
“the speed would match current AT” or when the cBCI would be “faster, have equivalent
applications [to current ATs] and be esthetically good”. Yet, most participants did state that
if residual movement/function deteriorates with time, they would consider a cBCI as an
option.
4. Discussion
In this study we gathered the opinion of Dutch individuals with LIS regarding three aspects
of BCIs for communication (cBCIs): the applications to control with a cBCI, the mental
strategies employed to generate the control signal, and the moment they would like to be
informed about cBCIs. We grouped the participants into neuromuscular disease (NMD) and
sudden onset (SO), and show that preferences of both groups on these aspects correspond to
a large extent.
4.1 Preferred applications
In this study we show that the choice of cBCI applications does not depend on the cause of
LIS. Direct personal communication, private conversation and general computer use were
the top three applications chosen by both groups. This is in agreement with earlier studies
that investigated quality of life in LIS, and that reported a strong relation between quality-of-
life and the ability to communicate 4–6. Regarding environmental control, the 4th most
chosen application, the participants expressed their desire to control the lights, doors,
wheelchairs and DVD players, which is also in correspondence with a previous survey
performed by Huggins and colleagues among individuals with ALS 15. Interestingly, in
contrast to previous studies that suggested that artistic expression is an important BCI tool
Branco et al. Page 8
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
for several individuals with severe motor paralysis 34–38, we found that this application was
one of the least preferred. In the current study, artistic expression may have received a lower
rank because (as in the general population) not all individuals are actively involved in artistic
expression and such application is not provided by all current communication aids, whereas
communication is a universally used concept.
4.2 Preferred mental strategies
Both SO and NMD participants had a strong preference for motor strategies (attempted
speech and movement) over working memory and reactive (evoked) strategies (i.e., visual
P300, SSVEPs and auditory P300). This result demonstrates that individuals with LIS prefer
to use an active rather than a reactive strategy for cBCI control. The somewhat lower
preference of SO participants, compared to NMD participants, for motor-related paradigms
could be related to earlier observations in LIS individuals with pontine, premotor and
parietal lesions were selectively impaired in mental manipulation of, for example, the hands
39–42. Interestingly, one participant, who was paralyzed from birth due to cerebral palsy, said
she “cannot imagine or attempt to make a movement”. This is in agreement with previous
BCI studies with individuals with CP (e.g., 43,44) and with studies that showed that people
with fetal brain damage may experience more difficulty acquiring reliable control of their
motor functions (e.g., 45).
Surprisingly, apart from the hand, toes and feet were the most chosen body parts for cBCI
control, even though only 6 (out of 9 selecting toes/feet) NMD and 2 (out of 7 selecting toes/
feet) SO participants could still move their toes and/or feet to a certain extent. Another
explanation could be the fact that feet are large body parts of which dexterity is
evolutionarily close to the hand46–48 and therefore easy to imagine/attempt control.
Nevertheless, a biased choice for these body parts cannot be completely ruled out as feet and
toes were the first and the last examples of 4 body parts shown in the animation video (“foot,
head, tongue or toes”). This psychological effect is commonly known as the serial-position
effect, where a person tends to recall the first and last items in a sequence best 49.
Taken together, both SO and NMD groups largely agree on preferred mental strategies for
cBCI control. However, the relative stronger preference of the NMD group for attempted
speech and hand movement and of the SO group for counting backwards and visual P300
overtly highlights the need to consider the users’ preference for strategies in future research
on BCIs for communication. Moreover, further investigation on the relation between the
mental strategy preference and actual the cBCI performance using that strategy may be the
key to detect the best features for accurate and stable cBCI control.
4.3 Willingness to consider cBCI
With fewer residual movements available, participants were more likely to the consider a
cBCI after the survey. This trend was slightly more pronounced for the NMD groups, which
is not surprising since these individuals are more likely to lose their current
residual50movements with the progression of the disease. However, the low effect size
indicates that a larger number of participants is required in order to corroborate these
findings. Most of the participants indicated that the current BCIs had limited benefit
Branco et al. Page 9
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
compared with current available assistive technology. As expected, many participants would
consider a cBCI if its speed, accuracy and/or appearance (with respect to non-invasive
setups) would be improved over current available systems. Some participants also expressed
their thought regarding the type of BCI systems currently available. External (non-invasive)
cBCIs were, in general, preferred over internal (implanted) cBCIs (8 against 2, out of 28).
Of the 10 participants who expressed their opinion, two NMD participants were open to the
possibility of an internal cBCI provided that a short hospitalization would be required, which
supports previous studies that reported the strong preference of users for outpatient surgery
15,20,24.
4.4 Time of information
Another topic that has received little attention in the field of BCI is the time of information,
that is the preferred moment when the users would like to be informed about and try cBCIs
as a communication AT-aid. In this study we investigated this subject and found that both
NMD and SO groups have a stronger preference to be informed when they most need an AT,
that is when they reach the locked-in state. Naturally, this yields different time points in the
clinical trajectory of the NMD and SO groups, as patients with progressive disorders have
(or perhaps need) more time to accept their situation and generally only require AT
sometime after diagnosis, while individuals with SO disorders are often faced with
immediate LIS and need AT aids directly. Yet, some NMD participants also expressed their
wished to be informed as soon as possible after diagnosis. This dichotomic result is in line
with the findings of a recent qualitative study on veterans with ALS, which reports that
while many patients described the urgency to be pro-active with respect to BCIs before they
lose muscular control and verbal communication, others prefer to wait for eventual new
technology and to enjoy their remaining time with their family 50. Altogether, our results re-
enforce the idea that the BCI community should play a more active role in informing
rehabilitation centers about cBCIs, such that these can be tested by SO users shortly after the
event.
4.5 Strengths and limitations
In this pioneer study we interviewed 28 Dutch individuals with LIS, which covers an ample
portion of the LIS population in the Netherlands (a total estimated number of 124 patients at
a prevalence of 0.73 patients per 100 000; 2). In this pooled sample the median duration of
paralysis was 16.5 years, indicating that individuals with LIS in the Netherlands live many
years with this condition, which deepens the value of their opinion on cBCIs. Another
strength of this study was the delivery of a questionnaire through structured interviews at the
participants’ home. During the home-visits we had the opportunity to explain the questions
and collect the participants’ opinions with respect to several open questions at their own
pace. Furthermore, for the purpose of this study we designed and validated several animation
videos that introduce and explain several concepts related to cBCIs.
This study also has some limitations. In the last years, a number of studies related to BCI
have been conducted in the Netherlands, including some of the current participants. As a
result, a majority of the participants (86%) was not naive to the concept of BCI before the
questionnaire described here. Although this fact may have influenced our results, we
Branco et al. Page 10
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
explained to the participants during the home-visits that this questionnaire is about an ideal
cBCI and not the ones they experimented with in past (if that was the case). Often caregivers
and family members were present during the user interviews. Even though they were asked
not to answer on behalf of the user, their presence could have theoretically biased the
preferences of the users.
Regarding the mental strategies it cannot be ruled out that some participants have comorbid
cognitive problems that make it difficult for them to use certain strategies. An answer to this
question would require access to medical information or a full evaluation of their cognitive
capabilities, which was beyond the scope of this study. However, the participants’
communication during the home visits did not lead to any suspicion of impaired cognition.
Also, the terms used in this study to describe the time of information were not always
applicable to both he NMD and SO groups. Nevertheless, we believe that the use of the
respective terms is unavoidable considering the different nature of the participants clinical
condition. Lastly, due to the (still) limited sample size, advanced regressive models were not
applied. A larger (and international) cohort would be required in order to statistically assess
the relation between the ranked applications and strategies and observed variables such as
age, duration of paralysis and ALSFRS-r scores. We make the methods in this study openly
available to allow other researchers to run this questionnaire in their user cohort.
5. Conclusion
In this study we investigated the opinion of prospective cBCI users regarding two important
aspects of BCIs for communication: the mental strategies for control and the controlled
output application. We showed that individuals with LIS consider (in)direct communication,
general computer use and environmental control important features of a cBCI and that
attempted speech and movement as a control strategy are preferred over the reactive
strategies, such as P300 and SSVEPs. Moreover, the preferred time to be informed about AT
aids and cBCI is when the user reaches the locked-in state and needs the AT. We believe this
survey provides valuable information to stakeholders in cBCI and AT development and
encourages the involvement of users in the research and development process, ultimately
promoting an optimal cBCI design and reducing risk of technology abandonment.
Supplementary Material
Refer to Web version on PubMed Central for supplementary material.
Acknowledgements
The authors would like to thank the participants for their time and interest in sharing their opinions about BCIs,
Merel Horsmeier for designing and producing the animation videos and Wesley Sewnundun for implementing the
questionnaire in Qualtrics. This research was funded by the ERC-Advanced ‘iConnect’ project (grant ADV 320708)
(NR), Dutch Technology Foundation STW NeuroCIMT project (grant 14906) (NR) and the National Institute On
Deafness And Other Communication Disorders of the National Institutes of Health (U01DC016686) (NR).
Branco et al. Page 11
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
References
1. ACRM AC of RM. Recommendations for use of uniform nomenclature pertinent to patients with
severe alterations in consciousness. American Congress of Rehabilitation Medicine. Arch Phys Med
Rehabil. 1995;76(2):205–209. [PubMed: 7848080]
2. Pels EGM, Aamoutse EJ, Ramsey NF, Vansteensel MJ. Estimated Prevalence of the Target
Population for Brain-Computer Interface Neurotechnology in the Netherlands. Neurorehabil Neural
Repair. 2017;31(7):677–685. doi:10.1177/1545968317714577 [PubMed: 28639486]
3. Blandin V ALIS; Association du Locked-In Syndrome. 12 ans d’expérience en France. Published
online Published 2009. https://www.uzleuven.be//sites/default/files/revalidatiecentrum/wittebols/
ALIS%20Leuven%201%20%20veronique%20blandin.pdf
4. Laureys S, Pellas F, Van Eeckhout P, et al. The locked-in syndrome : what is it like to be conscious
but paralyzed and voiceless? In: Laureys S, ed. Progress in Brain Research. Vol 150. The
Boundaries of Consciousness: Neurobiology and Neuropathology. Elsevier; 2005:495–611.
doi:10.1016/S0079-6123(05)50034-7 [PubMed: 16186044]
5. Bruno M-A, Bernheim JL, Ledoux D, Pellas F, Demertzi A, Laureys S. A survey on self-assessed
well-being in a cohort of chronic locked-in syndrome patients: happy majority, miserable minority.
BMJ Open. 2011;1(1):e000039. doi:10.1136/bmjopen-2010-000039
6. Rousseau M-C, Baumstarck K, Alessandrini M, Blandin V, Billette de Villemeur T, Auquier P.
Quality of life in patients with locked-in syndrome: Evolution over a 6-year period. Orphanet J Rare
Dis. 2015; 10:88. doi:10.1186/s13023-015-0304-z [PubMed: 26187655]
7. Kübler A, Nijboer F, Mellinger J, et al. Patients with ALS can use sensorimotor rhythms to operate a
brain-computer interface. Neurology. 2005;64(10): 1775–1777.
doi:10.1212/01.WNL.0000158616.43002.6D [PubMed: 15911809]
8. Sellers EW, Donchin E. A P300-based brain–computer interface: Initial tests by ALS patients. Clin
Neurophysiol. 2006;117(3):538–548. doi:10.1016/j.clinph.2005.06.027 [PubMed: 16461003]
9. Sellers EW, Vaughan TM, Wolpaw JR. A brain-computer interface for long-term independent home
use. Amyotroph Lateral Scler. 2010;11(5)449–455. doi:10.3109/17482961003777470 [PubMed:
20583947]
10. Vansteensel MJ, Pels EGM, Bleichner MG, et al. Fully Implanted Brain–Computer Interface in a
Locked-In Patient with ALS. N Engl J Med. 2016;375(21):2060–2066. doi:10.1056/
NEJMoa1608085 [PubMed: 27959736]
11. Wolpaw JR, Bedlack RS, Reda DJ, et al. Independent home use of a brain-computer interface by
people With amyotrophic lateral sclerosis. Neurology. 2018;91(3):e258–e267. doi:10.1212/
WNL.0000000000005812 [PubMed: 29950436]
12. Milekovic T, Sarma AA, Bacher D, et al. Stable long-term BCI-enabled communication in ALS
and locked-in syndrome using LFP signals. J Neurophysiol. Published online 4 25, 2018.
doi:10.1152/jn.00493.2017
13. Phillips B, Zhao H. Predictors of Assistive Technology Abandonment. Assist Technol. 1993;5(1):
36–45. doi:10.1080/10400435.1993.10132205 [PubMed: 10171664]
14. Kübler, Furdea A, Halder S, Hammer EM, Nijboer F, Kotchoubey B. A Brain–Computer Interface
Controlled Auditory Event-Related Potential (P300) Spelling System for Locked-in Patients. Ann
N Y Acad Sci. 2009; 1157(1):90–100. doi:10.1111/j.1749-6632.2008.04122.X [PubMed:
19351359]
15. Huggins JE, Wren PA, Gruis KL. What would brain-computer interface users want? Opinions and
priorities of potential users with amyotrophic lateral sclerosis. Amyotroph Lateral Scler.
2011;12(5):318–324. doi:10.3109/17482968.2011.572978 [PubMed: 21534845]
16. Plass-Oude Bos D, Poel M, Nijholt A. A Study in User-Centered Design and Evaluation of Mental
Tasks for BCI. In: Lee K-T, Tsai W-H, Liao H-YM, Chen T, Hsieh J-W, Tseng C-C, eds. Advances
in Multimedia Modeling. Lecture Notes in Computer Science. Springer Berlin Heidelberg;
2011:122–134.
17. Blain-Moraes S, Schaff R, Gruis KL, Huggins JE, Wren PA. Barriers to and mediators of brain–
computer interface user acceptance: focus group findings. Ergonomics. 2012;55(5):516–525.
doi:10.1080/00140139.2012.661082 [PubMed: 22455595]
Branco et al. Page 12
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
18. Kübler A, Holz EM, Riccio A, et al. The User-Centered Design as Novel Perspective for
Evaluating the Usability of BCI-Controlled Applications. PLOS ONE. 2014;9(12):e112392.
doi:10.1371/journal.pone.0112392 [PubMed: 25469774]
19. Nijboer F, Bos DP-O, Blokland Y, Wijk R van, Farquhar J. Design requirements and potential
target users for brain-computer interfaces – recommendations from rehabilitation professionals.
Brain-Comput Interfaces. 2014;1(1):50–61. doi:10.1080/2326263X.2013.877210
20. Huggins JE, Moinuddin AA, Chiodo AE, Wren PA. What Would Brain-Computer Interface Users
Want: Opinions and Priorities of Potential Users With Spinal Cord Injury. Arch Phys Med Rehabil.
2015;96(3, Supplement):S38–S45.e5. doi:10.1016/j.apmr.2014.05.028 [PubMed: 25721546]
21. Schicktanz S, Amelung T, Rieger JW. Qualitative assessment of patients’ attitudes and expectations
toward BCIs and implications for future technology development. Front Syst Neurosci. 2015;9.
doi:10.3389/fnsys.2015.00064 [PubMed: 25741247]
22. Andresen EM, Fried-Oken M, Peters B, Patrick DL. Initial constructs for patient-centered outcome
measures to evaluate brain–computer interfaces. Disabil Rehabil Assist Technol. 2016;11(7):548–
557. doi:10.3109/17483107.2015.1027298 [PubMed: 25806719]
23. Riccio A, Pichiorri F, Schettini F, et al. Chapter 12 - Interfacing brain with computer to improve
communication and rehabilitation after brain damage. In: Coyle D, ed. Progress in Brain Research.
Vol 228. Brain-Computer Interfaces: Lab Experiments to Real-World Applications. Elsevier;
2016:357–387. doi:10.1016/bs.pbr.2016.04.018 [PubMed: 27590975]
24. Lahr J, Schwartz C, Heimbach B, Aertsen A, Rickert J, Ball T. Invasive brain–machine interfaces:
a survey of paralyzed patients’ attitudes, knowledge and methods of information retrieval. J Neural
Eng. 2015;12(4):043001. doi:10.1088/1741-2560/12/4/043001 [PubMed: 26169755]
25. Freudenburg ZV, Branco MP, Leinders S, et al. Sensorimotor ECoG Signal Features for BCI
Control: A Comparison Between People With Locked-In Syndrome and Able-Bodied Controls.
Front Neurosci. 2019;13. doi:10.3389/fnins.2019.01058 [PubMed: 30760975]
26. Cedarbaum JM, Stambler N, Malta E, et al. The ALSFRS-R: a revised ALS functional rating scale
that incorporates assessments of respiratory function. J Neurol Sci. 1999;169(1):13–21.
doi:10.1016/S0022-510X(99)00210-5 [PubMed: 10540002]
27. Branco MP, Pels EGM, Sars RH, et al. Brain-Computer Interfaces for communication: preferences
of individuals with locked-in syndrome. Submitted. Published online 2020.
28. Vansteensel MJ, Hermes D, Aarnoutse EJ, et al. Brain–computer interfacing based on cognitive
control. Ann Neurol. 2010;67(6):809–816. doi:10.1002/ana.21985 [PubMed: 20517943]
29. Nicolas-Alonso LF, Gomez-Gil J. Brain computer interfaces, a review. Sensors. 2012;12(2):1211–
1279. doi:10.3390/s120201211 [PubMed: 22438708]
30. Riccio A, Mattia D, Simione L, Olivetti M, Cincotti F. Eye-gaze independent EEG-based brain-
computer interfaces for communication. J Neural Eng. 2012;9(4):045001.
doi:10.1088/1741-2560/9/4/045001 [PubMed: 22831893]
31. Boom MA van den, Vansteensel MJ, Koppeschaar MI, Raemaekers MAH, Ramsey NF. Towards an
intuitive communication-BCI: decoding visually imagined characters from the early visual cortex
using high-field fMRI. Biomed Phys Eng Express. 2019;5(5):055001. doi:10.1088/2057-1976/
ab302c [PubMed: 32983573]
32. Vansteensel MJ, Jarosiewicz B. Chapter 7 - Brain-computer interfaces for communicationaCurrent
affiliation: NeuroPace, Inc., Mountain View, CA, United States. In: Ramsey NF, Millán J del R,
eds. Handbook of Clinical Neurology. Vol 168. Brain-Computer Interfaces. Elsevier; 2020:67–85.
doi:10.1016/B978-0-444-63934-9.00007-X [PubMed: 32164869]
33. Vansteensel MJ, Kristo G, Aarnoutse EJ, Ramsey NF. The brain-computer interface researcher’s
questionnaire: from research to application. Brain-Comput Interfaces. 2017;4(4):236–247.
doi:10.1080/2326263X.2017.1366237
34. Muenssinger JI, Halder S, Kleih SC, et al. Brain Painting: First Evaluation of a New Brain–
Computer Interface Application with ALS-Patients and Healthy Volunteers. Front Neurosci.
2010;4. doi:10.3389/fnins.2010.00182 [PubMed: 20582258]
35. Zickler C, Halder S, Kleih SC, Herbert C, Kübler A. Brain Painting: Usability testing according to
the user-centered design in end users with severe motor paralysis. Artif Intell Med. 2013;59(2):99–
110. doi:10.1016/j.artmed.2013.08.003 [PubMed: 24080077]
Branco et al. Page 13
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
36. Botrel L, Holz EM, Kübler A. Brain Painting V2: evaluation of P300-based brain-computer
interface for creative expression by an end-user following the user-centered design. Brain-Comput
Interfaces. 2015;2(2-3):135–149. doi:10.1080/2326263X.2015.1100038
37. Holz EM, Botrel L, Kübler A. Independent home use of Brain Painting improves quality of life of
two artists in the locked-in state diagnosed with amyotrophic lateral sclerosis. Brain-Comput
Interfaces. 2015;2(2-3):117–134. doi:10.1080/2326263X.2015.1100048
38. Botrel L, Holz EM, Kübler A. Using Brain Painting at Home for 5 Years: Stability of the P300
During Prolonged BCI Usage by Two End-Users with ALS. In: Schmorrow DD, Fidopiastis CM,
eds. Augmented Cognition. Enhancing Cognition and Behavior in Complex Human Environments.
Lecture Notes in Computer Science. Springer International Publishing; 2017:282–292.
39. Sirigu A, Duhamel J-R, Cohen L, Pillon B, Dubois B, Agid Y. The Mental Representation of Hand
Movements After Parietal Cortex Damage. Science. 1996;273(5281): 1564–1568. doi:10.1126/
science.273.5281.1564 [PubMed: 8703221]
40. Tomasino B, Rumiati RI, Umiltà CA. Selective deficit of motor imagery as tapped by a left–right
decision of visually presented hands. Brain Cogn. 2003;53(2):376–380. doi:10.1016/
S0278-2626(03)00147-7 [PubMed: 14607185]
41. Conson M, Sacco S, Sarà M, Pistoia F, Grossi D, Trojano L. Selective motor imagery defect in
patients With locked-in syndrome. Neuropsychologia. 2008;46(11):2622–2628. doi:10.1016/
j.neuropsychologia.2008.04.015 [PubMed: 18533201]
42. Conson M, Pistoia F, Sarà M, Grossi D, Trojano L. Recognition and mental manipulation of body
parts dissociate in locked-in syndrome. Brain Cogn. 2010;73(3):189–193. doi:10.1016/
j.bandc.2010.05.001 [PubMed: 20537784]
43. Daly, Billinger M, Laparra-Hernández J, et al. On the control of brain-computer interfaces by users
with cerebral palsy. Clin Neurophysiol. 2013;124(9):1787–1797. doi:10.1016/j.clinph.2013.02.118
[PubMed: 23684128]
44. Daly, Faller J, Scherer R, et al. Exploration of the neural correlates of cerebral palsy for
sensorimotor BCI control. Front Neuroengineering. 2014;7. doi:10.3389/fneng.2014.00020
45. Palisano R, Rosenbaum P, Walter S, Russell D, Wood E, Galuppi B. Development and reliability of
a system to classify gross motor function in children with cerebral palsy. Dev Med Child Neurol.
1997;39(4):214–223. doi:10.1111/j.1469-8749.1997.tb07414.x [PubMed: 9183258]
46. Nelson RJ, Sur M, Felleman DJ, Kaas JH. Representations of the body surface in postcentral
parietal cortex of Macaca fascicularis. J Comp Neurol. 1980;192(4):611–643. doi:10.1002/
cne.901920402 [PubMed: 7419747]
47. Liao C-C, Qi H-X, Reed JL, Miller DJ, Kaas JH. Congenital foot deformation alters the
topographic organization in the primate somatosensory system. Brain Struct Funct.
2016;221(1):383–406. doi:10.1007/s00429-014-0913-7 [PubMed: 25326245]
48. Dempsey-Jones H, Wesselink DB, Friedman J, Makin TR. Organized Toe Maps in Extreme Foot
Users. Cell Rep. 2019;28(11):2748–2756.e4. doi:10.1016/j.celrep.2019.08.027 [PubMed:
31509738]
49. Ebbinghaus H Memory: A Contribution to Experimental Psychology. Teachers College Press;
1913. doi:10.1037/10011-000
50. Versalovic E, Diamond M, Klein E. “Re-identifying yourself”: a qualitative study of veteran views
on implantable BCI for mobility and communication in ALS. Disabil Rehabil Assist Technol.
Published online 9 17, 2020:1–8. doi:10.1080/17483107.2020.1817991
Branco et al. Page 14
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Figure 1 –. Representative screenshots of the animation videos used in the questionnaire.
A total of 9 animations videos were shown to each participant. A) Section 2 of the
questionnaire used an animation video to introduce cBCIs. Three illustrative screenshots of
the video explaining what a cBCI is, how to control it and what can it be used for are shown.
In this video we described the concept of an ideal cBCI that would be 100% accurate and
100% accepted by the users. B) In section 4 of the questionnaire animation videos were
presented to the participants, each describing a different mental strategy. For simplicity,
consistency across mental strategies and to avoid the application biasing the mental strategy,
all videos showed a spelling matrix as a control application (left screenshot) and a button
press (and subsequent letter selection) as a control output (right screenshot). C) Eight mental
strategies described in the questionnaire: attempted hand movement, attempted body
movement (other than hand), attempted speech, counting backwards, visual imagery, visual
P300, auditory P300 and steady-state visual evoked potentials (SSVEPs).
Branco et al. Page 15
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Figure 2 –. Demographic description of the participants.
The demographic information of the participants (N=28) in this study was extracted from
Section 1 of the questionnaire. The participants were divided into two groups based on the
cause of LIS, namely neuromuscular disease (NMD) or sudden onset (SO). (A-B)
Information (in percentage) about the participants’ gender (male, female), age group (≤ 50
years old, > 50 years old), living situation (at home or in a nursing home) and whether they
were naive to BCI is given for the NMD group (A) and the SO group (B). NMD accounted
for 46% (N=13) of the participants. (C-D) Histogram (in percentage) of the ALSFRS-r score
(C) and duration of paralysis in years (D) per group (NMD in green and SO in yellow). Of
note, at the time of diagnosis, patients with NMD are often still able to move and speak to a
certain extent, hence the exact timing of becoming locked-in (and therefore the duration of
the locked-in state) is unknown for these participants.
Branco et al. Page 16
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Figure 3 –. Current communication channels and residual movement.
A) Information (in percentage) about the remaining residual movement of the participants
per group (neuromuscular disease, NMD, in green; sudden onset, SO, in yellow) at the time
of the questionnaire. B) Histogram (in percentage) of the currently used communication
channels per group (NMD in green, and SO in yellow).
Branco et al. Page 17
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Figure 4 –. Preferred applications and mental strategies.
A-B) Ranking (using center-of-mass metric, COM) of preferred applications (A) and mental
strategies (B) possibly supported by a cBCI, by individuals with neuromuscular disease
(NMD, N=13, in green) and sudden onset (SO, N=15, in yellow). Statistical difference
between bars can be evaluated using the Monte Carlo variance indicated on the top right
corner: 0.34 in A and 0.28 in B. C-D) Body parts (other than hand) selected by the
participants during the ‘attempted body movement’ strategy, for both the NMD (C) and SO
Branco et al. Page 18
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
(D) groups. Rating scales ranged from 1 (least preferred) to 6 (most preferred) for A, and
from 1 (least preferred) to 4 (most preferred) for B.
Branco et al. Page 19
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Figure 5 –. Time of information.
Percentage of participants per group (neuromuscular diseases, NMD, in green; sudden onset,
SO, in yellow) who would like to be informed about AT solutions (including cBCIs) in
different phases after the onset or during the disease progression.
Branco et al. Page 20
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Figure 6 –. Willingness to consider cBCI.
Linear regression (dashed lines) between the number of residual movements the participant
had at the time of the survey (from 1 to 5, see Figure 3A) and the willingness to consider a
cBCI after the end of the questionnaire (from very unlikely to very likely in a 5-point scale).
NMD participants are indicated with a green cross and SO participants with yellow circle.
The size of the cross/circle indicates the number of participants per coordinate, that is the
larger the cross/circle the more participants. The linear regression equation and
correspondent r2 (per group) are indicated on the top right corner.
Branco et al. Page 21
Neurorehabil Neural Repair
. Author manuscript; available in PMC 2021 March 12.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
... Yet, it is still unclear how cBcis can benefit individuals with quadcP beyond current aac solutions and what the need and wishes of this population are regarding cBcis. Moreover, it is unclear if there is a preference of this target population for a specific neural signal recording method [42] or for a specific mental strategy (e.g., motor imagery/attempt or visual stimuli) to accomplish cBci control [43]. it is, therefore, crucial to further map the needs and interests of the target population in order to design the best clinically viable cBci system for children and young adults with quadcP. ...
... the online survey consisted of four parts: 1) information letter and informed consent, 2) screening and demographics, 3) communication barriers and currently used communication aac, 4) interest in cBcis and types of cBcis. animation videos narrated in Dutch were used to explain the concept of cBci and the types of cBcis in layman terms, similar to previous studies [43,44]. ...
... Parents/caregivers and health care professionals did not show a strong preference for a mental strategy for Bci control (i.e., P300 or motor imagery/attempt). this result is not in line with earlier findings on caregivers of adults with locked-in syndrome (lis), who seemed to prefer visual stimuli over attempted or imagined hand movement (although adults with lis themselves had the opposite opinion) [43]. Differences in the development of the motor impairment may explain this finding. ...
... In contrast to communication at the sentence level, efficient control of devices in the home, including computers, require reliable decoding of single-word commands with much higher accuracy than has been typical of sentence-level communication BCI's. Thus, it remains to be determined whether speech BCIs can also be used to provide functional control over computers and other devices in the home, which is a critical unmet need for this population 22 . ...
... Among individuals living with ALS, home environment and computational device control are ranked as the most critical needs after communication assistance 22 . While able-bodied people can physically interact with their devices or utilize voice assistants that decode acoustic speech to interface with smart home devices, these options are often unavailable to those with severe paralysis. ...
Preprint
Full-text available
Brain-computer interfaces can potentially restore autonomy to people with paralysis, including the ability to control their own environment via smart devices in the home. BCI applications for controlling smart devices to date have required visual displays or auditory cues, limiting the ability of users to autonomously and privately issue commands. In this study, a clinical trial participant with amyotrophic lateral sclerosis (ALS) used a chronically implanted electrocorticographic (ECoG) BCI to control smart devices with self-paced silent speech commands. Across 18 experimental sessions, silently mimed speech commands were detected in real time and decoded with a median accuracy of 97.1% (chance: 7.14%). These results demonstrate that silently attempted speech can be reliably decoded without exogenous timing cues, supporting the feasibility of reliable autonomous smart device control with an implantable BCI.
... To ensure that the multimodal RSVP Keyboard with switch input would meet the needs and preferences of potential BCI end users, we implemented a user-centered design approach. (18,19) In October 2020, four former BCI study participants were invited to act as consultants in collaborative design sessions (see overview in figure 1). 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 A c c e p t e d M a n u s c r i p t Diagram summarizing participant involvement and study visit procedures for the usercentered design process with potential end users, a pilot study with control participants, and a case study with a potential end user. SSPI = severe speech and physical impairments; IP = Inquiry Preview; UX = user experience. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 A c c e p t e d M a n u s c r i p t 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 A c c e p t e d M a n u s c r i p t End user consultants responded positively to all proposed switch functions. ...
... Participants who disliked the IP only condition (without switch input) reported that it felt slow and that they "didn't feel in control." One survey of potential BCI end users found that many report a preference for active strategies for cBCI control, such as imagined movement, (19) so the option of using an active strategy based 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 A c c e p t e d M a n u s c r i p t on actual movement may be appealing to those with some residual motor function. The copyspelling task also tended to take longer with IP only than with the other versions of the system (as shown in figure 4), in part because the preview was shown for the maximum duration before each inquiry instead of being cut short with switch input on some inquiries. ...
Article
Full-text available
Objective. The RSVP Keyboard is a non-implantable, event-related potential-based brain-computer interface (BCI) system designed to support communication access for people with severe speech and physical impairments. Here we introduce inquiry preview (IP), a new RSVP Keyboard interface incorporating switch input for users with some voluntary motor function, and describe its effects on typing performance and other outcomes. Approach. Four individuals with disabilities participated in the collaborative design of possible switch input applications for the RSVP Keyboard, leading to the development of IP and a method of fusing switch input with language model and electroencephalography (EEG) evidence for typing. Twenty-four participants without disabilities and one potential end user with incomplete locked-in syndrome took part in two experiments investigating the effects of IP and two modes of switch input on typing accuracy and speed during a copy-spelling task. Main results. For participants without disabilities, IP and switch input tended to worsen typing performance compared to the standard RSVP Keyboard condition, with more consistent effects across participants for speed than for accuracy. However, there was considerable variability, with some participants demonstrating improved typing performance and better user experience (UX) with IP and switch input. Typing performance for the potential end user was comparable to that of participants without disabilities. He typed most quickly and accurately with IP and switch input and gave favorable UX ratings to those conditions, but preferred standard RSVP Keyboard. Significance. IP is a novel multimodal interface for the RSVP Keyboard BCI, incorporating switch input as an additional control signal. Typing performance and UX and preference varied widely across participants, reinforcing the need for flexible, customizable BCI systems that can adapt to individual users. ClinicalTrials.gov Identifier: NCT04468919.
... It is important to note that our study is limited by a sample size of two participants with a similar etiology of speech loss, due to the rare nature of recording such data. Future studies should better sample the space of end-users, including people who are fully locked-in [62]. Our two participants also had slightly different ECoG array coverage, with Bravo-3 having a larger, denser array that was centered on the central sulcus and extended ventrally into the temporal lobe. ...
Preprint
Neuroprostheses can restore communicative ability to people with paralysis by decoding intended speech movements from the sensorimotor cortex (SMC). However, overlapping neural populations in the SMC are also engaged in visual and auditory processing. The nature of these shared motor and perceptual activations and their potential to interfere with decoding are particularly relevant questions for speech neuroprostheses, as reading and listening are essential daily functions. In two participants with vocal-tract paralysis and anarthria (ClinicalTrials.gov; NCT03698149 ), we developed an online electrocorticography (ECoG) based speech-decoding system that maintained accuracy and specificity to intended speech, even during common daily tasks like reading and listening. Offline, we studied the spectrotemporal characteristics and spatial distribution of reading, listening, and attempted-speech responses across our participants’ ECoG arrays. Across participants, the speech-decoding system had zero false-positive activations during 63.2 minutes of attempted speech and perceptual tasks, maintaining accuracy and specificity to volitional speech attempts. Offline, though we observed shared neural populations that responded to attempted speech, listening, and reading, we found they leveraged different neural representations with differentiable spectrotemporal responses. Shared populations localized to the middle precentral gyrus and may have a distinct role in speech-motor planning. Potential neuroprosthesis users strongly desire reliable systems that will retain specificity to volitional speech attempts during daily use. These results demonstrate a decoding framework for speech neuroprostheses that maintains this specificity and further our understanding of shared perceptual and motor activity on the SMC.
... However, there are limited medical options to improve the quality of life for these patients. BCI could be one of the most promising methods [3]. Even for those mildly affected patients, BCIs are still useful for rehabilitating lost motor functions. ...
Article
Noninvasive brain-computer interfaces (BCIs) have rapidly developed over the past decade. This new technology utilizes magneto-electrical recording or hemodynamic imaging approaches to acquire neurophysiological signals noninvasively, such as electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). These noninvasive signals have different temporal resolutions ranging from milliseconds to seconds and various spatial resolutions ranging from centimeters to millimeters. Thanks to these neuroimaging technologies, various BCI modalities like steady-state visual evoked potential (SSVEP), P300, and motor imagery (MI) could be proposed to rehabilitate or assist patients’ lost function of mobility or communication. This review focuses on the recent development of paradigms, methods, and applications of noninvasive BCI for motor or communication assistance and rehabilitation. The selection of papers follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), obtaining 223 research articles since 2016. We have observed that EEG-based BCI has gained more research focus due to its low cost and portability, as well as more translational studies in rehabilitation, robotic device control, etc. In the past decade, decoding approaches such as deep learning and source imaging have flourished in BCI. Still, there are many challenges to be solved to date, such as designing more convenient electrodes, improving the decoding accuracy and efficiency, designing more applicable systems for target patients, etc., before this new technology matures enough to benefit clinical users. Due to their economy and portability, noninvasive Brain-computer interfaces (BCI) using electroencephalography (EEG) signals are a research hotspot. Different BCI experimental paradigms require different EEG signal processing approaches for efficient decoding. Noninvasive BCI-based applications must solve several challenges to meet the requirements of real-life applications such as rehabilitation
... This has provided publications with an experimental and quantitative focus, including tools for user-centered design and usability assessment (van de Laar et al 2011, Lotte et al 2013, Schreuder et al 2013, Zickler et al 2013, Kübler et al 2014, Jeunet et al 2016, Chavarriaga et al 2017, Choi et al 2017, Mladenovic 2020, Roc et al 2021, Han et al 2022, Riccio et al 2022. At the same time, studies with a qualitative focus on the opinions of users and stakeholders have been vital for improving our understanding of the experiences and needs of end-users and related stakeholders (Peters et al 2016, 2022b, Kögel et al 2020, Branco et al 2021a, 2021b, Klein et al 2022, Pitt et al 2022, Versalovic et al 2022, Fried-Oken et al 2023, Monasterio Astobiza et al 2023. For instance, qualitative approaches have stressed that the experience of the same BCI system can differ widely between individuals. ...
Article
Full-text available
Objective. Brain-computer interfaces (BCIs) can support non-muscular communication and device control for severely paralyzed people. However, efforts that directly involve potential or actual end-users and address their individual needs are scarce, demonstrating a translational gap. An online BCI forum supported by the BCI Society could initiate and sustainably strengthen interactions between BCI researchers and end-users to bridge this gap. Approach. We interviewed six severely paralyzed individuals and surveyed 121 BCI researchers to capture their opinions and wishes concerning an online BCI forum. Data were analyzed with a mixed-method quantitative and qualitative content analysis. Main results. All end-users and most researchers (83%) reported an interest in participating in an online BCI forum. Rating questions and open comments to identify design aspects included what should be featured most prominently, how people would get engaged in the online BCI forum, and which pitfalls should be considered. Significance. Responses support establishing an online BCI forum to serve as a meaningful resource for the entire BCI community.
Article
Full-text available
Natural spoken communication happens instantaneously. Speech delays longer than a few seconds can disrupt the natural flow of conversation. This makes it difficult for individuals with paralysis to participate in meaningful dialogue, potentially leading to feelings of isolation and frustration. Here we used high-density surface recordings of the speech sensorimotor cortex in a clinical trial participant with severe paralysis and anarthria to drive a continuously streaming naturalistic speech synthesizer. We designed and used deep learning recurrent neural network transducer models to achieve online large-vocabulary intelligible fluent speech synthesis personalized to the participant’s preinjury voice with neural decoding in 80-ms increments. Offline, the models demonstrated implicit speech detection capabilities and could continuously decode speech indefinitely, enabling uninterrupted use of the decoder and further increasing speed. Our framework also successfully generalized to other silent-speech interfaces, including single-unit recordings and electromyography. Our findings introduce a speech-neuroprosthetic paradigm to restore naturalistic spoken communication to people with paralysis.
Preprint
Full-text available
Speech-based brain-computer interfaces (BCIs) can offer an intuitive means of communication for those who have lost the ability to speak due to paralysis. Significant progress has been made in classifying individual words from high numbers of electrocorticographic (ECoG) electrodes on the sensorimotor cortex (SMC). As implantations of larger grids with more ECoG electrodes are associated with higher surgical risk, we here examined whether confined electrode configurations can match the classification accuracy of larger grids. To this end, we analyzed data from eight able-bodied participants with high-density ECoG grids (64 to 128 electrodes) who performed a task that involved speaking 12 Dutch words. Word pronunciation was associated with changes in high frequency band activity in two SMC foci, one in the ventral SMC and another in the dorsal SMC. Using a combinatorics approach, we found that a smaller, rectangular, configuration with a surface area of 325 mm ² to 561 mm ² (32 electrodes) could achieve a word classification accuracy similar to that of the larger grids: 76±16% versus 75±17% across participants, respectively (practical chance level 16.7%). The best configurations were oriented vertically and centered on the central sulcus. These findings indicate that a 32-electrode ECoG grid placed optimally can be sufficient for achieving high word classification accuracy on a closed set of words. We conclude that targeted placement of small ECoG grids can reduce surgical demands on end users and justify energy- and complexity-efficient designs of fully implantable BCI devices for individuals with severe paralysis.
Article
Full-text available
The sensorimotor cortex is a frequently targeted brain area for the development of Brain-Computer Interfaces (BCIs) for communication in people with severe paralysis and communication problems (locked-in syndrome; LIS). It is widely acknowledged that this area displays an increase in high-frequency band (HFB) power and a decrease in the power of the low frequency band (LFB) during movement of, for example, the hand. Upon termination of hand movement, activity in the LFB band typically shows a short increase (rebound). The ability to modulate the neural signal in the sensorimotor cortex by imagining or attempting to move is crucial for the implementation of sensorimotor BCI in people who are unable to execute movements. This may not always be self-evident, since the most common causes of LIS, amyotrophic lateral sclerosis (ALS) and brain stem stroke, are associated with significant damage to the brain, potentially affecting the generation of baseline neural activity in the sensorimotor cortex and the modulation thereof by imagined or attempted hand movement. In the Utrecht NeuroProsthesis (UNP) study, a participant with LIS caused by ALS and a participant with LIS due to brain stem stroke were implanted with a fully implantable BCI, including subdural electrocorticography (ECoG) electrodes over the sensorimotor area, with the purpose of achieving ECoG-BCI-based communication. We noted differences between these participants in the spectral power changes generated by attempted movement of the hand. To better understand the nature and origin of these differences, we compared the baseline spectral features and task-induced modulation of the neural signal of the LIS participants, with those of a group of able-bodied people with epilepsy who received a subchronic implant with ECoG electrodes for diagnostic purposes. Our data show that baseline LFB oscillatory components and changes generated in the LFB power of the sensorimotor cortex by (attempted) hand movement differ between participants, despite consistent HFB responses in this area. We conclude that the etiology of LIS may have significant effects on the LFB spectral components in the sensorimotor cortex, which is relevant for the development of communication-BCIs for this population.
Article
Full-text available
Although the fine-grained features of topographic maps in the somatosensory cortex can be shaped by everyday experience, it is unknown whether behavior can support the expression of somatotopic maps where they do not typically occur. Unlike the fingers, represented in all primates, individuated toe maps have only been found in non-human primates. Using 1-mm resolution fMRI, we identify organized toe maps in two individuals born without either upper limb who use their feet to substitute missing hand function and even support their profession as foot artists. We demonstrate that the ordering and structure of the artists’ toe representation mimics typical hand representation. We further reveal ‘‘hand-like’’ features of activity patterns, not only in the foot area but also similarly in the missing hand area. We suggest humans may have an innate capacity for forming additional topographic maps that can be expressed with appropriate experience.
Article
Full-text available
Brain-computer interfaces aim to provide people with paralysis with the possibility to use their neural signals to control devices. For communication, most BCIs are based on the selection of letters from a (digital) letter board to spell words and sentences. Visual mental imagery of letters could offer a new, fast and intuitive way to spell in a BCI-communication solution. Here we provide a proof of concept for the decoding of visually imagined characters from the early visual cortex using 7 Tesla functional MRI. Sixteen healthy participants visually imagined three different characters for 3, 5 and 7 s in a slow event-related design. Using single-trial classification, we were able to decode the characters with an average accuracy of 54%, which is significantly above chance level (33%). Furthermore, the imagined characters were classifiable shortly after cue onset and remained classifiable with prolonged imagery. These properties, combined with the cortical location of the early visual cortex and its decodable activity, encourage further research on intracranial interfacing using surface electrodes to bring us closer to such a visual imagery based BCI communication solution.
Article
Full-text available
Objective: To assess the reliability and usefulness of an EEG-based brain-computer interface (BCI) for patients with advanced amyotrophic lateral sclerosis (ALS) who used it independently at home for up to 18 months. Methods: Of 42 patients consented, 39 (93%) met the study criteria, and 37 (88%) were assessed for use of the Wadsworth BCI. Nine (21%) could not use the BCI. Of the other 28, 27 (men, age 28-79 years) (64%) had the BCI placed in their homes, and they and their caregivers were trained to use it. Use data were collected by Internet. Periodic visits evaluated BCI benefit and burden and quality of life. Results: Over subsequent months, 12 (29% of the original 42) left the study because of death or rapid disease progression and 6 (14%) left because of decreased interest. Fourteen (33%) completed training and used the BCI independently, mainly for communication. Technical problems were rare. Patient and caregiver ratings indicated that BCI benefit exceeded burden. Quality of life remained stable. Of those not lost to the disease, half completed the study; all but 1 patient kept the BCI for further use. Conclusion: The Wadsworth BCI home system can function reliably and usefully when operated by patients in their homes. BCIs that support communication are at present most suitable for people who are severely disabled but are otherwise in stable health. Improvements in BCI convenience and performance, including some now underway, should increase the number of people who find them useful and the extent to which they are used.
Article
Full-text available
Restoring communication for people with locked-in syndrome remains a challenging clinical problem without a reliable solution. Recent studies have shown that people with paralysis can use brain-computer interfaces (BCIs) based on intracortical spiking activity to efficiently type messages. However, due to neuronal signal instability, most intracortical BCIs have required frequent calibration and continuous assistance of skilled engineers to maintain performance. Here, an individual with locked-in syndrome due to brain stem stroke and an individual with tetraplegia secondary to amyotrophic lateral sclerosis (ALS) used a simple communication BCI based on intracortical local field potentials (LFPs) for 76 and 138 days, respectively, without recalibration and without significant loss of performance. BCI spelling rates of 3.07 and 6.88 correct characters/minute allowed the participants to type messages and write emails. Our results indicate that people with locked-in syndrome could soon use a slow but reliable LFP-based BCI for everyday communication without ongoing intervention from a technician or caregiver. NEW & NOTEWORTHY This study demonstrates, for the first time, stable repeated use of an intracortical brain-computer interface by people with tetraplegia over up to four and a half months. The approach uses local field potentials (LFPs), signals that may be more stable than neuronal action potentials, to decode participants’ commands. Throughout the several months of evaluation, the decoder remained unchanged; thus no technical interventions were required to maintain consistent brain-computer interface operation.
Article
Full-text available
Over the last decades, the brain-computer interface (BCI) research field has seen steep progress and now recognizes several types of applications, each with its own target population. Despite this evolution, BCIs seem to remain a research application, and are hardly used in daily life at home, work or in the clinic. Therefore, as a field, we need to take the next step and make sure that we develop BCIs that can, and will, be used outside the laboratory. To this purpose, BCI researchers worldwide were approached by email with the request to fill out a questionnaire, aimed at laying out the near and far future of the BCI field. We show that researchers are quite optimistic about the feasibility of having BCIs applied in real life. Also, we identify the hurdles that need to be taken before these applications become commercial products and the research activities required to accomplish this.
Article
Full-text available
Background: People who suffer from paralysis have difficulties participating in society. Particularly burdensome is the locked-in syndrome (LIS). LIS patients are not able to move and speak but are cognitively healthy. They rely on assistive technology to interact with the world and may benefit from neurotechnological advances. Optimal research and design of such aids requires a well-defined target population. However, the LIS population is poorly characterized and the number of patients in this condition is unknown. Objective: Here we estimated and described the LIS patient population in the Netherlands to define the target population for assistive (neuro)technology. Methods: We asked physicians in the Netherlands if they had patients suffering from severe paralysis and communication problems in their files. Physicians responding affirmatively were asked to fill out a questionnaire on the patients' status. Results: We sent out 9570 letters to general practitioners (GPs), who reported 83 patients. After first screening, the GPs of 46 patients received the questionnaire. Based on the responses, 26 patients were classified as having LIS. Extrapolation of these numbers resulted in a prevalence of 0.73 patients per 100 000 inhabitants. Notable results from the questionnaire were the percentage of patients with neuromuscular disease (>50%) and living at home (>70%). Conclusions: We revealed an etiologically diverse group of LIS patients. The functioning and needs of these patients were, however, similar and many relied on assistive technology. By characterizing the LIS population, our study may contribute to optimal development of assistive (neuro)technology.
Article
Objectives: Brain-computer interface (BCI) technology to assist with mobility and communication is an active area of research in amyotrophic lateral sclerosis (ALS). Implantable BCI offers promise for individuals with severe disease, such as locked-in syndrome, but also raises important ethical issues. We undertook in-depth qualitative interviews with ALS patients from a Veterans Administration hospital ALS multi-disciplinary clinic and explored their perspectives on issues of identity, privacy, enhancement, informed consent, and responsibility related to implantable BCI. Methods: Semi-structured interviews were conducted with sixteen (n = 16) individuals, and transcripts were analysed using a modified grounded theory approach. Results: Emergent themes included: (1) attitudes towards BCI were characterised by fear, hope, and hesitation about adoption of BCI technology; (2) analogies to other technologies were a useful tool in understanding and communicating opinions about ethical issues in BCI; (3) concerns about potentially socially stigmatising effects of BCI and the burden of adjustment to new therapeutic devices were important considerations to be weighed against the potential functional benefit of BCI use; (4) therapeutic decision-making in ALS often intimately involves loved ones; and (5) prospective decision-making about BCI was significantly affected by weighing the timing of the intervention with the progression of illness. Conclusion: The interest in BCI and views on ethical issues raised by BCI is moderated by the experience of living with ALS. The findings from this study can help guide the development of implantable BCI technology for persons with ALS. Implications for rehabilitation Loved ones will play crucial roles in helping patients think through the possible benefits and burdens of getting a BCI device. Providers should consider how the ideal timing for getting an implantable BCI device will vary based on the priorities of persons with ALS and their disease stage. Concerns about social stigma, burden of adjustment, and the desire to maximise time left with loved ones may outweigh the potential functional benefits of BCI devices for some persons with ALS.
Chapter
Locked-in syndrome (LIS) is characterized by an inability to move or speak in the presence of intact cognition and can be caused by brainstem trauma or neuromuscular disease. Quality of life (QoL) in LIS is strongly impaired by the inability to communicate, which cannot always be remedied by traditional augmentative and alternative communication (AAC) solutions if residual muscle activity is insufficient to control the AAC device. Brain-computer interfaces (BCIs) may offer a solution by employing the person's neural signals instead of relying on muscle activity. Here, we review the latest communication BCI research using noninvasive signal acquisition approaches (electroencephalography, functional magnetic resonance imaging, functional near-infrared spectroscopy) and subdural and intracortical implanted electrodes, and we discuss current efforts to translate research knowledge into usable BCI-enabled communication solutions that aim to improve the QoL of individuals with LIS.
Conference Paper
Brain painting (BP) is non-invasive electroencephalography (EEG) based Brain-Computer Interface (BCI) for creative expression based on a P300 matrix. The technology was transferred into a home setup for two patients with amyotrophic lateral sclerosis (ALS), who used the system for several years while being evaluated on performance and satisfaction. Holz and colleagues found that the use of BP increased quality of life. Additionally, they described that changes in the amplitude of the P300 ERPs could be observed between recalibrations of the BCI. In this paper, we quantified the evolution of the P300 peaks in the two BCI end-users (HP and JT). For HP, the P300 peak amplitude increased during 9 months, then progressively decreased for the following 51 months, but the BCI accuracy remained stable. JT’s P300 peak amplitude did not significantly decrease during 32 months that separated the calibrations. Yet, JT’s BCI accuracy declined which we may attribute to a decline in physical functioning due to ALS. Painters used online BCI for hundreds of hours (HP 755, JT 223) and both finished more than 50 named brain paintings. HP could use BP autonomously and regularly at home for 33 months without recalibration of the system, and JT for 10 months, suggesting the stability of P300 and SWLDA online classifiers in the long-term, and demonstrating the feasibility of having a P300 based system at home that requires few involvement of BCI experts.