ArticlePDF Available

Abstract and Figures

Electroencephalography (EEG) has identified human brain potentials elicited by Artificial Grammar (AG) learning paradigms, which present participants with rule-based sequences of stimuli. Nonhuman animals are sensitive to certain AGs; therefore, evaluating which EEG Event Related Potentials (ERPs) are associated with AG learning in nonhuman animals could identify evolutionarily conserved processes. We recorded EEG potentials during an auditory AG learning experiment in two Rhesus macaques. The animals were first exposed to sequences of nonsense words generated by the AG. Then surface-based ERPs were recorded in response to sequences that were ‘consistent’ with the AG and ‘violation’ sequences containing illegal transitions. The AG violations strongly modulated an early component, potentially homologous to the Mismatch Negativity (mMMN), a P200 and a late frontal positivity (P500). The macaque P500 is similar in polarity and time of occurrence to a late EEG positivity reported in human AG learning studies but might differ in functional role.
Content may be subject to copyright.
EEG potentials associated with artificial grammar learning in the primate
brain
Adam Attaheri
a,b
, Yukiko Kikuchi
a,b
, Alice E. Milne
a,b
, Benjamin Wilson
a,b
, Kai Alter
a
,
Christopher I. Petkov
a,b,
a
Institute of Neuroscience, Henry Wellcome Building, Newcastle University, Framlington Place, Newcastle upon Tyne NE2 4HH, United Kingdom
b
Centre for Behaviour and Evolution, Henry Wellcome Building, Newcastle University, Framlington Place, Newcastle upon Tyne NE2 4HH, United Kingdom
article info
Article history:
Accepted 8 November 2014
Available online xxxx
Keywords:
Monkey
mMMN
Primate
Comparative neurobiology
Electroencephalography (EEG)
Event Related Potentials (ERPs)
Communication
Language
Statistical learning
abstract
Electroencephalography (EEG) has identified human brain potentials elicited by Artificial Grammar (AG)
learning paradigms, which present participants with rule-based sequences of stimuli. Nonhuman animals
are sensitive to certain AGs; therefore, evaluating which EEG Event Related Potentials (ERPs) are
associated with AG learning in nonhuman animals could identify evolutionarily conserved processes.
We recorded EEG potentials during an auditory AG learning experiment in two Rhesus macaques. The
animals were first exposed to sequences of nonsense words generated by the AG. Then surface-based
ERPs were recorded in response to sequences that were ‘consistent’ with the AG and ‘violation’ sequences
containing illegal transitions. The AG violations strongly modulated an early component, potentially
homologous to the Mismatch Negativity (mMMN), a P200 and a late frontal positivity (P500). The
macaque P500 is similar in polarity and time of occurrence to a late EEG positivity reported in human
AG learning studies but might differ in functional role.
Ó2014 The Authors. Published by Elsevier Inc. This is an open access article underthe CC BY license (http://
creativecommons.org/licenses/by/3.0/).
1. Introduction
To better understand the neurobiology of human language
requires distinguishing language-specific processes from cognitive,
domain-general processes not restricted to language (Bickerton &
Szathmary, 2009; Fedorenko, Duncan, & Kanwisher, 2012;
Friederici, 2011; Hagoort, 2005). Certain domain-general processes
may be evolutionarily conserved (Bozic, Tyler, Ives, Randall, &
Marslen-Wilson, 2010; Fitch & Friederici, 2012). Thus insights into
how the human brain has specialised for language could come
from cross-species comparative neurobiology. However, all
comparative efforts depend on first finding evidence for shared
abilities on tasks thought to be associated with language-related
processes in humans and second, testing nonhuman animals using
neurobiological techniques commonly used in humans.
Artificial Grammars (AG) regulate the relationships between
stimuli in a sequence (Friederici, Bahlmann, Heim, Schubotz, &
Anwander, 2006; Gomez & Gerken, 1999; Marcus, Vijayan, Bandi
Rao, & Vishton, 1999; Reber, 1967;Saffran, 2002;Saffran,
Johnson, Aslin, & Newport, 1999). AG learning paradigms have been
used to explore the abilities of adult humans, pre-verbal infants and
nonhuman animals to process different AGs (Bahlmann, Schubotz,
& Friederici, 2008; Fitch & Hauser, 2004; Gentner, Fenn,
Margoliash, & Nusbaum, 2006; Murphy, Mondragon, & Murphy,
2008; Saffran et al., 2008; van Heijningen, de Visser, Zuidema, &
ten Cate, 2009; Wilson et al., 2013). Typically, in AG learning studies
the participant is exposed to exemplary sequences of stimuli gener-
ated by the AG. In a subsequent testing phase, the participant’s
responses to ‘consistent’ sequences that follow the AG are
evaluated relative to those that violate it. Different responses to
‘violation’ versus consistent sequences can provide evidence that
the participant is sensitive to the properties of the AG.
The behavioural literature has highlighted potentially con-
served capabilities associated with AG learning in humans and
other animals. Nonhuman animals, including primates, have been
shown to be sensitive to a range of simple and moderate complex-
ity AGs (Fitch & Hauser, 2004; Gentner et al., 2006; Hauser &
Glynn, 2009; Murphy et al., 2008; Saffran et al., 2008; van
Heijningen et al., 2009; Wilson et al., 2013). In this regard, even
relatively simple AGs (such as ‘finite-state’ AGs, which generate a
finite set of sequences based on adjacent transitions between
stimuli; Chomsky, 1957; Fitch & Friederici, 2012) have been
informative about evolutionarily conserved sequence processing
http://dx.doi.org/10.1016/j.bandl.2014.11.006
0093-934X/Ó2014 The Authors. Published by Elsevier Inc.
This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/3.0/).
Corresponding author at: Institute of Neuroscience, Henry Wellcome Building,
Newcastle University, Framlington Place, Newcastle upon Tyne NE2 4HH, United
Kingdom. Fax: +44 (0) 191 208 5227.
E-mail address: chris.petkov@ncl.ac.uk (C.I. Petkov).
Brain & Language xxx (2014) xxx–xxx
Contents lists available at ScienceDirect
Brain & Language
journal homepage: www.elsevier.com/locate/b&l
Please cite this article in press as: Attaheri, A., et al. EEG potentials associated with artificial grammar learning in the primate brain. Brain & Language
(2014), http://dx.doi.org/10.1016/j.bandl.2014.11.006
capacities that predated human language evolution. Concurrently,
human brain imaging studies with functional Magnetic Resonance
Imaging (fMRI) have demonstrated that much of the perisylvian
language network can also be engaged during AG sequence pro-
cessing (Bahlmann et al., 2008; Friederici, 2011; Friederici et al.,
2006; Petersson, Folia, & Hagoort, 2012).
Although fMRI can identify brain regions associated with AG
learning, the temporal resolution of EEG is better suited for identi-
fying the time course of the neural response to AG sequences. In
humans, the polarity and general topography of EEG Event Related
Potentials (ERPs) associated with AG learning have been identified
and related to neurophysiological markers of natural language-
related processes (Friederici, 2002, 2005). Moreover, EEG studies
in humans and other animals have identified ERP components
associated with ‘oddball’ or change detection paradigms, which
can also be modulated by AG learning paradigms. Specifically,
unexpected auditory oddball stimuli elicit a Mismatch Negativity
(MMN; or its monkey homolog: mMMN), which is an enhanced
negativity at 150 ms thought to be generated by regions includ-
ing auditory cortex (Bekinschtein et al., 2009; Fishman &
Steinschneider, 2012; Gil-da-Costa, Stoner, Fung, & Albright,
2013; Javitt, Schroeder, Steinschneider, Arezzo, & Vaughan, 1992;
Naatanen & Alho, 1995;Ueno et al., 2008; Uhrig, Dehaene, &
Jarraya, 2014; Ulanovsky, Las, & Nelken, 2003). The human P200
is an ERP component that can be modulated by attention to infre-
quently presented auditory targets (Garcia-Larrea, Lukaszewicz, &
Mauguiere, 1992; Novak, Ritter, & Vaughan, 1992). A positivity at
300 ms (P3a) elicited in humans and its homolog in nonhuman
primates is thought to be a more general marker of change detec-
tion that seems to involve dorsal fronto-central brain regions
(Arthur & Starr, 1984; Gil-da-Costa et al., 2013; Molholm,
Martinez, Ritter, Javitt, & Foxe, 2005; Paller, Zola-Morgan, Squire,
& Hillyard, 1988; Pineda, Foote, Neville, & Holmes, 1988; Zevin,
Yang, Skipper, & McCandliss, 2010). The MMN and P3a components
in humans can also be elicited by AG paradigms, especially if vio-
lation sequences are presented infrequently (Baldwin & Kutas,
1997; Mueller, Friederici, & Männel, 2012). Moreover, in humans
AG learning paradigms can influence other ERP components also
associated with natural language processes (Friederici, 2004;
Friederici, Steinhauer, & Pfeifer, 2002). Namely, violations to
adjacent AG relationships (local violations) elicit more negative
potentials at 200–350 ms, such as the Early Left Anterior
Negativity (ELAN), which is stronger in frontal electrodes of the left
hemisphere (Friederici, 2005). More complex AGs (such as those
having non-adjacent relationships) can also elicit late centro-pari-
etal positivities (P600: Friederici, 2004; Friederici et al., 2002).
Despite behavioural evidence in humans and other primates for
finite-state AG learning, EEG studies associated with AG learning
were not previously available in nonhuman primates. Therefore,
the question posed is which macaque ERP components would be
elicited by AG sequences? If certain neural processes for AG learn-
ing were evolutionarily conserved, we might expect to find maca-
que ERP responses similar to those reported for comparable AG
processing in humans, including homologs of the MMN and ELAN
potentials, some of which might be stronger in frontal electrodes.
2. Methods
2.1. Properties of the current AG and summary of prior macaque
behavioural results
In a previous behavioural study we showed that Rhesus maca-
ques are sensitive to a moderately complex finite-state AG (Wilson
et al., 2013), based on an AG developed by Saffran et al. (2008).
Such findings suggest that the cognitive abilities required for this
form of AG learning are neither unique to humans nor to language.
The AG consists of branching relationships between several oblig-
atory and optional elements, all of which contribute to the struc-
ture of the AG (Fig. 1A). Such AGs allow the generation of less
predictable (non-deterministic) sequences of varying length: a
property of both sequences of natural events and of most linguistic
sequences (Hurford, 2012; Petkov & Wilson, 2012). After a period
of exposure to exemplary AG sequences, Rhesus macaques (two
of which participated in the current EEG experiment) showed
stronger orienting responses to novel sequences that violated the
AG, relative to those that were ‘consistent’ with the AG (Wilson
et al., 2013). In the behavioural work we also show evidence that
the macaque AG learning results cannot be explained by simple
learning strategies (Wilson et al., 2013).
2.2. Participants
Two adult male Rhesus monkeys (Macaca mulatta) from a group
housed colony participated in this experiment (ages, Macaque 1
Fig. 1. Artificial Grammar (AG), stimuli, sequence comparisons and macaque EEG electrode placement. (A) Schematic of the AG used. Following arrows from ‘start’ to ‘end’
creates a legal, consistent sequence. Not following the arrows (e.g., a ‘D’ to ‘F’ transition) creates a violation. (B) Spectrograms of the acoustic nonsense word sound elements
(A, C, D, F, G) in the sequences. For example, the nonsense word ‘‘YAG’’ took the position of element A in the AG sequences. (C) Exemplary matching consistent vs. violation
comparison sequence pair (see Suppl. Fig. S3 for all comparison pairs). The red box highlights the first illegal sound element in the violation sequence. The sequences are
aligned so that acoustically identical elements can be compared (e.g., ‘F’, ‘C’ and ‘G’). (D) Illustrates the approximate location of the eight scalp surface EEG electrodes on the
macaque, including ground and reference electrodes.
2A. Attaheri et al. / Brain & Language xxx (2014) xxx–xxx
Please cite this article in press as: Attaheri, A., et al. EEG potentials associated with artificial grammar learning in the primate brain. Brain & Language
(2014), http://dx.doi.org/10.1016/j.bandl.2014.11.006
(M1) = 15 years, Macaque 2 (M2) = 7 years; weight: M1 = 9.8 kg,
M2 = 16 kg). All the procedures performed were approved by the
UK Home Office and comply with the Animal Scientific Procedures
Act (1986) on the care and use of animals in research and also with
the European Directive on the protection of animals used in
research (2010/60/EU). We support the Animal Research Reporting
of In Vivo Experiments (ARRIVE) principles on reporting animal
research. All persons involved in this project were Home Office cer-
tified and the work was strictly regulated by the U.K. Home Office.
2.3. Stimuli
Each of the stimulus sequences (see Fig. 1) were made by
digitally combining recordings of naturally spoken nonsense words
produced by a female speaker. The recordings were made with an
Edirol R-09HR (Roland Corp.) sound recorder. The amplitude of the
recorded sounds was root-mean-square (RMS) balanced and the
nonsense word stimuli were combined into sequences using
customised Matlab scripts (150 ms inter-stimulus intervals). The
experiments were coded in Matlab (Psychophysics Toolbox:
http://psychtoolbox.org/) and Cortex software (Salk Institute). All
sounds were presented at 75 dB SPL (calibrated with an XL2
sound level meter, NTI Audio). The durations of the spoken
nonsense word stimuli were subsampled from a corpus so that
all the stimuli (YAG, LEK, KEM, PAV, ROP) were 413 ms long. For
additional details on the behavioural paradigm see Wilson et al.
(2013). The experimental paradigm is shown in Fig. 1 and Suppl.
Figs. S1–S3.
2.4. EEG recordings
The macaques were individually tested in a custom made pri-
mate chair within an acoustically insulated room (IAC). Once in
the acoustic chamber the macaque was placed 60 cm in front of
a monitor (24
00
Samsung, LCD) on which a fixation spot was pre-
sented and the animal completed trials of fixation (Suppl.
Fig. S1). The sounds were presented free-field from two audio
speakers (Creative Inspire T10) placed horizontally at ±30°on
either side of the monitor. A head post was used for immobilising
the head during testing. EEG signals were recorded using eight Ag/
AgCl (Silver/Silver-Chloride) electrodes held in place by a custom
made cap (Fig. 1C). Signals were sampled at a rate of 1000 Hz
through an EEG head stage and amplifier (Neuroscan).
2.5. Time course of a recording session
The macaques had previously been slowly acclimated to periods
of head immobilisation and were trained using operant training and
positive reinforcement to conduct a visual fixation task during
sound stimulation. During the first phase of the experiment the ani-
mals were exposed for 30 min with the exemplary consistent AG
sequences (Suppl. Fig. S2A). The exposure phase was followed by
a30 min testing phase (240 completed test sequence trials)
where randomly selected consistent and violation testing
sequences were individually presented (Suppl. Figs. S1–2). A test
sequence trial was initiated by the animal fixating a spot at the cen-
tre of the screen, measured with an infra-red eye tracker (Arrington
Research). To minimise eye movements, fixation to the centre of the
screen had to be maintained throughout the test sequence presen-
tation for a trial to be correctly completed (Suppl. Fig. S1). After the
end of the test sequence trial there was a 1000 ms interval before
the fixation spot was removed and the juice reward was given for
a completed trial. Only completed trials were included for analysis
with each session having a minimum of 240 completed trials. M1
broke fixation on average in 7% of the trials, M2 broke fixation on
average in 10% of the trials. After the inter-trial-interval (minimally
4500 ms; Suppl. Fig. S1) the fixation spot re-appeared and the next
testing trial began when the macaque engaged the fixation spot. See
Suppl. Figs. S1–3 for illustrations of the trial timing and further
details on the testing sequences used.
We had more testing sequences than we could test in a given
session, as each testing session was completed at the macaque’s
own pace. So to avoid undersampling the EEG data collection for
any of the pairs of sequences we split the experimental data collec-
tion into two blocks, Block A and Block B. Each block contained the
testing sequences illustrated in Suppl. Fig. S2 and consisted of a
number of separate daily testing sessions (total number of sessions
74, M1 = 37 sessions, 20 with Block A, 17 with Block B; M2 = 37
sessions, 18 with Block A, 19 with Block B; see Suppl. Fig. S2).
We counterbalanced the order of these two blocks of data collec-
tion between the two macaques (e.g., one macaque was tested first
on Block A and the other on Block B).
2.6. EEG data analysis
2.6.1. Pre-processing
Data analysis was conducted in Matlab R2011a (The Mathworks)
using the EEGLAB toolbox (http://sccn.ucsd.edu/). Pre-processing
was applied to the data from every channel in each recording ses-
sion. First a high pass filter at 0.3 Hz and a notch filter at 50 Hz were
applied to remove line noise effects. Manual inspection identified
other noisy periods in the EEG trace which were removed. This
resulted in on average 117 trials (±37 trials, standard deviation)
remaining for further analysis, out of the available 240 trials per ses-
sion. Following this, an independent-components algorithm
(‘runica’ in EEGLAB) was used to identify any other artefacts, which
in turn were extracted from the data.
The EEG activity elicited by each sequence trial within a session
was epoched from 200 ms before the sequence onset through to
3250 ms after sequence onset. For each session an average wave-
form was created per channel for each of the sixteen sequences
(Block A = four consistent and four violation sequences, Block
B = four consistent and four violation sequences). This procedure
was repeated for each macaque. Then for each average sequence
waveform the 200 ms pre-sequence silent period was used for
baseline correction. This baseline correction was repeated sepa-
rately for each of the sixteen sequences. Subsequently, Block A
and Block B sequences were treated as a combined set of sixteen
sequences (eight consistent and eight violation) in all further anal-
yses, unless specified otherwise. Finally, the average waveforms
across sessions in the channels of interest were averaged creating
a sequence average waveform.
2.6.2. Analysis of consistent vs. violation sequence effects
Next each of the EEG waveforms in response to the violation
sequences were analysed relative to the EEG responses to the
matching consistent sequence pairs. This allowed us to compare
the effects in response to a violation element in the violation
sequences to an acoustically identical element in the consistent
sequence (Fig. 1C). For this analysis some sequences had to be
aligned so that acoustically matched periods of the sequences
could be compared (Suppl. Fig. S3). After this alignment of
sequences, the EEG responses to the comparison (violation or con-
sistent) sequences were separately averaged (Fig. 3A). Then the
consistent and violation sequence response waveforms were sub-
tracted from each other to create a difference plot (violation minus
consistent; Fig. 3B). From this difference waveform we computed
the lower and upper bounds of the 95% confidence interval of the
baseline period. This was defined based on the variability in the
613 ms time period, including the 200 ms before the onset of
the sound sequence, through to the offset of the first sound
element in the sequence, which was always the same ‘A’ element
A. Attaheri et al. / Brain & Language xxx (2014) xxx–xxx 3
Please cite this article in press as: Attaheri, A., et al. EEG potentials associated with artificial grammar learning in the primate brain. Brain & Language
(2014), http://dx.doi.org/10.1016/j.bandl.2014.11.006
(200 to 413 ms: 613 ms window). Therefore, the confidence
interval (CI) reflects the 95% upper and lower bounds of the vari-
ability in the difference waveform during the baseline period
(i.e., reflecting the 2.5% and 97.5% levels of the null difference
waveform distribution). The CI analysis was used to identify signif-
icant differences between the matched violation and consistent
sequence pairs (Fig. 3B).
To investigate the topographical distribution of the results, such
as whether the effects identified with the CI analyses are more left
or right hemisphere lateralised, or more anterior or posterior, we
submitted the effects to a Repeated Measures ANOVA. First we
obtained the time of the peak difference for the mMMN, P200
and P500, where the ERP components of interest maximally
breached the CIs (e.g., Fig. 3B and Suppl. Fig. S4B). A 40 ms analysis
window was centred on these time points (analysis windows used:
mMMN: 128–168 ms; P200: 161–201 ms; P500: 480–520 ms).
These analysis windows were then used to calculate the maximum
EEG response value within the window, session-by-session. Next,
the EEG voltage potentials in response to the ‘consistent’ and
‘violation’ analyses were submitted to the RM-ANOVA as a
within-subject (repeated-measures) factor of ‘condition’ (consis-
tent or violation). The RM-ANOVA also included the between-
subjects factor of ‘Macaque’ (M1 or M2), and two other
between-subjects factors of ‘Hemisphere’ (left or right) and
‘Antero-posterior axis’ (anterior or posterior). The total number
of sessions numbered 74, M1 = 37 sessions (20 with Block A, 17
with Block B); M2 = 37 sessions (18 with Block A, 19 with Block
B; Suppl. Fig. S3). Each session had two comparison sequence pairs
(Suppl. Fig. S3) and data from the 8 channels. The ANOVA was con-
ducted separately for the mMMN, P200 and P500 ERP components.
The Supplementary Materials reports additional supporting
analyses and results as follows: (1) grand average responses in
all electrodes (Suppl. Fig. S4); (2) ERP effects to the violating sound
and a lack of such effects to the subsequent sound in the sequence
(Suppl. Fig. S5); (3) analyses on whether the effects remain in
sequences including no shifting between consistent and violation
pairs and those that were balanced in the direction of shifting
(Suppl. Fig. S6); (4) analyses showing that violation-related effects
do not seem to depend on the EEG responses to the sound prior to
the violation (Suppl. Fig. S7); and (5) ERP results shown separately
by macaque (Suppl. Fig. S8) shown also in Table S1 as maximum
voltages across sessions for the two macaques separately.
3. Results
We first exposed the macaques to the exemplary AG sequences
for 30 min (Suppl. Fig. S2). Then in the subsequent testing phase,
we recorded surface-based EEG potentials in the animals
(Fig. 1D; Suppl. Fig. S1) as the animals listened to randomly
presented testing sequences (Suppl. Fig. S2). The macaques con-
ducted a fixation task during sequence presentation and EEG data
acquisition (Suppl. Fig. S1). The testing sequences were either ‘con-
sistent’ sequences generated by the AG or ‘violation’ sequences,
which violated the AG structure by having an illegal transition
between nonsense word ‘elements’ (Fig. 1C shows one consistent
and violation matching sequence pair; see Suppl. Figs. S2-3 for
all sequences used). Critically, the first illegal sound element in a
violation sequence was identical to one in the matching consistent
sequence, allowing us to analyse acoustically identical parts of the
consistent and violation sequences (Suppl. Fig. S3).
We first evaluated the EEG response to each of the 5 elements in
the sequence and observed the presence of several typical Event
Related Potential components (ERPs) to each of the elements in
the sequence (Fig. 2). For this, we calculated the grand average
ERP response to each of the elements (across all testing sequences,
sessions, macaques and electrodes; Macaque 1, 37 testing sessions,
Macaque 2, 37 testing sessions). The results show the presence of
early positivities in the macaque brain (P100 at 80 ms; P200 at
200 ms) and a negativity (N100 at 110 ms), see Fig. 2. We also
observe that even the response to the last element showed clear
N100, P100, and P200 ERP components (Fig. 2C).
Next we evaluated effects related to the AG sequencing condi-
tion (consistent or violation) by analysing ERP differences to the
corresponding consistent and violation comparison sequence pairs.
Namely, the first violating sound present in the violation sequence
had an acoustically identical match in its consistent sequence pair
(Fig. 1C). Fig. 3A shows the ERP components to the violation and
consistent sequences in response to the violating sound in the
violation sequences, for the frontal electrodes where we expected
certain ERP components to be more prominent (Suppl. Fig. S4
shows the grand average ERPs for all electrodes). To identify statis-
tically significant effects we first created a difference waveform
(violation minus consistent; Fig. 3B). We then determined the
lower and upper bounds of the 95% confidence interval (CI) from
the difference waveform variability during a baseline period; the
baseline period was defined as the silent period before the start
of the sound sequences and the first element in the sequences,
which was always element ‘A’ (Suppl. Figs. 2 and 3). Projecting
the CI over the period during the violation element and its
corresponding consistent sound pair (Fig. 3) was used to identify
significant waveform differences that deviate in preference for
either the violation or consistent condition. This analysis identified
Fig. 2. Event-Related Potentials (ERPs) in response to the sounds in the sequence.
Grand average ERP from all electrodes (FP1, FP2, F3, F4, P3, P4, C3, C4) in response to
all recorded sequences, all having five elements in a sequence. (A) Expanded ERP to
the first element of the five within the sequences. (B) Grand average ERP to the five
element long sequence. (C) Expanded ERP to the final element of the five in the
sequence. Yellow boxes depict the periods of the ERP where the nonsense word
elements were presented.
4A. Attaheri et al. / Brain & Language xxx (2014) xxx–xxx
Please cite this article in press as: Attaheri, A., et al. EEG potentials associated with artificial grammar learning in the primate brain. Brain & Language
(2014), http://dx.doi.org/10.1016/j.bandl.2014.11.006
both positive and negative differences between the violation and
matched consistent sequence elements. In the four frontal elec-
trodes (FP1, FP2, F3, F4), the violation condition elicited a stronger
early negativity peaking at 148 ms (see red trace in Fig. 3A and the
first breach in the difference waveform in Fig. 3B). This early ERP
component resembles a macaque homologue of the human MMN
(which we will refer to as the mMMN; Fig. 3B). In these frontal
set of electrodes, the violation condition also elicited a later more
positive ERP peaking at 497 ms (Fig. 3A and B). The grand average
ERP across all of the electrodes also show a strong mMMN (Suppl.
Fig. S4), although in the results with all electrodes combined the
P500 is weaker and we identify another early component (P200).
Interestingly, these effects were specific to the first violation sound
because no obvious differences between the violation and consis-
tent sequences were evident for the subsequent sound after the
violation (Suppl. Fig. S5; note here that all three ERP components,
the mMMN, P200 and P500 are evident in this analysis only includ-
ing the sequences which had at least two sounds after the violation
that could be comparably analysed between the violation and con-
sistent sequences).
We evaluated whether there was a session-by-session ERP
response preference either for the violation or consistent condi-
tions. Here, we analysed the session-by-session breaches across
the confidence interval (CI) over the period including the violation
sound and its matching consistent sound element (563 ms). We
measured the number and average area (using trapezoid method)
of the CI breaches in favour for either the violation or consistent
condition. We observed that the distribution of average area
breaches across the CI was shifted towards significantly higher
areas for the violation, relative to the consistent sequences
(Fig. 3C; Wilcoxon signed-rank test, p= 0.013; mean CI breach area
(standard error of the mean, SEM), for violation: 12.81, (±1.96); for
consistent: 8.73 (±1.17)). The violation sequences also elicited a
significantly greater number of breaches above the confidence
intervals than the consistent sequences (Wilcoxon signed-rank
test, p< 0.001; mean number of breaches, for violation: 2.85
(±0.18); consistent: 2.07 (±0.16)).
We used a Repeated Measures Analysis of Variance (RM-ANOVA)
to investigate whether the identified ERP components (mMMN,
P200 and P500) were left or right hemisphere lateralized, or distrib-
uted more anterior or posterior on the head. First we identified the
time windows of interest for each of these components based on our
results with the CI analyses (Fig. 3B, Suppl. Fig. S4B). Next a 40 ms
response window was centred on the position of each of these iden-
tified ERP components (MMN: 128–168 ms; P200: 161–201 ms;
P500: 480–520 ms). Within these windows, the maximum value
of the EEG response to both the consistent and violation sequences
was measured. These values were submitted to the RM-ANOVA
containing a within subjects factor of Condition (consistent or
violation). Also between subjects factors of ‘monkey’ and two addi-
tional between subjects factors identifying the position of the elec-
trodes were modelled (‘Antero-posterior axis’ and ‘Hemisphere’
(left/right)).
With the RM-ANOVA results, first we confirmed that there were
significant main effects for Condition for all of the noted ERP
components (mMMN: F
(1,1176)
= 9.607, p< 0.001; P200:
F
(1,1176)
= 5.392, p< 0.001; P500: F
(1,1176)
= 5.058, p= 0.025). The
amplitude of the EEG responses differed by macaque for many of
the factors, as might be expected (main effect of Macaque; mMMN:
F
(1,1176)
= 9.443, p= 0.002; P200: F
(1,1176)
= 75.008, p< 0.001; P500:
F
(1,1176)
= 144.503, p< 0.001). Notably however the P500 and P200
component did not have a significant Condition by Macaque inter-
action, suggesting that the macaques did not differ in the effects for
these components (P200: F
(1,1176)
= 1.731, p= 0.188; P500:
F
(1,1176)
= 0.872, p= 0.351). The mMMN did show a Condition by
Macaque interaction (mMMN F
(1,1176)
= 9.607, p= 0.02). However,
the polarity of all ERP components (mMMN, P200 and P500) was
consistent across the macaques (Suppl. Fig. S8). Regarding topo-
graphical distribution, only the mMMN component was signifi-
cantly different between left- and right-hemisphere channels:
the mMMN was stronger in the left (FP1, F3, C3, P3) than right elec-
trodes (FP2, F4, C4, P4), (F
(1,1176)
= 4.199, p= 0.041). Regarding
anterior or posterior head distribution, the RM-ANOVA showed
that the mMMN, P200 and P500 components were all significantly
stronger in the more anterior electrodes (electrodes FP1, FP2, F3,
Fig. 3. Artificial grammar sequence processing effects in the frontal electrodes
following violation sound onset. (A, B) Grand average ERPs across the frontal
electrodes (FP1, FP2, F3, F4), aligned to the onset of a violation within the 5 element
sequence (see Fig. 1 and Suppl. Figs. S1–3). ERPs shown are for the first illegal sound
element and its matching consistent sequence element. (A) Grand average ERP for
consistent responses (blue line) and violation responses (red line). (B) Difference
plot (violation minus consistent, see A). Red lines correspond to the upper (solid)
and lower (dashed) bounds of the 95% confidence interval (2.5% and 97.5%
respectively), defined by the variability in the difference waveform during a 613 ms
baseline period including the 200 ms prior to the start of the first sound in the
sequence through the end of the first element in the sequences, which was always
element ‘A’ (see Section 2for further details). Black horizontal line shows the mean
of the baseline period difference waveform, reflecting some variability in the
difference waveform in response to the violation minus consistent sequence
elements. Areas that breach the confidence interval are filled in red. (C) Histogram
showing the distributions of average area of CI breaches (2 comparison pairs per
session, for all the sessions with each macaque; n= 148 data points).
A. Attaheri et al. / Brain & Language xxx (2014) xxx–xxx 5
Please cite this article in press as: Attaheri, A., et al. EEG potentials associated with artificial grammar learning in the primate brain. Brain & Language
(2014), http://dx.doi.org/10.1016/j.bandl.2014.11.006
F4; mMMN F
(1,1176)
= 48.893, p< 0.001; P200, F
(1,1176)
= 6.649,
p= 0.01; P500, F
(1,1176)
= 5.033, p= 0.025).
To match the violation sequences with the same elements in
consistent sequences involved shifting the alignment of some of
the sequences. We confirmed that the reported effects were evident
in the grand average ERP response including sequences that were
not shifted and those that were balanced in the direction of shifting
(Suppl. Fig. S6). Also, since we required that the sounds after a vio-
lation were acoustically matched, the experimental design necessi-
tated that the sounds preceding the violation were different
between consistent and violation sequences (Fig. 1C). Thus we
asked whether the magnitude of the response difference to these
sounds prior to the violation was associated with the size of the
mMMN and P500 ERP components seen in response to the violation
sound. This could identify an interesting contextual effect whereby
the strength of the acoustically-related EEG response to the consis-
tent vs. violation sequence element prior to the violation was asso-
ciated with the strength of the effect to the violation sound and its
acoustically matched consistent sequence sound (illustrated in
Suppl. Fig. S7C). However, there was no significant association with
the magnitude of the response difference to the acoustically differ-
ent sounds prior to the violation and the magnitude of the mMMN
and P500 effects to the violation sound (Suppl. Fig. S7).
4. Discussion
This macaque EEG study provides evidence that certain ERP
components are modulated by violations to a moderately complex,
finite-state AG, which macaques appear able to implicitly learn
(Wilson et al., 2013). We observed that violations to adjacent
relationships in the AG modulated positivities and negativities
(from 150–500 ms), with the strongest modulations occurring
for the macaque mMMN, P200 and a later frontal positivity
(P500). We next separately discuss each of these observed ERP
components in relation to the literature, including ERPs reported
in human EEG studies of AG learning.
Our experimental design ensured that effects related to a viola-
tion sound were analysed in relation to an acoustically identical
sound in a matched comparison consistent sequence. Thus the
results cannot easily be attributed to acoustical differences and
instead reflect the sequencing condition in which the nonsense
word elements occurred (i.e., whether the order of the preceding
elements in the sequence lead to the analysed element being
consistent with or in violation of the AG). We observed that for a
violation element, certain ERP components were modulated to a
greater extent than for their acoustically matched elements in
the consistent sequence. The effects were restricted to the violating
element, as none of the effects persisted for the next sound
following the violation element. Moreover, the reported effects
are evident in sequences with no shifting and balanced shifting
between consistent and violation sequences (Suppl. Fig. S6). Fur-
thermore, the reported effects do not appear to be associated with
the acoustically-related EEG response to the sound prior to the vio-
lation (Supp. Fig. S7).
We had hypothesised that AG violations would modulate a
number of components, such as the monkey homologs of the
MMN (Bekinschtein et al., 2009; Fishman & Steinschneider, 2012;
Gil-da-Costa et al., 2013; Javitt et al., 1992; Naatanen & Alho,
1995 ;Ueno et al., 2008; Uhrig et al., 2014; Ulanovsky et al.,
2003), human Early Left Anterior Negativity (ELAN: Friederici,
2004; Friederici et al., 2002), P200 (Garcia-Larrea et al., 1992;
Novak et al., 1992) and P3a (Arthur & Starr, 1984; Baldwin &
Kutas, 1997; Gil-da-Costa et al., 2013; Molholm et al., 2005;
Mueller et al., 2012; Paller et al., 1988; Pineda et al., 1988; Zevin
et al., 2010). Two of these predictions were met. We observed
mMMN and P200 ERP components. The mMMN is of interest
because human EEG studies using AGs with similar levels of com-
plexity to the AG used here (e.g., those with adjacent relationships)
can elicit an MMN (Baldwin & Kutas, 1997; Mueller et al., 2012).
However, such AGs also often elicit an ELAN (Friederici, 2004;
Friederici et al., 2002), for which we found no strong evidence of
a macaque homolog using our significance criteria, although care
is needed when interpreting topographical distributions from our
limited set of electrodes. Interestingly, we observed a prominent
late P500 component, which was not predicted because such a late
positivity in human AG learning studies is usually associated with
more complicated (e.g., non-adjacent) AG relationships (Friederici,
2004; Friederici et al., 2002).
Some of the earlier macaque ERP components show consider-
able similarities to those that have been reported in the EEG
literature, in relation to ERP components modulated by violations
of expectancy. Prior human and nonhuman animal work studying
neuronal responses or ERPs, associated with oddball sounds or
change detection, have also noted effects on early components.
For example, the nonhuman animal homolog of the MMN response
is an extended negativity occurring at 150 ms after stimulus
onset, which is elicited by an acoustically deviant sound
(Bekinschtein et al., 2009; Fishman & Steinschneider, 2012; Gil-
da-Costa et al., 2013; Javitt et al., 1992; Naatanen & Alho, 1995 ;
Ueno et al., 2008; Ulanovsky et al., 2003). Human EEG studies of
AG learning have also reported effects on the MMN or P300 when
the violation sequences are presented infrequently (Baldwin &
Kutas, 1997; Mueller et al., 2012). Thus, our observed enhance-
ment of the macaque mMMN and P200 by the AG violation condi-
tion could relate to violations of expectancy. However, our study
ensured balanced presentation of violation and consistent
sequences, which is also the case for many other AG learning stud-
ies (Friederici, 2004; Friederici et al., 2002). Thus, the violation of
expectancy in this experiment was established by the period of
exposure (lasting for 30 min) prior to testing.
The P500 component that we observed was unexpected but
appears to be a robust effect. The later positivity to AG violations
in humans (P600) might be near enough in time to be a homolog
of the component that we see in the macaque P500. However, the
P600 in humans is thought to be elicited by more complex AGs
including those that have hierarchical relationships of the forms
that are only present in human language (Friederici, 2002, 2005)
and for which there is currently no clear evidence that any nonhu-
man animal can learn (Berwick, Okanoya, Beckers, & Bolhuis, 2011).
Therefore, our macaque P500 is unlikely to be a direct homolog of
the P600 reported in humans for complex AG or syntax-related pro-
cesses. It also seems unlikely that the observed macaque P500 is a
later macaque homolog of the P3a since the macaque P3a in
response to oddball sounds does not seem to persist through to
500 ms after sound onset (Gil-da-Costa et al., 2013). Furthermore,
during the time period where we might expect a macaque P3a com-
ponent (200–350 ms), we see, if anything, a stronger negativity for
the violation sequences (Fig. 3). This observation is inconsistent
with our observed P500 being a remnant of a prior sub-threshold
P3a effect. Thus, the correspondences in the polarity and general
time of occurrence of the macaque P500 to the reported human
P600 might reflect evolutionarily conserved processes involved in
evaluating sequences for consistency with previously learned
sequencing relationships. The differences in the functional role for
the macaque P500 and the human P600 may reflect the differenti-
ation that has occurred in humans to support language-specific
processes.
In conclusion, we identified a number of expected effects on
early macaque ERP positivities and negativities associated with
AG learning, such as prominent effects on the macaque mMMN
and P200. We did not identify a corresponding homolog of the
human ELAN response to adjacent AG violations. However, we note
6A. Attaheri et al. / Brain & Language xxx (2014) xxx–xxx
Please cite this article in press as: Attaheri, A., et al. EEG potentials associated with artificial grammar learning in the primate brain. Brain & Language
(2014), http://dx.doi.org/10.1016/j.bandl.2014.11.006
a prominent later frontal positivity (P500), which although
unexpected is similar in polarity and relative time of occurrence,
but likely differs in its functional role, to the P600 that has been
reported in human EEG studies of more complex forms of AG
learning. This first macaque EEG study of AG learning raises the
possibility that certain processes associated with auditory
sequence analysis are evolutionarily conserved as reflected in the
ERP responses that were measured here. Some, like the macaque
P500, might have further functionally differentiated in humans.
The conserved aspects of the ERP components can now be studied
at the neuronal level in macaques, as a primate model system, and
related to humans using comparative EEG and fMRI.
Author contributions
A.A. and C.I.P. designed research; A.A. and A.M. performed
research; A.A. analysed data; B.W., K.A., Y.K., and C.I.P. provided
materials and intellectual contributions; A.A. and C.I.P. wrote the
paper with input from the co-authors.
Acknowledgments
We thank B. Malone and two anonymous reviewers for
constructive comments on a previous version of the manuscript.
We thank A. Hanson for assistance with EEG recordings, V. Willey
for custom machine work, and P. Flecknell and members of the
Comparative Biology Centre staff for expert veterinary and
husbandry support. Supported by the Wellcome Trust – United
Kingdom (to CIP; Project Grant WT092606/Z/10/Z; Investigator
Award WT102961MA).
Appendix A. Supplementary material
Supplementary data associated with this article can be found, in
the online version, at http://dx.doi.org/10.1016/j.bandl.2014.11.
006.
References
Arthur, D. L., & Starr, A. (1984). Task-relevant late positive component of the
auditory event-related potential in monkeys resembles P300 in humans.
Science, 223(4632), 186–188.
Bahlmann, J., Schubotz, R. I., & Friederici, A. D. (2008). Hierarchical artificial
grammar processing engages Broca’s area. Neuroimage, 42(2), 525–534.
Baldwin, K. B., & Kutas, M. (1997). An ERP analysis of implicit structured sequence
learning. Psychophysiology, 34(1), 74–86.
Bekinschtein, T. A., Dehaene, S., Rohaut, B., Tadel, F., Cohen, L., & Naccache, L. (2009).
Neural signature of the conscious processing of auditory regularities.
Proceedings of the National Academy of Sciences, 106(5), 1672–1677.
Berwick, R. C., Okanoya, K., Beckers, G. J., & Bolhuis, J. J. (2011). Songs to syntax: The
linguistics of birdsong. Trends in Cognitive Sciences, 15(3), 113–121.
Bickerton, D., & Szathmary, E. (2009). Biological foundations and origin of syntax.
Cambridge, MA: MIT Press.
Bozic, M., Tyler, L. K., Ives, D. T., Randall, B., & Marslen-Wilson, W. D. (2010).
Bihemispheric foundations for human speech comprehension. Proceedings of the
National academy of Sciences of the United States of America, 107(40),
17439–17444.
Chomsky, N. (1957). Syntactic structures. The Hague: Mouton.
Fedorenko, E., Duncan, J., & Kanwisher, N. (2012). Language-selective and domain-
general regions lie side by side within Broca’s area. Current Biology, 22(21),
2059–2062.
Fishman, Y. I., & Steinschneider, M. (2012). Searching for the mismatch negativity in
primary auditory cortex of the awake monkey: Deviance detection or stimulus
specific adaptation? Journal of Neuroscience, 32(45), 15747–15758.
Fitch, W. T., & Friederici, A. (2012). Artificial grammar learning meets formal
language theory: An overview. Philosophical Transactions of the Royal Society of
London Series B: Biological Sciences, 367, 1933–1955.
Fitch, W. T., & Hauser, M. D. (2004). Computational constraints on syntactic
processing in a nonhuman primate. Science, 303(5656), 377–380.
Friederici, A. D. (2002). Towards a neural basis of auditory sentence processing.
Trends in Cognitive Sciences, 6(2), 78–84.
Friederici, A. D. (2004). Processing local transitions versus long-distance syntactic
hierarchies. Trends in Cognitive Sciences, 8(6), 245–247.
Friederici, A. D. (2005). Neurophysiological markers of early language acquisition:
From syllables to sentences. Trends in Cognitive Sciences, 9(10), 481–488.
Friederici, A. D. (2011). The brain basis of language processing: From structure to
function. Physiological Reviews, 91(4), 1357–1392.
Friederici, A. D., Bahlmann, J., Heim, S., Schubotz, R. I., & Anwander, A. (2006). The
brain differentiates human and non-human grammars: Functional localization
and structural connectivity. Proceedings of the National Academy of Sciences of
the United States of America, 103(7), 2458–2463.
Friederici, A. D., Steinhauer, K., & Pfeifer, E. (2002). Brain signatures of artificial
language processing: Evidence challenging the critical period hypothesis.
Proceedings of the National Academy of Sciences, 99(1), 529–534.
Garcia-Larrea, L., Lukaszewicz, A. C., & Mauguiere, F. (1992). Revisiting the oddball
paradigm. Non-target vs neutral stimuli and the evaluation of ERP attentional
effects. Neuropsychologia, 30(8), 723–741.
Gentner, T. Q., Fenn, K. M., Margoliash, D., & Nusbaum, H. C. (2006). Recursive
syntactic pattern learning by songbirds. Nature, 440(7088), 1204–1207.
Gil-da-Costa, R., Stoner, G. R., Fung, R., & Albright, T. D. (2013). Nonhuman primate
model of schizophrenia using a noninvasive EEG method. Proceedings of the
National Academy of Sciences of the United States of America, 110(38),
15425–15430.
Gomez, R. L., & Gerken, L. (1999). Artificial grammar learning by 1-year-olds leads to
specific and abstract knowledge. Cognition, 70(2), 109–135.
Hagoort, P. (2005). On Broca, brain, and binding: A new framework. Trends in
Cognitive Sciences, 9(9), 416–423.
Hauser, M. D., & Glynn, D. (2009). Can free-ranging rhesus monkeys (Macaca
mulatta) extract artificially created rules comprised of natural vocalizations?
Journal of Comparative Psychology, 123(2), 161–167.
Hurford, J. R. (2012). The origins of grammar: Language in the light of evolution II.
Oxford University Press.
Javitt, D. C., Schroeder, C. E., Steinschneider, M., Arezzo, J. C., & Vaughan, H. G. Jr.,
(1992). Demonstration of mismatch negativity in the monkey.
Electroencephalography and Clinical Neurophysiology, 83(1), 87–90.
Marcus, G. F., Vijayan, S., Bandi Rao, S., & Vishton, P. M. (1999). Rule learning by
seven-month-old infants. Science, 283(5398), 77–80.
Molholm, S., Martinez, A., Ritter, W., Javitt, D. C., & Foxe, J. J. (2005). The neural
circuitry of pre-attentive auditory change-detection: An fMRI study of pitch and
duration mismatch negativity generators. Cerebral Cortex, 15(5), 545–551.
Mueller, J. L., Friederici, A. D., & Männel, C. (2012). Auditory perception at the root of
language learning. Proceedings of the National Academy of Sciences, 109(39),
15953–15958.
Murphy, R. A., Mondragon, E., & Murphy, V. A. (2008). Rule learning by rats. Science,
319(5871), 1849–1851.
Naatanen, R., & Alho, K. (1995). Generators of electrical and magnetic mismatch
responses in humans. Brain Topography, 7(4), 315–320.
Novak, G., Ritter, W., & Vaughan, H. G. Jr., (1992). Mismatch detection and the
latency of temporal judgements. Psychophysiology, 29(4), 398–411.
Paller, K. A., Zola-Morgan, S., Squire, L. R., & Hillyard, S. A. (1988). P3-like brain
waves in normal monkeys and in monkeys with medial temporal lesions.
Behavioral Neuroscience, 102(5), 714–725.
Petersson, K. M., Folia, V., & Hagoort, P. (2012). What artificial grammar learning
reveals about the neurobiology of syntax. Brain and Language, 120(2), 83–95.
Petkov, C. I., & Wilson, B. (2012). On the pursuit of the brain network for proto-
syntactic learning in non-human primates: Conceptual issues and
neurobiological hypotheses. Philosophical Transactions of the Royal Society of
London Series B: Biological Sciences, 367(1598), 2077–2088.
Pineda, J. A., Foote, S. L., Neville, H. J., & Holmes, T. C. (1988). Endogenous event-
related potentials in monkey: The role of task relevance, stimulus probability,
and behavioral response. Electroencephalography and Clinical Neurophysiology,
70(2), 155–171.
Reber, A. S. (1967). Implicit learning of artificial grammars. Journal of Verbal Learning
and Verbal Behaviour, 6(6), 855–863.
Saffran, J. R. (2002). Constraints on statistical language learning. Journal of Memory
and Language, 47(1), 172–196.
Saffran, J., Hauser, M., Seibel, R., Kapfhamer, J., Tsao, F., & Cushman, F. (2008).
Grammatical pattern learning by human infants and cotton-top tamarin
monkeys. Cognition, 107(2), 479–500.
Saffran, J. R., Johnson, E. K., Aslin, R. N., & Newport, E. L. (1999). Statistical learning of
tone sequences by human infants and adults. Cognition, 70(1), 27–52.
Ueno, A., Hirata, S., Fuwa, K., Sugama, K., Kusunoki, K., Matsuda, G., et al. (2008).
Auditory ERPs to stimulus deviance in an awake chimpanzee (Pan troglodytes):
Towards hominid cognitive neurosciences. PLoS One, 3(1), e1442.
Uhrig, L., Dehaene, S., & Jarraya, B. (2014). A hierarchy of responses to auditory
regularities in the macaque brain. Journal of Neuroscience, 34(4), 1127–1132.
Ulanovsky, N., Las, L., & Nelken, I. (2003). Processing of low-probability sounds by
cortical neurons. Nature Neuroscience, 6(4), 391–398.
van Heijningen, C. A., de Visser, J., Zuidema, W., & ten Cate, C. (2009). Simple rules
can explain discrimination of putative recursive syntactic structures by a
songbird species. Proceedings of the National Academy of Sciences of the United
States of America, 106(48), 20538–20543.
Wilson, B., Slater, H., Kikuchi, Y., Milne, A. E., Marslen-Wilson, W. D., Smith, K., &
Petkov, C. I. (2013). Auditory artificial grammar learning in macaque and
marmoset monkeys. Journal of Neuroscience, 33(48), 18825–18835.
Zevin, J. D., Yang, J., Skipper, J. I., & McCandliss, B. D. (2010). Domain general change
detection accounts for ‘‘dishabituation’’ effects in temporal–parietal regions in
functional magnetic resonance imaging studies of speech perception. Journal of
Neuroscience, 30(3), 1110–1117.
A. Attaheri et al. / Brain & Language xxx (2014) xxx–xxx 7
Please cite this article in press as: Attaheri, A., et al. EEG potentials associated with artificial grammar learning in the primate brain. Brain & Language
(2014), http://dx.doi.org/10.1016/j.bandl.2014.11.006
... Repeated exposure to the standard sound results in attenuation of neural responses in the auditory cortex, whereas rare deviant sounds elicit larger neural responses. To resolve this controversy, a number of studies have applied several control paradigms and violations of abstract rules in an attempt to elicit and record responses reflecting genuine deviance detection (Schröger and Wolff, 1996;Ruusuvirta et al., 2007;Wild et al., 2009;Ruhnau et al., 2012;Astikainen et al., 2014;Harms et al., 2014;Attaheri et al., 2015). ...
... Human infants demonstrated the ability to extract grammatical rules in an artificial language task using made-up words (e.g., ABA grammar, such as "ga ti ga" and ABB grammar, such as "ga ti ti") (Marcus et al., 1999). Recently, some animal studies measuring MMR reported that the auditory cortex of rats (Astikainen et al., 2014) and frontal cortex of macaques (Attaheri et al., 2015) respond to changes in a pattern of sound sequences. This suggests that some cognitive elements related to language learning, such as the ability to extract grammatical rules, might have originally evolved for more general behavioral skills. ...
... The detection of categorical changes is considered to reflect higher cognitive function rather than the effects of adaptation. Some studies using primates and rats demonstrated MMR elicited by the change in melodic contours (Ruusuvirta et al., 2007) and grammar-like sequences (Astikainen et al., 2014;Attaheri et al., 2015). In the triplet sequence paradigm, we detected MMR at 95-115 ms after the second sound onset (215-240 ms after the stimulus onset) specifically in pattern-violating sequences "ABB." ...
Article
Full-text available
Learning sound patterns in the natural auditory scene and detecting deviant patterns are adaptive behaviors that aid animals in predicting future events and behaving accordingly. Mismatch negativity (MMN) is a component of the event-related potential (ERP) that is reported in humans when they are exposed to unexpected or rare stimuli. MMN has been studied in several non-human animals using an oddball task by presenting deviant pure tones that were interspersed within a sequence of standard pure tones and comparing the neural responses. While accumulating evidence suggests the homology of non-human animal MMN-like responses (MMRs) and human MMN, it is still not clear whether the function and neural mechanisms of MMRs and MMN are comparable. The Java sparrow (Lonchura oryzivora) is a songbird that is a vocal learner, is highly social, and maintains communication with flock members using frequently repeated contact calls and song. We expect that the songbird is a potentially useful animal model that will broaden our understanding of the characterization of MMRs. Due to this, we chose this species to explore MMRs to the deviant sounds in the single sound oddball task using both pure tones and natural vocalizations. MMRs were measured in the caudomedial nidopallium (NCM), a higher-order auditory area. We recorded local field potentials under freely moving conditions. Significant differences were observed in the negative component between deviant and standard ERPs, both to pure tones and natural vocalizations in the oddball sequence. However, the subsequent experiments using the randomized standard sequence and regular pattern sequence suggest the possibility that MMR elicited in the oddball paradigm reflects the adaptation to a repeated standard sound but not the genuine deviance detection. Furthermore, we presented contact call triplet sequences and investigated MMR in the NCM in response to sound sequence order. We found a significant negative shift in response to a difference in sequence pattern. This demonstrates MMR elicited by violation of the pattern of the triplet sequence and the ability to extract sound sequence information in the songbird auditory forebrain. Our study sheds light on the electrophysiological properties of auditory sensory memory processing, expanding the scope of characterization of MMN-like responses beyond simple deviance detection, and provides a comparative perspective on syntax processing in human.
... Technically, MePhys is most closely related to stereotactic EEG 28,29 (SEEG), i.e., LFP recordings from several chronically implanted multi-contact shafts that are used in the clinic for the localization of seizure foci. MePhys also builds on decades of technical expertise from EEG 30,31 , and ECoG 32 recordings in humans, as well as a wide range of electrophysiolgocal techniques in animal model systems using macroelectrodes [33][34][35][36][37][38][39][40][41] , micro-electrodes [42][43][44] , linear arrays [45][46][47][48] , eCog arrays 49,50 , single-tipped electrode-arrays 3,12,13,17,51,52 , or arrays of multi-channel electrodes 53 . Conceptually, however, MePhys fundamentally differs from existing approaches along at least one of three dimensions: (i) Its field of view is a three-dimensional volume rather than one-or twodimensional manifold; (ii) MePhys spreads electrode contacts as widely as possible in order to maximize the field of view rather than spatial resolution; (iii) MePhys prioritizes LFPs over single-cell activity. ...
Preprint
Full-text available
The primate brain is a densely interconnected organ whose function is best understood by recording from the entire structure in parallel, rather than parts of it in sequence. However, available methods either have limited temporal resolution (functional magnetic resonance imaging), limited spatial resolution (macroscopic electroencephalography), or a limited field of view (microscopic electrophysiology). To address this need, we developed a volumetric, mesoscopic recording approach ( MePhys ) by tessellating the volume of a monkey hemisphere with 992 electrode contacts that were distributed across 62 chronically implanted multi-electrode shafts. We showcase the scientific promise of MePhys by describing the functional interactions of local field potentials between the more than 300,000 simultaneously recorded pairs of electrodes. We find that a subanesthetic dose of ketamine –believed to mimic certain aspects of psychosis– can create a pronounced state of functional disconnection and prevent the formation of stable large-scale intrinsic states. We conclude that MePhys provides a new and fundamentally distinct window into brain function whose unique profile of strengths and weaknesses complements existing approaches in synergistic ways.
... The strong correlation between willed actions and EEG signals in humans has already been known since Libet et al. (1982Libet et al. ( , 1983a pioneering experiments in the 1980's that demonstrated that EEG signals can be used to predict intentions to act, prior to the subject knowing their intention, findings that have inspired recent research efforts to build EEG-operated brain-computer interfaces (BCIs) for patients with prosthetic limbs (Guger et al., 1999) or suffering from locked-in syndrome (Aricò et al., 2018). Unfortunately, only limited studies of the correlation between EEG and behavior have been performed in primates (Attaheri et al., 2015), cats (Engemann et al., 2018), horses (de Camp et al., 2020), and a scattering of other animals (Klemm, 1992); but, type 1 EMF-ToCs do, at least, provide a framework through which the question of the level of consciousness in animals could potentially be measured. , 2020) and is fundamental to the gestalt information processing (McFadden, 2013b) of ideas and concepts that is characteristic of the conscious mind and contrasts with the digital processing capabilities of non-conscious minds. ...
Article
Full-text available
Conventional theories of consciousness (ToCs) that assume that the substrate of consciousness is the brain's neuronal matter fail to account for fundamental features of consciousness, such as the binding problem. Field ToC's propose that the substrate of consciousness is the brain's best accounted by some kind of field in the brain. Electromagnetic (EM) ToCs propose that the conscious field is the brain's well-known EM field. EM-ToCs were first proposed only around 20 years ago primarily to account for the experimental discovery that synchronous neuronal firing was the strongest neural correlate of consciousness (NCC). Although EM-ToCs are gaining increasing support, they remain controversial and are often ignored by neurobiologists and philosophers and passed over in most published reviews of consciousness. In this review I examine EM-ToCs against established criteria for distinguishing between ToCs and demonstrate that they outperform all conventional ToCs and provide novel insights into the nature of consciousness as well as a feasible route toward building artificial consciousnesses.
... History: Monkey 1 (Case 1) was 12 years old, weighing 13 kg. Case 1 contributed to a study that resulted in several behavioural [18][19][20], EEG [21], electrophysiological [22,23] and MRI [24] reports. ...
Article
Full-text available
Information from Magnetic Resonance Imaging (MRI) is useful for diagnosis and treatment management of human neurological patients. MRI monitoring might also prove useful for non-human animals involved in neuroscience research provided that MRI is available and feasible and that there are no MRI contra-indications precluding scanning. However, MRI monitoring is not established in macaques and a resource is urgently needed that could grow with scientific community contributions. Here we show the utility and potential benefits of MRI-based monitoring in a few diverse cases with macaque monkeys. We also establish a PRIMatE MRI Monitoring (PRIME-MRM) resource within the PRIMatE Data Exchange (PRIME-DE) and quantitatively compare the cases to normative information drawn from MRI data from typical macaques in PRIME-DE. In the cases, the monkeys presented with no or mild/moderate clinical signs, were well otherwise and MRI scanning did not present a significant increase in welfare impact. Therefore, they were identified as suitable candidates for clinical investigation, MRI-based monitoring and treatment. For each case, we show MRI quantification of internal controls in relation to treatment steps and comparisons with normative data in typical monkeys drawn from PRIME-DE. We found that MRI assists in precise and early diagnosis of cerebral events and can be useful for visualising, treating and quantifying treatment response. The scientific community could now grow the PRIME-MRM resource with other cases and larger samples to further assess and increase the evidence base on the benefits of MRI monitoring of primates, complementing the animals’ clinical monitoring and treatment regime.
... Although humans are the only species to have acquired language, it is becoming increasingly evident that non-human primates, especially old world species, possess some basic ability to process simple characteristics of human language (Attaheri et al., 2014;Milne et al., 2017;, although perhaps not on a semantic level. ...
Thesis
Full-text available
This project was initiated with two goals in mind. The first, to refine methods of head immobilisation for rhesus macaques participating in experiments which do not require direct access to the brain, and the second to investigate the effect of attention on lateralisation in auditory cortex. Head immobilisation is often necessary for neuroscientific procedures. A number of Non-invasive Head Immobilisation Systems (NHIS) for monkeys are available, but the need remains for a feasible integrated system combining a broad range of essential features. This thesis details the development of an individually customised macaque NHIS which addresses several animal welfare and scientific needs. The system comprises a customised facemask that can be used separately or combined with a back piece to form a full head helmet. The system was evaluated during performance on several auditory or visual behavioural tasks with testing sessions lasting 1.5-2hrs. To investigate the effect of attention on lateralised processes, four male rhesus macaques were trained to perform an active auditory spatial discrimination task (two of which used the NHIS) using either conspecific “coo” vocalisations or a coo vocalisation from a different individual which had the phase information scrambled, but preserved the spectral components (sCoo). Behavioural results indicated a directional bias during the task with coos, with the animals performing the task with ease when the coo initially appeared on the left but performance being hindered when the coo first appeared on the right. No bias was observed with an animal initially trained with the noise. Attention effects on hemispheric laterality were then studied using fMRI with the trained animals and, as a point of reference, a naïve animal who was passively presented with the task stimuli. The results shown have implications for the control of attention when investigating lateralised processing in both human and non-human species. Additionally, it is conclusively shown that auditory fMRI and behavioural experiments can be conducted without the need for invasive head immobilisation techniques in rhesus macaques.
... Theoretically, this is often conceptualized as learning the statistical regularities of the sensory environment (Romberg and Saffran, 2010;Erickson and Thiessen, 2015;Bretan et al., 2017;Skerritt-Davis and Elhilali, 2018) so as to predict upcoming events, in a process referred to as 'statistical learning'. Supporting evidence is that failed predictions due to deviations in the sensory sequence produce measurable brain activations that have been associated with the detection and strength of these irregularities, that is prediction error (Vuust et al., 2012;Clark, 2013;Moldwin et al., 2017;Omigie et al., 2019;Quiroga-Martinez et al., 2019b;Quiroga-Martinez et al., 2019a), and with learning (Storkel and Rogers, 2000;Attaheri et al., 2015;Qi et al., 2017). ...
Article
Full-text available
Humans engagement in music rests on underlying elements such as the listeners’ cultural background and interest in music. These factors modulate how listeners anticipate musical events, a process inducing instantaneous neural responses as the music confronts these expectations. Measuring such neural correlates would represent a direct window into high-level brain processing. Here we recorded cortical signals as participants listened to Bach melodies. We assessed the relative contributions of acoustic versus melodic components of the music to the neural signal. Melodic features included information on pitch progressions and their tempo, which were extracted from a predictive model of musical structure based on Markov chains. We related the music to brain activity with temporal response functions demonstrating, for the first time, distinct cortical encoding of pitch and note-onset expectations during naturalistic music listening. This encoding was most pronounced at response latencies up to 350 ms, and in both planum temporale and Heschl’s gyrus.
... Theoretically, this is often conceptualized as learning the statistical regularities of the sensory environment (Romberg and Saffran 2010;Erickson and Thiessen 2015;Bretan et al. 2017; Skerritt-Davis and Elhilali 2018) so as to predict upcoming events, in a process referred to as "statistical learning". Supporting evidence is that failed predictions due to deviations in the sensory sequence produce measurable brain activations that have been associated with the detection and strength of these irregularities, i.e. prediction error (Vuust et al. 2012;Clark 2013;Moldwin et al. 2017;Omigie et al. 2019;Quiroga-Martinez et al. 2019), and with learning (Storkel and Rogers 2000;Attaheri et al. 2015;Qi et al. 2017). ...
Preprint
Full-text available
Humans engagement in music rests on underlying elements such as the listeners' cultural background and general interest in music, all shaping the way music is processed in the brain and perceived. Crucially, these factors modulate how listeners anticipate musical events, a process inducing instantaneous neural responses as the music confronts these expectations. Measuring such neural correlates would represent a direct window into high-level brain processing of music. Here we recorded electroencephalographic and electrocorticographic brain responses as participants listened to Bach melodies. We assessed the relative contributions of the acoustic versus melodic components of the music to the neural signal. Acoustic features included envelope and its derivative. Melodic features included information on melodic progressions (pitch) and their tempo (onsets), which were extracted from a Markov model predicting the next note based on a corpus of Western music and the preceding proximal musical context. We related the music to brain activity with a linear temporal response function, and demonstrated that cortical responses to music encode melodic expectations. Specifically, individual-subject neural signals were better predicted by a combination of acoustic and melodic expectation features than by either alone. This effect was most pronounced at response latencies up to 350ms, and in both planum temporale and Heschl's gyrus. Finally, expectations of pitch and onset-time of musical notes exerted independent cortical effects, and such influences were modulated by the listeners' musical expertise. Overall, this study demonstrates how the interplay of experimental and theoretical approaches can yield novel insights into the cortical encoding of melodic expectations.
Preprint
Full-text available
Sudden and surprising sensory events trigger neural processes that swiftly adjust behavior. To study the phylogenesis and the mechanism of this phenomenon, we trained two rhesus monkeys to keep a cursor inside a visual target by exerting force on an isometric joystick. We examined the effect of surprising auditory stimuli on exerted force, scalp electroencephalographic (EEG) activity, and local field potentials (LFP) recorded from the dorso-lateral prefrontal cortex. Auditory stimuli elicited (1) a biphasic modulation of isometric force: a transient decrease followed by a corrective tonic increase, and (2) EEG and LFP deflections dominated by two large negative-positive waves (N70 and P130). The EEG potential was maximal at the scalp vertex, in all respects similar to the human "vertex potential". Electrocortical potentials and force were tightly coupled: the P130 amplitude predicted the magnitude of the corrective force increase, particularly in the EEG electrodes contralateral to the limb exerting force, and in the LFP recorded from deep rather than superficial cortical layers, suggesting a direct effect of the vertex potential on the motor output determining the behavior. These results disclose a phylogenetically-preserved cortico-motor mechanism supporting adaptive behavior in response to salient sensory events.
Article
Mismatch negativity (MMN) has long been considered to be one of the deviance-detecting neural characteristics. Animal models exhibit similar neural activities, called MMN-like responses; however, there has been considerable debate on whether MMN-like responses are homologous to MMN in humans. Herein, we reviewed several studies that compared the electrophysiological, pharmacological, and functional properties of MMN-like responses and adaptation-exhibiting middle-latency responses (MLRs) in animals with those in humans. Accumulating evidence suggests that there are clear differences between MMN-like responses and MLRs, in particular that MMN-like responses can be distinguished from mere effects of adaptation, i.e., stimulus-specific adaptation. Finally, we discuss a new direction for research on MMN-like responses by introducing our recent work, which demonstrated that MMN-like responses represent empirical salience of deviant stimuli, suggesting a new functional role of MMN beyond simple deviance detection.
Article
Despite a growing body of research devoted to the study of how humans encode environmental patterns, there is still no clear consensus about the nature of the neurocognitive mechanisms underpinning statistical learning nor what factors constrain or promote its emergence across individuals, species, and learning situations. Based on a review of research examining the roles of input modality and domain, input structure and complexity, attention, neuroanatomical bases, ontogeny, and phylogeny, ten core principles are proposed. Specifically, there exist two sets of neurocognitive mechanisms underlying statistical learning. First, a "suite" of associative-based, automatic, modality-specific learning mechanisms are mediated by the general principle of cortical plasticity, which results in improved processing and perceptual facilitation of encountered stimuli. Second, an attention-dependent system, mediated by the prefrontal cortex and related attentional and working memory networks, can modulate or gate learning and is necessary in order to learn nonadjacent dependencies and to integrate global patterns across time. This theoretical framework helps clarify conflicting research findings and provides the basis for future empirical and theoretical endeavors.
Article
Full-text available
Can monkeys learn simple auditory sequences and detect when a new sequence deviates from the stored pattern? Here we tested the predictive-coding hypothesis, which postulates that cortical areas encode internal models of sensory sequences at multiple hierarchical levels, and use these predictive models to detect deviant stimuli. In humans, hierarchical predictive coding has been supported by studies of auditory sequence processing, but it is unclear whether internal hierarchical models of auditory sequences are also available to nonhuman animals. Using fMRI, we evaluated the encoding of auditory regularities in awake monkeys listening to first- and second-order sequence violations. We observed distinct fMRI responses to first-order violations in auditory cortex and to second-order violations in a frontoparietal network, a distinction only demonstrated in conscious humans so far. The results indicate that the capacity to represent and predict the structure of auditory sequences is shared by humans and nonhuman primates.
Article
Full-text available
Artificial grammars (AG) are designed to emulate aspects of the structure of language, and AG learning (AGL) paradigms can be used to study the extent of nonhuman animals' structure-learning capabilities. However, different AG structures have been used with nonhuman animals and are difficult to compare across studies and species. We developed a simple quantitative parameter space, which we used to summarize previous nonhuman animal AGL results. This was used to highlight an under-studied AG with a forward-branching structure, designed to model certain aspects of the nondeterministic nature of word transitions in natural language and animal song. We tested whether two monkey species could learn aspects of this auditory AG. After habituating the monkeys to the AG, analysis of video recordings showed that common marmosets (New World monkeys) differentiated between well formed, correct testing sequences and those violating the AG structure based primarily on simple learning strategies. By comparison, Rhesus macaques (Old World monkeys) showed evidence for deeper levels of AGL. A novel eye-tracking approach confirmed this result in the macaques and demonstrated evidence for more complex AGL. This study provides evidence for a previously unknown level of AGL complexity in Old World monkeys that seems less evident in New World monkeys, which are more distant evolutionary relatives to humans. The findings allow for the development of both marmosets and macaques as neurobiological model systems to study different aspects of AGL at the neuronal level.
Article
Full-text available
The human brain produces a characteristic electrical response to relevant events that occur unexpectedly. Recent reports have suggested that a prominent part of this event-related brain potential—the P3 wave—may be related to memory functions and may arise from activity within the medial temporal lobe, especially the hippocampus. The latter idea was tested by means of epidural recordings of brain waves in monkeys. Responses to deviant auditory stimuli bore a close resemblance to P3 waves recorded from human subjects under comparable conditions. Monkeys with bilateral lesions of the medial temporal lobe still produced P3-like brain waves, which indicates that medial temporal brain structures are not critical for their generation.
Article
Full-text available
The mismatch negativity (MMN) is a preattentive component of the auditory event-related potential that is elicited by a change in a repetitive acoustic pattern. While MMN has been extensively used in human electrophysiological studies of auditory processing, the neural mechanisms and brain regions underlying its generation remain unclear. We investigate possible homologs of the MMN in macaque primary auditory cortex (A1) using a frequency oddball paradigm in which rare "deviant" tones are randomly interspersed among frequent "standard" tones. Standards and deviants had frequencies equal to the best frequency (BF) of the recorded neural population or to a frequency that evoked a response half the amplitude of the BF response. Early and later field potentials, current source density components, multiunit activity, and induced high-gamma band responses were larger when elicited by deviants than by standards of the same frequency. Laminar analysis indicated that differences between deviant and standard responses were more prominent in later activity, thus suggesting cortical amplification of initial responses driven by thalamocortical inputs. However, unlike the human MMN, larger deviant responses were characterized by the enhancement of "obligatory" responses rather than the introduction of new components. Furthermore, a control condition wherein deviants were interspersed among many tones of variable frequency replicated the larger responses to deviants under the oddball condition. Results suggest that differential responses under the oddball condition in macaque A1 reflect stimulus-specific adaptation rather than deviance detection per se. We conclude that neural mechanisms of deviance detection likely reside in cortical areas outside of A1.
Article
A recent study by Fitch and Hauser reported that finite-state grammars can be learned by non-human primates, whereas phrase-structure grammars cannot. Humans, by contrast, learn both grammars easily. This species difference is taken as the critical juncture in the evolution of the human language faculty. Given the far-reaching relevance of this conclusion, the question arises as to whether the distinction between these two types of grammars finds its reflection in different neural systems within the human brain.
Article
A fundamental task of language acquisition is to extract abstract algebraic rules. Three experiments show that 7-month-old infants attend longer to sentences with unfamiliar structures than to sentences with familiar structures. The design of the artificial language task used in these experiments ensured that this discrimination could not be performed by counting, by a system that is sensitive only to transitional probabilities, or by a popular class of simple neural network models. Instead, these results suggest that infants can represent, extract, and generalize abstract algebraic rules.
Conference Paper
According to a controversial hypothesis, a characteristic unique to human language is recursion (Hauser, Chomsky and Fitch, 2002). Contradicting this hypothesis, it has been claimed that the starling, one of the two animal species tested for this ability to date, is able to distinguish between acoustic stimuli based on the presence or absence of an abstract, center-embedded recursive structure i.e. they did distinguish between song fragments (A, B, etc) structured as AABB (recursive) and ABAB (non-recursive) (Gentner et al, 2006). In our experiment (van Heijningen et al, 2009) we show that another songbird species, the zebra finch, can also discriminate between artificial song stimuli with these structures. Zebra finches are able to generalize this to new songs constructed using novel elements belonging to the same categories, similar to starlings, i.e. new A and B type exemplars. However, to demonstrate that this is based on the ability to detect the putative recursive structure it is critical to test whether the birds can also distinguish songs with the same structure consisting of elements belonging to novel, unfamiliar categories, in this case C's and D's. We performed this test and show that seven out of eight zebra finches failed it. This suggests that the acquired discrimination was based on phonetic rather than syntactic generalization. The eighth bird, however, must have used more abstract, structural, cues. Nevertheless, further probe testing showed that the results of this bird, as well as those of others, could be explained by simpler rules than recursive ones. The eight bird for instance, used 'recency xx', meaning that he seemed to respond to structures ending with a repeated element and so made the distinction between AABB and ABAB instead of using all elements. Although our study casts doubts on whether the rules used by starlings and zebra finches really provide evidence for the ability to detect recursion as present in 'context-free' syntax, it does provide clear evidence for abstract learning of vocal structure in a songbird. Note from Publisher: This article contains the abstract and references.
Article
There is growing evidence that impaired sensory-processing significantly contributes to the cognitive deficits found in schizophrenia. For example, the mismatch negativity (MMN) and P3a event-related potentials (ERPs), neurophysiological indices of sensory and cognitive function, are reduced in schizophrenia patients and may be used as biomarkers of the disease. In agreement with glutamatergic theories of schizophrenia, NMDA antagonists, such as ketamine, elicit many symptoms of schizophrenia when administered to normal subjects, including reductions in the MMN and the P3a. We sought to develop a nonhuman primate (NHP) model of schizophrenia based on NMDA-receptor blockade using subanesthetic administration of ketamine. This provided neurophysiological measures of sensory and cognitive function that were directly comparable to those recorded from humans. We first developed methods that allowed recording of ERPs from humans and rhesus macaques and found homologous MMN and P3a ERPs during an auditory oddball paradigm. We then investigated the effect of ketamine on these ERPs in macaques. As found in humans with schizophrenia, as well as in normal subjects given ketamine, we observed a significant decrease in amplitude of both ERPs. Our findings suggest the potential of a pharmacologically induced model of schizophrenia in NHPs that can pave the way for EEG-guided investigations into cellular mechanisms and therapies. Furthermore, given the established link between these ERPs, the glutamatergic system, and deficits in other neuropsychiatric disorders, our model can be used to investigate a wide range of pathologies.