- Access to this full-text is provided by Springer Nature.
- Learn more
Download available
Content available from Scientific Reports
This content is subject to copyright. Terms and conditions apply.
1
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports
Cellists’ sound quality is shaped
by their primary postural behavior
Jocelyn Rozé*, Mitsuko Aramaki, Richard Kronland-Martinet & Sølvi Ystad
During the last 20 years, the role of musicians’ body movements has emerged as a central question
in instrument practice: Why do musicians make so many postural movements, for instance, with
their torsos and heads, while playing musical instruments? The musical signicance of such ancillary
gestures is still an enigma and therefore remains a major pedagogical challenge, since one does
not know if these movements should be considered essential embodied skills that improve musical
expressivity. Although previous studies established clear connections between musicians’ body
movements and musical structures (particularly for clarinet, piano or violin performances), no
evidence of direct relationships between body movements and the quality of the produced timbre
has ever been found. In this study, focusing on the area of bowed-string instruments, we address the
problem by showing that cellists use a set of primary postural directions to develop uid kinematic
bow features (velocity, acceleration) that prevent the production of poor quality (i.e., harsh, shrill,
whistling) sounds. By comparing the body-related angles between normal and posturally constrained
playing situations, our results reveal that the chest rotation and vertical inclination made by cellists
act as coordinative support for the kinematics of the bowing gesture. These ndings support the
experimental works of Alexander, especially those that showed the role of head movements with
respect to the upper torso (the so-called primary control) in ensuring the smooth transmission of ne
motor control in musicians all the way to the produced sound. More generally, our research highlights
the importance of focusing on this fundamental postural sense to improve the quality of human
activities across dierent domains (music, dance, sports, rehabilitation, working positions, etc.).
Playing a musical instrument is an activity that involves complex auditory-motor interactions. Whether creating
a short sound or developing a whole phrase, musicians must continuously establish a clear relationship between
the actions aorded by their instrument and the auditory feedback resulting from their actions1–3. Research in
neuroscience has demonstrated that such an active process intricately interweaves the auditory and motor regions
of the brain as a neural substrate of cognitive representation4,5. In the case of the cello, for example, longitudi-
nal studies conducted with non-musician participants and an MRI-compatible (Magnetic Resonance Imaging)
instrument revealed that “brain plasticity” emerged as an integrative function of the neural network in auditory-
motor information processing6. Both musical actions and percepts would thus depend on a single underlying
mental representation governing both auditory encoding and motor control along the same goal-directed action.
From these perspectives of embodied music cognition, we should consider the musical expressivity produced
by instrumentalists as a link between sonic and corporeal movements and analyze their musical intentionality
through the prism of a repertoire of learned gestural primitives7,8. Research in human biomechanics has high-
lighted that such a repertoire is composed of synergies, i.e., muscular cooperation patterns aiming to attain a
given action9. A strong consequence of the synergetic mechanisms is that each voluntary action, such as moving
a bow on a string, should be accompanied by anticipatory postural adjustments called APAs10–12. Anticipation
is crucial in musical practice because of the coupling between coordination and postural balance, which implies
that the fulllment of a single goal-directed action may be encoded beforehand as a selective activation of the
musicians’ joint degrees of freedom (DOFs)13–15. In dance practice, conversely, the mirror neuron system may
decode the perceived expressiveness into ne movement structures through the same kind of grounded synergetic
processes16–18. In the domain of rehabilitation, rhythmic auditory stimuli were ecient in reducing movement
disorders and improving walking abilities in Parkinson’s disease and stroke patients19–23.
Due to the weight of teaching habits, ignorance or misunderstandings, the role of embodiment among musi-
cians has been largely underestimated, despite evidence of its importance for the development of prociency
OPEN
*email: roze@prism.cnrs.fr
Content courtesy of Springer Nature, terms of use apply. Rights reserved
2
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
in many domains24. is underestimation is a recurrent problem in higher music education institutions that
traditionally encourage the rapid acquisition of technical skills without suciently considering the develop-
ment of musicians’ postural relations with their instruments25. Such pedagogical methods have always been
the subject of heated debates and remain controversial today because of the high rates of dropouts due to psy-
chological frustrations and musculoskeletal disorders among musicians26. Many students actually need to stop
this end-gaining process and adopt alternative methods drawn from experimental psychology27,28, particularly
the Alexander technique, which states that a well-directed primary postural control, i.e., a dynamic orientation
of the head, neck, and upper back, has many benets for coordination and musical expressivity29. Although
very ecient in practice, this assumption has never been scientically examined due to the diculty of making
accurate measurements of a musician’s primary postural control and of assessing its acoustical inuence in an
undisturbed way. In the area of bowed-string instruments, pioneer musical research analyzed sound features
with bowing machines by focusing on physical control variables such as bow force and bow velocity but without
considering the musician’s body30–33. Other studies assessed the instrumentalists’ auditory-motor mappings by
means of motion and sound synthesis techniques with an electric violin34–36. More recently, psycholinguistic
studies explored violinists’ cognitive processes by correlating perceptual adjectives of violin sounds (round, harsh,
light, mellow, dark, etc.) to physical features of the acoustic signal and haptic feedback of the instrument37–39.
Over the past two decades, we thus observed an increasing interest among the scientic community in better
understanding the signicance of musicians’ corporeal movements related to their expressive sound features. e
results revealed the importance of such “ancillary” gestures in supporting or accompanying the instrumentalists’
“eective gestures” that are directly responsible for sound production40–46. In particular, investigations of clarinet-
ists’ movements have shown that their sense of musical phrasing may be aected during ancillary impairment,
i.e., when asked to move as little as possible while keeping their natural expressive intention or when the bell
of their instrument was immobilized47. Such disembodied experimental conditions enable us to infer stable and
reproducible patterns between musicians’ nonobvious movements and their audible components.
In this study, we examined the key inuence of musicians’ primary postural directions on their sound quality.
is study is based on an experimental protocol48 that enabled us to compare the auditory-motor interactions of
highly skilled cellists between two postural conditions: a natural condition and a posturally constrained condition
in which the chest and the head were blocked by a safety race harness and a neck collar, respectively (cf “Meth-
ods” section). In the context of postural immobilization, the cellists’ timbre quality was consistently degraded
on some key notes of the more demanding passages (cf Fig.1). We supposed that this loss of expressiveness may
correspond to specic deciencies in the motor coordination of the right arm and impact the uency, i.e., the level
of precision, of the kinematic variations of the bow velocity. is assumption was inferred from the specialized
literature on cellists’ physiology: the term bow “speed” can be used to describe the degree of motor coordination
between the cellist’s body segments49; bow/string adherence, which shapes the timbre of the sound, would be
more related to bow displacement than to bow pressure because no sound can be produced by only pressing the
bow on a string without any movement50. We also built our experimental design on the assumptions provided by
motor theories of perception51–53, that predict complementary relationships between nonverbal “gesticulations”
in the case of speech and ancillary gestures in the case of music54,55. A psycholinguistic protocol actually revealed
that inhibitions of nonverbal gestures caused speech to become much more laborious and tense, altering both
intonation and expressiveness of the message56. is kind of connection was hypothesized in the music area
through the existence of sonic-gestural objects, i.e., mental constructs in which auditory and motion elements
co-occur both in the minds of the performer and the listener57. Such motor imagery of the musical experience
would contain dyadic properties likely to activate linkages between the structure of the written score and esthetic
Figure1. e musical passage and note investigated for this study. Spectrograms correspond to examples of the
acoustic signal of an E4 note (the rst one of this score sequence) played by the same cellist with good timbre
quality (round) in the normal situation [N] and poor timbre quality (harsh) in the posturally-constrained
situation [SCH] (Static Chest and Head).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
3
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
concepts of the perceived sound58,59. According to this model, features that characterize the produced sounds
may reveal the morphology of moving sonic shapes related to the kinematic displacements of the cellists.
Here, we chose to analyze cello sounds, commonly judged as poor or “harsh” in classical music, in terms of
incorrect moving sonic forms60. In practice, this means that the acoustic signal variations analyzed within a harsh
cello note may be expected to correlate with unsuitable bow velocity patterns, potentially induced from erroneous
chest or head directions. Such sonic movements can be highlighted by crossing advanced methodological aspects
of functional anatomy and acoustic processing (cf “Methods” section). Actually, movement scientists consider
movement coordination the result of an organized motor activity, which can be divided into several elementary
actions, also called functional units61. Similarly, psychoacousticians represent instrumental timbre within a per-
ceptual space of several dimensions that are oen related to temporal and spectral sound facets62,63. As cellists
continuously modulate their gestures while playing, we may thus suppose that they use specic functional motion
units to shape particular features of their sound production. is assumption guided us to design a statistical
framework and to perform functional comparisons of the cellists’ kinematic and acoustic features between the
normal and constrained conditions (cf Fig.2b). e conception of this approach was inspired by research in the
medical and biological engineering elds that provides ecient methods for comparing human motion patterns
over time and for quantitatively emphasizing pathological deviations from a reference control group64–67. e
results of those studies demonstrate that functional data analysis (FDA)68 and especially functional principal
component analysis (FPCA)69,70 have better discriminatory power than the classical PCA multivariate approach71.
FPCA is an emerging modern technique that extracts the principal modes (PCs) of a set of continuous waveforms
and quanties their dierences across subjects as temporal deviations from the mean curve72. e technique has
proven valuable for modeling simple motor behaviors73–75 or biomechanics of complex sport movements76,77,
and in analyzing coarticulation patterns of musicians78–81 or spontaneous movement responses to music54,82.
In this study, we carried out functional PCA to determine the dominant components of the cellists’ audio-
motor functional units and to assess their degradation on both the motion and the acoustic sides. e cellists’
bow velocity variations were dened as the main goal-directed actions, and the functional units set up to reach
this goal were dened as the linear combinations of joint-related angular time series (cf Table1). e acoustic
Figure2. (a) Kinematic model of the cellists’ trunk and right arm bowing presented at rest (frontal view). is
inertial system is composed of six key joints modeled as three single axes rotational joints in the Cardan/Euler
angle representation {roll (
ψn
), pitch (
θn
), yaw (
φn
)} where
n∈[1...6]
is the key joint number. (b) Statistical
framework illustrated for a given anatomic variable of the kinematic model. is framework is based on
functional principal component analyses (cf “Methods” section) and extracts two principal modes of variation
of the cellists’ behavior, which are referred to as major mode and minor mode in the text. e eects of each
mode are highlighted as functional deviations of the average time series between the normal (curves of blue
circles) and the constrained situation (curves of red crosses).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
4
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
variations were modeled by means of the descriptors highlighted in our previous work48 for characterizing the
perceived harsh phenomenon (cf Table2).
Table 1. Anatomic variables described as joint-related Euler angles {
ψ,θ,φ
} of the segmental kinematics. e
sign of each angle depends on its rotational direction that can be established from the resting kinematic model
(cf Fig.1a) by following the right-hand rule.
Euler angle Relation to segmental kinematics
Postural angles
root (1)
ψ1
Abdomen torsion To the le [
0◦
...
+90◦
]
To the right [
0◦
...
−90◦
]
θ1
Abdomen vertical inclination Forward [
0◦
...
−90◦
]
Backward [
0◦
...
+90◦
]
φ1
Abdomen lateral swing To the le [
0◦
...
−90◦
]
To the right [
0◦
...
+90◦
]
midtorso (2)
ψ2
Chest torsion To the le [
0◦
...
+90◦
]
To the right [
0◦
...
−90◦
]
θ2
Chest vertical inclination Forward [
0◦
...
−90◦
]
Backward [
0◦
...
+90◦
]
φ2
Chest lateral swing To the le [
0◦
...
−90◦
]
To the right [
0◦
...
+90◦
]
neck (3)
ψ3
Head torsion To the le [
0◦
...
+90◦
]
To the right [
0◦
...
−90◦
]
θ3
Head vertical inclination Forward [
0◦
...
−90◦
]
Backward [
0◦
...
+90◦
]
φ3
Head lateral swing To the le [
0◦
...
−90◦
]
To the right [
0◦
...
+90◦
]
ψ12 =ψ1+ψ2
Torso rotation To the le [
0◦
...
+90◦
]
To the right [
0◦
...
−90◦
]
Instrumental angles
rshoulder (4)
ψ4
Upper arm rotation External [
0◦
...
+90◦
]
Internal [
0◦
...
−90◦
]
θ4
Upper arm abduction Abduction [
0◦
...
+90◦
]
Adduction [
0◦
...
−90◦
]
φ4
Upper arm anteversion Antepulsion [
0◦
...
+90◦
]
Retropulsion [
0◦
...
−90◦
]
relbow (5)
ψ5
Forearm rotation Supination [
0◦
...
+90◦
]
Pronation [
0◦
...
−90◦
]
φ5
Forearm extension Full exion [
0◦
]
Full extension [
+180◦
]
rwrist (6)
ψ6
Hand rotation Supination [+]
Pronation [−]
θ6
Hand abduction Ulnar abduction [
0◦
...
+90◦
]
Radial abduction [
0◦
...
−90◦
]
φ6
Hand exion Palmar exion [
0◦
...
+90◦
]
Dorsal extension [
0◦
...
−90◦
]
ψ
56
=ψ
5
+ψ6
Forearm rotation Supination [
0◦
...
+90◦
]
Pronation [
0◦
...
−90◦
]
Content courtesy of Springer Nature, terms of use apply. Rights reserved
5
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
Results
By applying the steps of our analysis framework, which are thoroughly described in “Methods” section, we could
infer two main functional auditory-motor linkages responsible for the perceived quality of cello sounds. In this
paper, these two principal modes of variation are referred to as the major mode and minor mode. Each func-
tional mode can be considered the coupling between an eigenposture65 and an eigensonicform88: an eigenposture
describes a specic aggregate of postural and instrumental joint motions, and an eigensonicform describes a
specic interaction of bow kinematics and acoustic features. FPCA analyses (cf Eq.3) revealed that the major
and minor eigenpostures captured approximately 95% of the total data variance, i.e., 70% for FPC1 and 25%
for FPC2. Similarly, the major and minor eigensonicforms captured approximately 75% of the total data vari-
ance aer smoothing, i.e., 60% for FPC1 and 15% for FPC2. Such percentages of the largest explained variance
were sucient to reveal the two most prominent timbre features and establish correlations with the kinematic
behavior variations. Here, we present this eigenfunction structure with two gures describing the major mode
(Fig.3) and the minor mode (Fig.4). For the sake of clarity, these gures only highlight the functional variables
that presented signicantly dierent behaviors between the normal and constrained situations.
Major mode of variations. As observed in Fig.3, the rst (or major) functional unit corresponds to global
amplitude variations at all the dierent stages of the sound-gesture chain. is was particularly salient at the
physical stage, which reects the “eective” sound-producing gesture (cf Fig.3c), where the bow velocity globally
decreased in the constrained condition (Bowvel:
t(7)=2.07
).
At the postural stage of the trunk motor chain (cf Fig.3a), which reects the ancillary gestures, this bowing
alteration eect appeared to be associated with marked amplitude reductions of the natural chest torsion (
ψ12
:
t(7)=8.37∗∗∗
) and head torsion (
ψ3
:
t(7)=−3.10∗
). e analyses of the normal condition in the graph actually
revealed surprising symmetrical evolutions towards zero for these two movements, with the chest torsion moving
from the le and the head torsion from the right, while these tendencies were lost in the constrained condition.
In accordance with Mantel49, we suggest that such a grounded tendency characterizes the need for a strong
helicoidal energy transfer along the spine during the bow pulling movements to ensure optimal bow velocity
amplitudes. e constrained condition also clearly aected the other degrees of freedom of the head, i.e., head
elevation (
θ3
:
t(7)=−3.42∗
) and head lateral swing (
φ3
:
t(7)=2.38∗
), for which the amplitude variations were
considerably smaller than their natural counterparts. Interestingly, these two analyses of the head under natural
conditions in the graph revealed that the bouncing trend during the bow pulling movement, up-and-down and
right-and-le was absorbed by the constraint.
At the instrumental stage (cf Fig.3b), which reects the interaction between eective and ancillary gestures,
the major eect of postural impairments resulted in consistent amplitude alterations of the shoulder articulation,
i.e., a loss of upper arm abduction (
θ4
:
t(7)=4.40∗∗
) and external rotation (
ψ4
:
t(7)=3.40∗
). is insucient
upper arm external rotation also appeared to be symmetrically coupled to a loss of forearm pronation (
ψ56
:
t(7)=−2.32
). us, in the constrained condition, the major mode reects a systematic locking position of the
whole right arm through unsuitably combined tendencies of upper arm internal rotations and forearm supina-
tions that aected the bow velocity.
e results of multivariate regression on the major FPC scores of these anatomical angles was signicant
(
R2=0.90∗∗
,
R2
adjusted
=0.77
∗∗
, cf regression graph of Fig.3e). It was therefore possible to infer a linear rela-
tionship predicting the global bow velocity amplitudes based on the set of anatomic angles selected by the rst
functional unit. More importantly, an additional stepwise regression extracted a combination of two angular
degrees of freedom that explained the global variations of the bow velocity:
is simple predictive relation highlights a major mechanism of the cellist’s coordination, in which the coupling
between the chest torsion (ancillary gesture) and the external rotation of the right arm (instrumental gesture)
guaranteed suitable bow velocity amplitudes. More details on this major coordination mode (or eigenposture)
could be obtained by computing correlations between the FPC scores. Interestingly, these results revealed that
chest torsion was the coordinative support for bow velocity amplitudes (
rBowvel
ψ12
=0.55
∗
). Further cross-correla-
tions of the major angle scores revealed a chain of three coupling systems, which characterizes the coordination
transfer within the major mode: (1) the system {
ψ12|ψ3|θ3
} showed the abovementioned symmetry of the chest/
head torsions (
rψ
3
ψ12
=−0.61
∗
); (2) the system {
ψ3|θ3|φ3|ψ4
} showed the importance of all the degrees of free-
dom of the head, especially of the head torsion, for activating the external rotation of the arm (
rψ
4
ψ3
=−0.71
∗∗
);
and (3) the system {
θ3|θ4
} showed that up-and-down head bouncing contributed to the amplitude of shoulder
(1)
Bowvel =0.75 ×ψ2−0.52 ×ψ4
Table 2. Acoustic descriptors used in the study and their correlation to the perceived harshness phenomenon.
Name Description Correlation to harshness
HSV Harmonic Spectral Variation83 Increase of harmonic asynchrony
ATS Attack Time Slope84 Slower attack slope of the temporal envelope
MFCCratio Ratio between MFCC coecients c2 and c185 Emergence of formantic area
SC Harmonic Spectral Centroid86 Increase of spectral centroid
TRIratio Ratio between tristimulus tr3 and tr1 + tr287 Spectral energy transfer towards high-frequency components
Content courtesy of Springer Nature, terms of use apply. Rights reserved
6
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
abduction (
rθ
4
θ3
=−0.53
∗
). No signicant cross-correlations were obtained with the angle of prono-supination
(
ψ56
), which conrms that global bow velocity amplitudes were not controlled by the forearm but by the upper
arm at the shoulder level through the helicoidal work of the trunk.
From the acoustical point of view (cf Fig.3d), the major mode revealed that three of the ve sound signal
descriptors characterized the time-dependent perceptual dierences between round and harsh cello sounds in
terms of global amplitude variations. e graph analyses between normal and constrained situations revealed
energy decreases within the temporal envelope (Rms:
t(7)=3.04∗
), energy increases on the upper partials of the
spectral envelope (Triratio:
t(7)=−3.53∗∗
), and more harmonic asynchrony, especially during the birth phase
of the sound (Hsv:
t(7)=−2.08
). More details about this major acoustic mode (or eigensonicform) could be
obtained by computing correlations between the FPC scores. Surprisingly, these results revealed that the temporal
energy level was the main descriptor impacted by global changes in bow velocity (
rBowvel
Rms
=0.52
∗
). More trivially,
the cross-correlations of major acoustic scores revealed a strong collinearity between the amounts of harmonic
asynchronicity and high-frequency spectral energy (
rTriratio
Hsv
=0.75
∗∗∗
). No signicant cross-correlations were
Figure3. Major mode of the cellists’ functional variations. is mode explained 70% of the variance contained
in the kinematic data—(a) postural, (b) instrumental, (c) physical—and 60% of the variance contained in the
(d) acoustical data. At each stage of this functional unit, the eect of the major mode is visualized as functional
deviations of the average time series between the normal situation (curves of blue circles) and the constrained
situation (curves of red crosses). e attached boxplots present the distribution of FPC1 scores, i.e. the way
each individual curve contributed to the major mode, for each variable that signicantly discriminated the
postural conditions. Normal and constrained functional components were added or subtracted to or from the
mean curve, according to the mean sign of the FPC1 scores in each postural condition. e bottom right panel
(e) shows the graph obtained by linear regression of the major scores (FPC1) of the bow velocity with respect
to those of anatomic angles, which were signicantly dierent between the postural conditions (
R2=0.90∗∗
,
R2
adjusted
=0.77
∗∗
).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
7
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
obtained with the amount of temporal energy (Rms). ese results suggest that the major functional coordina-
tion unit essentially captured the temporal variations of the sound shape responsible for harshness perception,
independent of its purely spectral aspects.
Minor mode of variations. As observed in Fig.4, the second (or minor) functional unit corresponds to
local variations of data amplitudes at the dierent stages of the sound-gesture chain. At the physical stage, which
reects the “eective” sound-producing gesture (cf Fig.4c), the bow velocity decreased faster in the constrained
condition than in the normal postural condition (Bowvel:
t(7)=4.37∗∗
).
At the postural stage (cf Fig.4a), which reects the ancillary gestures, this bowing deceleration appeared to be
associated with a loss of natural bouncing between the chest torsion (
ψ12
:
t(7)=8.80∗∗∗
) and the head torsion
(
ψ3
:
t(7)=−2.35
). e analyses of the normal condition in the graph actually revealed surprising symmetrical
delays, chest torsion bouncing to the le and head torsion to the right, while these tendencies were lost in the
constrained condition. In accordance with Hoppenot25, we suggest that such a grounded tendency characterized
Figure4. Minor mode of the cellists’ functional variations. is mode explained 25% of the variance contained
in the kinematic data—(a) postural, (b) instrumental, (c) physical—and 15% of the variance contained in the
(d) acoustic data. At each stage of this functional unit, the eect of the minor mode is visualized as functional
deviations of the average time series between the normal situation (curves of blue circles) and the constrained
situation (curves of red crosses). e attached boxplots present the distribution of FPC2 scores, i.e. the way
each individual curve contributed to the minor mode, for each variable that signicantly discriminated the
postural conditions. Normal and constrained functional components were added or subtracted to or from the
mean curve, according to the mean sign of the FPC2 scores in each postural condition. e bottom right panel
(e) shows the graph obtained by linear regression of the minor scores (FPC2) of the bow velocity with respect
to those of anatomic angles, which were signicantly dierent between the postural conditions (
R2=0.91∗
,
R2
adjusted
=0.73
∗
).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
8
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
the need for a phase of active postural resistance to the bow pulling expansions to ensure optimal bow accel-
erations. is eect could also be observed in the lateral swings of the head (
φ3
:
t(7)=−2.36
) whose natural
right-and-le bouncing disappeared in the constrained condition. Another interesting minor eect concerned
the decrease in amplitude of the naturally vertical down-to-up inclinations of the chest (
θ2
:
t(7)=−3.09∗
) along
the bow-pulling movements.
At the instrumental stage (cf Fig.4b), which reects the interaction between eective and ancillary gestures,
the lack of an active resistance phase to the bow expansion was evidenced by the behavior of shoulder articula-
tion through the loss of upper arm abduction (
θ4
:
t(7)=3.39∗
) during the beginning of the movement. e
dierence in external rotation was also very interesting (
ψ4
:
t(7)=−2.83∗
) because it highlights the role of the
shoulder in providing natural support that ensured the projection of the whole right arm. Actually, the amount
of external rotation remained quite constant along a natural bow-pulling movement, whereas it drastically
decreased in the constrained condition. It could also be observed that this naturally sustained external rotation
guaranteed a reinforcement of the forearm pronation along the movement (
ψ56
:
t(7)=−2.05
), whereas in the
constrained condition, a forearm supination appeared as soon as the upper arm switched in internal rotation.
Importantly, the minor mode of variations also revealed a strong dierence in elbow exion/extension between
the two conditions (
φ5
:
t(7)=3.54∗∗
). In the normal condition, the elbow remained slightly bent during the
phase of active resistance before it considerably stretched out during the phase of bow expansion. By contrast,
in the constrained condition, the elbow increasingly exed and locked the whole arm movement. is elbow-
locking eect was also reected by two losses of mobility at the wrist level: the exion-to-extension progression
(
φ6
:
t(7)=3.48∗
) and the ulnar-to-radial inclination (
θ6
:
t(7)=2.38∗
).
As for the major mode, the results from multivariate regression on the minor FPC scores of these anatomic
angles were signicant (
R2=0.91∗
,
R2
adjusted =
0.73
∗
, cf regression graph of Fig.4e). It was therefore possible to
infer a linear relationship predicting the local bow velocity amplitudes, or bow accelerations, based on the set
of anatomic angles selected by the second functional unit. More importantly, an additional stepwise regression
extracted a combination of two angular degrees of freedom that explained the local variations of bow velocity:
is simple predictive relation highlights a minor mechanism of the cellist’s coordination, in which the coupling
between the vertical inclination of the chest (ancillary gesture) and the extension of the right wrist (instrumen-
tal gesture) ensured suitable bow accelerations. More details concerning this minor coordination mode (or
eigenposture) could be obtained by computing correlations between the FPC scores. Interestingly, the results
conrmed the importance of the vertical inclination of the chest (
rBowvel
θ2
=−0.58
∗
) and of the extension of
the wrist (
rBowvel
φ6
=0.73
∗∗
) during bow accelerations. e scores of elbow extension were also marginally cor-
related to those of the bow accelerations (
rBowvel
φ5
=
0.47
,
p=0.063
). Further cross-correlations of minor angle
scores revealed a chain of four coupling systems, which characterized the coordination transfer within the
minor mode: (1) system {
θ2|ψ12|ψ3|φ3
} showed the postural coupling among the chest torsion and vertical
inclination (
rψ
12
θ2
=−0.51
∗
), the bouncing symmetry of chest/head torsions (
rψ
3
ψ12
=−0.56
∗
), and the strong
dependence between head torsions and lateral swings (
rφ
3
ψ3
=0.90
∗∗∗
); (2) system {
ψ3|φ3|θ4|ψ4|ψ56
} showed the
importance of the degrees of freedom of the head, especially of the head torsion, to activate the external rotation
of the arm (
rψ
4
ψ3
=−0.71
∗∗
) and that of the coupling between this external rotation and the forearm pronation
(
rψ
56
ψ4
=0.52
∗
); (3) system {
ψ12|ψ3|φ3|θ6
} showed the indirect inuence of many postural angles, especially
the angles linked to head torsion and lateral swing on the wrist inclination (
rθ
6
ψ3
=−0.64
∗∗
and
rθ
6
φ3
=−0.66
∗∗
respectively); and (4) system {
φ5|φ6
} showed that the wrist extension was conditioned by the elbow extension
(
rφ
6
φ5
=0.71
∗∗
). ese results conrmed the importance of the double phase of postural resistance/expansion
along the movement for ensuring optimal bow pulling accelerations.
From the acoustical point of view (cf Fig.4d), the minor mode revealed that the same acoustic descriptors
as in the major mode with an additional fourth descriptor, the Mfccratio, were signicantly aected by the con-
strained condition. e analyses in the graph revealed an inability to maintain the acoustic signal energy during
the entire movement in the constrained condition. is eect was noticeable both in the temporal domain and in
spectral domains (Rms:
t(7)=2.08
, Triratio:
t(7)=−2.45∗
, respectively). In particular, the Mfccratio revealed
an excessive amount of high-frequency spectral energy at the beginning of the sound that corresponded to the
emergence of a formantic area (Mfccratio:
t(7)=−2.04
). More details concerning the minor acoustic mode (or
eigensonicform) could be obtained by computing correlations between the PC scores. Surprisingly, the results
revealed that the amount of high-frequency spectral energy was the main descriptor impacted by local changes in
bow velocity (
rBowvel
Triratio
=−0.58
∗
). More trivially, the cross-correlations of minor acoustic scores revealed a strong
collinearity between the amounts of spectral energy (
rHsc
Triratio =
0.88
∗∗∗
) and formantic energy (
rMfccratio
Triratio
=0.60
∗
).
No signicant cross-correlations were obtained with the amount of temporal energy (Rms). Complementary to
the major mode, these results suggested that the minor functional coordination unit had essentially captured the
variations in the spectral shape of the sound responsible for harshness perception (independent of its temporal
aspects).
Discussion
In summary, our functional analyses revealed that two primary postural directions are involved in the sound
quality produced by highly skilled cellists: rst, a major mechanism controlling bowing velocity (cf Eq.1) linked
to the evolution of the temporal shape of the sound and, second, a minor mechanism controlling bowing accel-
eration (cf Eq.2) linked to the evolution of the spectral content of the sound. ese results are consistent with
the physics of the instrument and the pioneering acoustic studies based on bowing machines. First, the bow
velocity should be correlated to the amount of transmitted vibrations to the surrounding air by the body of
(2)
Bowvel =0.41 ×θ2+0.64 ×φ6
Content courtesy of Springer Nature, terms of use apply. Rights reserved
9
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
the cello and thus determine the energy level or intensity of the acoustic signal. Actually, harsh sounds cor-
respond to global decreases in bow velocity and weaker temporal proles of acoustic energy (cf major mode of
Fig.3c,d). Second, the bow acceleration should be correlated to the amount of high-frequency energy and thus
determine the quenching rates of upper partials in the spectrum89. Harsh sounds actually correspond to global
bow decelerations and higher quenching rates of spectral energy for upper partials (cf minor mode of Fig.4c,d).
Among the set of acoustic descriptors that characterize perceived harshness, harmonic asynchrony remains only
poorly explained by kinematic bowing analyses. is indicator of spectral uctuations might be inuenced more
strongly by the strict bow/string adherence nely tuned by the bow force parameter90. As a perspective, it may
thus be interesting to reiterate the same kind of functional analyses with dynamic features, i.e., the prediction
of variations in bow force from the muscular eorts estimated for each cellist’s body segment. Nevertheless, the
bow/string adherence quality involved in the perceived sound density depends on the bow velocity50, which was
insucient in this study when the right arm remained locked in a position of excessive supination and internal
rotation.
From our coordination study, such a tighter instrumental bowing gesture would be caused by inadequate
combinations of postural variables, particularly the loss of a symmetric combination between chest and head
torsion movements. e freedom of the head movement was particularly important to balance the chest tor-
sion with the external rotation of the right arm involved in both kinetic functionalities of the bowing (velocity
and acceleration). ese results are consistent with previous studies on cellists’ right arm behaviors, especially
the role of shoulder mobility during musical playing on the A string91,92. Furthermore, our ndings emerged
from large bow pulling gestures on one note, for which the impaired cellists could not compensate as simply as
elsewhere in the score. As the chest and head constraints aected the cellists’ sound quality on other notes to a
lesser extent, the execution of this particular note would stand for a limit in terms of postural adaptation, which
clearly depends on the score structure and not only on the ergonomics of the instrument. By generalizing to the
whole score, we suggest that this salient local eect of recurrent sound degradation highlights a more generic
deciency of cellists’ postural control, also called posturo-kinetic capacity12 in movement science. Even though
its variations may remain subtle, such a capacity would guarantee body stability during any goal-directed action,
such as bowing on one or several notes. Actually, the postural deviations of our highly skilled cellists were no
more than 5 degrees from the mean value in the major mode (cf Fig.3a), but this was enough to globally inu-
ence the quality of their auditory-motor interactions. is postural capacity is also highlighted through a double
phase of postural resistance/mobility to bow expansion in the minor mode (cf Fig.4a), which resulted in spectral
alterations in the sound when the musicians were posturally impaired. e constraints thus revealed the cel-
lists’ primary postural directions by disembodiment8, which supports the idea that the musicians’ structural and
expressive concepts are grounded in their sensorimotor networks.
e correlations established between the cellists’ movements and their sound quality features also provide
knowledge on their theoretical physiological principles49,93. Actually, our results suggest that the cellists’ bow-
ing actions would be more eective if organized in terms of “distal events”94,95, i.e., when their attention is not
centered on the movement itself but more on its potential inuence on the sound quality. Here, we suppose that
the postural impairment considerably disrupted the musicians’ natural sensations, i.e., the external focus of
attention needed to correctly perform an expressive musical task (professional cellists oen talk about “playing
without thinking”). As such, the context of this experiment may be considered a relevant “constrained action
hypothesis”96,97 for reinforcing the concept of supra-postural activity98,99: the quality and eciency of a task
would depend on this supra-postural control, i.e., the way individual body movements are subsumed into a
unied Gestalt for achieving the given goal. Interestingly, two of the seven cellists in our experiment stated that
they became more aware of their belly respiration insituations of postural impairment. In our opinion, these
remarks indicate that before being impaired, both respiratory and postural control were naturally piloted by an
external focus, i.e., by supra-postural commands of their attention. e constraint forced the cellists to adopt an
internal focus and to compensate by more conscious control of their movements. We hereby consider that these
scientic deductions give strong support to the concept of primary postural control, which was postulated as part
of the Alexander technique100, not only in the context of instrumentalists but also for any goal-directed actions
requiring a strong supra-postural activity. By encouraging performers to focus on the results of the actions rather
than on the actions themselves, the motor system could be trained in a more embodied and self-organized way
for natural and ecient performances.
ese ndings clearly suggest important applications for improving and optimizing practice habits among
musicians. is subject is a hot topic in research areas that assess the risk of musculoskeletal disorders among
musicians and search for strategies to promote health or reduce injury26,101,102. Feedback analyses of students
in higher music education institutions especially revealed the upper limb, upper trunk, and neck as the main
body parts aected by muscle pain syndromes102–104. e population of bowed-string players would also be more
aected by these postural disorders because of the asymmetric arm positions related to the trunk105,106. Such
results are clearly compliant with those of our study and reinforce the importance of integrating musicians’ pri-
mary postural control within individual rehabilitation programs. e magnitude of the cellists’ spinal curvatures
that we highlighted in relation to their sound quality may particularly help in developing strengthening-exibility
exercises targeting the trunk muscles of bowed-string players. As a whole, we think that the constrained condition
of our experiment altered the natural musicians’ action/perception cycle in a way that could be referred to as a
“phenomenological experience on non-sense”107. If cognition is our way of dealing with non-sense experiences,
then the tools established to reeducate the musicians’ proprioceptive feedback should authorize such an experi-
ence on nondoing or nonactivity consciousness, also known as inhibition in the Alexander technique29. We hereby
support the idea that the quality disruptions occurring in a musical discourse nd their origin in a faulty postural
awareness100, and may be solved by rening the musicians’ global perception of somatosensory processing.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
10
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
e ndings presented in this paper may also have a strong impact in other areas related to expert perfor-
mance, especially due to the statistical framework that we established. Sports biomechanics is one example of
a domain where body posture, dynamic somatic practice, and motor control need to remain inherently and
strongly connected to ensure the eciency of a given action66,76,77,108. For example, research on human-material
interfaces demonstrated that tennis players or runners need to nely tune the shock vibrations induced by the
racket or the ground surface109–111. In that context, functional data analyses may provide an opportunity to infer
continuous patterns of adaptation between the eector limb (hand or foot) and the entire body of these athletes.
By extension, such analyses could also highlight a functional interdependence between the sound produced in
reaction to the impact (with a racket/ground surface) and the biomechanical propagation of shock-induced
vibrations. Such examples suggest that our statistical framework may be suitable for analyzing the sound-gesture
relationships in a reverse way, i.e., assessing the role of auditory information on perceptual-motor processes. In
recent years, many studies have highlighted the benets of gestural sonication5,112–115, especially in the domains
of sports performance and motor rehabilitation116,117. For example, sonication eciently reduced the vari-
ability of golf swing gestures in novices118,119, or improved the pedal force eectiveness among cyclists120. e
benecial eects of sonication in reeducating patients with severe gait dysfunctions, such as Parkinson’s disease
patients, by rhythmic auditory cueing21–23,121, or neuromotor decits related to the uency of handwriting, such as
dysgraphia122–126, were also well recognized. In the same way, we suppose that such continuous auditory feedback
may help musicians and dancers improve or recover their body awareness, for example, through experiments of
sound tracing and motor mimicry, which are already known to stimulate covert mental images associated with
musical experience58,81,127,128.
Conclusion
In this paper, we assessed how postural impairments of highly skilled musicians aected their perceived sound
quality. rough functional analyses of cellists’ kinematic and acoustic interactions, it could be demonstrated
that feedforward deciencies of the primary postural command locally altered the quality of their musical
expression. Such ndings suggest that musical teaching should, to a much greater extent, consider the student?s
body as a global exible and proactive structure rather than focusing on specialized cognitive patterns that break
the sensorimotor processes into rigid units. is conclusion is consistent with embodied learning frameworks,
especially the Alexander technique, that correlate optimal body usage to proper directions of the spinal structure
and ne balance mechanisms between the head, neck, and trunk. It should therefore be possible to inuence
expressive perceptual processes and thus shape the musical mind by developing a kinesthetic awareness of the
sensory-motor relationships, i.e., integrating the sensations of joint mobility, muscular stability, and posture as
a whole. If such indirect procedures would contribute to reinforcing musculoskeletal health and the quality of
the performance in the musical domain, they may also be applied in a reverse way for learning dance and sport
skills or for patients in clinical rehabilitation by means of experimental manipulations of auditory feedback.
As a promising perspective of this study, we started to develop a complementary approach for assessing
the eects of harsh timbre degradation on cellists’ motor behavior. By means of our statistical framework of
functional analyses, we expect to close the perceptual loop that links cellists’ timbre quality to their postural
control. e methodological aspects of such a work are based on the use of an electric silent cello and the setup
of a multimodal platform combining a motion capture system and spatial rendering to study sound/gesture
interactions. We think that augmenting the perceptual information, especially through ne sound synthesis
techniques applied to gestural sonication, might provide a suitable means to strengthen the understanding of
the body schema related to cognitive interpretation and physical expression of structures within music or dance
performance. Such an approach has the potential to guide research on the design of skill training or rehabilita-
tion scenarios in the context of real-world applications, and it is particularly well-suited for (but not limited to)
musicians and dancers.
Methods
Participants. Seven highly skilled cellists (males = 4; females = 3; mean age =
40.5 ±11.1
) were recruited
on a voluntary basis from the Music Conservatory and the Opera of Marseille to participate in a 3-h experiment
that, as they were told, consisted of ‘ “exploring cellists’ sound/gesture relationships”. Before the experiment, each
musician signed a consent form that advised them of the precise the nature of the postural conditions and in
which they agreed to the publication of the information/image(s) collected during the experiment in an online
open-access publication. e musicians were also given an honorarium for their participation. All the proce-
dures of the protocol were approved by a local ethics board at the ISM-Aix-Marseille University and were carried
out according to the relevant guidelines expressed in the 1964 Declaration of Helsinki.
Design and apparatus. e design of our experiment was based on four postural conditions of gradual
diculty129. For each condition, the cellists were asked to play a score composed of dierent technical patterns
as expressively as possible. e full score was executed three times by postural condition, according to two tempi
[45/70 bpm] and bowing modes [detached/legato]. e postural conditions and repetitions of factor combina-
tions were randomly presented to each participant. At the end of each postural session, we collected the par-
ticipants’ impressions regarding their diculties in terms of motion and sound production by means of a short
questionnaire. In this paper, we focus on the two extreme experimental conditions (cf Fig.1): the natural perfor-
mance (entitled [N]: Normal) and the fully constrained condition (entitled [SCH]: Static Chest and Head). is
fully constrained condition consisted of impairing the cellists by two immobilization devices that reduced their
primary postural control in a noninvasive way: a six-point safety race harness that restrained the torso displace-
Content courtesy of Springer Nature, terms of use apply. Rights reserved
11
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
ments and an adjusted neck collar that limited the freedom of head movements. We installed this equipment on
the musicians so that their shoulder mobility was not aected.
e cellists’ movements were recorded by an infrared motion capture system (Vicon 8, fps=125 Hz) that
tracked the three-dimensional positions of the reective markers positioned on the performer’s body and the
instrument. We followed the anatomical “Plug-in-Gait” (Vicon Motion Systems. Plug-in-Gait product guide.
Oxford: Vicon Motion Systems, 2010, https ://www.c-m otio n.com/downl oad/IORGa itFil es/p igma nualv er1.pdf)
standard to distribute the marker locations on the instrumentalist’s body. For this study, we focused the kinematic
analyses on a subset of seven key markers covering the cellists’ postural chain (torso/head) and the instrumental
chain responsible for the bowing gestures produced by the right arm. Some of these markers were virtually com-
puted from the Plug-in-Gait anatomical landmarks located on each segment, in accordance with the Dempster
model convention130 (cf Supplementary Table1). e acoustic signals produced by the instrument were recorded
by a DPA 4096 microphone placed under the cello bridge and connected to a MOTU interface (Ultralite MIC3,
fps = 44.1 kHz). Both recording systems were synchronized by a manual clap.
Stimuli and procedure. e stimuli were extracted from the cellists’ post-experimental feedback, which
identied a part of the performed score as frequently degraded in the constrained postural situation. Actually,
several notes belonging to this passage sounded harsher and shriller in agreement with the cellists’ comments
regarding their performance, in particular, their impression of producing “tighter and tenser sounds”, or “sounds
lacking depth and natural resonance”. Such harshness phenomena (i.e., degraded, metallic sound color) occurred
during the execution of quick syncopated patterns requiring excellent synchronization between the two arms
and were quite consistent among cellists on the rst note of the sequence (cf Fig.1). is dotted sixteenth of pitch
E4 is a key note that provides the motion impulse to the musical phrase through a large bow-pulling gesture
on the rst (A) cello string. Spectrogram analyses of this note between the normal and constrained postural
situations revealed salient signal dierences, which were thoroughly explored and connected to the musicians’
perception in a previous work48. We assessed the qualitative harshness phenomenon judgments according to
esthetic criteria of classical music by means of perceptual tests administered to a population of 15 trained cel-
lists, both teachers and advanced students. None of these cellists had participated in the experiment and had no
knowledge of the constrained postural conditions.
For this paper, we used the same corpus as in our previous work, which was built from perceptual evaluations
of harshness between the normal and constrained performances of the seven cellists. is corpus was composed
of the eight most salient pairs of round/harsh (good/poor quality) sounds of the E4 note, extracted from the
cellists’ performances in the normal and constrained contexts (mean note duration =
310 ±60
ms
∀
[N/SCH]).
Each round[N]/harsh[SCH] note pair belonged to a given cellist performing in slow tempo (45 bpm) and legato
bowing mode. e pairs of samples also belonged to dierent cellists and could thus be considered independent.
Motion analyses. Motion analyses were based on the anatomic displacements of the cellists’ joints associ-
ated with each sound of the corpus and on their bow velocity over time. To assess ne coordination features, we
designed a kinematic model describing the temporal evolution of these body joints (cf Fig.2a). e model was
composed of a linkage of six main rotary joints (cf Table1) articulating seven segments related to the body trunk
and the right arm (pelvis, abdomen, chest, head, upper arm, forearm, hand). Each corporeal segment was
assumed to be a rigid link, and the six articulations were approximated from the skeleton geometry as spherical
joints of three-dimensional degrees of freedom (DOFs)131,132. We computed 18 DOFs (6 joints
×
3 angles) as
joint-related triplets of anatomic angles {
ψn,θn,φn
},
n∈[1...6]
(cf Table1) by performing Cardan/Euler con-
versions of their segment-related marker coordinates132,133. For each joint, the method consisted of computing
the way the distal segment of the join was spatially rotated with respect to its proximal segment (cf Supplemen-
tary Figure1). In geometric terms, this approach merely dened a rotation matrix between two bases {
ip,
jp,
k
p
}
and {
id,
jd,
k
d
} attached to the joint proximal and distal segments, respectively (cf Supplementary Table2). Such
a matrix represents a succession of three rotations needed to transform a joint proximal basis into its relative
distal basis: rst rotation around X by an angle
ψ
(roll), second rotation around Y by an angle
θ
(pitch), and third
rotation around Z by an angle
φ
(yaw). As six rotation matrices should be computed to model all the DOFs, we
iterated the process along the six reference body hinges of the cellists’ motor chain. In addition to these joint
single-axis rotations, we also dened two composite angles for characterizing the global torso rotation (
ψ12
) and
the global forearm pronation/supination (
ψ56
). Note that angle
θ5
was removed because of the redundancy with
the external/internal rotation of the shoulder (
ψ4
); most biomechanics literature actually expresses the elbow
joint by only two DOFs: exion/extension (
φ5
) and pronation/supination (
ψ5
)134. At the end of this chain of
anatomic angles, the bow velocity was computed as the velocity vector norms of the bow “frog” marker (cf Sup-
plementary Table1) along the duration of each note composing the corpus:
Bowvel
=
(v2
x+v2
y+v2
z
)
, where
the triplet (
vx,vy,vz
) refers to the derivatives of the spatial coordinates of the bow frog at a given time.
Acoustic analyses. Acoustic analyses were based on the computation of ve acoustic descriptors over time
(cf Table2), which had been determined to be signicant in our previous work48 for discriminating between
round and harsh cello sounds. e extraction process for note E4 relied on a pitch-tracking algorithm adapted
from the MIR toolbox (Music Information Retrieval)135 of MATLAB soware. We developed a dedicated work-
ow in MATLAB to compute the ve acoustic descriptors over time by following the MPEG-7 standards136:
HSV (Harmonic Spectral Variations) relates to the sound spectral ux as a time-varying spectral content of its
harmonic components83; it was obtained from the spectral variation of harmonic amplitudes between adjacent
temporal frames. ATS (Attack Time Slope) corresponds to the attack time slope of the sound signal; it was deter-
Content courtesy of Springer Nature, terms of use apply. Rights reserved
12
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
mined from the logarithmic rise time of the signal energy during the attack phase. MFCCratio is a ratio between
the two rst MFCCs (Mel-Frequency Cepstral Coecients)85, which we designed to highlight specic variations
of the sound spectral envelope in a perceptual way; the coecients were classically obtained through a DCT
(Discrete Cosine Transform) applied to the logarithmic spectral envelope. SC (Spectral Centroid) corresponds
to an amplitude-weighted mean of the harmonic spectral peaks; it was obtained through a decomposition in
subbands centered on the signal harmonics137. TRIratio describes the spectral energy distribution in three fre-
quency bands as an energy ratio between each band and the total number of harmonics. e rst band contains
the fundamental frequency, the second band contains the medium partials (two, three, four) and the last band
contains the higher partials (ve and more). e three tristimulus coordinates were obtained by spectral centroid
computations for each band87.
Statistical framework. Our statistical framework was designed with the aim of carrying out functional
comparisons of the cellists’ sound-gesture interactions between the normal and constrained conditions. is
process can be divided into ve steps, which are described below by referring to the schema components of
Fig.2b. All the calculations were performed with the help of MATLAB soware and the FDA toolbox138.
Functional data analyses (FDA). In contrast with the classic PCA approach, functional data analysis considers
the entire sequence of measurements a function or a single entity rather than a series of individual data points76.
To represent our motion features (anatomic angles, bow velocity) and acoustic descriptors as time-varying func-
tions, the FDA methodology consisted of decomposing each time-series of variables as a linear combination
of B-spline basis functions. We chose an equally spaced 6-order B-spline basis because it was better suited for
numerical calculations than polynomials that are less stable. Furthermore, B-spline functions were very useful
for smoothing acoustic data of noisier natures than kinematic data while eciently accommodating changes in
local behavior. A semi-sampled spline basis was sucient to keep a ne-grained denition of each curve. e
B-spline mathematical decomposition is also required to align the
n=16
time series (eight {normal/constraint}
data pairs) of motion and acoustic descriptors to the duration of the longest series beforehand. is duration was
normalized between 0 and 1 to be consistent with the FDA time-warping mechanism.
Functional principal component analyses (FPCA). FPCA was carried out based on the spline-based representa-
tion of time-point data. is technique has the major advantage of producing functional principal components
that can be interpreted in the same domain as the original observations (kinematic and acoustic). Actually, this
technique models each descriptor time-series
fi
as a linear combination of weighted deviations from its mean
dataset f
i
(t
)
:
where
ξk(t)
are the functional principal components (FPCs), also called eigenfunctions, that captured the K rst
main hidden modes of variations. e coecients
cik
correspond to score projections as in classical PCA but
assess the extent to which the shape of each individual behavior
fi
of the dataset matches with the global mean
trend
fi
(
t)
.
ǫi
is the prediction error between the observations
fi(t)
and their model as a sum of projections on
the K principal modes.
In this study, for each kinematic or acoustic descriptor, we performed an FPCA on the set of its spline-
based time-series
fi(t),i∈[1, 16]
, without considering, for the moment, a separation between the normal and
constrained conditions. e acoustic descriptors were processed by adding a small amount of smoothing to
the B-spline model to more easily capture the main variation trends while avoiding distortion of the data. e
deviation patterns obtained by FPCA, especially those related to the acoustic descriptors, took into account
this compromise between data smoothness and the largest proportion of explained variance. According to the
statistics literature68,70, FPCA should be interpreted through graphs that present the ensemble mean curve of
the original observations (
fi
(
t)
) and the functions obtained by adding or subtracting a suitable multiple of each
FPC (
ξk(t)
) to or from this mean. Generally, this multiple corresponds to the percentage p of explained variance,
which can be written in this way:
fi
(
t
)±
p
×ξ
k
(
t)
. We followed this methodology in the paper to explain the
K=2
main modes of variation resulting from our analyses through two gures describing their detailed eects
on both motion and acoustic sides (cf Figs.3 and 4). In these graphs, the decision to add or subtract a functional
component to the mean curve was made according to the mean sign of the FPC scores of each postural condition.
Statistical comparisons of the functional principal components (FPCs). e functional principal component
scores returned by the FPCA could be used to compare the behavior of each kinematic or acoustic variable
between the two postural conditions. We carried out these comparisons by means of two-tailed paired Student’s
t-tests on the eight normal (N) and constrained (SCH) score samples of each variable. e eects were consid-
ered signicant for p-values equal to or less than .05, and the proportion of signicance was indicated by a num-
ber of stars related to p-values:
p<0.05∗,p<0.01∗∗,p<0.001∗∗∗
. For the rst functional behavior (referred
to as major mode), we retained the FPC scores that signicantly and directly separated the postural conditions.
For the secondary functional behavior (referred to as minor mode), we performed a Varimax rotation of the PCA
structure for prior insignicant score discrimination and retained the rotated scores if their t-test comparisons
highlighted signicant postural dierences. Varimax rotation is a procedure of variance distribution and rep-
resents a convenient way to focus on the structure of the second variation mode to facilitate interpretation. As
a consequence of this process, the eigenfunctions capturing the rst and second behavioral dierences may not
(3)
fi(t)=fi(t)+
K
k=1
cikξk(t)+ǫi,cik =ξk(t)fi(t)
dt
Content courtesy of Springer Nature, terms of use apply. Rights reserved
13
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
be perfectly orthogonal. In practice, however, the functional units related to each of the two motor behaviors
enabled clearly distinct interpretations.
Functional principal component regressions (FPCR). When the FPC scores of an analysis variable could be sig-
nicantly discriminated between the two postural conditions, we needed to conduct further analyses to compute
the functional principal components corresponding to each intergroup variation (i.e., normal and constrained).
Actually, the eigenfunctions returned by FPCA did not integrate the criteria for separating the postural condi-
tions. Such a problem could be resolved by applying an inverse methodology of functional principal component
regression (FPCR). is technique also allowed us to rebuild the original set of curves from the scores computed
by FPCA and nally assess the tting accuracy of our model68,74. Starting from a design matrix Z of the signicant
PC scores, FPCR determines K regression functions
βk
to t at best the shape of the time series
fi(t),i∈[1, 16]
:
where the function
β0
corresponds to the mean curve of the time series, and
βk
,
k∈[
1,
K]
stands for unbundled
eigenfunctions (
ξN
k
and
ξSCH
k
), which could not be dierentiated in the FPCA context (cf Eq.3). e score matrix
Z enabled such separation between the two postural conditions [N/SCH] by dividing each group of eight
zik
scores into
K=2
columns.
Multiple regressions and correlations of FPC scores. Standard statistical techniques were used to highlight the
main functional units shared by the cellists between the normal and constrained conditions. We determined
how their motor coordination inuenced the variations in bow velocity by carrying out two multivariate linear
regressions, one for each functional principal component. In this design, the signicant FPC scores of anatomic
angles were considered predictors of the bow velocity FPC scores. is approach resulted in two models of
functional motor units, which are presented in the bottom right part of Figs.3e and 4e. Each model is also char-
acterized by a linear relationship (cf Eqs.1 and 2) between the most signicant anatomic variables involved in
the coordination chain.
Two kinds of correlation analyses were nally performed in both motion and acoustic domains. First, we
extracted the important joint coupling chains of motor coordination by means of crossed correlations between
the signicant anatomic FPC scores. Second, we assessed functional sound-gesture interactions by computing
standard Pearson correlations between the FPC scores of bow velocity and those of each acoustic descriptor. e
most relevant correlations of these analyses provided a better understanding of how cellists’ motor programs
inuence their functional sound features in subtle ways.
Data availability
e datasets generated and analyzed during the current study are available from the corresponding author on
reasonable request.
Received: 10 December 2019; Accepted: 27 July 2020
References
1. Maes, P.-J., Wanderley, M. M. & Palmer, C. e role of working memory in the temporal control of discrete and continuous
movements. Exp. Brain Res. 233, 263–273 (2015).
2 . Dalla Bella, S. & Palmer, C. Rate eects on timing, key velocity, and nger kinematics in piano performance. PLoS ONE 6, e20518
(2011).
3. Dotov, D.G., Nie, L. & DeWit, M.M. Understanding aordances: History and contemporary development of gibson’s central
concept. Avant J. Philos. Interdiscip. Vanguard (2012).
4. Rizzolatti, G. & Craighero, L. e mirror-neuron system. Annu. Rev. Neurosci. 27, 169–192 (2004).
5. Zatorre, R. J., Chen, J. L. & Penhune, V. B. When the brain plays music: Auditory-motor interactions in music perception and
production. Nat. Rev. Neurosci. 8, 547–558 (2007).
6. Wollman, I., Penhune, V., Segado, M., Carpentier, T. & Zatorre, R. J. Neural network retuning and neural predictors of learning
success associated with cello training. Proc. Natl. Acad. Sci. 115, E6056–E6064 (2018).
7. Leman, M. Musical gestures and embodied cognition. In Journées d’informatique musicale (JIM-2012), 5–7 (2012).
8. Leman, M. e role of embodiment in the perception of music. Empir. Musicol. Rev. 9, 236–246 (2014).
9. Wojtara, T., Alnajjar, F., Shimoda, S. & Kimura, H. Muscle synergy stability and human balance maintenance. J. Neuroeng.
Rehabil. 11, 129 (2014).
10. Belenkii, V., Gurnkel, V. & Pal’tsev, E. On elements of voluntary movement control. Biozika 12, 135–141 (1967).
11. Gahery, Y. & Massion, J. Coordination between posture and movement. Motor Syst. Neurobiol. 4, 199–202 (1981).
12. Bouisset, S. & Zattara, M. Biomechanical study of the programming of anticipatory postural adjustments associated with vol-
untary movement. J. Biomech. 20, 735–742 (1987).
13. Bernstein, N.A. e Coordination and Regulation of Movements ((American translation 1967), Pergamon Press Ltd., 1935).
14. Berthoz, A. Le sens du mouvement (Odile Jacob, 1997).
(4)
fi(t)=Zβ(t)+ǫi=β0(t)+
K
k=1
zikβk(t)+ǫi
=β0(t)+
K
k=1
zN
ik βN
k(t)+
K
k=1
zSCH
ik βSCH
k(t)+ǫ
i
=fi(t)+
K
k=1
cN
ik ξN
k(t)+
K
k=1
cSCH
ik ξSCH
k(t)+ǫi
Content courtesy of Springer Nature, terms of use apply. Rights reserved
14
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
15. Klapp, S. T. & Jagacinski, R. J. Gestalt principles in the control of motor action. Psychol. Bull. 137, 443 (2011).
16. Burger, B., ompson, M. R., Luck, G., Saarikallio, S. & Toiviainen, P. Inuences of rhythm-and timbre-related musical features
on characteristics of music-induced movement. Front. Psychol. 4, 1–10 (2013).
17. Toiviainen, P., Luck, G. & ompson, M. R. Embodied meter: Hierarchical eigenmodes in music-induced movement. Music
Percept. Interdiscip. J. 28, 59–70 (2010).
18 . Naveda, L. etal. Methods for the analysis of rhythmic and metrical responses to music in free movement trajectories. In Proceed-
ings of the 11th International Symposium on Computer Music Multidisciplinary Research (CMMR), 248–262 (2015).
19. Ripollés, P. et al. Music supported therapy promotes motor plasticity in individuals with chronic stroke. Brain Imaging Behav.
10, 1289–1307 (2016).
20. aut, M.H. e discovery of human auditory–motor entrainment and its role in the development of neurologic music therapy.
In Progress in brain research, Vol. 217, 253–266 (Elsevier, Amsterdam, 2015).
21. Schiavio, A. & Altenmüller, E. Exploring music-based rehabilitation for parkinsonism through embodied cognitive science.
Front. Neurol. 6, 217 (2015).
22. Dotov, D. et al. Biologically-variable rhythmic auditory cues are superior to isochronous cues in fostering natural gait variability
in Parkinson’s disease. Gait Posture 51, 64–69 (2017).
23. Dalla Bella, S., Dotov, D., Bardy, B. & de Cock, V. C. Individualization of music-based rhythmic auditory cueing in Parkinson’s
disease. Ann. N. Y. Acad. Sci. 1423, 308–317 (2018).
24. Ghazali, G. M. & Alam, S. In the Minds of Children: Understanding Motivation to Learn Music (2005).
25. Hoppenot, D. Le violon intérieur (Van de Velde, Brussels, 1981).
26. Blanco-Piñeiro, P., Díaz-Pereira, M. P. & Martínez, A. Musicians, postural quality and musculoskeletal health: A literature’s
review. J. Bodywork Mov. er. 21, 157–172 (2017).
27. Alexander, F. M. e Use of the Self: Its Conscious Direction in Relation to Diagnosis, Functionning, and the Control of Reaction
(Integral Press, New York, 1955).
28. Hillier, S. & Worley, A. e eectiveness of the feldenkrais method: A systematic review of the evidence. Evid. Based Comple-
ment. Altern. Med. 2015, (2015).
29. DeAlcantara, P. Technique Alexander pour les musiciens (Editions AleXitère, 2000).
30. Schelleng, J. C. e bowed string and the player. J. Acoust. Soc. Am. 53, 26–41 (1973).
31. Askenfelt, A. Measurement of bow motion and bow force in violin playing. J. Acoust. Soc. Am. 80, 1007 (1986).
32. Guettler, K. & Askenfelt, A. Acceptance limits for the duration of pre-helmholtz transients in bowed string attacks. J. Acoust.
Soc. Am. 101, 2903–2913 (1997).
33. Woodhouse, J. & Galluzzo, P. e bowed string as we know it today. Acta Acustica United with Acustica 90, 579–589 (2004).
34. Demoucron, M. & Caussé, R. Sound synthesis of bowed string instruments using a gesture based control of a physical model.
Int. Symp. Musical Acoust. 1–1, (2007).
35 . Schoonderwaldt, E. e violinist’s sound palette: Spectral centroid, pitch attening and anomalous low frequencies. Acta Acu stica
united with acustica 95, 901–914 (2009).
36. Pérez Carrillo, A., Bonada, J., Maestre, E., Guaus, E. & Blaauw, M. Performance control driven violin timbre model based on
neural networks. IEEE Trans. Audio Speech. Lang. Process. 20, 1007–1021 (2012).
37. Fritz, C., Blackwell, A. F., Cross, I., Woodhouse, J. & Moore, B. C. Exploring violin sound quality: Investigating English timbre
descriptors and correlating resynthesized acoustical modications with perceptual properties. J. Acoust. Soc. Am. 131, 783–794
(2012).
38. Wollman, I., Fritz, C. & Poitevineau, J. Inuence of vibrotactile feedback on some perceptual features of violins. J. Acoust. Soc.
Am. 136, 910–921 (2014).
39. Saitis, C., Fritz, C., Scavone, G. P., Guastavino, C. & Dubois, D. Perceptual evaluation of violins: A psycholinguistic analysis of
preference verbal descriptions by experienced musicians. J. Acoust. Soc. Am. 141, 2746–2757 (2017).
40. Cadoz, C. & Wanderley, M.M. Gesture-music : Trends in Gestural Control of Music, vol.12 (Ircam - Centre Pompidou, 2000).
41 . Wanderley, M. M., Vines, B. W., Middleton, N., McKay, C. & Hatch, W. e musical signicance of clarinetists’ ancillary gestures:
An exploration of the eld. J. New Music Res. 34, 97–113 (2005).
42 . Nusseck, M. & Wanderley, M. M. Music and motion: How music-related ancillary body movements contribute to the experience
of music. Music Percept. Interdiscip. J. 26, 335–353 (2009).
43. Visi, F., Coorevits, E., Miranda, E. & Leman, M. Eects of Dierent Bow Stroke Styles on Body Movements of a Viola Player: An
Exploratory Study (Michigan Publishing, University of Michigan Library, Ann Arbor, 2014).
4 4. Massie-Laberge, C., Cossette, I. & Wanderley, M. M. Kinematic analysis of pianists’ expressive performances of romantic excerpts:
Applications for enhanced pedagogical approaches. Front. Psychol. 9, 2725 (2019).
45. Santos, T.F. & Loureiro, M.A. e observation of ancillary gestures using the laban-bartenie movement fundamentals. In
Anais do XIII Simpósio Internacional de Cognição e Artes Musicais (2017).
46. Rozé, J., Aramaki, M., Kronland-Martinet, R., Bourdin, C. & Ystad, S. Eluding the inuence of postural constraints on cellists’
bowing movements and timbral quality. In Bridging People and Sound-Post-Proceedings of CMMR, Vol. 10525 of LNCS, 128–144
(Springer, Heidelberg, 2017).
47. Wanderley, M.M. Quantitative analysis of non-obvious performer gestures. In Gesture and Sign Language in Human–Computer
Interaction, 241–253 (Springer, Berlin, 2002).
48. Rozé, J., Aramaki, M., Kronland-Martinet, R. & Ystad, S. Exploring the perceived harshness of cello sounds by morphing and
synthesis techniques. J. Acoust. Soc. Am. 141, 2121–2136 (2017).
49. Mantel, G. Cello Technique: Principles and Forms of Movement (Indiana University Press, Bloomington, 1995).
50. Gagnepain, X. Du musicien en général... au violoncelliste en particulier (Cité de la musique, 2001).
51. Liberman, A. M. & Mattingly, I. G. e motor theory of speech perception revised. Cognition 21, 1–36 (1985).
52. McNeill, D. Language and Gesture Vol. 2 (Cambridge University Press, Cambridge, 2000).
53. Kendon, A. Gesture: Visible Action as Utterance (Cambridge University Press, Cambridge, 2004).
54. Jensenius, A.R. Action-sound: Developing methods and tools to study music-related body movement. Ph.D. thesis, Department
of Musicology - University of Oslo (2007).
55. Caramiaux, B., Bevilacqua, F. & Schnell, N. Towards a gesture-sound cross-modal analysis. In Gesture in Embodied Communica-
tion and Human–Computer Interaction, 158–170 (Springer, Berlin, 2009).
56. Knapp, M. L., Hall, J. A. & Horgan, T. G. Nonverbal Communication in Human Interaction (Cengage Learning, Boston, 2013).
57. Godøy, R. I., Jensenius, A. R. & Nymoen, K. Production and perception of goal-points and coarticulations in music. J. Acoust.
Soc. Am. 123, 3657–3657 (2008).
58. Jensenius, A. R., Wanderley, M. M., Godøy, R. I. & Leman, M. Musical gestures : Concepts and methods in research. Musical
Gestures Sound Mov. Mean. 12, 12–35 (2009).
59. Zapata-Fonseca, L., Dotov, D., Fossion, R. & Froese, T. Time-series analysis of embodied interaction: Movement variability and
complexity matching as dyadic properties. Front. Psychol. 7, 1940 (2016).
60. Desmet, F. et al. Assessing a clarinet player’s performer gestures in relation to locally intended musical targets. J. New Music Res.
41, 31–48 (2012).
61. Turvey, M. T. Coordination. Am. Psychol. 45, 938 (1990).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
15
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
62. Grey, J. M. Multidimensional perceptual scaling of musical timbres. J. Acoust. Soc. Am. 61, 1270–1277 (1977).
63. McAdams, S., Winsberg, S., Donnadieu, S., De Soete, G. & Krimpho, J. Perceptual scaling of synthesized musical timbres:
Common dimensions, specicities, and latent subject classes. Psychol. Res. 58, 177–192 (1995).
64. Deluzio, K. & Astephen, J. Biomechanical features of gait waveform data associated with knee osteoarthritis: An application of
principal component analysis. Gait Posture 25, 86–93 (2007).
6 5. Epifanio, I., Ávila, C., Page, Á & Atienza, C. Analysis of multiple waveforms by means of functional principal component analysis:
Normal versus pathological patterns in sit-to-stand movement. Med. Biol. Eng. Comput. 46, 551–561 (2008).
66. Donoghue, O. A., Harrison, A. J., Coey, N. & Hayes, K. Functional data analysis of running kinematics in chronic achilles
tendon injury. Med. Sci. Sports Exerc. 40, 1323–1335 (2008).
67. Godwin, A., Takahara, G., Agnew, M. & Stevenson, J. Functional data analysis as a means of evaluating kinematic and kinetic
waveforms. eor. Issues Ergon. Sci. 11, 489–503 (2010).
68. Ramsay, J. O. Functional Data Analysis (Wiley Online Library, New York, 2006).
69. Coey, N., Harrison, A. J., Donoghue, O. A. & Hayes, K. Common functional principal components analysis: A new approach
to analyzing human movement data. Hum. Mov. Sci. 30, 1144–1166 (2011).
70. Robertson, G., Caldwell, G., Hamill, J., Kamen, G. & Whittlesey, S. Research Methods in Biomechanics, 2E (Human Kinetics,
Champaign, 2013).
7 1. Daertshofer, A., Lamoth, C. J., Meijer, O. G. & Beek, P. J. PCA in studying coordination and variability: A tutorial. Clin. Biomech.
19, 415–428 (2004).
72 . Troje, N. F. Decomposing biological motion: A framework for analysis and synthesis of human gait patterns. J. Vis. 2, 2–2 (2002).
7 3. Ramsay, J. O., Munhall, K. G., Gracco, V. L. & Ostry, D. J. Functional data analyses of lip motion. J. Acoust. Soc. Am. 99, 3718–3727
(1996).
74. Faraway, J. J. Modeling reach motions using functional regression analysis (Tech. Rep, SAE Technical Paper, 2000).
75. Sanger, T. D. Human arm movements described by a low-dimensional superposition of principal components. J. Neurosci. 20,
1066–1072 (2000).
76. Ryan, W., Harrison, A. & Hayes, K. Functional data analysis of knee joint kinematics in the vertical jump. Sports Biomech. 5,
121–138 (2006).
77. Harrison, A., Ryan, W. & Hayes, K. Functional data analysis of joint coordination in the development of vertical jump perfor-
mance. Sports Biomech. 6, 199–214 (2007).
78. Amelynck, D., Maes, P.-J., Martens, J.-P. & Leman, M. Expressive body movement responses to music are coherent, consistent,
and low dimensional. IEEE Trans. Cybern. 44, 2288–2301 (2014).
79. Bianco, T., Fréour, V., Rasamimanana, N., Bevilaqua, F. & Caussé, R. On gestural variation and coarticulation eects in sound
control. In Gesture in Embodied Communication and Human-Computer Interaction, 134–145 (Springer, Berlin, 2009).
80. Dalca, I.M., Vines, B.W., Pearce, M.T. & Wanderley, M.M. Expressivity as time-dependent movement for music performance:
A statistical exploration. In 10th International Symposium on Computer Music Multidisciplinary Research, Marseille, France,
October 15–18, 2013, 845–854 (2013).
81. Visi, F., Coorevits, E., Schramm, R. & Miranda, E. Instrumental movements of neophytes: analysis of movement periodicities,
commonalities and individualities in mimed violin performance performance. In 11th International Symposium on CMMR,
518–533 (e Laboratory of Mechanics and Acoustics, 2015).
82. Godøy, R.I., Jensenius, A.R. & Nymoen, K. Chunking by coarticulation in music-related gestures. In 8th International Gesture
Workshop, Bielefeld, 25–27 (2009).
83. Chudy, M., Carrillo, A.P. & Dixon, S. On the relation between gesture, tone production and perception in classical cello per-
formance. In Proceedings of Meetings on Acoustics, vol.19, 035017 (Acoustical Society of America, 2013).
84. Peeters, G. A large set of audio features for sound description (similarity and classication) in the cuidado project (Tech. Rep,
IRCAM, 2004).
85. Davis, S. & Mermelstein, P. Experiments in syllable-based recognition of continuous speech. IEEE Trans. Acoust. Speech Signal
Process. 28, 357–366 (1980).
86. Barthet, M., Guillemain, P., Kronland-Martinet, R. & Ystad, S. From clarinet control to timbre perception. Acta Acustica united
with Acustica 96, 678–689 (2010).
87. Pollard, H. F. & Jansson, E. V. A tristimulus method for the specication of musical timbre. Acta Acustica united with Acustica
51, 162–171 (1982).
88 . Godøy, R. I., Jensenius, A. R. & Nymoen, K. Chunking in music by coarticulation. Acta Acustica united with Acustica 96, 690–700
(2010).
89 . Guettler, K. Looking at starting transients and tone coloring of the bowed string. In Proceedings of Frontiers of Research on Speech
and Music (2004).
90. Woodhouse, J. On the playability of violins. Part I: Reection functions. Acta Acustica united with Acustica 78, 125–136 (1993).
91. Winold, H. & elen, E. Coordination and control in the bow arm movements of highly skilled cellists. Ecol. Psychol. 6, 1–31
(1994).
92. Turner-Stokes, L. & Reid, K. ree-dimensional motion analysis of upper limb movement in the bowing arm of string-playing
musicians. Clin. Biomech. 14, 426–433 (1999).
93. Starker, J. An Organized Method of String Playing (Indiana University Press, Bloomington, 1975).
94. Wulf, G. & Prinz, W. Directing attention to movement eects enhances learning: A review. Psychon. Bull. Rev. 8, 648–660 (2001).
95. Wulf, G. Attentional focus and motor learning: A review of 15 years. Int. Rev. Sport Exerc. Psychol. 6, 77–104 (2013).
96. McNevin, N. H., Shea, C. H. & Wulf, G. Increasing the distance of an external focus of attention enhances learning. Psychol. Res.
67, 22–29 (2003).
97. Wulf, G., Weigelt, M., Poulter, D. & McNevin, N. Attentional focus on suprapostural tasks aects balance learning. Q. J. Exp.
Psychol. Sect. A 56, 1191–1211 (2003).
9 8. McNevin, N. H. & Wulf, G. Attentional focus on supra-postural tasks aects postural control. Hum. Mov. Sci. 21, 187–202 (2002).
99. Totsika, V. & Wulf, G. e inuence of external and internal foci of attention on transfer to novel situations and skills. Res. Q.
Exerc. Sport 74, 220–232 (2003).
100. Alexander, F. .M. e Resurrection of the Body: e Essential Writings of F. Matthias Alexander (Dell Publishing Company, New
York, 1974).
101. Lederman, R. J. Neuromuscular and musculoskeletal problems in instrumental musicians. Muscle Nerv. 27, 549–561 (2003).
102. Lee, S.-H. Intervention program in college instrumental musicians, with kinematics analysis of cello and ute playing: A com-
bined program of yogic breathing and muscle strengthening-exibility exercises. Med. Probl. Perform. Artist. 27, 85–94 (2012).
103. Staes, F. F. et al. Physical therapy as a means to optimize posture and voice parameters in student classical singers: A case report.
J. Voice 25, e91–e101 (2011).
104. López, T. M. & Martínez, J. F. Strategies to promote health and prevent musculoskeletal injuries in students from the high
conservatory of music of Salamanca, Spain. Med. Probl. Perform. Artist. 28, 100–106 (2013).
105. Wahlström Edling, C. & Fjellman-Wiklund, A. Musculoskeletal disorders and asymmetric playing postures of the upper extrem-
ity and back in music teachers: A pilot study. Med. Probl. Perform. Artist. 24, 113–118 (2009).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
16
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
106. Barczyk-Pawelec, K., Sipko, T., Demczuk-Włodarczyk, E. & Boczar, A. Anterioposterior spinal curvatures and magnitude of
asymmetry in the trunk in musicians playing the violin compared with nonmusicians. J. Manip. Physiol. er. 35, 319–326 (2012).
107. Dotov, D. & Chemero, A. Breaking the perception-action cycle: Experimental phenomenology of non-sense and its implications
for theories of perception and movement science. In Enactive Cognition at the Edge of Sense-Making, 37–60 (Springer, Berlin,
2014).
108. Dona, G., Preatoni, E., Cobelli, C., Rodano, R. & Harrison, A. J. Application of functional principal component analysis in race
walking: An emerging methodology. Sports Biomech. 8, 284–301 (2009).
109. Chadefaux, D., Rao, G., Androuet, P., Berton, E. & Vigouroux, L. Active tuning of stroke-induced vibrations by tennis players.
J. Sports Sci. 35, 1643–1651 (2017).
110. Chadefaux, D., Berton, E. & Rao, G. How runners deal with the shock induced vibrations propagating through their body?. J.
Acoust. Soc. Am. 141, 3978–3978 (2017).
111. Chadefaux, D., Gueguen, N., ouze, A. & Rao, G. 3d propagation of the shock-induced vibrations through the whole lower-
limb during running. J. Biomech. 96, 109343 (2019).
112. Rosati, G., Oscari, F., Spagnol, S., Avanzini, F. & Masiero, S. Eect of task-related continuous auditory feedback during learning
of tracking motion exercises. J. Neuroeng. Rehabil. 9, 79 (2012).
113. Bevilacqua, F. et al. Sensori-motor learning with movement sonication: Perspectives from recent interdisciplinary studies.
Front. Neurosci. 10, 385 (2016).
114. Parseihian, G., Gondre, C., Aramaki, M., Ystad, S. & Kronland-Martinet, R. Comparison and evaluation of sonication strategies
for guidance tasks. IEEE Trans. Multimed. 18, 674–686 (2016).
115. Bressolette, B. et al. Harnessing audio in auto control: e challenge of sonifying virtual objects for gesture control of cars. IEEE
Consumer Electron. Mag. 7, 91–100 (2018).
116. Eenberg, A. O., Fehse, U., Schmitz, G., Krueger, B. & Mechling, H. Movement sonication: Eects on motor learning beyond
rhythmic adjustments. Front. Neurosci. 10, 219 (2016).
117. Schaert, N., Janzen, T. B., Mattes, K. & aut, M. H. A review on the relationship between sound and movement in sports and
rehabilitation. Front. Psychol. 10, 244 (2019).
118. O’Brien, B. etal. Considerations for developing sound in golf putting experiments. In International Symposium on Computer
Music Multidisciplinary Research, 338–358 (Springer, Berlin, 2017).
119. O’Brien, B., Vidal, A., Bringoux, L., Bourdin, C. Developing. & movement sonication for sports performance. A survey of
studies developed at the institute of movement science. In Interactive Sonication Workshop, ISON, 2019 (KTH Royal Institute
of Technology, Stockholm, 2019).
120. Vidal, A., Bertin, D., Drouot, F., Kronland-Martinet, R. & Bourdin, C. Improving the pedal force eectiveness using real-time
sonication. IEEE Access 8, 62912–62923 (2020).
121. Schneider, S., Schönle, P. W., Altenmüller, E. & Münte, T. F. Using musical instruments to improve motor skill recovery following
a stroke. J. Neurol. 254, 1339–1346 (2007).
122. Kronland-Martinet, R., Ystad, S. & Aramaki, M. High-level control of sound synthesis for sonication processes. AI Soc. J.
Knowl. Cult. Commun. 27, 245–255 (2012).
123. Merer, A., Aramaki, M., Ystad, S. & Kronland-Martinet, R. Perceptual characterization of motion evoked by sounds for synthesis
control purposes. Association for Computing Machinery. Trans. Appl. Percept. 10, 1–24 (2013).
124. Letanneux, A., Danna, J., Velay, J.-L., Viallet, F. & Pinto, S. From micrographia to Parkinson’s disease dysgraphia. Mov. Disord.
29, 1467–1475 (2014).
125. Danna, J. et al. “Let me hear your handwriting”! evaluating the movement uency from its sonication. PLoS ONE 10, e0128388
(2015).
126. oret, E., Aramaki, M., Bringoux, L., Ystad, S. & Kronland-Martinet, R. Seeing circles and drawing ellipses: When sound biases
reproduction of visual motion. PloS one 11, e0154475 (2016).
127. Godøy, R.I., Haga, E. & Jensenius, A.R. Exploring music-related gestures by sound-tracing: A preliminary study (2006).
128. Godøy, R.I., Haga, E. & Jensenius, A.R. Playing “air instruments”: Mimicry of sound-producing gestures by novices and experts.
In International Gesture Workshop, 256–267 (Springer, Berlin, 2006).
129. Rozé, J. etal. Assessing the inuence of constraints on cellists’ postural displacements and musical expressivity. In Mus ic, Mind
and Embodiment - Post-proceedings of CMMR, vol. 9617 of LNCS, 22–41 (Springer, Berlin, 2016).
130. Dempster, W. T. Space requirements of the seated operator: Geometrical, kinematic, and mechanical aspects of the body, with special
reference to the limbs (University of Michigan, Tech. Rep., 1955).
131. Droulez, J. & Berthoz, A. Servo-controlled (conservative) versus topological (projective) mode of sensory motor control (Elsevier,
Disorders of posture and gait, 1986).
132. Riener, R. & Straube, A. Inverse dynamics as a tool for motion analysis: Arm tracking movements in cerebellar patients. J.
Neurosci. Methods 72, 87–96 (1997).
133. Apkarian, J., Naumann, S. & Cairns, B. A three-dimensional kinematic and dynamic model of the lower limb. J. Biomech. 22,
143–155 (1989).
134. Raikova, R. A general approach for modelling and mathematical investigation of the human upper limb. J. Biomech. 25, 857–867
(1992).
135. Lartillot, O. & Toiviainen, P. A matlab toolbox for musical feature extraction from audio. In Proceedings of the International
Conference on Digital Audio Eects 237–244 (2007).
136. Kim, H.-G., Moreau, N. & Sikora, T. MPEG-7 Audio and Beyond: Audio Content Indexing and Retrieval (Wiley, New York, 2006).
137. Barthet, M., Kronland-Martinet, R., Ystad, S. & Depalle, P. e eect of timbre in clarinet interpretation. In International Com-
puter Music Conference (ICMC), 59–62 (Copenhague, Danemark, 2007).
138. Ramsay, J. O. & Silverman, B. W. Applied Functional Data Analysis: Methods and Case Studies (Springer, Berlin, 2007).
Acknowledgements
We acknowledge the ISM (Institut des Sciences du Mouvement) of Marseille for providing the technological
environment of the motion capture system and support related to the computations of anatomical Cardan/Euler
angles. is work is part of the “SoniMove” project (ANR-14-CE24-0018).
Author contributions
All authors participated to the design of the experiment and reviewed the manuscript. J.R. and S.Y. conducted the
experiment. With the help of ISM, J.R. conducted the functional motion analyses. M.A. contributed to statistical
analyses and R.K.M. contributed to acoustical analyses.
Competing interests
e authors declare no competing interests.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
17
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 |
www.nature.com/scientificreports/
Additional information
Supplementary information is available for this paper at https ://doi.org/10.1038/s4159 8-020-70705 -8.
Correspondence and requests for materials should be addressed to J.R.
Reprints and permissions information is available at www.nature.com/reprints.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and
institutional aliations.
Open Access is article is licensed under a Creative Commons Attribution 4.0 International
License, which permits use, sharing, adaptation, distribution and reproduction in any medium or
format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the
Creative Commons licence, and indicate if changes were made. e images or other third party material in this
article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the
material. If material is not included in the article’s Creative Commons licence and your intended use is not
permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from
the copyright holder. To view a copy of this licence, visit http://creat iveco mmons .org/licen ses/by/4.0/.
© e Author(s) 2020
Content courtesy of Springer Nature, terms of use apply. Rights reserved
1.
2.
3.
4.
5.
6.
Terms and Conditions
Springer Nature journal content, brought to you courtesy of Springer Nature Customer Service Center GmbH (“Springer Nature”).
Springer Nature supports a reasonable amount of sharing of research papers by authors, subscribers and authorised users (“Users”), for small-
scale personal, non-commercial use provided that all copyright, trade and service marks and other proprietary notices are maintained. By
accessing, sharing, receiving or otherwise using the Springer Nature journal content you agree to these terms of use (“Terms”). For these
purposes, Springer Nature considers academic use (by researchers and students) to be non-commercial.
These Terms are supplementary and will apply in addition to any applicable website terms and conditions, a relevant site licence or a personal
subscription. These Terms will prevail over any conflict or ambiguity with regards to the relevant terms, a site licence or a personal subscription
(to the extent of the conflict or ambiguity only). For Creative Commons-licensed articles, the terms of the Creative Commons license used will
apply.
We collect and use personal data to provide access to the Springer Nature journal content. We may also use these personal data internally within
ResearchGate and Springer Nature and as agreed share it, in an anonymised way, for purposes of tracking, analysis and reporting. We will not
otherwise disclose your personal data outside the ResearchGate or the Springer Nature group of companies unless we have your permission as
detailed in the Privacy Policy.
While Users may use the Springer Nature journal content for small scale, personal non-commercial use, it is important to note that Users may
not:
use such content for the purpose of providing other users with access on a regular or large scale basis or as a means to circumvent access
control;
use such content where to do so would be considered a criminal or statutory offence in any jurisdiction, or gives rise to civil liability, or is
otherwise unlawful;
falsely or misleadingly imply or suggest endorsement, approval , sponsorship, or association unless explicitly agreed to by Springer Nature in
writing;
use bots or other automated methods to access the content or redirect messages
override any security feature or exclusionary protocol; or
share the content in order to create substitute for Springer Nature products or services or a systematic database of Springer Nature journal
content.
In line with the restriction against commercial use, Springer Nature does not permit the creation of a product or service that creates revenue,
royalties, rent or income from our content or its inclusion as part of a paid for service or for other commercial gain. Springer Nature journal
content cannot be used for inter-library loans and librarians may not upload Springer Nature journal content on a large scale into their, or any
other, institutional repository.
These terms of use are reviewed regularly and may be amended at any time. Springer Nature is not obligated to publish any information or
content on this website and may remove it or features or functionality at our sole discretion, at any time with or without notice. Springer Nature
may revoke this licence to you at any time and remove access to any copies of the Springer Nature journal content which have been saved.
To the fullest extent permitted by law, Springer Nature makes no warranties, representations or guarantees to Users, either express or implied
with respect to the Springer nature journal content and all parties disclaim and waive any implied warranties or warranties imposed by law,
including merchantability or fitness for any particular purpose.
Please note that these rights do not automatically extend to content, data or other material published by Springer Nature that may be licensed
from third parties.
If you would like to use or distribute our Springer Nature journal content to a wider audience or on a regular basis or in any other manner not
expressly permitted by these Terms, please contact Springer Nature at
onlineservice@springernature.com
Available via license: CC BY
Content may be subject to copyright.