ArticlePDF Available

Abstract and Figures

During the last 20 years, the role of musicians’ body movements has emerged as a central question in instrument practice: Why do musicians make so many postural movements, for instance, with their torsos and heads, while playing musical instruments? The musical significance of such ancillary gestures is still an enigma and therefore remains a major pedagogical challenge, since one does not know if these movements should be considered essential embodied skills that improve musical expressivity. Although previous studies established clear connections between musicians’ body movements and musical structures (particularly for clarinet, piano or violin performances), no evidence of direct relationships between body movements and the quality of the produced timbre has ever been found. In this study, focusing on the area of bowed-string instruments, we address the problem by showing that cellists use a set of primary postural directions to develop fluid kinematic bow features (velocity, acceleration) that prevent the production of poor quality (i.e., harsh, shrill, whistling) sounds. By comparing the body-related angles between normal and posturally constrained playing situations, our results reveal that the chest rotation and vertical inclination made by cellists act as coordinative support for the kinematics of the bowing gesture. These findings support the experimental works of Alexander, especially those that showed the role of head movements with respect to the upper torso (the so-called primary control) in ensuring the smooth transmission of fine motor control in musicians all the way to the produced sound. More generally, our research highlights the importance of focusing on this fundamental postural sense to improve the quality of human activities across different domains (music, dance, sports, rehabilitation, working positions, etc.).
(a) Kinematic model of the cellists’ trunk and right arm bowing presented at rest (frontal view). This inertial system is composed of six key joints modeled as three single axes rotational joints in the Cardan/Euler angle representation {roll (ψn\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\psi _{\text {n}}$$\end{document}), pitch (θn\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\theta _{\text {n}}$$\end{document}), yaw (ϕn\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\phi _{\text {n}}$$\end{document})} where n∈[1…6]\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$n\in [1\ldots 6]$$\end{document} is the key joint number. (b) Statistical framework illustrated for a given anatomic variable of the kinematic model. This framework is based on functional principal component analyses (cf “Methods” section) and extracts two principal modes of variation of the cellists’ behavior, which are referred to as major mode and minor mode in the text. The effects of each mode are highlighted as functional deviations of the average time series between the normal (curves of blue circles) and the constrained situation (curves of red crosses).
… 
Major mode of the cellists’ functional variations. This mode explained 70% of the variance contained in the kinematic data—(a) postural, (b) instrumental, (c) physical—and 60% of the variance contained in the (d) acoustical data. At each stage of this functional unit, the effect of the major mode is visualized as functional deviations of the average time series between the normal situation (curves of blue circles) and the constrained situation (curves of red crosses). The attached boxplots present the distribution of FPC1 scores, i.e. the way each individual curve contributed to the major mode, for each variable that significantly discriminated the postural conditions. Normal and constrained functional components were added or subtracted to or from the mean curve, according to the mean sign of the FPC1 scores in each postural condition. The bottom right panel (e) shows the graph obtained by linear regression of the major scores (FPC1) of the bow velocity with respect to those of anatomic angles, which were significantly different between the postural conditions (R2=0.90∗∗\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$R^{2}=0.90^{**}$$\end{document}, Radjusted2=0.77∗∗\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$R^{2}_{adjusted}=0.77^{**}$$\end{document}).
… 
This content is subject to copyright. Terms and conditions apply.
1

SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports
Cellists’ sound quality is shaped
by their primary postural behavior
Jocelyn Rozé*, Mitsuko Aramaki, Richard Kronland-Martinet & Sølvi Ystad
During the last 20 years, the role of musicians’ body movements has emerged as a central question
in instrument practice: Why do musicians make so many postural movements, for instance, with
their torsos and heads, while playing musical instruments? The musical signicance of such ancillary
gestures is still an enigma and therefore remains a major pedagogical challenge, since one does
not know if these movements should be considered essential embodied skills that improve musical
expressivity. Although previous studies established clear connections between musicians’ body
movements and musical structures (particularly for clarinet, piano or violin performances), no
evidence of direct relationships between body movements and the quality of the produced timbre
has ever been found. In this study, focusing on the area of bowed-string instruments, we address the
problem by showing that cellists use a set of primary postural directions to develop uid kinematic
bow features (velocity, acceleration) that prevent the production of poor quality (i.e., harsh, shrill,
whistling) sounds. By comparing the body-related angles between normal and posturally constrained
playing situations, our results reveal that the chest rotation and vertical inclination made by cellists
act as coordinative support for the kinematics of the bowing gesture. These ndings support the
experimental works of Alexander, especially those that showed the role of head movements with
respect to the upper torso (the so-called primary control) in ensuring the smooth transmission of ne
motor control in musicians all the way to the produced sound. More generally, our research highlights
the importance of focusing on this fundamental postural sense to improve the quality of human
activities across dierent domains (music, dance, sports, rehabilitation, working positions, etc.).
Playing a musical instrument is an activity that involves complex auditory-motor interactions. Whether creating
a short sound or developing a whole phrase, musicians must continuously establish a clear relationship between
the actions aorded by their instrument and the auditory feedback resulting from their actions13. Research in
neuroscience has demonstrated that such an active process intricately interweaves the auditory and motor regions
of the brain as a neural substrate of cognitive representation4,5. In the case of the cello, for example, longitudi-
nal studies conducted with non-musician participants and an MRI-compatible (Magnetic Resonance Imaging)
instrument revealed that “brain plasticity” emerged as an integrative function of the neural network in auditory-
motor information processing6. Both musical actions and percepts would thus depend on a single underlying
mental representation governing both auditory encoding and motor control along the same goal-directed action.
From these perspectives of embodied music cognition, we should consider the musical expressivity produced
by instrumentalists as a link between sonic and corporeal movements and analyze their musical intentionality
through the prism of a repertoire of learned gestural primitives7,8. Research in human biomechanics has high-
lighted that such a repertoire is composed of synergies, i.e., muscular cooperation patterns aiming to attain a
given action9. A strong consequence of the synergetic mechanisms is that each voluntary action, such as moving
a bow on a string, should be accompanied by anticipatory postural adjustments called APAs1012. Anticipation
is crucial in musical practice because of the coupling between coordination and postural balance, which implies
that the fulllment of a single goal-directed action may be encoded beforehand as a selective activation of the
musicians’ joint degrees of freedom (DOFs)1315. In dance practice, conversely, the mirror neuron system may
decode the perceived expressiveness into ne movement structures through the same kind of grounded synergetic
processes1618. In the domain of rehabilitation, rhythmic auditory stimuli were ecient in reducing movement
disorders and improving walking abilities in Parkinson’s disease and stroke patients1923.
Due to the weight of teaching habits, ignorance or misunderstandings, the role of embodiment among musi-
cians has been largely underestimated, despite evidence of its importance for the development of prociency
OPEN

*email: roze@prism.cnrs.fr
Content courtesy of Springer Nature, terms of use apply. Rights reserved
2
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
in many domains24. is underestimation is a recurrent problem in higher music education institutions that
traditionally encourage the rapid acquisition of technical skills without suciently considering the develop-
ment of musicians’ postural relations with their instruments25. Such pedagogical methods have always been
the subject of heated debates and remain controversial today because of the high rates of dropouts due to psy-
chological frustrations and musculoskeletal disorders among musicians26. Many students actually need to stop
this end-gaining process and adopt alternative methods drawn from experimental psychology27,28, particularly
the Alexander technique, which states that a well-directed primary postural control, i.e., a dynamic orientation
of the head, neck, and upper back, has many benets for coordination and musical expressivity29. Although
very ecient in practice, this assumption has never been scientically examined due to the diculty of making
accurate measurements of a musicians primary postural control and of assessing its acoustical inuence in an
undisturbed way. In the area of bowed-string instruments, pioneer musical research analyzed sound features
with bowing machines by focusing on physical control variables such as bow force and bow velocity but without
considering the musicians body3033. Other studies assessed the instrumentalists’ auditory-motor mappings by
means of motion and sound synthesis techniques with an electric violin3436. More recently, psycholinguistic
studies explored violinists’ cognitive processes by correlating perceptual adjectives of violin sounds (round, harsh,
light, mellow, dark, etc.) to physical features of the acoustic signal and haptic feedback of the instrument3739.
Over the past two decades, we thus observed an increasing interest among the scientic community in better
understanding the signicance of musicians’ corporeal movements related to their expressive sound features. e
results revealed the importance of such “ancillary” gestures in supporting or accompanying the instrumentalists
“eective gestures” that are directly responsible for sound production4046. In particular, investigations of clarinet-
ists’ movements have shown that their sense of musical phrasing may be aected during ancillary impairment,
i.e., when asked to move as little as possible while keeping their natural expressive intention or when the bell
of their instrument was immobilized47. Such disembodied experimental conditions enable us to infer stable and
reproducible patterns between musicians’ nonobvious movements and their audible components.
In this study, we examined the key inuence of musicians’ primary postural directions on their sound quality.
is study is based on an experimental protocol48 that enabled us to compare the auditory-motor interactions of
highly skilled cellists between two postural conditions: a natural condition and a posturally constrained condition
in which the chest and the head were blocked by a safety race harness and a neck collar, respectively (cf “Meth-
ods” section). In the context of postural immobilization, the cellists’ timbre quality was consistently degraded
on some key notes of the more demanding passages (cf Fig.1). We supposed that this loss of expressiveness may
correspond to specic deciencies in the motor coordination of the right arm and impact the uency, i.e., the level
of precision, of the kinematic variations of the bow velocity. is assumption was inferred from the specialized
literature on cellists’ physiology: the term bow “speed” can be used to describe the degree of motor coordination
between the cellist’s body segments49; bow/string adherence, which shapes the timbre of the sound, would be
more related to bow displacement than to bow pressure because no sound can be produced by only pressing the
bow on a string without any movement50. We also built our experimental design on the assumptions provided by
motor theories of perception5153, that predict complementary relationships between nonverbal “gesticulations
in the case of speech and ancillary gestures in the case of music54,55. A psycholinguistic protocol actually revealed
that inhibitions of nonverbal gestures caused speech to become much more laborious and tense, altering both
intonation and expressiveness of the message56. is kind of connection was hypothesized in the music area
through the existence of sonic-gestural objects, i.e., mental constructs in which auditory and motion elements
co-occur both in the minds of the performer and the listener57. Such motor imagery of the musical experience
would contain dyadic properties likely to activate linkages between the structure of the written score and esthetic
Figure1. e musical passage and note investigated for this study. Spectrograms correspond to examples of the
acoustic signal of an E4 note (the rst one of this score sequence) played by the same cellist with good timbre
quality (round) in the normal situation [N] and poor timbre quality (harsh) in the posturally-constrained
situation [SCH] (Static Chest and Head).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
3
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
concepts of the perceived sound58,59. According to this model, features that characterize the produced sounds
may reveal the morphology of moving sonic shapes related to the kinematic displacements of the cellists.
Here, we chose to analyze cello sounds, commonly judged as poor or “harsh” in classical music, in terms of
incorrect moving sonic forms60. In practice, this means that the acoustic signal variations analyzed within a harsh
cello note may be expected to correlate with unsuitable bow velocity patterns, potentially induced from erroneous
chest or head directions. Such sonic movements can be highlighted by crossing advanced methodological aspects
of functional anatomy and acoustic processing (cf “Methods” section). Actually, movement scientists consider
movement coordination the result of an organized motor activity, which can be divided into several elementary
actions, also called functional units61. Similarly, psychoacousticians represent instrumental timbre within a per-
ceptual space of several dimensions that are oen related to temporal and spectral sound facets62,63. As cellists
continuously modulate their gestures while playing, we may thus suppose that they use specic functional motion
units to shape particular features of their sound production. is assumption guided us to design a statistical
framework and to perform functional comparisons of the cellists’ kinematic and acoustic features between the
normal and constrained conditions (cf Fig.2b). e conception of this approach was inspired by research in the
medical and biological engineering elds that provides ecient methods for comparing human motion patterns
over time and for quantitatively emphasizing pathological deviations from a reference control group6467. e
results of those studies demonstrate that functional data analysis (FDA)68 and especially functional principal
component analysis (FPCA)69,70 have better discriminatory power than the classical PCA multivariate approach71.
FPCA is an emerging modern technique that extracts the principal modes (PCs) of a set of continuous waveforms
and quanties their dierences across subjects as temporal deviations from the mean curve72. e technique has
proven valuable for modeling simple motor behaviors7375 or biomechanics of complex sport movements76,77,
and in analyzing coarticulation patterns of musicians7881 or spontaneous movement responses to music54,82.
In this study, we carried out functional PCA to determine the dominant components of the cellists’ audio-
motor functional units and to assess their degradation on both the motion and the acoustic sides. e cellists’
bow velocity variations were dened as the main goal-directed actions, and the functional units set up to reach
this goal were dened as the linear combinations of joint-related angular time series (cf Table1). e acoustic
Figure2. (a) Kinematic model of the cellists’ trunk and right arm bowing presented at rest (frontal view). is
inertial system is composed of six key joints modeled as three single axes rotational joints in the Cardan/Euler
angle representation {roll (
ψn
), pitch (
θn
), yaw (
φn
)} where
n∈[1...6]
is the key joint number. (b) Statistical
framework illustrated for a given anatomic variable of the kinematic model. is framework is based on
functional principal component analyses (cf “Methods” section) and extracts two principal modes of variation
of the cellists’ behavior, which are referred to as major mode and minor mode in the text. e eects of each
mode are highlighted as functional deviations of the average time series between the normal (curves of blue
circles) and the constrained situation (curves of red crosses).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
4
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
variations were modeled by means of the descriptors highlighted in our previous work48 for characterizing the
perceived harsh phenomenon (cf Table2).
Table 1. Anatomic variables described as joint-related Euler angles {
ψ,θ,φ
} of the segmental kinematics. e
sign of each angle depends on its rotational direction that can be established from the resting kinematic model
(cf Fig.1a) by following the right-hand rule.
Euler angle Relation to segmental kinematics
Postural angles
root (1)
ψ1
Abdomen torsion To the le [
0
...
]
To the right [
0
...
90
]
θ1
Abdomen vertical inclination Forward [
0
...
90
]
Backward [
0
...
]
φ1
Abdomen lateral swing To the le [
0
...
90
]
To the right [
0
...
+90
]
midtorso (2)
ψ2
Chest torsion To the le [
0
...
]
To the right [
0
...
90
]
θ2
Chest vertical inclination Forward [
0
...
90
]
Backward [
0
...
]
φ2
Chest lateral swing To the le [
0
...
90
]
To the right [
0
...
+90
]
neck (3)
ψ3
Head torsion To the le [
0
...
]
To the right [
0
...
90
]
θ3
Head vertical inclination Forward [
0
...
90
]
Backward [
0
...
]
φ3
Head lateral swing To the le [
0
...
90
]
To the right [
0
...
+90
]
ψ12 =ψ1+ψ2
Torso rotation To the le [
0
...
]
To the right [
0
...
90
]
Instrumental angles
rshoulder (4)
ψ4
Upper arm rotation External [
0
...
]
Internal [
0
...
90
]
θ4
Upper arm abduction Abduction [
0
...
]
Adduction [
0
...
90
]
φ4
Upper arm anteversion Antepulsion [
0
...
]
Retropulsion [
0
...
90
]
relbow (5)
ψ5
Forearm rotation Supination [
0
...
]
Pronation [
0
...
90
]
φ5
Forearm extension Full exion [
0
]
Full extension [
+180
]
rwrist (6)
ψ6
Hand rotation Supination [+]
Pronation [−]
θ6
Hand abduction Ulnar abduction [
0
...
]
Radial abduction [
0
...
90
]
φ6
Hand exion Palmar exion [
0
...
+90
]
Dorsal extension [
0
...
90
]
ψ
56
=ψ
5
+ψ6
Forearm rotation Supination [
0
...
]
Pronation [
0
...
90
]
Content courtesy of Springer Nature, terms of use apply. Rights reserved
5
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
Results
By applying the steps of our analysis framework, which are thoroughly described in “Methods” section, we could
infer two main functional auditory-motor linkages responsible for the perceived quality of cello sounds. In this
paper, these two principal modes of variation are referred to as the major mode and minor mode. Each func-
tional mode can be considered the coupling between an eigenposture65 and an eigensonicform88: an eigenposture
describes a specic aggregate of postural and instrumental joint motions, and an eigensonicform describes a
specic interaction of bow kinematics and acoustic features. FPCA analyses (cf Eq.3) revealed that the major
and minor eigenpostures captured approximately 95% of the total data variance, i.e., 70% for FPC1 and 25%
for FPC2. Similarly, the major and minor eigensonicforms captured approximately 75% of the total data vari-
ance aer smoothing, i.e., 60% for FPC1 and 15% for FPC2. Such percentages of the largest explained variance
were sucient to reveal the two most prominent timbre features and establish correlations with the kinematic
behavior variations. Here, we present this eigenfunction structure with two gures describing the major mode
(Fig.3) and the minor mode (Fig.4). For the sake of clarity, these gures only highlight the functional variables
that presented signicantly dierent behaviors between the normal and constrained situations.
Major mode of variations. As observed in Fig.3, the rst (or major) functional unit corresponds to global
amplitude variations at all the dierent stages of the sound-gesture chain. is was particularly salient at the
physical stage, which reects the “eective” sound-producing gesture (cf Fig.3c), where the bow velocity globally
decreased in the constrained condition (Bowvel:
t(7)=2.07
).
At the postural stage of the trunk motor chain (cf Fig.3a), which reects the ancillary gestures, this bowing
alteration eect appeared to be associated with marked amplitude reductions of the natural chest torsion (
ψ12
:
t(7)=8.37∗∗∗
) and head torsion (
ψ3
:
t(7)=−3.10
). e analyses of the normal condition in the graph actually
revealed surprising symmetrical evolutions towards zero for these two movements, with the chest torsion moving
from the le and the head torsion from the right, while these tendencies were lost in the constrained condition.
In accordance with Mantel49, we suggest that such a grounded tendency characterizes the need for a strong
helicoidal energy transfer along the spine during the bow pulling movements to ensure optimal bow velocity
amplitudes. e constrained condition also clearly aected the other degrees of freedom of the head, i.e., head
elevation (
θ3
:
t(7)=−3.42
) and head lateral swing (
φ3
:
t(7)=2.38
), for which the amplitude variations were
considerably smaller than their natural counterparts. Interestingly, these two analyses of the head under natural
conditions in the graph revealed that the bouncing trend during the bow pulling movement, up-and-down and
right-and-le was absorbed by the constraint.
At the instrumental stage (cf Fig.3b), which reects the interaction between eective and ancillary gestures,
the major eect of postural impairments resulted in consistent amplitude alterations of the shoulder articulation,
i.e., a loss of upper arm abduction (
θ4
:
t(7)=4.40∗∗
) and external rotation (
ψ4
:
t(7)=3.40
). is insucient
upper arm external rotation also appeared to be symmetrically coupled to a loss of forearm pronation (
ψ56
:
t(7)=−2.32
). us, in the constrained condition, the major mode reects a systematic locking position of the
whole right arm through unsuitably combined tendencies of upper arm internal rotations and forearm supina-
tions that aected the bow velocity.
e results of multivariate regression on the major FPC scores of these anatomical angles was signicant
(
R2=0.90∗∗
,
R2
adjusted
=0.77
∗∗
, cf regression graph of Fig.3e). It was therefore possible to infer a linear rela-
tionship predicting the global bow velocity amplitudes based on the set of anatomic angles selected by the rst
functional unit. More importantly, an additional stepwise regression extracted a combination of two angular
degrees of freedom that explained the global variations of the bow velocity:
is simple predictive relation highlights a major mechanism of the cellists coordination, in which the coupling
between the chest torsion (ancillary gesture) and the external rotation of the right arm (instrumental gesture)
guaranteed suitable bow velocity amplitudes. More details on this major coordination mode (or eigenposture)
could be obtained by computing correlations between the FPC scores. Interestingly, these results revealed that
chest torsion was the coordinative support for bow velocity amplitudes (
rBowvel
ψ12
=0.55
). Further cross-correla-
tions of the major angle scores revealed a chain of three coupling systems, which characterizes the coordination
transfer within the major mode: (1) the system {
ψ12|ψ3|θ3
} showed the abovementioned symmetry of the chest/
head torsions (
rψ
3
ψ12
=−0.61
); (2) the system {
ψ3|θ3|φ3|ψ4
} showed the importance of all the degrees of free-
dom of the head, especially of the head torsion, for activating the external rotation of the arm (
rψ
4
ψ3
=−0.71
∗∗
);
and (3) the system {
θ3|θ4
} showed that up-and-down head bouncing contributed to the amplitude of shoulder
(1)
Bowvel =0.75 ×ψ20.52 ×ψ4
Table 2. Acoustic descriptors used in the study and their correlation to the perceived harshness phenomenon.
Name Description Correlation to harshness
HSV Harmonic Spectral Variation83 Increase of harmonic asynchrony
ATS Attack Time Slope84 Slower attack slope of the temporal envelope
MFCCratio Ratio between MFCC coecients c2 and c185 Emergence of formantic area
SC Harmonic Spectral Centroid86 Increase of spectral centroid
TRIratio Ratio between tristimulus tr3 and tr1 + tr287 Spectral energy transfer towards high-frequency components
Content courtesy of Springer Nature, terms of use apply. Rights reserved
6
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
abduction (
rθ
4
θ3
=−0.53
). No signicant cross-correlations were obtained with the angle of prono-supination
(
ψ56
), which conrms that global bow velocity amplitudes were not controlled by the forearm but by the upper
arm at the shoulder level through the helicoidal work of the trunk.
From the acoustical point of view (cf Fig.3d), the major mode revealed that three of the ve sound signal
descriptors characterized the time-dependent perceptual dierences between round and harsh cello sounds in
terms of global amplitude variations. e graph analyses between normal and constrained situations revealed
energy decreases within the temporal envelope (Rms:
t(7)=3.04
), energy increases on the upper partials of the
spectral envelope (Triratio:
t(7)=−3.53∗∗
), and more harmonic asynchrony, especially during the birth phase
of the sound (Hsv:
t(7)=−2.08
). More details about this major acoustic mode (or eigensonicform) could be
obtained by computing correlations between the FPC scores. Surprisingly, these results revealed that the temporal
energy level was the main descriptor impacted by global changes in bow velocity (
rBowvel
Rms
=0.52
). More trivially,
the cross-correlations of major acoustic scores revealed a strong collinearity between the amounts of harmonic
asynchronicity and high-frequency spectral energy (
rTriratio
Hsv
=0.75
∗∗∗
). No signicant cross-correlations were
Figure3. Major mode of the cellists’ functional variations. is mode explained 70% of the variance contained
in the kinematic data—(a) postural, (b) instrumental, (c) physical—and 60% of the variance contained in the
(d) acoustical data. At each stage of this functional unit, the eect of the major mode is visualized as functional
deviations of the average time series between the normal situation (curves of blue circles) and the constrained
situation (curves of red crosses). e attached boxplots present the distribution of FPC1 scores, i.e. the way
each individual curve contributed to the major mode, for each variable that signicantly discriminated the
postural conditions. Normal and constrained functional components were added or subtracted to or from the
mean curve, according to the mean sign of the FPC1 scores in each postural condition. e bottom right panel
(e) shows the graph obtained by linear regression of the major scores (FPC1) of the bow velocity with respect
to those of anatomic angles, which were signicantly dierent between the postural conditions (
R2=0.90∗∗
,
R2
adjusted
=0.77
∗∗
).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
7
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
obtained with the amount of temporal energy (Rms). ese results suggest that the major functional coordina-
tion unit essentially captured the temporal variations of the sound shape responsible for harshness perception,
independent of its purely spectral aspects.
Minor mode of variations. As observed in Fig.4, the second (or minor) functional unit corresponds to
local variations of data amplitudes at the dierent stages of the sound-gesture chain. At the physical stage, which
reects the “eective” sound-producing gesture (cf Fig.4c), the bow velocity decreased faster in the constrained
condition than in the normal postural condition (Bowvel:
t(7)=4.37∗∗
).
At the postural stage (cf Fig.4a), which reects the ancillary gestures, this bowing deceleration appeared to be
associated with a loss of natural bouncing between the chest torsion (
ψ12
:
t(7)=8.80∗∗∗
) and the head torsion
(
ψ3
:
t(7)=−2.35
). e analyses of the normal condition in the graph actually revealed surprising symmetrical
delays, chest torsion bouncing to the le and head torsion to the right, while these tendencies were lost in the
constrained condition. In accordance with Hoppenot25, we suggest that such a grounded tendency characterized
Figure4. Minor mode of the cellists’ functional variations. is mode explained 25% of the variance contained
in the kinematic data—(a) postural, (b) instrumental, (c) physical—and 15% of the variance contained in the
(d) acoustic data. At each stage of this functional unit, the eect of the minor mode is visualized as functional
deviations of the average time series between the normal situation (curves of blue circles) and the constrained
situation (curves of red crosses). e attached boxplots present the distribution of FPC2 scores, i.e. the way
each individual curve contributed to the minor mode, for each variable that signicantly discriminated the
postural conditions. Normal and constrained functional components were added or subtracted to or from the
mean curve, according to the mean sign of the FPC2 scores in each postural condition. e bottom right panel
(e) shows the graph obtained by linear regression of the minor scores (FPC2) of the bow velocity with respect
to those of anatomic angles, which were signicantly dierent between the postural conditions (
R2=0.91
,
R2
adjusted
=0.73
).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
8
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
the need for a phase of active postural resistance to the bow pulling expansions to ensure optimal bow accel-
erations. is eect could also be observed in the lateral swings of the head (
φ3
:
t(7)=−2.36
) whose natural
right-and-le bouncing disappeared in the constrained condition. Another interesting minor eect concerned
the decrease in amplitude of the naturally vertical down-to-up inclinations of the chest (
θ2
:
t(7)=−3.09
) along
the bow-pulling movements.
At the instrumental stage (cf Fig.4b), which reects the interaction between eective and ancillary gestures,
the lack of an active resistance phase to the bow expansion was evidenced by the behavior of shoulder articula-
tion through the loss of upper arm abduction (
θ4
:
t(7)=3.39
) during the beginning of the movement. e
dierence in external rotation was also very interesting (
ψ4
:
t(7)=−2.83
) because it highlights the role of the
shoulder in providing natural support that ensured the projection of the whole right arm. Actually, the amount
of external rotation remained quite constant along a natural bow-pulling movement, whereas it drastically
decreased in the constrained condition. It could also be observed that this naturally sustained external rotation
guaranteed a reinforcement of the forearm pronation along the movement (
ψ56
:
t(7)=−2.05
), whereas in the
constrained condition, a forearm supination appeared as soon as the upper arm switched in internal rotation.
Importantly, the minor mode of variations also revealed a strong dierence in elbow exion/extension between
the two conditions (
φ5
:
t(7)=3.54∗∗
). In the normal condition, the elbow remained slightly bent during the
phase of active resistance before it considerably stretched out during the phase of bow expansion. By contrast,
in the constrained condition, the elbow increasingly exed and locked the whole arm movement. is elbow-
locking eect was also reected by two losses of mobility at the wrist level: the exion-to-extension progression
(
φ6
:
t(7)=3.48
) and the ulnar-to-radial inclination (
θ6
:
t(7)=2.38
).
As for the major mode, the results from multivariate regression on the minor FPC scores of these anatomic
angles were signicant (
R2=0.91
,
R2
adjusted =
0.73
, cf regression graph of Fig.4e). It was therefore possible to
infer a linear relationship predicting the local bow velocity amplitudes, or bow accelerations, based on the set
of anatomic angles selected by the second functional unit. More importantly, an additional stepwise regression
extracted a combination of two angular degrees of freedom that explained the local variations of bow velocity:
is simple predictive relation highlights a minor mechanism of the cellist’s coordination, in which the coupling
between the vertical inclination of the chest (ancillary gesture) and the extension of the right wrist (instrumen-
tal gesture) ensured suitable bow accelerations. More details concerning this minor coordination mode (or
eigenposture) could be obtained by computing correlations between the FPC scores. Interestingly, the results
conrmed the importance of the vertical inclination of the chest (
rBowvel
θ2
=−0.58
) and of the extension of
the wrist (
rBowvel
φ6
=0.73
∗∗
) during bow accelerations. e scores of elbow extension were also marginally cor-
related to those of the bow accelerations (
rBowvel
φ5
=
0.47
,
p=0.063
). Further cross-correlations of minor angle
scores revealed a chain of four coupling systems, which characterized the coordination transfer within the
minor mode: (1) system {
θ2|ψ12|ψ3|φ3
} showed the postural coupling among the chest torsion and vertical
inclination (
rψ
12
θ2
=−0.51
), the bouncing symmetry of chest/head torsions (
rψ
3
ψ12
=−0.56
), and the strong
dependence between head torsions and lateral swings (
rφ
3
ψ3
=0.90
∗∗∗
); (2) system {
ψ3|φ3|θ4|ψ4|ψ56
} showed the
importance of the degrees of freedom of the head, especially of the head torsion, to activate the external rotation
of the arm (
rψ
4
ψ3
=−0.71
∗∗
) and that of the coupling between this external rotation and the forearm pronation
(
rψ
56
ψ4
=0.52
); (3) system {
ψ12|ψ3|φ3|θ6
} showed the indirect inuence of many postural angles, especially
the angles linked to head torsion and lateral swing on the wrist inclination (
rθ
6
ψ3
=−0.64
∗∗
and
rθ
6
φ3
=−0.66
∗∗
respectively); and (4) system {
φ5|φ6
} showed that the wrist extension was conditioned by the elbow extension
(
rφ
6
φ5
=0.71
∗∗
). ese results conrmed the importance of the double phase of postural resistance/expansion
along the movement for ensuring optimal bow pulling accelerations.
From the acoustical point of view (cf Fig.4d), the minor mode revealed that the same acoustic descriptors
as in the major mode with an additional fourth descriptor, the Mfccratio, were signicantly aected by the con-
strained condition. e analyses in the graph revealed an inability to maintain the acoustic signal energy during
the entire movement in the constrained condition. is eect was noticeable both in the temporal domain and in
spectral domains (Rms:
t(7)=2.08
, Triratio:
t(7)=−2.45
, respectively). In particular, the Mfccratio revealed
an excessive amount of high-frequency spectral energy at the beginning of the sound that corresponded to the
emergence of a formantic area (Mfccratio:
t(7)=−2.04
). More details concerning the minor acoustic mode (or
eigensonicform) could be obtained by computing correlations between the PC scores. Surprisingly, the results
revealed that the amount of high-frequency spectral energy was the main descriptor impacted by local changes in
bow velocity (
rBowvel
Triratio
=−0.58
). More trivially, the cross-correlations of minor acoustic scores revealed a strong
collinearity between the amounts of spectral energy (
rHsc
Triratio =
0.88
∗∗∗
) and formantic energy (
rMfccratio
Triratio
=0.60
).
No signicant cross-correlations were obtained with the amount of temporal energy (Rms). Complementary to
the major mode, these results suggested that the minor functional coordination unit had essentially captured the
variations in the spectral shape of the sound responsible for harshness perception (independent of its temporal
aspects).
Discussion
In summary, our functional analyses revealed that two primary postural directions are involved in the sound
quality produced by highly skilled cellists: rst, a major mechanism controlling bowing velocity (cf Eq.1) linked
to the evolution of the temporal shape of the sound and, second, a minor mechanism controlling bowing accel-
eration (cf Eq.2) linked to the evolution of the spectral content of the sound. ese results are consistent with
the physics of the instrument and the pioneering acoustic studies based on bowing machines. First, the bow
velocity should be correlated to the amount of transmitted vibrations to the surrounding air by the body of
(2)
Bowvel =0.41 ×θ2+0.64 ×φ6
Content courtesy of Springer Nature, terms of use apply. Rights reserved
9
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
the cello and thus determine the energy level or intensity of the acoustic signal. Actually, harsh sounds cor-
respond to global decreases in bow velocity and weaker temporal proles of acoustic energy (cf major mode of
Fig.3c,d). Second, the bow acceleration should be correlated to the amount of high-frequency energy and thus
determine the quenching rates of upper partials in the spectrum89. Harsh sounds actually correspond to global
bow decelerations and higher quenching rates of spectral energy for upper partials (cf minor mode of Fig.4c,d).
Among the set of acoustic descriptors that characterize perceived harshness, harmonic asynchrony remains only
poorly explained by kinematic bowing analyses. is indicator of spectral uctuations might be inuenced more
strongly by the strict bow/string adherence nely tuned by the bow force parameter90. As a perspective, it may
thus be interesting to reiterate the same kind of functional analyses with dynamic features, i.e., the prediction
of variations in bow force from the muscular eorts estimated for each cellists body segment. Nevertheless, the
bow/string adherence quality involved in the perceived sound density depends on the bow velocity50, which was
insucient in this study when the right arm remained locked in a position of excessive supination and internal
rotation.
From our coordination study, such a tighter instrumental bowing gesture would be caused by inadequate
combinations of postural variables, particularly the loss of a symmetric combination between chest and head
torsion movements. e freedom of the head movement was particularly important to balance the chest tor-
sion with the external rotation of the right arm involved in both kinetic functionalities of the bowing (velocity
and acceleration). ese results are consistent with previous studies on cellists’ right arm behaviors, especially
the role of shoulder mobility during musical playing on the A string91,92. Furthermore, our ndings emerged
from large bow pulling gestures on one note, for which the impaired cellists could not compensate as simply as
elsewhere in the score. As the chest and head constraints aected the cellists’ sound quality on other notes to a
lesser extent, the execution of this particular note would stand for a limit in terms of postural adaptation, which
clearly depends on the score structure and not only on the ergonomics of the instrument. By generalizing to the
whole score, we suggest that this salient local eect of recurrent sound degradation highlights a more generic
deciency of cellists’ postural control, also called posturo-kinetic capacity12 in movement science. Even though
its variations may remain subtle, such a capacity would guarantee body stability during any goal-directed action,
such as bowing on one or several notes. Actually, the postural deviations of our highly skilled cellists were no
more than 5 degrees from the mean value in the major mode (cf Fig.3a), but this was enough to globally inu-
ence the quality of their auditory-motor interactions. is postural capacity is also highlighted through a double
phase of postural resistance/mobility to bow expansion in the minor mode (cf Fig.4a), which resulted in spectral
alterations in the sound when the musicians were posturally impaired. e constraints thus revealed the cel-
lists’ primary postural directions by disembodiment8, which supports the idea that the musicians’ structural and
expressive concepts are grounded in their sensorimotor networks.
e correlations established between the cellists’ movements and their sound quality features also provide
knowledge on their theoretical physiological principles49,93. Actually, our results suggest that the cellists’ bow-
ing actions would be more eective if organized in terms of “distal events”94,95, i.e., when their attention is not
centered on the movement itself but more on its potential inuence on the sound quality. Here, we suppose that
the postural impairment considerably disrupted the musicians’ natural sensations, i.e., the external focus of
attention needed to correctly perform an expressive musical task (professional cellists oen talk about “playing
without thinking”). As such, the context of this experiment may be considered a relevant “constrained action
hypothesis”96,97 for reinforcing the concept of supra-postural activity98,99: the quality and eciency of a task
would depend on this supra-postural control, i.e., the way individual body movements are subsumed into a
unied Gestalt for achieving the given goal. Interestingly, two of the seven cellists in our experiment stated that
they became more aware of their belly respiration insituations of postural impairment. In our opinion, these
remarks indicate that before being impaired, both respiratory and postural control were naturally piloted by an
external focus, i.e., by supra-postural commands of their attention. e constraint forced the cellists to adopt an
internal focus and to compensate by more conscious control of their movements. We hereby consider that these
scientic deductions give strong support to the concept of primary postural control, which was postulated as part
of the Alexander technique100, not only in the context of instrumentalists but also for any goal-directed actions
requiring a strong supra-postural activity. By encouraging performers to focus on the results of the actions rather
than on the actions themselves, the motor system could be trained in a more embodied and self-organized way
for natural and ecient performances.
ese ndings clearly suggest important applications for improving and optimizing practice habits among
musicians. is subject is a hot topic in research areas that assess the risk of musculoskeletal disorders among
musicians and search for strategies to promote health or reduce injury26,101,102. Feedback analyses of students
in higher music education institutions especially revealed the upper limb, upper trunk, and neck as the main
body parts aected by muscle pain syndromes102104. e population of bowed-string players would also be more
aected by these postural disorders because of the asymmetric arm positions related to the trunk105,106. Such
results are clearly compliant with those of our study and reinforce the importance of integrating musicians’ pri-
mary postural control within individual rehabilitation programs. e magnitude of the cellists’ spinal curvatures
that we highlighted in relation to their sound quality may particularly help in developing strengthening-exibility
exercises targeting the trunk muscles of bowed-string players. As a whole, we think that the constrained condition
of our experiment altered the natural musicians’ action/perception cycle in a way that could be referred to as a
“phenomenological experience on non-sense”107. If cognition is our way of dealing with non-sense experiences,
then the tools established to reeducate the musicians’ proprioceptive feedback should authorize such an experi-
ence on nondoing or nonactivity consciousness, also known as inhibition in the Alexander technique29. We hereby
support the idea that the quality disruptions occurring in a musical discourse nd their origin in a faulty postural
awareness100, and may be solved by rening the musicians’ global perception of somatosensory processing.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
10
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
e ndings presented in this paper may also have a strong impact in other areas related to expert perfor-
mance, especially due to the statistical framework that we established. Sports biomechanics is one example of
a domain where body posture, dynamic somatic practice, and motor control need to remain inherently and
strongly connected to ensure the eciency of a given action66,76,77,108. For example, research on human-material
interfaces demonstrated that tennis players or runners need to nely tune the shock vibrations induced by the
racket or the ground surface109111. In that context, functional data analyses may provide an opportunity to infer
continuous patterns of adaptation between the eector limb (hand or foot) and the entire body of these athletes.
By extension, such analyses could also highlight a functional interdependence between the sound produced in
reaction to the impact (with a racket/ground surface) and the biomechanical propagation of shock-induced
vibrations. Such examples suggest that our statistical framework may be suitable for analyzing the sound-gesture
relationships in a reverse way, i.e., assessing the role of auditory information on perceptual-motor processes. In
recent years, many studies have highlighted the benets of gestural sonication5,112115, especially in the domains
of sports performance and motor rehabilitation116,117. For example, sonication eciently reduced the vari-
ability of golf swing gestures in novices118,119, or improved the pedal force eectiveness among cyclists120. e
benecial eects of sonication in reeducating patients with severe gait dysfunctions, such as Parkinsons disease
patients, by rhythmic auditory cueing2123,121, or neuromotor decits related to the uency of handwriting, such as
dysgraphia122126, were also well recognized. In the same way, we suppose that such continuous auditory feedback
may help musicians and dancers improve or recover their body awareness, for example, through experiments of
sound tracing and motor mimicry, which are already known to stimulate covert mental images associated with
musical experience58,81,127,128.
Conclusion
In this paper, we assessed how postural impairments of highly skilled musicians aected their perceived sound
quality. rough functional analyses of cellists’ kinematic and acoustic interactions, it could be demonstrated
that feedforward deciencies of the primary postural command locally altered the quality of their musical
expression. Such ndings suggest that musical teaching should, to a much greater extent, consider the student?s
body as a global exible and proactive structure rather than focusing on specialized cognitive patterns that break
the sensorimotor processes into rigid units. is conclusion is consistent with embodied learning frameworks,
especially the Alexander technique, that correlate optimal body usage to proper directions of the spinal structure
and ne balance mechanisms between the head, neck, and trunk. It should therefore be possible to inuence
expressive perceptual processes and thus shape the musical mind by developing a kinesthetic awareness of the
sensory-motor relationships, i.e., integrating the sensations of joint mobility, muscular stability, and posture as
a whole. If such indirect procedures would contribute to reinforcing musculoskeletal health and the quality of
the performance in the musical domain, they may also be applied in a reverse way for learning dance and sport
skills or for patients in clinical rehabilitation by means of experimental manipulations of auditory feedback.
As a promising perspective of this study, we started to develop a complementary approach for assessing
the eects of harsh timbre degradation on cellists’ motor behavior. By means of our statistical framework of
functional analyses, we expect to close the perceptual loop that links cellists’ timbre quality to their postural
control. e methodological aspects of such a work are based on the use of an electric silent cello and the setup
of a multimodal platform combining a motion capture system and spatial rendering to study sound/gesture
interactions. We think that augmenting the perceptual information, especially through ne sound synthesis
techniques applied to gestural sonication, might provide a suitable means to strengthen the understanding of
the body schema related to cognitive interpretation and physical expression of structures within music or dance
performance. Such an approach has the potential to guide research on the design of skill training or rehabilita-
tion scenarios in the context of real-world applications, and it is particularly well-suited for (but not limited to)
musicians and dancers.
Methods
Participants. Seven highly skilled cellists (males = 4; females = 3; mean age =
40.5 ±11.1
) were recruited
on a voluntary basis from the Music Conservatory and the Opera of Marseille to participate in a 3-h experiment
that, as they were told, consisted of ‘ “exploring cellists’ sound/gesture relationships”. Before the experiment, each
musician signed a consent form that advised them of the precise the nature of the postural conditions and in
which they agreed to the publication of the information/image(s) collected during the experiment in an online
open-access publication. e musicians were also given an honorarium for their participation. All the proce-
dures of the protocol were approved by a local ethics board at the ISM-Aix-Marseille University and were carried
out according to the relevant guidelines expressed in the 1964 Declaration of Helsinki.
Design and apparatus. e design of our experiment was based on four postural conditions of gradual
diculty129. For each condition, the cellists were asked to play a score composed of dierent technical patterns
as expressively as possible. e full score was executed three times by postural condition, according to two tempi
[45/70 bpm] and bowing modes [detached/legato]. e postural conditions and repetitions of factor combina-
tions were randomly presented to each participant. At the end of each postural session, we collected the par-
ticipants’ impressions regarding their diculties in terms of motion and sound production by means of a short
questionnaire. In this paper, we focus on the two extreme experimental conditions (cf Fig.1): the natural perfor-
mance (entitled [N]: Normal) and the fully constrained condition (entitled [SCH]: Static Chest and Head). is
fully constrained condition consisted of impairing the cellists by two immobilization devices that reduced their
primary postural control in a noninvasive way: a six-point safety race harness that restrained the torso displace-
Content courtesy of Springer Nature, terms of use apply. Rights reserved
11
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
ments and an adjusted neck collar that limited the freedom of head movements. We installed this equipment on
the musicians so that their shoulder mobility was not aected.
e cellists’ movements were recorded by an infrared motion capture system (Vicon 8, fps=125 Hz) that
tracked the three-dimensional positions of the reective markers positioned on the performer’s body and the
instrument. We followed the anatomical “Plug-in-Gait” (Vicon Motion Systems. Plug-in-Gait product guide.
Oxford: Vicon Motion Systems, 2010, https ://www.c-m otio n.com/downl oad/IORGa itFil es/p igma nualv er1.pdf)
standard to distribute the marker locations on the instrumentalist’s body. For this study, we focused the kinematic
analyses on a subset of seven key markers covering the cellists’ postural chain (torso/head) and the instrumental
chain responsible for the bowing gestures produced by the right arm. Some of these markers were virtually com-
puted from the Plug-in-Gait anatomical landmarks located on each segment, in accordance with the Dempster
model convention130 (cf Supplementary Table1). e acoustic signals produced by the instrument were recorded
by a DPA 4096 microphone placed under the cello bridge and connected to a MOTU interface (Ultralite MIC3,
fps = 44.1 kHz). Both recording systems were synchronized by a manual clap.
Stimuli and procedure. e stimuli were extracted from the cellists’ post-experimental feedback, which
identied a part of the performed score as frequently degraded in the constrained postural situation. Actually,
several notes belonging to this passage sounded harsher and shriller in agreement with the cellists’ comments
regarding their performance, in particular, their impression of producing “tighter and tenser sounds”, or “sounds
lacking depth and natural resonance”. Such harshness phenomena (i.e., degraded, metallic sound color) occurred
during the execution of quick syncopated patterns requiring excellent synchronization between the two arms
and were quite consistent among cellists on the rst note of the sequence (cf Fig.1). is dotted sixteenth of pitch
E4 is a key note that provides the motion impulse to the musical phrase through a large bow-pulling gesture
on the rst (A) cello string. Spectrogram analyses of this note between the normal and constrained postural
situations revealed salient signal dierences, which were thoroughly explored and connected to the musicians’
perception in a previous work48. We assessed the qualitative harshness phenomenon judgments according to
esthetic criteria of classical music by means of perceptual tests administered to a population of 15 trained cel-
lists, both teachers and advanced students. None of these cellists had participated in the experiment and had no
knowledge of the constrained postural conditions.
For this paper, we used the same corpus as in our previous work, which was built from perceptual evaluations
of harshness between the normal and constrained performances of the seven cellists. is corpus was composed
of the eight most salient pairs of round/harsh (good/poor quality) sounds of the E4 note, extracted from the
cellists’ performances in the normal and constrained contexts (mean note duration =
310 ±60
ms
[N/SCH]).
Each round[N]/harsh[SCH] note pair belonged to a given cellist performing in slow tempo (45 bpm) and legato
bowing mode. e pairs of samples also belonged to dierent cellists and could thus be considered independent.
Motion analyses. Motion analyses were based on the anatomic displacements of the cellists’ joints associ-
ated with each sound of the corpus and on their bow velocity over time. To assess ne coordination features, we
designed a kinematic model describing the temporal evolution of these body joints (cf Fig.2a). e model was
composed of a linkage of six main rotary joints (cf Table1) articulating seven segments related to the body trunk
and the right arm (pelvis, abdomen, chest, head, upper arm, forearm, hand). Each corporeal segment was
assumed to be a rigid link, and the six articulations were approximated from the skeleton geometry as spherical
joints of three-dimensional degrees of freedom (DOFs)131,132. We computed 18 DOFs (6 joints
×
3 angles) as
joint-related triplets of anatomic angles {
ψn,θn,φn
},
n∈[1...6]
(cf Table1) by performing Cardan/Euler con-
versions of their segment-related marker coordinates132,133. For each joint, the method consisted of computing
the way the distal segment of the join was spatially rotated with respect to its proximal segment (cf Supplemen-
tary Figure1). In geometric terms, this approach merely dened a rotation matrix between two bases {
ip,
jp,
k
p
}
and {
id,
jd,
k
d
} attached to the joint proximal and distal segments, respectively (cf Supplementary Table2). Such
a matrix represents a succession of three rotations needed to transform a joint proximal basis into its relative
distal basis: rst rotation around X by an angle
ψ
(roll), second rotation around Y by an angle
θ
(pitch), and third
rotation around Z by an angle
φ
(yaw). As six rotation matrices should be computed to model all the DOFs, we
iterated the process along the six reference body hinges of the cellists’ motor chain. In addition to these joint
single-axis rotations, we also dened two composite angles for characterizing the global torso rotation (
ψ12
) and
the global forearm pronation/supination (
ψ56
). Note that angle
θ5
was removed because of the redundancy with
the external/internal rotation of the shoulder (
ψ4
); most biomechanics literature actually expresses the elbow
joint by only two DOFs: exion/extension (
φ5
) and pronation/supination (
ψ5
)134. At the end of this chain of
anatomic angles, the bow velocity was computed as the velocity vector norms of the bow “frog” marker (cf Sup-
plementary Table1) along the duration of each note composing the corpus:
Bowvel
=
(v2
x+v2
y+v2
z
)
, where
the triplet (
vx,vy,vz
) refers to the derivatives of the spatial coordinates of the bow frog at a given time.
Acoustic analyses. Acoustic analyses were based on the computation of ve acoustic descriptors over time
(cf Table2), which had been determined to be signicant in our previous work48 for discriminating between
round and harsh cello sounds. e extraction process for note E4 relied on a pitch-tracking algorithm adapted
from the MIR toolbox (Music Information Retrieval)135 of MATLAB soware. We developed a dedicated work-
ow in MATLAB to compute the ve acoustic descriptors over time by following the MPEG-7 standards136:
HSV (Harmonic Spectral Variations) relates to the sound spectral ux as a time-varying spectral content of its
harmonic components83; it was obtained from the spectral variation of harmonic amplitudes between adjacent
temporal frames. ATS (Attack Time Slope) corresponds to the attack time slope of the sound signal; it was deter-
Content courtesy of Springer Nature, terms of use apply. Rights reserved
12
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
mined from the logarithmic rise time of the signal energy during the attack phase. MFCCratio is a ratio between
the two rst MFCCs (Mel-Frequency Cepstral Coecients)85, which we designed to highlight specic variations
of the sound spectral envelope in a perceptual way; the coecients were classically obtained through a DCT
(Discrete Cosine Transform) applied to the logarithmic spectral envelope. SC (Spectral Centroid) corresponds
to an amplitude-weighted mean of the harmonic spectral peaks; it was obtained through a decomposition in
subbands centered on the signal harmonics137. TRIratio describes the spectral energy distribution in three fre-
quency bands as an energy ratio between each band and the total number of harmonics. e rst band contains
the fundamental frequency, the second band contains the medium partials (two, three, four) and the last band
contains the higher partials (ve and more). e three tristimulus coordinates were obtained by spectral centroid
computations for each band87.
Statistical framework. Our statistical framework was designed with the aim of carrying out functional
comparisons of the cellists’ sound-gesture interactions between the normal and constrained conditions. is
process can be divided into ve steps, which are described below by referring to the schema components of
Fig.2b. All the calculations were performed with the help of MATLAB soware and the FDA toolbox138.
Functional data analyses (FDA). In contrast with the classic PCA approach, functional data analysis considers
the entire sequence of measurements a function or a single entity rather than a series of individual data points76.
To represent our motion features (anatomic angles, bow velocity) and acoustic descriptors as time-varying func-
tions, the FDA methodology consisted of decomposing each time-series of variables as a linear combination
of B-spline basis functions. We chose an equally spaced 6-order B-spline basis because it was better suited for
numerical calculations than polynomials that are less stable. Furthermore, B-spline functions were very useful
for smoothing acoustic data of noisier natures than kinematic data while eciently accommodating changes in
local behavior. A semi-sampled spline basis was sucient to keep a ne-grained denition of each curve. e
B-spline mathematical decomposition is also required to align the
n=16
time series (eight {normal/constraint}
data pairs) of motion and acoustic descriptors to the duration of the longest series beforehand. is duration was
normalized between 0 and 1 to be consistent with the FDA time-warping mechanism.
Functional principal component analyses (FPCA). FPCA was carried out based on the spline-based representa-
tion of time-point data. is technique has the major advantage of producing functional principal components
that can be interpreted in the same domain as the original observations (kinematic and acoustic). Actually, this
technique models each descriptor time-series
fi
as a linear combination of weighted deviations from its mean
dataset f
i
(t
)
:
where
ξk(t)
are the functional principal components (FPCs), also called eigenfunctions, that captured the K rst
main hidden modes of variations. e coecients
cik
correspond to score projections as in classical PCA but
assess the extent to which the shape of each individual behavior
fi
of the dataset matches with the global mean
trend
fi
(
t)
.
ǫi
is the prediction error between the observations
fi(t)
and their model as a sum of projections on
the K principal modes.
In this study, for each kinematic or acoustic descriptor, we performed an FPCA on the set of its spline-
based time-series
fi(t),i∈[1, 16]
, without considering, for the moment, a separation between the normal and
constrained conditions. e acoustic descriptors were processed by adding a small amount of smoothing to
the B-spline model to more easily capture the main variation trends while avoiding distortion of the data. e
deviation patterns obtained by FPCA, especially those related to the acoustic descriptors, took into account
this compromise between data smoothness and the largest proportion of explained variance. According to the
statistics literature68,70, FPCA should be interpreted through graphs that present the ensemble mean curve of
the original observations (
fi
(
t)
) and the functions obtained by adding or subtracting a suitable multiple of each
FPC (
ξk(t)
) to or from this mean. Generally, this multiple corresponds to the percentage p of explained variance,
which can be written in this way:
fi
(
t
)±
p
×ξ
k
(
t)
. We followed this methodology in the paper to explain the
K=2
main modes of variation resulting from our analyses through two gures describing their detailed eects
on both motion and acoustic sides (cf Figs.3 and 4). In these graphs, the decision to add or subtract a functional
component to the mean curve was made according to the mean sign of the FPC scores of each postural condition.
Statistical comparisons of the functional principal components (FPCs). e functional principal component
scores returned by the FPCA could be used to compare the behavior of each kinematic or acoustic variable
between the two postural conditions. We carried out these comparisons by means of two-tailed paired Students
t-tests on the eight normal (N) and constrained (SCH) score samples of each variable. e eects were consid-
ered signicant for p-values equal to or less than .05, and the proportion of signicance was indicated by a num-
ber of stars related to p-values:
p<0.05,p<0.01∗∗,p<0.001∗∗∗
. For the rst functional behavior (referred
to as major mode), we retained the FPC scores that signicantly and directly separated the postural conditions.
For the secondary functional behavior (referred to as minor mode), we performed a Varimax rotation of the PCA
structure for prior insignicant score discrimination and retained the rotated scores if their t-test comparisons
highlighted signicant postural dierences. Varimax rotation is a procedure of variance distribution and rep-
resents a convenient way to focus on the structure of the second variation mode to facilitate interpretation. As
a consequence of this process, the eigenfunctions capturing the rst and second behavioral dierences may not
(3)
fi(t)=fi(t)+
K
k=1
cikξk(t)+ǫi,cik =ξk(t)fi(t)
dt
Content courtesy of Springer Nature, terms of use apply. Rights reserved
13
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
be perfectly orthogonal. In practice, however, the functional units related to each of the two motor behaviors
enabled clearly distinct interpretations.
Functional principal component regressions (FPCR). When the FPC scores of an analysis variable could be sig-
nicantly discriminated between the two postural conditions, we needed to conduct further analyses to compute
the functional principal components corresponding to each intergroup variation (i.e., normal and constrained).
Actually, the eigenfunctions returned by FPCA did not integrate the criteria for separating the postural condi-
tions. Such a problem could be resolved by applying an inverse methodology of functional principal component
regression (FPCR). is technique also allowed us to rebuild the original set of curves from the scores computed
by FPCA and nally assess the tting accuracy of our model68,74. Starting from a design matrix Z of the signicant
PC scores, FPCR determines K regression functions
βk
to t at best the shape of the time series
fi(t),i∈[1, 16]
:
where the function
β0
corresponds to the mean curve of the time series, and
βk
,
k∈[
1,
K]
stands for unbundled
eigenfunctions (
ξN
k
and
ξSCH
k
), which could not be dierentiated in the FPCA context (cf Eq.3). e score matrix
Z enabled such separation between the two postural conditions [N/SCH] by dividing each group of eight
zik
scores into
K=2
columns.
Multiple regressions and correlations of FPC scores. Standard statistical techniques were used to highlight the
main functional units shared by the cellists between the normal and constrained conditions. We determined
how their motor coordination inuenced the variations in bow velocity by carrying out two multivariate linear
regressions, one for each functional principal component. In this design, the signicant FPC scores of anatomic
angles were considered predictors of the bow velocity FPC scores. is approach resulted in two models of
functional motor units, which are presented in the bottom right part of Figs.3e and 4e. Each model is also char-
acterized by a linear relationship (cf Eqs.1 and 2) between the most signicant anatomic variables involved in
the coordination chain.
Two kinds of correlation analyses were nally performed in both motion and acoustic domains. First, we
extracted the important joint coupling chains of motor coordination by means of crossed correlations between
the signicant anatomic FPC scores. Second, we assessed functional sound-gesture interactions by computing
standard Pearson correlations between the FPC scores of bow velocity and those of each acoustic descriptor. e
most relevant correlations of these analyses provided a better understanding of how cellists’ motor programs
inuence their functional sound features in subtle ways.
Data availability
e datasets generated and analyzed during the current study are available from the corresponding author on
reasonable request.
Received: 10 December 2019; Accepted: 27 July 2020
References
1. Maes, P.-J., Wanderley, M. M. & Palmer, C. e role of working memory in the temporal control of discrete and continuous
movements. Exp. Brain Res. 233, 263–273 (2015).
2 . Dalla Bella, S. & Palmer, C. Rate eects on timing, key velocity, and nger kinematics in piano performance. PLoS ONE 6, e20518
(2011).
3. Dotov, D.G., Nie, L. & DeWit, M.M. Understanding aordances: History and contemporary development of gibson’s central
concept. Avant J. Philos. Interdiscip. Vanguard (2012).
4. Rizzolatti, G. & Craighero, L. e mirror-neuron system. Annu. Rev. Neurosci. 27, 169–192 (2004).
5. Zatorre, R. J., Chen, J. L. & Penhune, V. B. When the brain plays music: Auditory-motor interactions in music perception and
production. Nat. Rev. Neurosci. 8, 547–558 (2007).
6. Wollman, I., Penhune, V., Segado, M., Carpentier, T. & Zatorre, R. J. Neural network retuning and neural predictors of learning
success associated with cello training. Proc. Natl. Acad. Sci. 115, E6056–E6064 (2018).
7. Leman, M. Musical gestures and embodied cognition. In Journées d’informatique musicale (JIM-2012), 5–7 (2012).
8. Leman, M. e role of embodiment in the perception of music. Empir. Musicol. Rev. 9, 236–246 (2014).
9. Wojtara, T., Alnajjar, F., Shimoda, S. & Kimura, H. Muscle synergy stability and human balance maintenance. J. Neuroeng.
Rehabil. 11, 129 (2014).
10. Belenkii, V., Gurnkel, V. & Pal’tsev, E. On elements of voluntary movement control. Biozika 12, 135–141 (1967).
11. Gahery, Y. & Massion, J. Coordination between posture and movement. Motor Syst. Neurobiol. 4, 199–202 (1981).
12. Bouisset, S. & Zattara, M. Biomechanical study of the programming of anticipatory postural adjustments associated with vol-
untary movement. J. Biomech. 20, 735–742 (1987).
13. Bernstein, N.A. e Coordination and Regulation of Movements ((American translation 1967), Pergamon Press Ltd., 1935).
14. Berthoz, A. Le sens du mouvement (Odile Jacob, 1997).
(4)
fi(t)=Zβ(t)+ǫi=β0(t)+
K
k=1
zikβk(t)+ǫi
=β0(t)+
K
k=1
zN
ik βN
k(t)+
K
k=1
zSCH
ik βSCH
k(t)+ǫ
i
=fi(t)+
K
k=1
cN
ik ξN
k(t)+
K
k=1
cSCH
ik ξSCH
k(t)+ǫi
Content courtesy of Springer Nature, terms of use apply. Rights reserved
14
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
15. Klapp, S. T. & Jagacinski, R. J. Gestalt principles in the control of motor action. Psychol. Bull. 137, 443 (2011).
16. Burger, B., ompson, M. R., Luck, G., Saarikallio, S. & Toiviainen, P. Inuences of rhythm-and timbre-related musical features
on characteristics of music-induced movement. Front. Psychol. 4, 1–10 (2013).
17. Toiviainen, P., Luck, G. & ompson, M. R. Embodied meter: Hierarchical eigenmodes in music-induced movement. Music
Percept. Interdiscip. J. 28, 59–70 (2010).
18 . Naveda, L. etal. Methods for the analysis of rhythmic and metrical responses to music in free movement trajectories. In Proceed-
ings of the 11th International Symposium on Computer Music Multidisciplinary Research (CMMR), 248–262 (2015).
19. Ripollés, P. et al. Music supported therapy promotes motor plasticity in individuals with chronic stroke. Brain Imaging Behav.
10, 1289–1307 (2016).
20. aut, M.H. e discovery of human auditory–motor entrainment and its role in the development of neurologic music therapy.
In Progress in brain research, Vol. 217, 253–266 (Elsevier, Amsterdam, 2015).
21. Schiavio, A. & Altenmüller, E. Exploring music-based rehabilitation for parkinsonism through embodied cognitive science.
Front. Neurol. 6, 217 (2015).
22. Dotov, D. et al. Biologically-variable rhythmic auditory cues are superior to isochronous cues in fostering natural gait variability
in Parkinsons disease. Gait Posture 51, 64–69 (2017).
23. Dalla Bella, S., Dotov, D., Bardy, B. & de Cock, V. C. Individualization of music-based rhythmic auditory cueing in Parkinson’s
disease. Ann. N. Y. Acad. Sci. 1423, 308–317 (2018).
24. Ghazali, G. M. & Alam, S. In the Minds of Children: Understanding Motivation to Learn Music (2005).
25. Hoppenot, D. Le violon intérieur (Van de Velde, Brussels, 1981).
26. Blanco-Piñeiro, P., Díaz-Pereira, M. P. & Martínez, A. Musicians, postural quality and musculoskeletal health: A literatures
review. J. Bodywork Mov. er. 21, 157–172 (2017).
27. Alexander, F. M. e Use of the Self: Its Conscious Direction in Relation to Diagnosis, Functionning, and the Control of Reaction
(Integral Press, New York, 1955).
28. Hillier, S. & Worley, A. e eectiveness of the feldenkrais method: A systematic review of the evidence. Evid. Based Comple-
ment. Altern. Med. 2015, (2015).
29. DeAlcantara, P. Technique Alexander pour les musiciens (Editions AleXitère, 2000).
30. Schelleng, J. C. e bowed string and the player. J. Acoust. Soc. Am. 53, 26–41 (1973).
31. Askenfelt, A. Measurement of bow motion and bow force in violin playing. J. Acoust. Soc. Am. 80, 1007 (1986).
32. Guettler, K. & Askenfelt, A. Acceptance limits for the duration of pre-helmholtz transients in bowed string attacks. J. Acoust.
Soc. Am. 101, 2903–2913 (1997).
33. Woodhouse, J. & Galluzzo, P. e bowed string as we know it today. Acta Acustica United with Acustica 90, 579–589 (2004).
34. Demoucron, M. & Caussé, R. Sound synthesis of bowed string instruments using a gesture based control of a physical model.
Int. Symp. Musical Acoust. 1–1, (2007).
35 . Schoonderwaldt, E. e violinist’s sound palette: Spectral centroid, pitch attening and anomalous low frequencies. Acta Acu stica
united with acustica 95, 901–914 (2009).
36. Pérez Carrillo, A., Bonada, J., Maestre, E., Guaus, E. & Blaauw, M. Performance control driven violin timbre model based on
neural networks. IEEE Trans. Audio Speech. Lang. Process. 20, 1007–1021 (2012).
37. Fritz, C., Blackwell, A. F., Cross, I., Woodhouse, J. & Moore, B. C. Exploring violin sound quality: Investigating English timbre
descriptors and correlating resynthesized acoustical modications with perceptual properties. J. Acoust. Soc. Am. 131, 783–794
(2012).
38. Wollman, I., Fritz, C. & Poitevineau, J. Inuence of vibrotactile feedback on some perceptual features of violins. J. Acoust. Soc.
Am. 136, 910–921 (2014).
39. Saitis, C., Fritz, C., Scavone, G. P., Guastavino, C. & Dubois, D. Perceptual evaluation of violins: A psycholinguistic analysis of
preference verbal descriptions by experienced musicians. J. Acoust. Soc. Am. 141, 2746–2757 (2017).
40. Cadoz, C. & Wanderley, M.M. Gesture-music : Trends in Gestural Control of Music, vol.12 (Ircam - Centre Pompidou, 2000).
41 . Wanderley, M. M., Vines, B. W., Middleton, N., McKay, C. & Hatch, W. e musical signicance of clarinetists’ ancillary gestures:
An exploration of the eld. J. New Music Res. 34, 97–113 (2005).
42 . Nusseck, M. & Wanderley, M. M. Music and motion: How music-related ancillary body movements contribute to the experience
of music. Music Percept. Interdiscip. J. 26, 335–353 (2009).
43. Visi, F., Coorevits, E., Miranda, E. & Leman, M. Eects of Dierent Bow Stroke Styles on Body Movements of a Viola Player: An
Exploratory Study (Michigan Publishing, University of Michigan Library, Ann Arbor, 2014).
4 4. Massie-Laberge, C., Cossette, I. & Wanderley, M. M. Kinematic analysis of pianists’ expressive performances of romantic excerpts:
Applications for enhanced pedagogical approaches. Front. Psychol. 9, 2725 (2019).
45. Santos, T.F. & Loureiro, M.A. e observation of ancillary gestures using the laban-bartenie movement fundamentals. In
Anais do XIII Simpósio Internacional de Cognição e Artes Musicais (2017).
46. Rozé, J., Aramaki, M., Kronland-Martinet, R., Bourdin, C. & Ystad, S. Eluding the inuence of postural constraints on cellists
bowing movements and timbral quality. In Bridging People and Sound-Post-Proceedings of CMMR, Vol. 10525 of LNCS, 128–144
(Springer, Heidelberg, 2017).
47. Wanderley, M.M. Quantitative analysis of non-obvious performer gestures. In Gesture and Sign Language in Human–Computer
Interaction, 241–253 (Springer, Berlin, 2002).
48. Rozé, J., Aramaki, M., Kronland-Martinet, R. & Ystad, S. Exploring the perceived harshness of cello sounds by morphing and
synthesis techniques. J. Acoust. Soc. Am. 141, 2121–2136 (2017).
49. Mantel, G. Cello Technique: Principles and Forms of Movement (Indiana University Press, Bloomington, 1995).
50. Gagnepain, X. Du musicien en général... au violoncelliste en particulier (Cité de la musique, 2001).
51. Liberman, A. M. & Mattingly, I. G. e motor theory of speech perception revised. Cognition 21, 1–36 (1985).
52. McNeill, D. Language and Gesture Vol. 2 (Cambridge University Press, Cambridge, 2000).
53. Kendon, A. Gesture: Visible Action as Utterance (Cambridge University Press, Cambridge, 2004).
54. Jensenius, A.R. Action-sound: Developing methods and tools to study music-related body movement. Ph.D. thesis, Department
of Musicology - University of Oslo (2007).
55. Caramiaux, B., Bevilacqua, F. & Schnell, N. Towards a gesture-sound cross-modal analysis. In Gesture in Embodied Communica-
tion and Human–Computer Interaction, 158–170 (Springer, Berlin, 2009).
56. Knapp, M. L., Hall, J. A. & Horgan, T. G. Nonverbal Communication in Human Interaction (Cengage Learning, Boston, 2013).
57. Godøy, R. I., Jensenius, A. R. & Nymoen, K. Production and perception of goal-points and coarticulations in music. J. Acoust.
Soc. Am. 123, 3657–3657 (2008).
58. Jensenius, A. R., Wanderley, M. M., Godøy, R. I. & Leman, M. Musical gestures : Concepts and methods in research. Musical
Gestures Sound Mov. Mean. 12, 12–35 (2009).
59. Zapata-Fonseca, L., Dotov, D., Fossion, R. & Froese, T. Time-series analysis of embodied interaction: Movement variability and
complexity matching as dyadic properties. Front. Psychol. 7, 1940 (2016).
60. Desmet, F. et al. Assessing a clarinet player’s performer gestures in relation to locally intended musical targets. J. New Music Res.
41, 31–48 (2012).
61. Turvey, M. T. Coordination. Am. Psychol. 45, 938 (1990).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
15
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
62. Grey, J. M. Multidimensional perceptual scaling of musical timbres. J. Acoust. Soc. Am. 61, 1270–1277 (1977).
63. McAdams, S., Winsberg, S., Donnadieu, S., De Soete, G. & Krimpho, J. Perceptual scaling of synthesized musical timbres:
Common dimensions, specicities, and latent subject classes. Psychol. Res. 58, 177–192 (1995).
64. Deluzio, K. & Astephen, J. Biomechanical features of gait waveform data associated with knee osteoarthritis: An application of
principal component analysis. Gait Posture 25, 86–93 (2007).
6 5. Epifanio, I., Ávila, C., Page, Á & Atienza, C. Analysis of multiple waveforms by means of functional principal component analysis:
Normal versus pathological patterns in sit-to-stand movement. Med. Biol. Eng. Comput. 46, 551–561 (2008).
66. Donoghue, O. A., Harrison, A. J., Coey, N. & Hayes, K. Functional data analysis of running kinematics in chronic achilles
tendon injury. Med. Sci. Sports Exerc. 40, 1323–1335 (2008).
67. Godwin, A., Takahara, G., Agnew, M. & Stevenson, J. Functional data analysis as a means of evaluating kinematic and kinetic
waveforms. eor. Issues Ergon. Sci. 11, 489–503 (2010).
68. Ramsay, J. O. Functional Data Analysis (Wiley Online Library, New York, 2006).
69. Coey, N., Harrison, A. J., Donoghue, O. A. & Hayes, K. Common functional principal components analysis: A new approach
to analyzing human movement data. Hum. Mov. Sci. 30, 1144–1166 (2011).
70. Robertson, G., Caldwell, G., Hamill, J., Kamen, G. & Whittlesey, S. Research Methods in Biomechanics, 2E (Human Kinetics,
Champaign, 2013).
7 1. Daertshofer, A., Lamoth, C. J., Meijer, O. G. & Beek, P. J. PCA in studying coordination and variability: A tutorial. Clin. Biomech.
19, 415–428 (2004).
72 . Troje, N. F. Decomposing biological motion: A framework for analysis and synthesis of human gait patterns. J. Vis. 2, 2–2 (2002).
7 3. Ramsay, J. O., Munhall, K. G., Gracco, V. L. & Ostry, D. J. Functional data analyses of lip motion. J. Acoust. Soc. Am. 99, 3718–3727
(1996).
74. Faraway, J. J. Modeling reach motions using functional regression analysis (Tech. Rep, SAE Technical Paper, 2000).
75. Sanger, T. D. Human arm movements described by a low-dimensional superposition of principal components. J. Neurosci. 20,
1066–1072 (2000).
76. Ryan, W., Harrison, A. & Hayes, K. Functional data analysis of knee joint kinematics in the vertical jump. Sports Biomech. 5,
121–138 (2006).
77. Harrison, A., Ryan, W. & Hayes, K. Functional data analysis of joint coordination in the development of vertical jump perfor-
mance. Sports Biomech. 6, 199–214 (2007).
78. Amelynck, D., Maes, P.-J., Martens, J.-P. & Leman, M. Expressive body movement responses to music are coherent, consistent,
and low dimensional. IEEE Trans. Cybern. 44, 2288–2301 (2014).
79. Bianco, T., Fréour, V., Rasamimanana, N., Bevilaqua, F. & Caussé, R. On gestural variation and coarticulation eects in sound
control. In Gesture in Embodied Communication and Human-Computer Interaction, 134–145 (Springer, Berlin, 2009).
80. Dalca, I.M., Vines, B.W., Pearce, M.T. & Wanderley, M.M. Expressivity as time-dependent movement for music performance:
A statistical exploration. In 10th International Symposium on Computer Music Multidisciplinary Research, Marseille, France,
October 15–18, 2013, 845–854 (2013).
81. Visi, F., Coorevits, E., Schramm, R. & Miranda, E. Instrumental movements of neophytes: analysis of movement periodicities,
commonalities and individualities in mimed violin performance performance. In 11th International Symposium on CMMR,
518–533 (e Laboratory of Mechanics and Acoustics, 2015).
82. Godøy, R.I., Jensenius, A.R. & Nymoen, K. Chunking by coarticulation in music-related gestures. In 8th International Gesture
Workshop, Bielefeld, 25–27 (2009).
83. Chudy, M., Carrillo, A.P. & Dixon, S. On the relation between gesture, tone production and perception in classical cello per-
formance. In Proceedings of Meetings on Acoustics, vol.19, 035017 (Acoustical Society of America, 2013).
84. Peeters, G. A large set of audio features for sound description (similarity and classication) in the cuidado project (Tech. Rep,
IRCAM, 2004).
85. Davis, S. & Mermelstein, P. Experiments in syllable-based recognition of continuous speech. IEEE Trans. Acoust. Speech Signal
Process. 28, 357–366 (1980).
86. Barthet, M., Guillemain, P., Kronland-Martinet, R. & Ystad, S. From clarinet control to timbre perception. Acta Acustica united
with Acustica 96, 678–689 (2010).
87. Pollard, H. F. & Jansson, E. V. A tristimulus method for the specication of musical timbre. Acta Acustica united with Acustica
51, 162–171 (1982).
88 . Godøy, R. I., Jensenius, A. R. & Nymoen, K. Chunking in music by coarticulation. Acta Acustica united with Acustica 96, 690–700
(2010).
89 . Guettler, K. Looking at starting transients and tone coloring of the bowed string. In Proceedings of Frontiers of Research on Speech
and Music (2004).
90. Woodhouse, J. On the playability of violins. Part I: Reection functions. Acta Acustica united with Acustica 78, 125–136 (1993).
91. Winold, H. & elen, E. Coordination and control in the bow arm movements of highly skilled cellists. Ecol. Psychol. 6, 1–31
(1994).
92. Turner-Stokes, L. & Reid, K. ree-dimensional motion analysis of upper limb movement in the bowing arm of string-playing
musicians. Clin. Biomech. 14, 426–433 (1999).
93. Starker, J. An Organized Method of String Playing (Indiana University Press, Bloomington, 1975).
94. Wulf, G. & Prinz, W. Directing attention to movement eects enhances learning: A review. Psychon. Bull. Rev. 8, 648–660 (2001).
95. Wulf, G. Attentional focus and motor learning: A review of 15 years. Int. Rev. Sport Exerc. Psychol. 6, 77–104 (2013).
96. McNevin, N. H., Shea, C. H. & Wulf, G. Increasing the distance of an external focus of attention enhances learning. Psychol. Res.
67, 22–29 (2003).
97. Wulf, G., Weigelt, M., Poulter, D. & McNevin, N. Attentional focus on suprapostural tasks aects balance learning. Q. J. Exp.
Psychol. Sect. A 56, 1191–1211 (2003).
9 8. McNevin, N. H. & Wulf, G. Attentional focus on supra-postural tasks aects postural control. Hum. Mov. Sci. 21, 187–202 (2002).
99. Totsika, V. & Wulf, G. e inuence of external and internal foci of attention on transfer to novel situations and skills. Res. Q.
Exerc. Sport 74, 220–232 (2003).
100. Alexander, F. .M. e Resurrection of the Body: e Essential Writings of F. Matthias Alexander (Dell Publishing Company, New
York, 1974).
101. Lederman, R. J. Neuromuscular and musculoskeletal problems in instrumental musicians. Muscle Nerv. 27, 549–561 (2003).
102. Lee, S.-H. Intervention program in college instrumental musicians, with kinematics analysis of cello and ute playing: A com-
bined program of yogic breathing and muscle strengthening-exibility exercises. Med. Probl. Perform. Artist. 27, 85–94 (2012).
103. Staes, F. F. et al. Physical therapy as a means to optimize posture and voice parameters in student classical singers: A case report.
J. Voice 25, e91–e101 (2011).
104. López, T. M. & Martínez, J. F. Strategies to promote health and prevent musculoskeletal injuries in students from the high
conservatory of music of Salamanca, Spain. Med. Probl. Perform. Artist. 28, 100–106 (2013).
105. Wahlström Edling, C. & Fjellman-Wiklund, A. Musculoskeletal disorders and asymmetric playing postures of the upper extrem-
ity and back in music teachers: A pilot study. Med. Probl. Perform. Artist. 24, 113–118 (2009).
Content courtesy of Springer Nature, terms of use apply. Rights reserved
16
Vol:.(1234567890)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
106. Barczyk-Pawelec, K., Sipko, T., Demczuk-Włodarczyk, E. & Boczar, A. Anterioposterior spinal curvatures and magnitude of
asymmetry in the trunk in musicians playing the violin compared with nonmusicians. J. Manip. Physiol. er. 35, 319–326 (2012).
107. Dotov, D. & Chemero, A. Breaking the perception-action cycle: Experimental phenomenology of non-sense and its implications
for theories of perception and movement science. In Enactive Cognition at the Edge of Sense-Making, 37–60 (Springer, Berlin,
2014).
108. Dona, G., Preatoni, E., Cobelli, C., Rodano, R. & Harrison, A. J. Application of functional principal component analysis in race
walking: An emerging methodology. Sports Biomech. 8, 284–301 (2009).
109. Chadefaux, D., Rao, G., Androuet, P., Berton, E. & Vigouroux, L. Active tuning of stroke-induced vibrations by tennis players.
J. Sports Sci. 35, 1643–1651 (2017).
110. Chadefaux, D., Berton, E. & Rao, G. How runners deal with the shock induced vibrations propagating through their body?. J.
Acoust. Soc. Am. 141, 3978–3978 (2017).
111. Chadefaux, D., Gueguen, N., ouze, A. & Rao, G. 3d propagation of the shock-induced vibrations through the whole lower-
limb during running. J. Biomech. 96, 109343 (2019).
112. Rosati, G., Oscari, F., Spagnol, S., Avanzini, F. & Masiero, S. Eect of task-related continuous auditory feedback during learning
of tracking motion exercises. J. Neuroeng. Rehabil. 9, 79 (2012).
113. Bevilacqua, F. et al. Sensori-motor learning with movement sonication: Perspectives from recent interdisciplinary studies.
Front. Neurosci. 10, 385 (2016).
114. Parseihian, G., Gondre, C., Aramaki, M., Ystad, S. & Kronland-Martinet, R. Comparison and evaluation of sonication strategies
for guidance tasks. IEEE Trans. Multimed. 18, 674–686 (2016).
115. Bressolette, B. et al. Harnessing audio in auto control: e challenge of sonifying virtual objects for gesture control of cars. IEEE
Consumer Electron. Mag. 7, 91–100 (2018).
116. Eenberg, A. O., Fehse, U., Schmitz, G., Krueger, B. & Mechling, H. Movement sonication: Eects on motor learning beyond
rhythmic adjustments. Front. Neurosci. 10, 219 (2016).
117. Schaert, N., Janzen, T. B., Mattes, K. & aut, M. H. A review on the relationship between sound and movement in sports and
rehabilitation. Front. Psychol. 10, 244 (2019).
118. O’Brien, B. etal. Considerations for developing sound in golf putting experiments. In International Symposium on Computer
Music Multidisciplinary Research, 338–358 (Springer, Berlin, 2017).
119. O’Brien, B., Vidal, A., Bringoux, L., Bourdin, C. Developing. & movement sonication for sports performance. A survey of
studies developed at the institute of movement science. In Interactive Sonication Workshop, ISON, 2019 (KTH Royal Institute
of Technology, Stockholm, 2019).
120. Vidal, A., Bertin, D., Drouot, F., Kronland-Martinet, R. & Bourdin, C. Improving the pedal force eectiveness using real-time
sonication. IEEE Access 8, 62912–62923 (2020).
121. Schneider, S., Schönle, P. W., Altenmüller, E. & Münte, T. F. Using musical instruments to improve motor skill recovery following
a stroke. J. Neurol. 254, 1339–1346 (2007).
122. Kronland-Martinet, R., Ystad, S. & Aramaki, M. High-level control of sound synthesis for sonication processes. AI Soc. J.
Knowl. Cult. Commun. 27, 245–255 (2012).
123. Merer, A., Aramaki, M., Ystad, S. & Kronland-Martinet, R. Perceptual characterization of motion evoked by sounds for synthesis
control purposes. Association for Computing Machinery. Trans. Appl. Percept. 10, 1–24 (2013).
124. Letanneux, A., Danna, J., Velay, J.-L., Viallet, F. & Pinto, S. From micrographia to Parkinson’s disease dysgraphia. Mov. Disord.
29, 1467–1475 (2014).
125. Danna, J. et al. “Let me hear your handwriting”! evaluating the movement uency from its sonication. PLoS ONE 10, e0128388
(2015).
126. oret, E., Aramaki, M., Bringoux, L., Ystad, S. & Kronland-Martinet, R. Seeing circles and drawing ellipses: When sound biases
reproduction of visual motion. PloS one 11, e0154475 (2016).
127. Godøy, R.I., Haga, E. & Jensenius, A.R. Exploring music-related gestures by sound-tracing: A preliminary study (2006).
128. Godøy, R.I., Haga, E. & Jensenius, A.R. Playing “air instruments”: Mimicry of sound-producing gestures by novices and experts.
In International Gesture Workshop, 256–267 (Springer, Berlin, 2006).
129. Rozé, J. etal. Assessing the inuence of constraints on cellists’ postural displacements and musical expressivity. In Mus ic, Mind
and Embodiment - Post-proceedings of CMMR, vol. 9617 of LNCS, 22–41 (Springer, Berlin, 2016).
130. Dempster, W. T. Space requirements of the seated operator: Geometrical, kinematic, and mechanical aspects of the body, with special
reference to the limbs (University of Michigan, Tech. Rep., 1955).
131. Droulez, J. & Berthoz, A. Servo-controlled (conservative) versus topological (projective) mode of sensory motor control (Elsevier,
Disorders of posture and gait, 1986).
132. Riener, R. & Straube, A. Inverse dynamics as a tool for motion analysis: Arm tracking movements in cerebellar patients. J.
Neurosci. Methods 72, 87–96 (1997).
133. Apkarian, J., Naumann, S. & Cairns, B. A three-dimensional kinematic and dynamic model of the lower limb. J. Biomech. 22,
143–155 (1989).
134. Raikova, R. A general approach for modelling and mathematical investigation of the human upper limb. J. Biomech. 25, 857–867
(1992).
135. Lartillot, O. & Toiviainen, P. A matlab toolbox for musical feature extraction from audio. In Proceedings of the International
Conference on Digital Audio Eects 237–244 (2007).
136. Kim, H.-G., Moreau, N. & Sikora, T. MPEG-7 Audio and Beyond: Audio Content Indexing and Retrieval (Wiley, New York, 2006).
137. Barthet, M., Kronland-Martinet, R., Ystad, S. & Depalle, P. e eect of timbre in clarinet interpretation. In International Com-
puter Music Conference (ICMC), 59–62 (Copenhague, Danemark, 2007).
138. Ramsay, J. O. & Silverman, B. W. Applied Functional Data Analysis: Methods and Case Studies (Springer, Berlin, 2007).
Acknowledgements
We acknowledge the ISM (Institut des Sciences du Mouvement) of Marseille for providing the technological
environment of the motion capture system and support related to the computations of anatomical Cardan/Euler
angles. is work is part of the “SoniMove” project (ANR-14-CE24-0018).
Author contributions
All authors participated to the design of the experiment and reviewed the manuscript. J.R. and S.Y. conducted the
experiment. With the help of ISM, J.R. conducted the functional motion analyses. M.A. contributed to statistical
analyses and R.K.M. contributed to acoustical analyses.
Competing interests
e authors declare no competing interests.
Content courtesy of Springer Nature, terms of use apply. Rights reserved
17
Vol.:(0123456789)
SCIENTIFIC REPORTS | (2020) 10:13882 | 
www.nature.com/scientificreports/
Additional information
Supplementary information is available for this paper at https ://doi.org/10.1038/s4159 8-020-70705 -8.
Correspondence and requests for materials should be addressed to J.R.
Reprints and permissions information is available at www.nature.com/reprints.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and
institutional aliations.
Open Access is article is licensed under a Creative Commons Attribution 4.0 International
License, which permits use, sharing, adaptation, distribution and reproduction in any medium or
format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the
Creative Commons licence, and indicate if changes were made. e images or other third party material in this
article are included in the articles Creative Commons licence, unless indicated otherwise in a credit line to the
material. If material is not included in the article’s Creative Commons licence and your intended use is not
permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from
the copyright holder. To view a copy of this licence, visit http://creat iveco mmons .org/licen ses/by/4.0/.
© e Author(s) 2020
Content courtesy of Springer Nature, terms of use apply. Rights reserved
1.
2.
3.
4.
5.
6.
Terms and Conditions
Springer Nature journal content, brought to you courtesy of Springer Nature Customer Service Center GmbH (“Springer Nature”).
Springer Nature supports a reasonable amount of sharing of research papers by authors, subscribers and authorised users (“Users”), for small-
scale personal, non-commercial use provided that all copyright, trade and service marks and other proprietary notices are maintained. By
accessing, sharing, receiving or otherwise using the Springer Nature journal content you agree to these terms of use (“Terms”). For these
purposes, Springer Nature considers academic use (by researchers and students) to be non-commercial.
These Terms are supplementary and will apply in addition to any applicable website terms and conditions, a relevant site licence or a personal
subscription. These Terms will prevail over any conflict or ambiguity with regards to the relevant terms, a site licence or a personal subscription
(to the extent of the conflict or ambiguity only). For Creative Commons-licensed articles, the terms of the Creative Commons license used will
apply.
We collect and use personal data to provide access to the Springer Nature journal content. We may also use these personal data internally within
ResearchGate and Springer Nature and as agreed share it, in an anonymised way, for purposes of tracking, analysis and reporting. We will not
otherwise disclose your personal data outside the ResearchGate or the Springer Nature group of companies unless we have your permission as
detailed in the Privacy Policy.
While Users may use the Springer Nature journal content for small scale, personal non-commercial use, it is important to note that Users may
not:
use such content for the purpose of providing other users with access on a regular or large scale basis or as a means to circumvent access
control;
use such content where to do so would be considered a criminal or statutory offence in any jurisdiction, or gives rise to civil liability, or is
otherwise unlawful;
falsely or misleadingly imply or suggest endorsement, approval , sponsorship, or association unless explicitly agreed to by Springer Nature in
writing;
use bots or other automated methods to access the content or redirect messages
override any security feature or exclusionary protocol; or
share the content in order to create substitute for Springer Nature products or services or a systematic database of Springer Nature journal
content.
In line with the restriction against commercial use, Springer Nature does not permit the creation of a product or service that creates revenue,
royalties, rent or income from our content or its inclusion as part of a paid for service or for other commercial gain. Springer Nature journal
content cannot be used for inter-library loans and librarians may not upload Springer Nature journal content on a large scale into their, or any
other, institutional repository.
These terms of use are reviewed regularly and may be amended at any time. Springer Nature is not obligated to publish any information or
content on this website and may remove it or features or functionality at our sole discretion, at any time with or without notice. Springer Nature
may revoke this licence to you at any time and remove access to any copies of the Springer Nature journal content which have been saved.
To the fullest extent permitted by law, Springer Nature makes no warranties, representations or guarantees to Users, either express or implied
with respect to the Springer nature journal content and all parties disclaim and waive any implied warranties or warranties imposed by law,
including merchantability or fitness for any particular purpose.
Please note that these rights do not automatically extend to content, data or other material published by Springer Nature that may be licensed
from third parties.
If you would like to use or distribute our Springer Nature journal content to a wider audience or on a regular basis or in any other manner not
expressly permitted by these Terms, please contact Springer Nature at
onlineservice@springernature.com
... In line with this interpretation, similar effects have been observed in solo string players during various forms of perturbations. First, enhanced metrical coupling between head and bow motion, reduced head motion and shifts toward movements at faster metrical timescales all occurred spontaneously and without much change in bow motion properties when cellists had their posture constrained (Rozé et al., 2017(Rozé et al., , 2019(Rozé et al., , 2020. Next, violists' head motion changed (and most often diminished) when their bow strokes were constrained as well (Visi et al., 2014). ...
... In violinists, the link between body kinematics and focus of attention has been demonstrated as well (Allingham et al., 2021). More particularly, shifts in head motion patterns during perturbation of solo string players have been interpreted as reflecting attentional changes (Visi et al., 2014;Rozé et al., 2020). Interestingly, cellists too moved their head more frequently and with more energy at several timescales (especially at half and quarter-notes levels) when they played a melody by focusing their attention on shorter rather than longer groupings of notes (Huberth and Fujioka, 2018). ...
... This questions the conceptual segregation between ancillary and instrumental movements. In effect, posture and head movements seem to offer support for the control of instrumental gestures (Rozé et al., 2020). By shaping attention, framing sensory processing, and thereby honing musicians' sense of timing, ancillary movements might directly participate to the fine-grained motor coordination of instrumental gestures (Colley et al., 2020). ...
Article
Full-text available
Social behaviors rely on the coordination of multiple effectors within one’s own body as well as between the interacting bodies. However, little is known about how coupling at the interpersonal level impacts coordination among body parts at the intrapersonal level, especially in ecological, complex, situations. Here, we perturbed interpersonal sensorimotor communication in violin players of an orchestra and investigated how this impacted musicians’ intrapersonal movements coordination. More precisely, first section violinists were asked to turn their back to the conductor and to face the second section of violinists, who still faced the conductor. Motion capture of head and bow kinematics showed that altering the usual interpersonal coupling scheme increased intrapersonal coordination. Our perturbation also induced smaller yet more complex head movements, which spanned multiple, faster timescales that closely matched the metrical levels of the musical score. Importantly, perturbation differentially increased intrapersonal coordination across these timescales. We interpret this behavioral shift as a sensorimotor strategy that exploits periodical movements to effectively tune sensory processing in time and allows coping with the disruption in the interpersonal coupling scheme. As such, head movements, which are usually deemed to fulfill communicative functions, may possibly be adapted to help regulate own performance in time.
... The cello position and the player's sitting posture are important aspects not only for the musician's personal technique, but also for cello teaching and the prevention of injuries in playing. 11 However, in cello literature only very little information can be found on this topic, and only few studies are analysing the cello posture and playing technique with systematic methods. As an example, Gerhard Mantel, author of a well-known book on cello techniques, writes the following about cellist posture: ...
... This leads to postural relations being underrepresented in higher cello education and therefore introducing frustrating, chronic injuries and musculoskeletal disorders among musicians, while it being clear that chest rotation and inclination is supporting bowing movement. 11 In the present study, optical motion-capture technology is used to record the player's bowing actions and to examine the relationship between the instrument position and the player sitting posture (Fig. 1), considering several parameters such as the length of the cello spike or the inclination of the instrument. Motion capture is commonly used to investigate performance related matters in string instruments, with a strong focus on bow control and technique on the violin. ...
Conference Paper
Full-text available
Cello position and playing posture are of great importance in the cello learning process as well as for the players’ technique. To gain more information on this topic, a study is conducted in which advanced cellists are recorded using optical motion capture technology to examine their posture, cello position and bow movement. In addition, this study aims to find a position of the cello in which it can be played comfortably by both human players and an instructed robotic arm. Therefore, a cello is mounted on a custom-made holding structure in which it can be held immobile during playing. Participants are invited to play several bowing exercises on open-strings and music excerpts from cello literature. The bowing actions and the sitting parameters are compared between the cellists. While the exercises contribute to the data collection of bowing motions to apply to the robotic arm, the music excerpts are used to analyze the playing posture and to allow participants to evaluate their comfort during playing. These investigations will gather information regarding the cello position and the bowing action to inform artificial playing setups as well as introduce systematic methodologies for artistic and educational purposes on the topic of cello posture.
... A violinist's mechanisms of bow control are situated within the musician's whole body, therefore it is considered important that the whole body is able to move freely so that stiffness and excess muscle tension are avoided (Medoff, 1999;Roos, 2001). For example, in cello playing, head and torso movements contribute to the player's ability to generate fluid bowing and good quality sound (Rozé et al., 2020). This finding highlights how overall freedom of body motion might impact sound quality. ...
... The systematic changes in sway observed here, were a matter of millimetres in magnitude, suggesting changes in micro-motion rather than large swaying motions which could be disruptive to playing technique. As freedom of body motion is considered a positive pedagogical outcome (Roos, 2001), inhibiting overall body motion has been shown to negatively impact music performance (Rozé et al., 2020;Turner & Kenny, 2011), and increases in micromotion while sitting have been associated with reductions in pain (Vergara & Page, 2002), we interpreted increased instrument sway as representing subtle relaxations of posture and thus an improvement in freedom of body motion. This finding therefore partially supports our first hypothesis, with freer motion in the somatic focus relative to internal focus. ...
Article
Full-text available
Violin bowing is a specialised sound-producing action, which may be affected by psychological performance techniques. In sport, attentional focus impacts motor performance, but limited evidence for this exists in music. We investigated the effects of attentional focus on acoustical, physiological, and physical parameters of violin bowing in experienced and novice violinists. Attentional focus significantly affected spectral centroid, bow contact point consistency, shoulder muscle activity, and novices’ violin sway. Performance was most improved when focusing on tactile sensations through the bow (somatic focus), compared to sound (external focus) or arm movement (internal focus). Implications for motor performance theory and pedagogy are discussed.
... Optical motion capture uses infrared cameras to track the position of reflecting markers attached to musicians' body parts and instruments. To better understand and incorporate the player actions in the analysis of bowed-string instruments, the body motions have been measured and taken into account in few studies considering violin and cello playing [7,8,9], particularly those regarding the motion of the bowing arm. Such studies made use of motion capture systems to locate the position of the human body parts and the position of the bow and instrument during playing. ...
Conference Paper
Full-text available
The action of the bow on the string is one of the key aspects of the player-instrument interaction in bowed string instruments. For the analysis of this interaction, it is common to use custom-built artificial excitation mechanisms, where the human arm is substituted by a mechanical setup. Such artificial means allow recreating the excitation mechanism repeatedly. In this study, a robotic arm with 6 degrees of freedom is used to achieve highly precise motion of a cello bow. Preliminary tests have achieved repeatable reproduction of plucked and bowed string sounds using linear trajectories of a plectrum or a bow. In order to take the nuances of the player actions into account, a more realistic bow movement is required. To that aim, the robot might be instructed with bowing trajectories obtained from a real playing situation with expert cellists. These bowing trajectories are recorded using optical motion capture. The motion capture system consists of infrared cameras that track the position of a set of reflective markers attached to the bow, musician, and instrument. The combination of motion-capture data with a fine control of the robotic arm creates a framework for the accurate analysis of the player-instrument interaction in bowed string instruments.
... The increase in congruence in V2 for the six parameters shared by music and movement was significantly perceived by respondents in this study. The intended match in this sports routine further justifies the perceived congruence in music and dance [18, 21, 22, 52,] audio-visual subjects [30], and gestures of instrumentalists [41,55], which has been discussed earlier. This study emphasizes that the six parameters shared by various subjects are considered fundamental to our body movement, as many findings suggest that the precursors of music perception emerge in the early stages of human development [56]. ...
Article
Full-text available
The use of music in sports routines that involve choreography is inevitable, and the appropriateness between the two is taken into account for awarding points in competitions. In dance, theatre, or in firm music, the use of music in choreography displays the subjectivity of interpretation to a certain extent due to preferences, background of audience, coach, and composer. However, more scientific and fundamental aspects shared between music and movement can provide a better perception of a particular routine. This study reports an experiment on a rhythmic gymnastics routine to investigate whether an increased congruence between music and movement enhances the perception of sports quality from a musical perspective. In the experiment, the original music accompaniment was changed with a new composition to increase the congruence between music and movement using six parameters including tempo, rhythm, phrasing, accent, direction, and dynamic. Fifty-two undergraduate music majors evaluated two videos of the same routine in a questionnaire regarding the qualities of the performance. Apart from motivation, the results show that the sports qualities with the new accompaniment were significantly perceived better than the original version.
... • Patterns of sound-producing motion that are particularly successful in generating good-sounding results with minimal effort, known as idioms, are important in the context of soundmotion objects because they testify to the extensive fusion of sound and motion optimization. • On the other hand, implementing motion constraints may drastically change features of the output sound (Rozé et al., 2020). ...
... • Patterns of sound-producing motion that are particularly successful in generating good-sounding results with minimal effort, known as idioms, are important in the context of soundmotion objects because they testify to the extensive fusion of sound and motion optimization. • On the other hand, implementing motion constraints may drastically change features of the output sound (Rozé et al., 2020). ...
Article
Full-text available
The aim of this paper is to present principles of constraint-based sound-motion objects in music performance. Sound-motion objects are multimodal fragments of combined sound and sound-producing body motion, usually in the duration range of just a few seconds, and conceived, produced, and perceived as intrinsically coherent units. Sound-motion objects have a privileged role as building blocks in music because of their duration, coherence, and salient features and emerge from combined instrumental, biomechanical, and motor control constraints at work in performance. Exploring these constraints and the crucial role of the sound-motion objects can enhance our understanding of generative processes in music and have practical applications in performance, improvisation, and composition.
Article
Full-text available
The pedal force effectiveness, an important parameter in cycling performance, is rarely optimal. Decreased power is generally observed during the recovery phase (the cyclist does not pull enough). An essential part of training for cyclists consists in improving pedaling technique. Visual feedback can be useful but may not be feasible in real life, where the cyclist has to visually focus on the road. We propose auditive feedback as a better way to help cyclists improve their pedal force effectiveness in real-time. In this study, both competitive cyclists and non-cyclists tested different online sonification strategies of force effectiveness, comparing them to a silent control. The ”Squeak” strategy, generating a squeak when torque was negative, had the most positive impact on Torque Effectiveness: some participants managed to eliminate any negative torque for a full minute.
Conference Paper
Full-text available
This paper offers a survey of movement sonification studies conducted over the last four years at the Institute of Movement Science. Our research focuses on studying the effects of online sonification on sporting performance and movement in golf and cycling. Given the different goals and motor control skills required to be successful, our experiences have provided us with significant insight when considering experimental design and analysis. Skill level and the complexity and ease of repeating motor tasks are major factors when developing sonification strategies and studying its effects. Decisions regarding which movement parameters and the presentation of sonification are equally important depending on study goals. The following outlines our perspectives and methodologies when developing and studying sonification and its effect on sports performance and movement.
Article
Full-text available
The role of auditory information on perceptual-motor processes has gained increased interest in sports and psychology research in recent years. Numerous neurobiological and behavioral studies have demonstrated the close interaction between auditory and motor areas of the brain, and the importance of auditory information for movement execution, control, and learning. In applied research, artificially produced acoustic information and real-time auditory information have been implemented in sports and rehabilitation to improve motor performance in athletes, healthy individuals, and patients affected by neurological or movement disorders. However, this research is scattered both across time and scientific disciplines. The aim of this paper is to provide an overview about the interaction between movement and sound and review the current literature regarding the effect of natural movement sounds, movement sonification, and rhythmic auditory information in sports and motor rehabilitation. The focus here is threefold: firstly, we provide an overview of empirical studies using natural movement sounds and movement sonification in sports. Secondly, we review recent clinical and applied studies using rhythmic auditory information and sonification in rehabilitation, addressing in particular studies on Parkinson’s disease and stroke. Thirdly, we summarize current evidence regarding the cognitive mechanisms and neural correlates underlying the processing of auditory information during movement execution and its mental representation. The current state of knowledge here reviewed provides evidence of the feasibility and effectiveness of the application of auditory information to improve movement execution, control, and (re)learning in sports and motor rehabilitation. Findings also corroborate the critical role of auditory information in auditory-motor coupling during motor (re)learning and performance, suggesting that this area of clinical and applied research has a large potential that is yet to be fully explored.
Article
Full-text available
Established pedagogical theories for classical piano usually do not consider the essential relationship between the musical structure, whole body movements, and expression. Research focusing on musicians' expression has shown that body movements reflect the performer's understanding of the musical structure. However, most studies to date focus on the performance of a single piece at a time, leaving unanswered the question on how structural parameters of pieces with varied technical difficulties influence pianists' movements. In this study, ten pianists performed three contrasting Romantic excerpts in terms of technical level and character, while motion data was collected with a passive infrared motion capture system. We observed how pianists modulate their performances for each of the three pieces and measured the absolute difference in percentage of duration and quantity of motion (QoM) between four expressive conditions (normal, deadpan, exaggerated, immobile). We analyzed common patterns within the time-series of position data to investigate whether pianists embody musical structure in similar ways. A survey was filled in by pianists to understand how they conceive the relationship between body movements and musical structure. Results show that the variation in duration between the exaggerated and deadpan conditions was significant in one measure for one of the excerpts, and that tempo was less affected by the QoM used than by the level of expression. By applying PCA on the pianists' position data, we found that the head QoM is an important parameter for communicating different expressions and structural features. Significant variations in head QoM were found in the immobile and deadpan conditions if compared to the normal condition, only in specific regions of the score. Recurrent head movements occurred along with certain structural parameters for two of the excerpts only. Altogether, these results indicate that the analysis of pianists' body movements and expressive intentions should be carried out in relation to the specific musical context, being dependent on the technical level of the pieces and the repertoire. These results, combined with piano teaching methods, may lead to the development of new approaches in instrumental lessons to help students make independent choices regarding body movements and expression.
Article
Full-text available
Significance In sophisticated auditory–motor learning such as musical instrument learning, little is understood about how brain plasticity develops over time and how the related individual variability is reflected in the neural architecture. In a longitudinal fMRI training study on cello learning, we reveal the integrative function of the dorsal cortical stream in auditory–motor information processing, which comes online quickly during learning. Additionally, our data show that better performers optimize the recruitment of regions involved in auditory encoding and motor control and reveal the critical role of the pre-supplementary motor area and its interaction with auditory areas as predictors of musical proficiency. The present study provides unprecedented understanding of the neural substrates of individual learning variability and therefore has implications for pedagogy and rehabilitation.
Article
Full-text available
Gait dysfunctions in Parkinson's disease can be partly relieved by rhythmic auditory cueing. This consists in asking patients to walk with a rhythmic auditory stimulus such as a metronome or music. The effect on gait is visible immediately in terms of increased speed and stride length. Moreover, training programs based on rhythmic cueing can have long-term benefits. The effect of rhythmic cueing, however, varies from one patient to the other. Patients’ response to the stimulation may depend on rhythmic abilities, often deteriorating with the disease. Relatively spared abilities to track the beat favor a positive response to rhythmic cueing. On the other hand, most patients with poor rhythmic abilities either do not respond to the cues or experience gait worsening when walking with cues. An individualized approach to rhythmic auditory cueing with music is proposed to cope with this variability in patients’ response. This approach calls for using assistive mobile technologies capable of delivering cues which adapt in real time to patients’ gait kinematics, thus affording step synchronization to the beat. Individualized rhythmic cueing can provide a safe and cost-effective alternative to standard cueing which patients may want to use in their everyday lives.
Article
Shock-induced vibrations to the feet have been related to the feel of comfort, the biomechanical control of performance, and the risk of fatigue or injury. Up to recently, the complexity of measuring the human biodynamic response to vibration exposure implied to focus most of the research on the axial acceleration at the tibia. Using wireless three-dimensional accelerometers, this paper investigates the propagation of shock-induced vibrations through the whole lower-limb during running in the temporal and the spectral domains. Results indicated that the vibrations were not consistent across the lower-limb, showing various spatial and spectral distributions of energy. The amount of energy was not constantly decreasing from the distal to the proximal extremity of the runner's lower-limb, especially regarding the lateral epicondyle of the femur. Vibrations in the transversal plane of the segments were substantial compared to the longitudinal axis regarding the distal extremity of the tibia, and the lateral epicondyle of the femur. Further, the spectral content was wider at the distal than at the proximal end of the lower-limb. Finally, to get a thorough understanding of the risks incurred by the runners, the need to account for shock-induced vibrations up to 50 Hz has been stressed when investigating three-dimensional vibrations. The overall study raises attention on the substantial importance of the transverse components of the acceleration, and their potential relation to shear fatigue and injury during running.
Chapter
This chapter presents the core interests and challenges of using sound for learning motor skills and describes the development of sonification techniques for three separate golf-putting experiments. These studies are part of the ANR SoniMove project, which aims to develop new Human Machine Interfaces (HMI) that provide gestural control of sound in the areas of sports and music. After a brief introduction to sonification and sound-movement studies, the following addresses the ideas and sound synthesis techniques developed for each experiment.
Article
This article presents a gesture sonification system for blind interface manipulation based on interaction with a virtual object (VO). Commands are given through gestures, and sounds carry the feedback on how the VO was affected. The sound feedback allows the user to manipulate the interface without vision. Here, we chose to focus on a swipe gesture. In the first part of the article, we study different curves that relate the VO parameters to sound parameters to create the most natural association between the two. On the basis of this experiment, we undertook a second experiment, comparing different sonification strategies for a particular VO manipulation task. The results helped us to classify the sound strategies and choose the most promising ones for future studies.
Conference Paper
While playing expressively, cellists tend to produce postural movements, which seem to be part of their musical discourse. This article describes how their instrumental bowing gestures and timbral features of the produced sounds may be affected when constraining these postural (or ancillary) movements. We focus here on a specific acoustic timbre alteration qualified as harshness in the constrained condition. A method based on Canonical Correlation Analysis (CCA) is used to extract the correlations between the bowing displacement and the sound rendition with and without postural constraint among several cellists. Then a detailed investigation of the covariation between gestural and sound data for the duration of the note is carried out, using Functional Data Analysis (FDA) techniques. Results reveal interesting effects of the postural constraint on the coupling patterns between the bowing movement and the spectro-temporal acoustical features.