Conference PaperPDF Available

Exploring learning effects during virtual swimming using biomechanical analysis (a work in progress)

Authors:

Abstract and Figures

In this work-in-progress (WIP), kinematics of movement during playing virtual swimming exergame between novice and experienced players was analyzed in order to detect possible learning effects. Ten participants performed a 100-meter front crawl virtual swimming using Xbox and Kinect. A 12 camera Qualisys motion capture system tracked the position of 22 reflective markers simultaneously. Preliminary results indicate that novice players showed a pattern closer to real swimming, spending more time on accuracy of movement, whereas the experienced players used an adaptive circular pattern in order to win the game. Citation: Soltani, P., & Vilas-Boas, J. P. (2013). Exploring learning effects during virtual swimming using biomechanical analysis (a work in progress). In P. Escudeiro, & C.V. de Cravalho. (Eds.). Paper presented at Proceedings of the 7th European Conference on Games Based Learning (Portugal), Porto (pp. 793-796). Sonning Common, UK: Academic Conferences and Publishing International.
Content may be subject to copyright.
Proceeding of 7th European Conference on Games
Based Learning (ECGBL2013)
Porto, Portugal
793
Exploring learning effects during virtual swimming using biomechanical analysis (a work in progress)
Pooya Soltani, João Paulo Vilas-Boas
Porto Biomechanics Laboratory (LABIOMEP), Faculty of Sport, University of Porto, Porto - Portugal
111114024@fade.up.pt
jpvb@fade.up.pt
CITATION (APA):
Soltani, P., & Vilas-Boas, J. P. (2013). Exploring learning effects during virtual swimming using
biomechanical analysis (a work in progress). In P. Escudeiro, & C.V. de Cravalho. (Eds.). Paper presented
at Proceedings of the 7th European Conference on Games Based Learning (Portugal), Porto (pp. 793-
796). Sonning Common, UK: Academic Conferences and Publishing International.
Abstract: In this work-in-progress (WIP), kinematics of movement during playing virtual swimming
exergame between novice and experienced players was analyzed in order to detect possible learning
effects. Ten participants performed a 100-meter front crawl virtual swimming using Xbox and Kinect. A
12 camera Qualisys motion capture system tracked the position of 22 reflective markers simultaneously.
Preliminary results indicate that novice players showed a pattern closer to real swimming, spending
more time on accuracy of movement, whereas the experienced players used an adaptive circular
pattern in order to win the game.
Keywords: Exergame; Virtual Sport; Learning; Biomechanics
Introduction: Since 2000, new types of video game consoles (i.e. Microsoft Xbox and Kinect, Nintendo
Wii or Sony Move) often tagged as Exergames have been introduced in which users have to interact
physically in order to advance in the game. Claiming that Exergames can promote an active lifestyle,
they don’t actually increase levels of physical activity but rather the motivation to perform some basic
repetitive movements (Peng et al., 2013).
As one of the genres of popular games, virtual sports encourage participants to perform the activity as
though they are playing the real sport. These systems use several methods to detect the movements of
players. Adaptations to active video games may happen after playing for some time. In fact, most of the
users start playing technically rather than emotionally which means that they will learn how to play the
game with less effort (Pasch et al., 2009). One of the causes is related to specifications of the platform
used, which allows for the use of such strategies. For example, Nintendo Wii uses a sensor which detects
the movement with an internal accelerometer. Although the optimum goal is to perform the complete
movements in virtual sports, there is always the possibility of “cheating” due to the user being able to
easily fool the accelerometer by using one’s wrist to manipulate the controller (Lavac et al., 2009). This
possibility is often discovered through experience or learning other players’ styles of playing.
On the other hand, as there is no exact force confronting players’ actions, there are some concerns
regarding efficacy and safety during the use of Exergames, especially when high exposure to the game is
expected. Characterizing Exergames biomechanically allows designers to create more realistic games for
Proceeding of 7th European Conference on Games
Based Learning (ECGBL2013)
Porto, Portugal
794
a more meaningful experience; it will allow hardware developers to identify the limitations of their
platforms in order to minimize the effects of learning; reduce musculoskeletal injuries (accidents due to
limitations of players both in terms of space and muscle activity), and create additional resources (e.g.
warm up and cool down periods).
Therefore the purpose of this work-in-progress is to compare spatiotemporal parameters between
novice and experienced players to characterize possible learning occurring during playing virtual sports.
Methods: Ten healthy subjects (6 male and 4 female; Age: 22-31) played Michael Phelps: Push the Limit
(505 Games, Milan, Italy) virtual swimming game using Xbox 360 and Kinect (Microsoft, Redmond, WA).
Subjects were divided into two groups of “Bad Performers” if their ranking during the game was 1st to 4th
and “Good Performers” if their position was 5th to 8th. All testing was conducted on the dominant arm.
Virtual Swimming: Subjects had to stand in front of the Kinect sensor and had to bend forward and as
soon as they saw the “Go!” command, they had to return back to normal position with arms in front.
After that, they had to swing their arms in order to move the avatar in the game (100-meter front crawl
swimming). At the end of the event, they had to drop both hands and then raise one of them to finish
the race. In order to prevent the player from swimming too fast or too slow, there is a spectrum on the
screen with a blue zone in between which indicates if the speed is at the moderate level. At the middle
of the second lap, there is a possibility to swim as fast as possible called “Push the Limit”. We called it
“fast” swimming.
Collection of Kinematics data: Dominant arm’s movements were recorded at 200 Hz with a 12-camera
Qualisys motion capture system (Qualisys AB, Gothenburg, Sweden). Before each experiment, the
cameras were calibrated to the measurement volume. 22 spherical reflective markers were placed over
the skin. Collection of data was started when the subjects were placed at the “ready” position over a
period of one minute. The data were collected in acquisition software (Qualisys Track Manager).
Swimming technique and definition of cycles: The event was divided into four phases as suggested by
Maglischo (1993). Based on the speed (Normal Vs. Fast), Good and Bad Performers were compared. The
swimming cycle began with stretching the right arm forward which is considered as “Entry”. As the so
called propulsive phase of left arm finished, a phase called “Downsweep+Catch” starts. Some
characteristics of this phase are different than in real swimming due to the position of the body.
Following this phase, the hand moves in a circular sweep known as the “Insweep”. Hand direction
switches out, back, and up in a term called “Upseep”. This phase finishes as the hand passes the thigh
where its direction changes from back and up, to up and forward which is known as the “Recovery
phases.
Statistical Analysis: All data was statistically analysed using SPSS version 20. An independent sample t-
test was conducted to compare spatiotemporal parameters in two performance groups. Statistical
significance was accepted at p ≤ 0.05.
Results: Total time to complete the event, numbers of cycles, start, average and max velocities, and
angular distance covered during the event are presented in Table 1. A sample movement pattern
created by a marker placed on the dominant hand in line with the index finger for both performance
groups was shown in Figure 1. As shown especially in superior view, bad performers’ moving pattern is
Proceeding of 7th European Conference on Games
Based Learning (ECGBL2013)
Porto, Portugal
795
closer to real swimming following swimming phases in their performance while the good performers
were creating a circular pattern. Time Motion Analysis and percentage of time dedicated to each phase
is shown in Table 2.
As shown in table 1, Good performers completed the event in a significantly shorter time (t(4.45)=-4.99,
p = 0.01). They also had lower numbers of cycles during both normal and fast swimming (t(8)=-2.64, p =
0.03 and t(4.34)=-3.03, p = 0.03 respectively). There were no differences in start velocity between the
two groups (t(8)=-0.19, p = 0.86). Good performers had significantly lower velocity during normal phase
of swimming (t(8)=-2.24, p = 0.05). However, there were no significant differences in average velocity
and maximum velocity during fast swimming phase (t(8)=-2.95, p = 0.78 and t(8)=-1.34, p = 0.22
respectively). Bad performers covered significantly more angular distance (t(8)=-2.84, p = 0.02).
Table 1: Spatiotemporal parameters of 100-meters front crawl virtual swimming in two levels of
performance
PARAMETERS
PERFORMANCE
N
MEAN
STD. DEVIATION
TOTAL TIME OF EVENT* (s)
GOOD
5
48.40
0.89
BAD
5
57.00
3.74
TOTAL NUMBERS OF CYCLES*: NORMAL
GOOD
5
36.60
3.21
BAD
5
46.40
7.63
TOTAL NUMBERS OF CYCLES*: FAST
GOOD
5
8.80
0.45
BAD
5
11.80
2.17
START VELOCITY (m.s-1)
GOOD
5
5.0640
1.64
BAD
5
4.8760
1.53
AVERAGE VELOCITY*: NORMAL (m.s-1)
GOOD
5
2.5160
0.52
BAD
5
3.1720
0.39
AVERAGE VELOCITY: FAST (m.s-1)
GOOD
5
3.9660
0.91
BAD P
5
4.1240
0.78
MAX VELOCITY: FAST (m.s-1)
GOOD
5
5.9100
1.10
BAD
5
7.1480
1.74
TOTAL DISTANCE COVERED* (m)
GOOD
5
115.00
24.32
BAD
5
160.60
26.35
*: Significant differences were observed between the two performance groups
Proceeding of 7th European Conference on Games
Based Learning (ECGBL2013)
Porto, Portugal
796
FRONTAL VIEW
BAD
PERFORMERS
GOOD
PERFORMERS
Figure 1: Sample hand pattern in one complete cycle in front crawl
Table 2: Time Motion Analysis of different phases of virtual swimming between novice and expert
players
FRONT CRAWL
PERCENTAGE OF TIME IN EACH PHASE: NORMAL [FAST SWIMMING]
ENTRY
DOWN+CATCH+INSWEEP
UPSWEEP
RECOVERY
GOOD PERFORMERS
25±5 [25±1]
28±5 [25±3]
19±7 [20±2]
26±3 [27±2]
BAD PERFORMERS
30±7 [30±6]
29±4 [27±4]
16±2 [19±3]
21±5 [22±5]
Numbers are expressed in Mean±SD.
Discussion: The purpose of this WIP was to detect the learning effects occurring during the playing of
virtual sports using biomechanics. The preliminary results show that, in general, the movement pattern
of bad performers was closer to real swimming. As a result of learning, good performers were focused
more on completion of the circular movement.
Bad performers wanted to adapt their movements to the spectrum and sometimes they swung their
arms slower in order to decrease the speed of the avatar in the game. They dedicated more time to
learning how to adapt to the game. Average velocity was lower in good performers because of the
consistency of their movements. As good performers had lower numbers of cycles, angular distance
covered was also lower. The good performers dedicated more time to the recovery phase as they were
creating a circular pattern while bad performers spent more time to the down+catch+insweep phase
which shows that they were following the real swimming pattern and therefore spent more time in this
phase.
Proceeding of 7th European Conference on Games
Based Learning (ECGBL2013)
Porto, Portugal
797
According to our observations, as bad performers entered the fast swimming phase (Push the Limit),
they stopped following the real-swimming-movements. Good performers prioritized their movements to
make more circular pathways. As good performers learned how to play the game, they perceived that
real-swimming-movements were not necessary to play the game.
Previously, virtual reality has been used to teach in several training programs (Snyder et al., 2011). As
these gaming environments provide similar environments (Miles et al., 2012), and because of time
constraints, virtual sport exergames might be a good alternative to be considered in tandem with
traditional training methods. The biomechanical analysis used in the games may provide an image of
how reliable these systems are in terms of teaching and structuring practice; especially when it comes to
unsupervised long term usage.
Exergames may benefit players physiologically, but since the possibility of cheating exists due to the
technical limitations of different platforms, developing a detailed characterization of these games may
provide valuable information to be used in the feedback provided by these games. If we consider the
process of learning during the use of exergames, good performers adapted their movement in order to
win the game while bad performers were more focused on the accuracy of their movements. It seems
that the Kinect sensor is not able to detect the delicate movements which may prove to be a good
reason to switch from performing real movement to adaptive movements in exergames.
References
Levac, Danielle, Pierrynowski, Michael R., Canestraro, Melissa, Gurr, Lindsay, Leonard, Laurean, &
Neeley, Christyann. (2010) "Exploring children’s movement characteristics during virtual reality
video game play" Human Movement Science, Vol. 29, No. 6, pp 1023-1038.
Maglischo, E. W. (1993) Swimming even faster. Mayfield Publishing Co., Mountain View, Calif.; United
States.
Miles, Helen C., Pop, Serban R., Watt, Simon J., Lawrence, Gavin P., & John, Nigel W. (2012) "A review of
virtual environments for training in ball sports" Computers & Graphics, Vol. 36, No. 6, pp 714-
726.
Pasch, Marco, Bianchi-Berthouze, Nadia, van Dijk, Betsy, & Nijholt, Anton. (2009) "Movement-based
sports video games: Investigating motivation and gaming experience", Entertainment
Computing, Vol. 1, No. 2, pp 49-61.
Peng, Wei, Crouse, Julia C., & Lin, Jih-Hsuan. (2013) "Using Active Video Games for Physical Activity
Promotion: A Systematic Review of the Current State of Research", Health Education &
Behavior, Vol. 40, No. 2, pp 171-192.
Snyder, Christopher W., Vandromme, Marianne J., Tyra, Sharon L., Porterfield, John R., Jr., Clements,
Ronald H., & Hawn, Mary T. (2011) " Effects of virtual reality simulator training method and
observational learning on surgical performance", World Journal Of Surgery, Vol. 35, No. 2, pp
245-252.
... For example, when we play exergames, we constantly use visual information within the game to progress. In case of sport exergames, a negative feedback leads to change movement from original (or real sport movement) to certain degrees which are enough to proceed in the game (Soltani & Vilas-Boas, 2013). ...
... Another possible explanation would be that as the games involve lots of repetitive movements or the movements are tiring, players are looking for strategies to exert less. This is happening as they switch from emotional playing to technical playing (Soltani & Vilas-Boas, 2013). ...
... For example, when we play exergames, we constantly use visual information within the game to progress. In case of sport exergames, a negative feedback leads to change movement from original (or real sport movement) to certain degrees which are enough to proceed in the game (Soltani & Vilas-Boas, 2013). ...
... Another possible explanation would be that as the games involve lots of repetitive movements or the movements are tiring, players are looking for strategies to exert less. This is happening as they switch from emotional playing to technical playing (Soltani & Vilas-Boas, 2013). ...
Chapter
Exergames may provide low-cost solutions for playing, training and rehabilitation. Exergame user research, studies the interaction between an exergame and users, in order to provide feedback for game developers and safe and meaningful game play. Detailed evaluations and a coding system based on muscle activation levels are necessary to characterize. This is important when it comes to use exergames in purposes other than fun. The purpose of this chapter was to characterize the muscle activation during a swimming exergame and to compare the level of activation during different conditions. Healthy subjects played bouts of exergame using Xbox360 and Kinect. Muscle activation was monitored for desired muscles on dominant upper limb using wireless electromyography system. An investigation of muscular coordination was also conducted to provide activation sequences of studied muscles. Preliminary results showed that upper trapezius was the most active muscle in all techniques. Results can provide insights for practitioners to have a baseline on application of exergames in their routines.
... For example, when we play exergames, we constantly use visual information within the game to progress. In case of sport exergames, a negative feedback leads to change movement from original (or real sport movement) to certain degrees which are enough to proceed in the game (Soltani & Vilas-Boas, 2013). ...
... Another possible explanation would be that as the games involve lots of repetitive movements or the movements are tiring, players are looking for strategies to exert less. This is happening as they switch from emotional playing to technical playing (Soltani & Vilas-Boas, 2013). ...
Chapter
Full-text available
Exergames may provide low-cost solutions for playing, training and rehabilitation. Exergame user research (EUR), studies the interaction between an Exergame and users, in order to provide feedback for game developers and safe and meaningful gameplay. Detailed evaluations and a coding system based on muscle activation levels are necessary to characterize Exergames. This is important when it comes to use exergames in purposes other than fun. The purpose of this chapter was to characterize the muscle activation during a swimming Exergame as an example and to compare the level of activation during different conditions. Healthy subjects played bouts of Exergame using Xbox360 and Kinect. Muscle activation was monitored for desired muscles on dominant upper limb using wireless electromyographic system. Preliminary resutls showed that upper trapezius was the most active muscle in all techniques. An investigation of muscular coordination was also conducted to provide an activation sequences of studied muscles. Results can provide insights for practitioners to have a baseline on application of exergames in their routines. Citation: Soltani, P., Vilas-Boas J.P. Muscle activation during exergame playing. In: Novák, D., Tulu, B., & Brendryen, H. (eds.). (2016). Handbook of Research on Holistic Perspectives in Gamification for Clinical Practice (pp. 312-341). Hershey, PA: IGI Global. doi:10.4018/978-1-4666-9522-1
... Finally, AVG can significantly increase energy expenditure (Lyons et al., 2011), improve sports skills (Soltani, & Vilas-Boas, 2013) and can thereby battle against obesity (Staiano et al., 2012). Many schools are beginning to use AVG as an appointment work out for students in their physical curriculum (Finco, Reategui, Variani, & Zaro, 2013). ...
Article
Full-text available
p class="AbstractText">This article sets out to conduct a systematic review of the current literature on active video games as potential educational tools for physical education or physical activity. To begin with, research on active video games for educational and physical purposes has been examined with the purpose of verifying improvement of attitudes, intellectual skills, knowledge, motor skills and physical properties associated with physical activity and physical education. A second aim will be to determine the effectiveness of active video games compared with traditional approaches to physical activity. From this perspective, a systematic literature search from relevant international databases was conducted from January to July 2015 in order to find papers published in journals or conference proceedings from January 2010 onwards. Then, 2648 references were identified in database searches and 100 of these papers met the inclusion criteria. Two main conclusions are to be drawn from this research. Firstly, controlled studies demonstrate that active video games increase capacities in relation to physical activity and education. Secondly, Research also shows that physical activity interventions designed and measured using behavioural theories are more likely to be successful in comparison with traditional exercise activities.</p
Article
Full-text available
This systematic review evaluates interventions using active video games (AVGs) to increase physical activity and summarizes laboratory studies quantifying intensity of AVG play among children and adults. Databases (Cochrane Library, PsychInfo, PubMed, SPORTDiscus, Web of Science) and forward citation and reference list searches were used to identify peer-reviewed journal articles in English through March 2011. Studies that used off-the-shelf AVGs to increase physical activity with quantitative outcomes or studies that quantified intensity of AVG play were included. Information on sample characteristics, AVGs employed, study design and conditions, outcome measures, results, and conclusions was extracted by two researchers. Intervention studies were ranked on design quality. Thirteen interventions and 28 laboratory studies were identified. All laboratory studies demonstrated that AVGs are capable of providing light-to-moderate intensity physical activity. However, only three interventions supported AVGs as an effective tool to significantly increase physical activity or exercise attendance. As AVGs are becoming more popular, additional research is needed to determine how to capitalize on the potential of AVGs to increase physical activity.
Article
Full-text available
Video game consoles that enable gamers to use active body movements are becoming increasingly popular. Yet, little is known about the influence of movement on how gamers experience such games. This study takes an exploratory approach, using different data collection methods. A theory about the relationship between body movement and gaming experience emerges through the systematic collection and analysis of data obtained from interviews, questionnaires, video observations and a motion capture system. A Grounded Theory analysis of the interviews reveals two distinct motivations (to achieve and to relax) with which gamers approach such games, together with two corresponding movement control strategies. Four movement-specific items are found to influence immersion in movement-based interaction: natural control, mimicry of movements, proprioceptive feedback, and physical challenge. These results are verified by exploiting the movement patterns of gamers playing the Nintendo Wii Boxing game. This theory offers insights to game designers as to how to design future generations of movement-based games. Whilst a controller that leaves more space for appropriation can be appealing to a larger population, its design may fail to promote and motivate physical activity and emotional well-being.
Article
Virtual reality (VR) simulators and Web-based instructional videos are valuable supplemental training resources in surgical programs, but it is unclear how to optimally integrate them into minimally invasive surgical training. Medical students were randomized to proficiency-based training on VR laparoscopy and endoscopy simulators by two different methods: proctored training (automated simulator feedback plus human expert feedback) or independent training (simulator feedback alone). After achieving simulator proficiency, trainees performed a series of laparoscopic and endoscopic tasks in a live porcine model. Prior to their entry into the animal lab, all trainees watched an instructional video of the procedure and were randomly assigned to either observe or not observe the actual procedure before performing it themselves. The joint effects of VR training method and procedure observation on time to successful task completion were evaluated with Cox regression models. Thirty-two students (16 proctored, 16 independent) completed VR training. Cox regression modeling with adjustment for relevant covariates demonstrated no significant difference in the likelihood of successful task completion for independent versus proctored training [Hazard Ratio (HR) 1.28; 95% Confidence Interval (CI) 0.96-1.72; p=0.09]. Trainees who observed the actual procedure were more likely to be successful than those who watched the instructional video alone (HR 1.47; 95% CI 1.09-1.98; p=0.01). Proctored VR training is no more effective than independent training with respect to surgical performance. Therefore, time-consuming human expert feedback during VR training may be unnecessary. Instructional videos, while useful, may not be adequate substitutes for actual observation when trainees are learning minimally invasive surgical procedures.
Article
There is increasing interest in the use of commercially-available virtual reality video gaming systems within pediatric rehabilitation, yet little is known about the movement characteristics of game play. This study describes quantity and quality of movement during Nintendo Wii and Wii Fit game play, explores differences in these movement characteristics between games and between novice and experienced players, and investigates whether motivation to succeed at the game impacts movement characteristics. Thirty-eight children (aged 7-12) with and without previous game experience played Wii (boxing and tennis) and Wii Fit (ski slalom and soccer heading) games. Force plate data provided center of pressure displacement (quantity) and processed pelvis motion indicated smoothness of pelvic movement (quality). Children rated their motivation to succeed at each game. Movement quantity and quality differed between games (p<.001). Children with previous experience playing Wii Fit games demonstrated greater movement quantity during Wii Fit game play (p<.001); quality of movement did not differ between groups. Motivation to succeed did not influence the relationship between experience and outcomes. Findings enhance clinical understanding of this technology and inform the development of research questions to explore its potential to improve movement skills in children with motor impairments.
Swimming even faster
  • E W Maglischo
Maglischo, E. W. (1993) Swimming even faster. Mayfield Publishing Co., Mountain View, Calif.; United States.
Using Active Video Games for Physical Activity Promotion: A Systematic Review of the Current State of Research
  • Wei Peng
  • Julia C Crouse
  • Lin
  • Jih-Hsuan
Peng, Wei, Crouse, Julia C., & Lin, Jih-Hsuan. (2013) "Using Active Video Games for Physical Activity Promotion: A Systematic Review of the Current State of Research", Health Education & Behavior, Vol. 40, No. 2, pp 171-192.