ArticlePDF Available

Shallow Gamification - Testing Psychological Effects of Framing an Activity as a Game


Abstract and Figures

This article experimentally dissociates the psychological impact of framing versus game mechanics, when presenting a serious activity as a game. Studies of game elements in nongame contexts tend to describe full packages, with no way of assessing their individual psychological and functional impact. To isolate the effects of framing, students (N = 90) were assigned to either discuss study environment issues through a list of questions, via a competitive discussion board game, or though the same game artifacts but with no game mechanics. Task engagement and self-reported intrinsic motivation were compared between groups. Results demonstrate that the effects of simply framing the activity as a game though vernacular and artifacts holds almost as much psychological power as the full game mechanics. In both game conditions, interest and enjoyment were significantly superior to controls, but other intrinsic motivation variables remained unchanged. Implications for game design in nongame contexts are discussed, and a framework for differentiating “deep and shallow gamification” in terms of mechanics and framing is developed.
Content may be subject to copyright.
Games and Culture
The online version of this article can be found at:
DOI: 10.1177/1555412014559978
published online 1 December 2014Games and Culture
Andreas Lieberoth
as a Game
Shallow Gamification: Testing Psychological Effects of Framing an Activity
Published by:
can be found at:Games and CultureAdditional services and information for Alerts:
What is This?
- Dec 1, 2014OnlineFirst Version of Record >>
by guest on December 3, 2014gac.sagepub.comDownloaded from by guest on December 3, 2014gac.sagepub.comDownloaded from
Original Manuscript
Shallow Gamification:
Testing Psychological
Effects of Framing an
Activity as a Game
Andreas Lieberoth
This article experimentally dissociates the psychological impact of framing versus
game mechanics, when presenting a serious activity as a game. Studies of game
elements in nongame contexts tend to describe full packages, with no way of
assessing their individual psychological and functional impact. To isolate the
effects of framing, students (N¼90) were assigned to either discuss study
environment issues through a list of questions, via a competitive discussion
board game, or though the same game artifacts but with no game mechanics.
Task engagement and self-reported intrinsic motivation were compared
between groups. Results demonstrate that the effects of simply framing the
activity as a game though vernacular and artifacts holds almost as much psycho-
logical power as the full game mechanics. In both game conditions, interest and
enjoyment were significantly superior to controls, but other intrinsic motivation
variables remained unchanged. Implications for game design in nongame contexts
are discussed, and a framework for differentiating ‘‘deep and shallow gamifica-
tion’’ in terms of mechanics and framing is developed.
School of Business and Social Sciences, Department of Psychology and Behavioral Sciences, Aarhus
University, Aarhus, Denmark
Interacting Minds Center (IMC), Aarhus University, Denmark
Center for Community Driven Research (CODER) Aarhus University, Denmark Center for
Corresponding Author:
Andreas Lieberoth, School of Business and Social Sciences, Department of Psychology and Behavioral
Sciences, Aarhus University, Bartholins Alle 16, Aarhus N, DK-8000, Denmark.
Games and Culture
ªThe Author(s) 2014
Reprints and permission:
DOI: 10.1177/1555412014559978
by guest on December 3, 2014gac.sagepub.comDownloaded from
gamification, framing, serious games, game psychology, game mechanics, intrinsic
motivation, experiment
Games are becoming pervasive tools for framing, structuring, and motivating activ-
ities, ranging from consumer behavior, over online participation in science, to orga-
nizational processes. The term gamification has gained traction in describing the
piecemeal use of game design elements in nongame contexts (Deterding, Khaled,
Nacke, & Dixon, 2011) or implementing design concepts from games, loyalty pro-
grams, and behavioral economics to drive user engagement (Zichermann & Linder,
2013) but has in common parlance gradually (e.g., Kapp, 2012) come to refer to any
process using games and game-like phenomena in nonleisure settings (Lieberoth,
Møller, & Marin, 2014).
Studies of gamification tend to focus on the effect of piecemeal game mechanics,
and critics often call attention to the psychological impoverishment brought about by
mobilizing only a few game elements like points, badges, leaderboards, and set col-
lection in nongame contexts compare to leveraging full games, in e.g. education or
workplace facilitation (as per Deterding, Khaled, et al., 2011; e.g., Ferrara, 2013). As
such, game mechanics have been disentangled from their places in games, but the
framing of an activity as playful (or gameful, Deterding, Dixon, Khaled, & Nacke,
2011) has yet to be empirically studied as an independent effective component in the
game-based experience.
This study sets out to test the social psychological effects of framing serious tasks
as gaming in a way that is dissociable from the impact of game mechanics and exist-
ing properties of the core task. Our experiment tests the ‘‘framification’’ hypothesis
that the immediate framing of an activity with game elements and vernacular, but
little or no good game mechanics, can still have a measurable psychological impact
on engagement. We used highly recognizable trappings of traditional ‘‘race’’ board
games (i.e., Bell, 1973) to set up a social activity and compared effects on individual
and shared engagement using a randomized controlled setup. Dependent variables
were both subjective and behavioral, following the intrinsic motivation setup (for
a review, see Deci, Koestner, & Ryan, 1999). The board game was chosen for its
simple design requirements and also to address the so far underdescribed practice
of using board- and card game elements as communication and learning tools in
organizations (for exceptions touching on the subjects, see Eisenack, 2012; Rehn,
2008). For instance, titles like Co-Creator and Wallbreakers are used to generate
exchanges among stakeholders and participants with challenges in organizational
processes (for a review of games in organizations, see Henriksen, 2010)
Gamifying serious settings can also generate both engagement and resistance
(Heeter, Lee, Magerko, & Medler, 2011; Shen, Wang, & Ritterfeld, 2006), but little
2Games and Culture
by guest on December 3, 2014gac.sagepub.comDownloaded from
effort has been dedicated to study what happens to engagement and productivity
when players know that they are ‘‘just’’ playing a game. So an emerging question
is: Can the social and psychological frames of gaming and serious work coexist?
By looking to the social processes going on in nondigital games, through the lens
of experimental social psychology, we can learn much about the basic social and
cognitive factors that come into at play when simulations and games are deployed
in the workplace. Ninety psychology students were divided into three conditions
and given different materials to facilitate discussions about a recent student’s satis-
faction survey designed to mirror a workplace evaluation processes. Some played a
simple ‘‘race-and-quiz’’ game with performance-contingent progress, where the best
discussion facilitator would win. Others were given a mock version with no game-
play beyond superficial turn taking. Controls worked from written instructions
alone. It was found that the mock ‘‘frame only’’ game materials worked just as well
(or bad) as the real thing in terms of intrinsic motivation (Deci & Ryan, 2008), but
with added experiences of interest and engagement. A significant part of the subjec-
tive engagement experienced in game situations would thus seem attributable to
social and psychological framing alone.
Psychological and Mechanical Constituents of the Gaming Frame
Positive experiences in games used for serious purposes might stem from a combi-
nation of mechanics, superficial but alluring outward design, and the expectations of
fun generated when people believe they are about to play a game. Indeed, visual
appeal and simple interactions seem to be among the strongest psychological attrac-
tors for the casual gamer (Juul, 2010). Core mechanics and aesthetic production val-
ues in serious games may seem impoverished compared to successful commercial
titles, especially in the fast-moving digital realm, but psychological criteria like
effort, valorization of outcome, competence, autonomy, and relatedness (Juul,
2005; Rigby & Ryan, 2011) can still be sparked by the frame alone.
The emerging game science literature defines games as systems or activities
made out of certain recurring constituent parts, which are sometimes described in
psychological terms and other times as game mechanical elements. For instance,
McGonigal lists goal, rules, feedback system, and voluntary participation
(2011)—a mix of psychological and design-oriented features. Rigby and Ryan
(2011) focus on strictly psychological factors, namely, games’ ability to satisfy
competence,autonomy, and relatedness. Framing is strongly present in defining fea-
tures like voluntary participation in games (McGonigal, 2011), as well as in their
artificial (Salen & Zimmerman, 2004), abstract (Koester, 2004), and/or fictional
(Juul, 2005) nature, in the negotiable consequences (Juul, 2005) and centrally accep-
tance of rules, goals, and outcomes on the player’s part (Juul, 2005; Koester, 2004;
McGonigal, 2011; Salen & Zimmerman, 2004). A key component to game engage-
ment thus seems to be the way people understand differences between situations,
such as playing versus arguing (Bateson, 1972; Goffman, 1976). Frames enable us
Lieberoth 3
by guest on December 3, 2014gac.sagepub.comDownloaded from
to more or less consciously navigate the different situations that confront us in our
daily lives and activate cognitive and cultural scripts (Schank & Abelson, 1977)
and schemas (Bartlett, 1932). As one layman author puts it, writing about the plea-
sure found in the repetitive chores in World of Warcraft: ‘‘The difference for these
teenagers was that these small mundane tasks were considered fun, because it was
done in the game world’’ (Marczewski, 2012, pp. 176, 700). This is not to advocate
a strict separate worlds view (as per Stevens, Satwicz, & McCarthy, 2008) between
games, cognition, and reality but to highlight the fact that participants are able to
identify a game as a particular kind of activity with implicit rules (Bergstro¨m,
2010) accompanied by expectations of playful engagement (Apter, 1991; Suits,
1972). Gameplay emerges in this dynamic but is rarely determined by the game
mechanics alone. There are often many ways to play the same game dependent
on informally negotiated rules, mindsets, and the context of play (Elias, Gar-
field, & Gutschera, 2012; Kallio, Ma¨yra¨, & Kaipainen, 2010).
The cognitive and behavioral effect of framing on behavior is well known within
social psychology (Cesario, Corker, & Jelinek, 2013; Landau, Keefer, & Rothschild,
2014), where experiments can be used to manipulate how the stakes, outcomes, and
social configurations of different decision tasks are experienced (Ku
¨hberger, 1998;
McNeil, Pauker, Sox, & Tversky, 1982; Reyna et al., 2011; Tversky & Kahneman,
1974). Framing effects have also been discussed at some length in the study of
games and media (de Freitas, Rebolledo-Mendez, Liarokapis, Magoulas, & Poulo-
vassilis, 2010; Deterding, 2009; Harviainen & Lieberoth, 2011; Scheufele, 1999) but
rarely as an empirically testable constituent of gameplay psychology.
This understanding of frames as central to the gaming experience leads to the
working hypotheses that simply framing an activity as a game should lead to changes
in behavior and subjective experience of intrinsic motivation.
Here, framing devices are thus understood as elements dissociable form
mechanics. Sicart (2008, p. 2) defines game mechanics as ‘‘methods invoked by
agents, designed for interaction with the game state.’’ Translated into nonvideo
game terms, this refers to the designed-for junctions during the activity, where play-
ers and parts of the game influence each other directly. For instance, drawing a lucky
card and getting the last ‘‘cheese’’ in Trivial Pursuit significantly alters the game
state, with a new goal of getting to the middle. In video games, most rules are pre-
programmed and must be learned through play. Aesthetics and narrative elements
may also have mechanical functions as mediators of goals, feedback, and interaction
affordances. In addition, most games suppose a well-defined game space, which is
often shared and supported by physical artifacts like wii-motes, playing cards, wres-
tling rings, or simply a particular use of a coin (e.g., flipping and trying to bounce it
into a cup). Form and material artifacts, in other words, hold psychological and cul-
tural meanings in addition to serving practical mechanical purposes.
Framing thus exists in a reciprocally constituting relationship to materiality and
rule mechanics: Their presence helps constitute the frame as well as structuring the
4Games and Culture
by guest on December 3, 2014gac.sagepub.comDownloaded from
activity, but conversely, acceptance of the emerging gaming mind-set also orients
players toward mechanical game elements.
Intrinsic Motivation as Measure of Engagement
In most cases, the goal of applying games in serious settings is to create sustained
engagement (Rigby & Ryan, 2011), with subjective experiences of enjoyment as
a happy but loudly touted by-product. Intrinsic motivation can be defined as the
doing of an activity for its inherent satisfaction, rather than some separable conse-
quence (Ryan & Deci, 2000, p. 56) which conceptually translates into the notion
of paratelic engagement (Apter, 1991; as per Suits, 1972)— or fun. This study
adapted the self-determination theory’s (SDT) Intrinsic Motivation Inventories
(IMIs), which have been widely applied to learning and work, and also gaming
(Bumpus, Olbeter, & Glover, 1998; Deci et al., 1999; Ryan, Rigby, & Przybylski,
2006). Deci’s (1980) theory centrally holds that intrinsic motivation stems not only
from the immediately observable relationship of a task with rewards (social, mate-
rial, or otherwise) but also from the reward’s function as meaningful feedback in the
perception of self-propelled progress. According to the theory, competence, auton-
omy, and social relatedness constitute three basic psychological motives that games
are ideally poised to fulfill (Rigby & Ryan, 2011; Ryan et al., 2006). Intrinsic motiva-
tion has been showed to work at several contextual levels, from being an active sports
practitioner down to individual matches (Blanchard, Mask, Vallerand, de la Sablon-
nie`re, & Provencher, 2007), or from school in general down to an autonomy-
hampering experience reflecting negatively on motivation in subsequent classes
(Radel, Pelletier, Baxter, Fournier, & Sarrazin, 2014). However, factors like achieve-
ment orientation have also been known to influence enjoyment stemming from clas-
sical game elements like competition (Tauer & Harackiewicz, 1999), meaning that
there is no one-size-fits-all relationship between game design and intrinsic interest and
enjoyment. In accordance with the SDT tradition, the study reported here used both
behavioral measures of time spent on task and the six-subscale IMI battery to measure
intrinsic motivation. The interest/enjoyment subscale with its items on ‘‘fun,’’ ‘‘bore-
dom,’’ and sustained attention was of particular interest, because the IMI (1994)
defines it as the central single measure of intrinsic motivation.
Ninety volunteers were recruited from a third year psychology student cohort
(72 females, ages 20–43, M¼23.49, SD ¼3.355) and randomly assigned to three
conditions: Full game, framing, or controls (core task only; see Table 1).
Participants were told that INPUT (without any mention of gaming) is a popular
business consulting tool under consideration by the university for future student
satisfaction surveys (deception). Participants would take part in a pilot designed
Lieberoth 5
by guest on December 3, 2014gac.sagepub.comDownloaded from
as a randomized controlled trial to evaluate different incarnations of the product.
Their inputs would reach the department head of studies (true). No credits or mon-
etary compensation were offered in accordance with Danish university standards,
but participants were given refreshments after the study.
Table 1. The Three Experimental Conditions.
Core task Control
Instruction sheet
Input sheet w./rating stars
pr. item
Discussion prompts on paper
Five clusters of six participants took
turns reading questions from a list
The reader facilitated a brief
discussion and noted down inputs,
possibly directed by an icon on the
The group then rated the discussion
item and their own inputs with one
to five stars
Game Conditions Game condition 1
Instruction sheet
Input sheet w./rating stars
pr. item
Pawns on game board
Discussion prompts on game
Five clusters of six participants took
turns moving pawns to the next
vacant space, drawing a facedown
card, and reading it
The reader facilitated a brief
discussion and noted down inputs,
possibly directed by an icon on the
game board
The group then rated the discussion
item and their own inputs with one
to five stars
Game condition 2
Form þMechanics
Instruction sheet
Input sheet w./rating stars
pr. item
Pawns on game board
Discussion prompts on game
Five clusters of six participants took
turns drawing a facedown card, and
reading it
The reader facilitated a brief
discussion and noted down inputs,
possibly directed by an icon on the
The group then rated the discussion
item and their own inputs with one
to five stars
The reader was then allowed to
move his piece along the track
contingent on the number of stars
given. The player who progressed
the furthest was declared the
Note. ‘‘rating stars’’ refers to the in-game rating of items and players’ own responses. N¼30 participants
in each group before missing data.
Icons on the control condition sheets were assigned with the same frequency as on the game-board.
Four icon cards allowing players to assign stipulations to another participant’s discussion card were
mixed into the deck for added interaction.
6Games and Culture
by guest on December 3, 2014gac.sagepub.comDownloaded from
Participants were set to do to the same core task, but with different framing through
artifacts and assistants’ descriptions: One framing group was given the task with
game artifacts (a game board, cards with discussion items, and pawns), to which
was added some simple competitive mechanics for a second full game group. The
control group did the core activity, but with nicely layouted paper sheets as
step-by-step instructions, to structure the activity. The core task can be summar-
ized as a social discussion in clusters of five to six people prompted by written
cues, with participants taking turns facilitating the conversation and writing down
feedback for the department. IMI and behavioral measures were used to test the
hypothesis that the framing effects of these manipulations could be measured in
terms of between-group differences in intrinsic motivation.
The six-player board game, titled INPUT, was designed following the recognizable
race/quiz formula known from family games, like Trivial Pursuit and Pictionary (see
Figure 1). Fourteen of the 28 fields on the game board included icons prompting
players to direct their discussion toward a particular group of stakeholders (myself,
us, the faculty, and the university). Pawns were placed on ‘‘start.’’ Cards with dis-
cussion prompts were packed in a random-looking order. To mirror workplace eva-
luations, items for discussion were chosen from all areas where our department
performed subpar in the 2011 student satisfaction survey (e.g., too few students feel
that they encounter their teachers outside the lecture halls), paired with a direct
prompt/question for discussion (e.g., what could be behind this statistic? or what
could be done about it?). Instructions and printed materials for each condition dif-
fered only in how to actually play the game/read the prompts and strategically placed
framing vernacular like ‘‘play,’’ ‘‘player’’ and ‘‘game,’’ in order to ensure similarity
between the conditions at all levels, except game elements.
In the control condition, participants were given the same core task, but on sheets
of paper with discussion items (including icons in the same order as on the game
board) appearing as a step-by-step list. Prominent graphics like the INPUT logo
were featured in the control condition’s materials to ensure a somewhat similar aes-
thetic feel.
After being given the cover story and randomly assigned to the three conditions, par-
ticipants were ushered off to three separate rooms. Clusters of six participants were
created ad hoc around tables containing the materials and instructed on their tasks
based on the (game) materials. Discussion clusters were encouraged to proceed at
their own pace but not devote too much time to each question. Each cluster of
Lieberoth 7
by guest on December 3, 2014gac.sagepub.comDownloaded from
players was supplied with printed rules/instructions and an INPUT sheet for writing
down their ideas and comments during the activity but encouraged to submit elec-
tronically, using an online SurveyXact-sheet, which supported time stamps for start
and completion.
Participants were mandatorily engaged in the activity for 30 min, after which an
assistant told them that the final evaluation questionnaire had not arrived yet and that
they had to stay seated to avoid contaminating the experiment (deception—a false
finish). Assistants quoted the script ‘‘you can go on playing/working if you like,
or you can do something else. As long as you stay put.’’ This started the 20-min
free-choice period, where the groups’ time on-task was monitored via SurveyXact
time stamps and end-time noted on paper. After the free-choice period, evaluation
questionnaires (paper and link to an online version) were distributed with our (fake)
apologies (see Figure 2).
A formal debriefing was given on the following lecture. Here, students were
informed of the experiment’s true purposes. A show of hands revealed that no one
Figure 1. Input game materials.
8Games and Culture
by guest on December 3, 2014gac.sagepub.comDownloaded from
Figure 2. Experimental procedure (50 min play þbriefing/debriefing and self-report questionnaires).
by guest on December 3, 2014gac.sagepub.comDownloaded from
had figured out the design, so no data were excluded from analysis on those grounds.
The university ethics board did not review the experiment, given its nonclinical
The IMI was used for self-report measures of engagement with 38 items distributed
on the subscales interest/enjoyment (7), value/usefulness (7), importance/effort (5)
and of course competence (6), autonomy (7), and relatedness (6).
Four items gauged whether the stimulus materials were convincing at face value,
as a professionally made consultant’s tool (as per the cover story), and 1 item gauged
whether it came across like a game. A 13-item Crown and Marlowe’s (1960) Social
Desirability Scale (trans. Lasgaard, Goossens, & Elklit, 2011) was used to test for
pleasing behavior.
Behavioral engagement was measured as the time six-person discussion clusters
would spend on-task during a 20-min free-choice period, in accordance with the
intrinsic motivation literature. The number of items addressed was also counted. The
number of items addressed was expected to be a secondary indication of engagement
and productivity.
The six-person discussion clusters were asked to rate the quality/importance of
each discussion item and the quality/importance of their own inputs after each dis-
cussion on scales from one to five ‘‘stars.’’ In Game condition 2, these in-game eva-
luations were also used as a performance contingent game mechanics (see Table 1).
Data Analysis
Ninety self-report questionnaires were collected. Behavioral data were successfully
recorded for 12 discussion clusters of five to six participants (two for Game condi-
tion 1, five for Game condition 2, and five for controls).
The data were analyzed using IMB SPSS 20.0 with Tukey’s post hoc tests applied
to one-way analyses of variance (ANOVAs). Missing values were handled using
mean imputation, where subjects had filled in over 80%of each self-report scale
(as per Schafer & Graham, 2002). IMI scales (a¼.743–.882) displayed good coher-
ence before mean imputation. One item was removed from the Social Desirability
Scale to achieve an acceptable avalue (12 items, a¼.649). Although slightly above
neutral (M¼3.337, SD ¼0.439), it showed a small positive correlation only with
the autonomy IMI subscale, r(89) ¼.239, p< .024. Pleasing behavior thus did not
appear to play a significant role in participants’ self-reports. Aggregating the data
into clusters and running a linear regression weighted by number of individuals in
each nested group yielded no significant overall differences between the clusters.
As predicted, main effects on the self-report measures seem to be found at condition
level. No significant effects on IMI scales were found for gender. Age showed a
small negative correlation only with relatedness, r(88) ¼.281, p< .008. Centrally,
10 Games and Culture
by guest on December 3, 2014gac.sagepub.comDownloaded from
the face-value item ‘‘INPUT was like a game’ confirmed the basic premise that both
game conditions would generate a more gamelike psychological frame than in the
control task, F(2, 69) ¼19.424, p< .001, partial Z
¼0.367. A Tukey’s post hoc
test revealed significant differences (p< .05–.001) between all three conditions:
Game condition 2 ranked highest (M¼3.68, SD ¼1.069), Game condition 1 fell
somewhat lower (M¼2.95, SD ¼1.133), and controls on average did not find their
activity gamelike at all (M¼1.83, SD ¼0.887). A similar confirmation emerged for
the 4-item scale (a¼.835) gauging whether INPUT comes across as a professional
consultancy tool, F(2, 68 ¼8.562, p< .001, partial Z
¼0.206, except here the two
game conditions (M¼3.524, SD ¼0.921 and M¼3.510, SD ¼0.765) both ranged
above controls (M¼2.652, SD ¼0.771) with no significant difference between
them. After accounting for missing values, such as lacking identity markers and
some unreliable time stamps resulting from technical issues with SurveyXact, 70
participants’ self-reports (control n¼23, Game 1 n¼22, Game 2 n¼25), but only
12 discussion clusters with just 2 of these (N¼11 individuals) in Game Condition 1,
could be treated as part of one of the three experimental conditions.
A one-way ANOVA revealed a significant difference in interest/enjoyment
between the conditions, F(2, 67) ¼8.223, p< .001, with a small-to-medium effect
size (Z
¼0.197). A Tukey’s post hoc test revealed that both Game condition 1
(form; M¼3.247, SD ¼0.854) and Game condition 2 (form þmechanics; M¼
3.366, SD ¼0.596) reported significantly higher (p<.007andp< .001, respec-
tively) interest/enjoyment than controls (M¼2.602, SD ¼0.614). No other IM-
subscales differed significantly between groups (Figure 3). All conditions reported
above medium totaled intrinsic motivation scale scores (M¼3.24–3.53), with no
significant differences between the three conditions, F(2, 68) ¼2.204 p< .118.
Behavioral data (Figure 4) were largely inconclusive. A Kruskal–Wallis test
uncovered no statistically reliable difference on the time the successfully recorded
discussion clusters (N¼12) spent on task (M¼43.385, SD ¼8.180) in Game con-
ditions 1 (M¼37.385, SD ¼1.280), 2 (M¼37.385, SD ¼1.2799), and controls
(M¼45.508, SD ¼2.638).
Controls addressed significantly more items (M¼9.800, SD ¼2.168, mean rank
¼8.50) than both Game condition 1 (M¼5.500, SD ¼0.707, mean rank ¼1.75)
and Game condition 2 (M¼7.667, SD ¼1.155, mean rank ¼5.00), H(2) ¼
6.702, p< .035, (overall M¼8.090, SD ¼2.343). There were no significant differ-
ences in average in-game evaluations.
The experience of INPUT as gamelike was significantly (p< .002) related to over-
all IM, r(89) ¼0.450, and to IMI subscales interest/enjoyment, value/usefulness, com-
petence, and autonomy with medium-to-large effect sizes. Similarly, the perception of
INPUT as a professional tool was positively correlated (ps < .002–.001) with IM, r(89)
¼0.656, and subscales, except for relatedness. See the matrix for full results.
Lieberoth 11
by guest on December 3, 2014gac.sagepub.comDownloaded from
The study confirms that framing has a significant effect on enjoyment, when a task is
presented as a game.
First, adding game artifacts significantly enhanced players’ face-value experi-
ence of INPUT as gamelike compared to controls, but only on the interest/enjoyment
subscale of intrinsic motivation, which within the self-determination framework
(IMI, 1994; Rigby & Ryan, 2011; R. M. Ryan et al., 2006) translates into the ‘‘fun’
of games.
Second, game mechanics only made a difference at the level of game likeness.
Having performance-contingent rules, where one player is declared the winner,
apparently made the experience seem more like a real game, but this translated into
neither significantly more fun nor motivation.
Third, the behavioral data must be viewed as largely inconclusive, as they lead to
neither acceptance nor rejection of the null hypothesis—largely due to missing data.
Control participants, who were only given comparably boring sheets of paper with
Figure 3. Intrinsic Motivation Inventory self-report results.
12 Games and Culture
by guest on December 3, 2014gac.sagepub.comDownloaded from
instructions and a bit of graphical varnish did, however, generate more outputs than
gaming participants. I surmise that that adding a playful frame to the task actually
took away some of the grit and output orientation of more goal-oriented work. If
at all significant, the numbers could simply stem from extra time spent fidgeting
with game artifacts and understanding game rules or from more thorough discus-
sions. We don’t know whether the high-producing clusters worked harder or simply
skipped more superficially across each item. This detrimental effect of adding a
lighter frame to serious activities, or alternatively its ability to engage people in con-
versations at a deeper level, is worth investigating further.
Ultimately, the fact that main effects on the intrinsic motivation variables were
only found in the interest/enjoyment subscale leads to the overall conclusion that
making something look like a game makes it seem more fun, but other motivational
variables remain largely unchanged.
Game artifacts and game vernacular thus seem to be good bare-bone tools for
making a rudimentary task more engaging at face value and creating a lighter
mind-set. It seems that the genre of consultancy/training games INPUT was modeled
after is therefore well suited to engage participants in infrequent activities, by virtue
of their ability to frame and structure, even without the mechanics that most game
designers strive to perfect.
Figure 4. Mean time spent on task during free-choice period in each condition.
Lieberoth 13
by guest on December 3, 2014gac.sagepub.comDownloaded from
We have ascribed this positive impact to framing effects resulting from recogniz-
able game artifacts and strategically used vernacular. Simple novelty effects repre-
sent an alternative explanation. Presenting people with new and complex
experiences is known to generate interest (Berlyne, 1954, 1970), so it is quite pos-
sible that the thin varnish in Game condition 1 would wear off, while players chal-
lenged by Condition 2’s relatively more competitive mechanics and thus more
variable game possibility space might to explore new strategies and strengthen their
sense of personal competence and autonomy in the longer term. Processes intended
to create replayability and sustained engagement may thus still need to focus on
well-tuned mechanics, even if an alluring gamelike form is fine for creating interest
and enjoyment in briefer activities. The contribution of the game materials relative
to social presentation (assistants speaking of the task as game or work) is unknown,
but dissociating the two by splitting Condition 1 into further subgroups is an inter-
esting line for potential future inquiry.
So how does this address the foundational debate about effective elements in
gamification? In its broadest current use (e.g., Kapp, 2012), the term means the pro-
cess of designing and using games for any serious purposes, but a more narrow def-
inition entails applying only game mechanics—often limited to points, badges,
quests, and leaderboards guided by simple behaviorist notions of motivation (e.g.,
Marczewski, 2012; Zichermann & Linder, 2010). In other words, traditional
Figure 5. Framing and mechanics as characteristics of shallow gamification.
14 Games and Culture
by guest on December 3, 2014gac.sagepub.comDownloaded from
gamification seeks to structure and motivate activities like chores, shopping, or
learning in a gamelike manner, without the framing that normally codifies an activ-
ity as a kind of game. This study in a sense legitimizes simple alluring designs that
frame activities as games but spare both designers and participants an overabun-
dance of rules and mechanics. These two design strategies—‘‘framification’’ versus
gamification—represent two widely used dimensions of the shallow end of the
gamification and applied games spectrum, which might be viewed as opposing quad-
rants of a 2 2 model (see Figure 5), where full games occupy the top-left quadrant.
Collecting data at the level of six-person discussion clusters made the study vulner-
able to several cases of missing behavioral data. In some instances, it was impossible
to place respondent data reliably in a condition or discussion cluster. The study
encountered several other challenges related to the social nature of our tasks. Indeed,
research continues to call attention to cultural and social processes ‘‘in-room’’ that
strongly affect cognition ‘‘in-game’’ (Stevens et al., 2008). For instance, it is hard to
predict whether individuals would have left the activity much earlier or would pri-
vately have liked to continue playing when their group stopped. Further, discussion
clusters were seated around tables in the same room for each condition, so it is likely
that overall in-room events, such as the first cluster collectively disengaging from
the task, influenced the entire condition. This could even negatively affect self-
reports about the experience as a whole, as individuals might feel less intrinsically
motivated in retrospect, due to group coercion. However, high levels on the related-
ness measure throughout, makes this unlikely. Although it would entail an entirely
different study, ethnographic observation of players’ interactions, including detailed
analysis of the time dedicated to subactivities like off-task chatter, mechanics, and
serious discussions, would offer important glimpses into the round-table dynamics
in a game like INPUT.
Since we took great pains making three conditions that were similar in all other
aspects than game form and mechanics, what we created for Game condition 2 was
not a great game by any stretch of the imagination. Although not significant, it is
however worth noticing that players in Condition 2 answered more positively than
both Condition 1 and controls on all self-report variables other than relatedness: A
tendency that future studies might be able to boost with better game mechanics.
Future Directions
The evidence-based literature on effective gamification components is still scattered
between applications and far from a point where systematic meta-analysis is possible
(Hamari, Koivisto, & Sarsa, 2014). Because just positing gamification as a lie like
Ferrara (2013) or bombarding interested practitioners with proposed use cases
(Bowser, Preece, & Hansen, 2013; Zichermann & Linder, 2010) is uninteresting and
Lieberoth 15
by guest on December 3, 2014gac.sagepub.comDownloaded from
counterproductive, researchers and practitioners alike are realizing the need to
knuckle down and register effect data—not just from subjective evaluations but also
observable behavior and net gains in the intended setting. Also, more studies should
try to break clusters of game elements down to individual functional units, to dis-
sociate which traditionally suggested gamification tricks work on their own or in
conjunction, in what context, and on what psychological and behavioral dimensions
impacts can be detected (for an unsuccesful attempt, see Lieberoth, Kock, Marin,
Planke, & Sherson, 2014).
Framing effects can also be moderated by a host of other factors, such as person-
ality traits (Levin, Gaeth, Schreiber, & Lauriola, 2002). While this study does con-
sider pleasing behavior and issues of face-value acceptance, future research should
address the deeper predictor structures arising from demographic factors (e.g., see
Kovisto & Hamari, 2014; Lieberoth, Kock, et al., 2014), personality variables and
even preferred play style (Heeter, 2009; Yee, 2007).
There was no right or wrong in the discussion tasks used in this study—just the
structured democratic notion of letting everyone contribute to an evaluation of their
shared educational environment. Future studies might be interested in whether framing
of fun versus seriousness affects the quality and not quantity of performance, including
creative and rote problem solving.
The experiment presented here supports the notion that framing accounts for a
significant part of the psychological impact games have on fun, engagement,
and other participation dynamics.
Overall, the effects of adding a ‘‘shallow’’ game coating to an otherwise serious
activity were found at the level of enjoyment and face-value appreciation of the
activity as gamelike—not engagement in a broader sense. The addition of compet-
itive game mechanics surprisingly did not make a difference.
Framing training activities or social exchanges with a gamelike design is an
effective way to engage people around a table and can capitalize on simple physical
artifacts to motivate and structure cognition and behavior. This study indicates that
good game mechanics are a nicety that may sometimes be psychologically second-
ary to the more shallow signals conveyed by the game artifacts themselves.
The author wishes to express his gratitude to Sigurd Rubech Hartmeyer-Dinesen for graphic
design, Kristina Schoemmel, Noomi Matthiesen, and Jesper Aagaard for their assistance run-
ning the experiment, and Klaus Nielsen and Andreea Marin for proof and comments.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship,
and/or publication of this article.
16 Games and Culture
by guest on December 3, 2014gac.sagepub.comDownloaded from
The author(s) disclosed receipt of the following financial support for the research, authorship,
and/or publication of this article: The author produced this research under funding from the
Aarhus University PhD program in psychology and behavioral sciences.
Apter, M. J. (1991). The structural phenomenology of play. In J. E. Kerr & M. J. Apter (Eds.),
Adult play: A reversal theory approach (pp. 13–30). Amsterdam, The Netherlands:
Sweits & Zeitlinger.
Bartlett, F. C. (1932). Remembering: A study in experimental and social psychology.
New York, NY: Cambridge University Press.
Bateson, G. (1972). Steps to an ecology of mind: Collected essays in anthropology, psychia-
try, evolution, and epistemology. Chicago, IL: University of Chicago Press.
Bell, C. M. (1973). Discovering old board games (2008th ed.). Oxford, England: Osprey.
Bergstro¨ m, K. (2010). The implicit rules of board games: On the particulars of the lusory
agreement. In Proceedings of the 14th International Academic MindTrek Conference:
Envisioning Future Media Environments. Tampere, Finland.
Berlyne, D. E. (1954). A theory of human curiosity. British Journal of Psychology,45, 180–191.
Berlyne, D. E. (1970). Novelty, complexity, and hedonic value. Perception and Psychophysics,
8, 279–286.
Blanchard, C. M., Mask, L., Vallerand, R. J., de la Sablonnie`re, R., & Provencher, P. (2007).
Reciprocal relationships between contextual and situational motivation in a sport setting.
Psychology of Sport and Exercise,8, 854–873. doi:10.1016/j.psychsport.2007.03.004
Bowser, A., Preece, J., & Hansen, D. (2013). Gamifying citizen science: Lessons and future
directions. In Proceedings of CHI’13 Workshop Designing Gamification: Creating
Gameful and Playful Experiences, April 27–May 2, 2013, Paris, France, pp. 5–8.
Bumpus, M. A., Olbeter, S., & Glover, S. H. (1998). Influences of situational characteristics
on intrinsic motivation. The Journal of Psychology,132, 451–463. doi:10.1080/
Cesario, J., Corker, K. S., & Jelinek, S. (2013). A self-regulatory framework for message
framing. Journal of Experimental Social Psychology,49, 238–249. doi:10.1016/j.jesp.
Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psy-
chopathology. Journal of Consulting Psychology,24, 349–354.
Deci, E. L. (1980). The psychology of self-determination. Lexington, MA: D. C. Heath
(Lexington Books).
Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A meta-analytic review of experiments
examining the effects of extrinsic rewards on intrinsic motivation. Psychological
Bulletin,125, 627–668; discussion 692–700.
Deci, E. L., & Ryan, R. M. (2008). Self-determination theory: A macrotheory of human moti-
vation, development, and health. Canadian Psychology/Psychologie,49, 182–185.
De Freitas, S., Rebolledo-Mendez, G., Liarokapis, F., Magoulas, G., & Poulovassilis, A.
(2010). Learning as immersive experiences: Using the four-dimensional framework for
Lieberoth 17
by guest on December 3, 2014gac.sagepub.comDownloaded from
designing and evaluating immersive learning experiences in a virtual world. British
Journal of Educational Technology,41, 69–85. doi:10.1111/j.1467-8535.2009.01024.x
Deterding, S. (2009). The game frame: Systemizing a goffmanian approach to video game the-
ory. In Breaking New Ground: Innovation in Games, Play, Practice and Theory.
Proceedings of DiGRA 2009, Brunel University, London, England.
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to
gamefulness: Defining ‘‘Gamification.’In Proceeding of the MindTrek’11, September
28–30, Tampere, Finland..
Deterding, S., Khaled, R., Nacke, L., & Dixon, D. (2011). Gamification: Toward a definition. In
Proceedings of CHI 2011 Workshop on Gamification, pp. 12–15, May 7–12 , Vancouver, BC.
Eisenack, K. (2012). A climate change board game for interdisciplinary communication and
education. Simulation & Gaming,44, 328–348. doi:10.1177/1046878112452639
Elias, G. S., Garfield, R. S., & Gutschera, K. R. (2012). Characteristics of games. Cambridge
MA: MIT Press.
Ferrara, J. (2013). Games for persuasion: Argumentation, procedurality, and the lie of gami-
fication. Games and Culture,8, 289–304. doi:10.1177/1555412013496891
Goffman, E. (1976). Frame analysis: An essay on the organization of experience. Cambridge,
MA: Harvard University Press.
Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work?—A literature review of
empirical studies on gamification. In 2014 47th Hawaii International Conference on
System Sciences: IEEE (pp. 3025–3034), Hawaii. doi:10.1109/HICSS.2014.377
Harviainen, J. T., & Lieberoth, A. (2011). Similarity of social information processes in
games and rituals: Magical interfaces. Simulation & Gaming,43, 528–549. doi:10.
Heeter, C. (2009). Play styles and learning. In R. Fertig (Ed.), Handbook of research on effec-
tive electronic gaming in education (pp. 826–828). Hershey, PA: Information scinece ref-
erence. doi:10.4018/978-1-59904-808-6.ch047
Heeter, C., Lee, Y.-H., Magerko, B., & Medler, B. (2011). Impacts of forced serious game
play on vulnerable subgroups. International Journal of Gaming and Computer-
Mediated Simulations,3, 34–53. doi:10.4018/jgcms.2011070103
Henriksen, T. D. (2010). A little more conversation, a little less action, please. Saarbru
Germany: Lambert Academic Publishing.
Intrinsic Motivation Inventory. (1994). Intrinsic Motivation Inventory (IMI). The Intrinsic
Motivation Inventory, Scale description. Retrieved from http://www.selfdeterminationthe-
Juul, J. (2005). Half-real: Video games between real rules and fictional worlds. Cambridge
MA: MIT Press.
Juul, J. (2010). A casual revolution: Reinventing video games and their players. Cambridge,
MA: MIT Press
Kallio, K. P., Ma¨yra¨, F., & Kaipainen, K. (2010). At least nine ways to play: Approaching
gamer mentalities. Games and Culture,6, 327–353. doi:10.1177/1555412010391089
Kapp, K. M. (2012). The gamification of learning and instruction: Game-based methods and
strategies for training and education. San Fransisco, CA: John Wiley.
18 Games and Culture
by guest on December 3, 2014gac.sagepub.comDownloaded from
Koester, R. (2004). A theory of fun for game design. Kansas City, MO: Paraglyph Press.
Kovisto, J., & Hamari, J. (2014). Demographic differences in perceived benefits from
gamification. Computers in Human Behavior,35, 179–188. doi:10.1016/j.chb.2014.
¨hberger, A. (1998). The influence of framing on risky decisions: A meta-analysis.
Orgainzational Behavior and Human Decision Processes,75, 23–55.
Landau, M. J., Keefer, L. A., & Rothschild, Z. K. (2014). Epistemic motives moderate the
effect of metaphoric framing on attitudes. Journal of Experimental Social Psychology,
53, 125–138. doi:10.1016/j.jesp.2014.03.009
Lasgaard, M., Goossens, L., & Elklit, A. (2011). Loneliness, depressive symptomatology, and
suicide ideation in adolescence. Journal of Abnormal Child Psychology,39, 137–150. doi:
Levin, I. P., Gaeth, G. J., Schreiber, J., & Lauriola, M. (2002). A new look at framing effects:
Distribution of effect sizes, individual differences, and independence of types of effects.
Organizational Behavior and Human Decision Processes,88, 411–429. doi:10.1006/
Lieberoth, A., Kock, M., Marin, A., Planke, T., & Sherson, J. F. (2014). User acquisition,
engagement and early results from the citizen cyberscience game Quantum Moves. A mid-
stream report (working title). Human Computation, 1.
Lieberoth, A., Mrin, A. C., & Møller, M. (forthcoming). Deep and shallow gamification - shaky
evidence and the forgotten power of good games, In Jose´Martı´-Parren
˜o, Carla Ruiz-Mafe´,
& Lisa L. Scribner (Eds.), Engaging Consumers through Branded Entertainment and
Convergent Media. IGI-Global: Hershey, PA.
Marczewski, A. (2012). Gamification—A simple introduction. Tips, advice and thoughts on
gamification., Self-published via Retrieved from Amazon.
McGonigal, J. (2011). Reality is broken: Why games make us better and how they can change
the world. London, England: Random House.
McNeil, B. J., Pauker, S. G., Sox, H. C., & Tversky, A. (1982). On the elicitation of prefer-
ences for alternative therapies. New England Journal of Medicine,306, 1259–1262. doi:
Radel, R., Pelletier, L., Baxter, D., Fournier, M., & Sarrazin, P. (2014). The paradoxical effect
of controlling context on intrinsic motivation in another activity. Learning and Instruction,
29, 95–102. doi:10.1016/j.learninstruc.2013.09.004
Rehn, A. (2008). Pop (Culture) goes the organization: On highbrow, lowbrow and hybrids in
studying popular culture within organization studies. Organization,15, 765–783. doi:10.
Reyna, V. F., Estrada, S. M., DeMarinis, J. A., Myers, R. M., Stanisz, J. M., & Mills, B. A.
(2011). Neurobiological and memory models of risky decision making in adolescents ver-
sus young adults. Journal of Experimental Psychology: Learning, Memory, and Cognition,
37, 1125–1142.
Rigby, C. S., & Ryan, R. M. (2011). Glued to games—How video games draw us in and hold
us spellbound. Santa Barbara, CA: Praeger.
Lieberoth 19
by guest on December 3, 2014gac.sagepub.comDownloaded from
Ryan, R., & Deci, E. (2000). Intrinsic and extrinsic motivations: Classic definitions and new
directions. Contemporary Educational Psychology,25, 54–67. doi:10.1006/ceps.1999.1020
Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006). The motivational pull of video games: A
self-determination theory approach. Motivation and Emotion,30, 344–360. doi:10.1007/
Salen, K., & Zimmerman, E. (2004). Rules of play: Game design fundamentals. Cambridge,
MA: MIT Press.
Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art.
Psychological Methods,7, 147–177. doi:10.1037/1082-989X.7.2.147
Schank, R. C., & Abelson, R. P. (1977). Scripts, plans, goals and understanding: An inquiry
into human knowledge structures. Scripts plans goals and understanding An inquiry into
human knowledge structures (Vol. 2, p. 248). New York, NY: Halsted.
Scheufele, D. (1999). Framing as a theory of media effects. Journal of Communication,49,
Shen, C., Wang, H., & Ritterfeld, U. (2006). Serious games and seriously fun games can they
be one and the same? In U. Ritterfeld, M. J. Cody, & P. Vorderer (Eds.), Serious games:
Mechanisms and effects (pp. 48–62). New York, NY: Routledge.
Sicart, M. (2008). Defining game mechanics. Game Studies,8, 1–14
Stevens, R., Satwicz, T., & McCarthy, L. (2008). In-game, In-room, In-world: Reconnecting
video game play to the rest of kids ’ lives. In K. Salen (Ed.), The ecology of games (pp.
41–66). Cambridge, MA: The MIT Press. doi:10.1162/dmal.9780262693646.041
Suits, B. (1972). The Grasshopper—Games, life and utopia. Toronto, Canada: University of
Toronto Press.
Tauer, J. M., & Harackiewicz, J. M. (1999). Winning isn’t everything: Competition, achieve-
ment orientation, and intrinsic motivation. Journal of Experimental Social Psychology,35,
209–238. doi:10.1006/jesp.1999.1383
Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases.
Science,185, 1124–1131. doi:10.1126/science.185.4157.1124
Yee, N. (2007). Motivations of play in online games. CyberPsychology & Behavior,9, 772–775.
Zichermann, G., & Linder, J. (2010). Game-based marketing: Inspire customer loyalty
through rewards, challenges, and contests. San Fransisco, CA: John Wiley.
Zichermann, G., & Linder, J. (2013). The gamification revolution: How leaders leverage
game mechanics to crush the competition. New York, NY: McGraw-Hill Education.
Author Biography
Andreas Lieberoth is an applied game psychology researcher at the Interacting Minds
Centre, Aarhus University and an associated researcher and game designer at the Centre for
Community Driven Research (CODER). His PhD was in cognitive and educational psychol-
ogy. He has (co-)designed several games, both digital and analogue. His academic work cen-
ters on the social psychology and cognitive neuroscience of gaming, especially in the context
of game-based learning and citizen cyberscience, with current focus on dissociating the
individual psychologically functional elements of game designs.
20 Games and Culture
by guest on December 3, 2014gac.sagepub.comDownloaded from
... We did not follow the one-size-fits-all approach [9, 12] by simply adding points, badges and leaderboards, but instead picked up a well-known concept from role play games: the boss fighta particularly challenging type of quest, where players need to overcome a boss character. To support this concept, we framed the activity with a gameful narrative to foster an actual game-like perception and thus increase enjoyment [9]. Additionally, players got to pick an avatar, which represents them during the boss fight [16]. ...
... Since then, the share of publications studying the long-term effects of gamification has grown, but it remains scarce compared to cross-sectional studies. Yet, recent studies for example by Mekler et al. [10], Lieberoth [9], Forde et al. [3] or Sailer et al. [16] suggest that gamification can also support intrinsic and thus long-term motivation [15]. The past two years, we used the published knowledge of the gamification community to develop a gamified application for testing factual knowledge in lectures. ...
... Moreover, a variety elements could also help to satisfy different psychological needs (e. g. badges for competence, avatars for autonomy & teams for relatedness), as empirical studies suggest [10,16]. Furthermore, a gameful frame should be created because the app's perception as an actual game supports enjoyment and thus motivation (RG3) [9]. ...
Conference Paper
Full-text available
Gamification is used to influence the motivation and behavior of users. In research, the effect of gamification on motivation and other psychological outcomes has been confirmed in various application contexts. Gamification critics state that a sustained success is unlikely, because of the implementation of ex-trinsic motivation drivers like rewards. Current studies, however, have shown that gamification possesses the potential to support intrinsic motivation. In this article, we introduce a gamified app for testing factual knowledge, which we developed based on current empirical findings and recommendations and analyzed in a longitudinal study for novelty effects. In contrast to other contributions, our app takes up the boss fight concept to support a gameful framing and uses various game elements to provide feedback to students in lectures. Overall, students evaluated the app to be very useful and fun, and additionally reported positive outcomes concerning the experiences of autonomy and competence.
... Gamification methods can help educational systems to increase user activity and user engagement by providing creative ways to motivate students to learn different topics [4]. Gamification is defined as "using game elements in non-game contexts" [5]. ...
... In order to have a fully gamified system, we need to consider psychological aspects and their effects on children's subconscious [4]. If not implemented correctly, gamification methods can have negative effects on children's performance, and consequently decreasing the efficiency of the system [8]. ...
... Gamification methods need to be implemented based on certain psychological guidelines. Especially when the target audience is children and young students, the role of psychology in applying gamification methods to a learning platform, becomes more highlighted [4]. If not applied correctly, gamification elements may provide only a short term motivation instead of long term effect [16]. ...
Conference Paper
Online learning platforms are growing and gaining attention each day. With the advancement of technology, children today do not adapt well with traditional classrooms and learning procedures. The goal of educational systems is to increase the efficiency and performance level of students. This requires new interactive ways to engage and motivate them, especially for younger students. Gamification methods can solve this issue by providing an attractive environment for children to learn, experiment, and enjoy at the same time. In this research, an online learning platform concerning gamification methods and its psychological aspects is proposed. The platform has a number of mostly used gamification methods implemented at its core and aims to deliver a fully gamified experience for young students. It is expected to observe an increase in user activity and students’ performance using this platform.
... The two sections had the same instructor, course structure, learning objectives, assignments, quizzes, term projects, and exams. Section 1's curriculum had (i) a gamified structure of assessment activities and (ii) an overlay of videogame nomenclature integrated to the assessment activities, following the application by Lieberoth (2015) and Stansbury and Earnest (2016). ...
... It is possible that gamifying assessment had some novelty value in the beginning of the semester resulting in higher motivation and engagement, but as students became accustomed to the course design and perceived the tasks as equally rudimentary as those in any other course, the novelty value may have faded and even harmed student performance in quizzes and exams. Lieberoth (2015) finds that adding a playful frame to tasks (shallow gamification) takes away the grit and output orientation of more goal-oriented work, which may further explain the declining trend in the content knowledge of the experimental group. ...
Full-text available
We explored the effects of assessment gamification on students' content knowledge and perceptions of satisfaction, course experience, learning, and impact of teaching techniques. The course preparation, attendance, quizzes, classroom activities, and team projects of an undergraduate operations and supply chain management course had game elements that accumulate to team advantages in the collaborative midterm and final exam. Interestingly, we found that gamifying assessment activities resulted in significantly lower content knowledge, satisfaction, and course experience. Difference in perceived learning was not significant. Also, team exam scores were significantly lower in the gamified group, whereas individual exam scores were not significantly different. This study contributes to the literature by providing empirical evidence that gamification in classroom may produce unintended consequences and implementing gamification restrictively to assessment is ineffective at best. Directions for further research are discussed.
... Table 2 shows a general tendency towards positive effects of gamification on student course engagement and satisfaction. With regards to course engagement, Morillas Barrio et al. (2016) showed that gamified class and traditional class had no difference on student course engagement, while five studies found gamified class worked better (i.e., Gafni, Achituv, Eidelman, & Chatsky, 2018;Haruna et al., 2018;Lieberoth, 2015;Poondej & Lerdpornkulrat, 2016;Yildirim, 2017). With regards to satisfaction, only one trial of Hanus and Fox's (2015) found student did not get more satisfaction from innovative gamified learning, but the majority of studies approved the effectiveness of gamified class (i.e., Haruna et al., 2018;Hung, 2018;Wu, 2018). ...
Full-text available
第四届游戏化学习学术会议(ICGBL 2019) ——游戏化学习与未来教育
... These questions were formulated based on previous studies on GBL (including research in dental education) that indicated that the use of games increased motivation, engagement, concentration, feeling of integration in the social environment, and learning in general (e.g. 17,[23][24][25][26][27] ). Thus, the students were asked to think of the GBL and FC session in comparison with the conventional FC sessions and indicate on a 5-point Likert scale their agreement with the given statements: playing the game increased their motivation of being in class that day, their engagement, and concentration and helped them being more focused in class; helped them feel more integrated in the social environment of the class and learn more about the knowledge topics. ...
Full-text available
Aim To investigate the use of game‐based learning (GBL) to enhance students’ experience of the flipped classroom (FC) in dental education. Materials and Methods Students participated in three sessions organized as FC, implemented either as conventional FC or FC augmented with the GoDental! game. In the pre‐class phase, sessions 1 and 2 were organized as instructor‐made video lectures, plus a questionnaire. These activities were supplemented with the individual development of questions and answers for the game in session 3. In the in‐class phase, group and plenary discussions were used during sessions 1 and 2 and were replaced by game activities in session 3. Perceptions of session 3 compared to that of sessions 1 and 2 were explored via a questionnaire with both open‐ended and Likert‐scale items. Results Most students (29, 97%) perceived the FC session augmented with the GoDental! game as enjoyable. The game augmented session was perceived as more enjoyable compared to the conventional FC sessions. Students agreed that GBL augmented FC compared to conventional FC increased engagement (25, 83%), motivation (24, 83%), their integration in the social environment (23, 77%), and concentration (22, 73%), helped them learn more about the topic (24, 80%), and was a good learning method (25, 83%). There was a positive correlation between the degree of enjoyment and concentration and the feeling that the game helped them learn more about the topic. Conclusion GBL augmented FC proved to enhance students’ experience, resulting in increased enjoyment compared to the conventional FC setup. Future studies should explore whether the use of GBL in FC has the potential to increase exam performance.
... Meaningful gamification, on the other hand, applies intrinsic motivation-based elements as well as extrinsic reward-based elements to provide meaningful experience. Similarly, some researchers differentiate between shallow gamification and deep gamification (Lieberoth 2015;Santos 2015). While shallow gamification involves using game elements without substantial changes in the core teaching and learning processes, deep gamification uses game elements and game design skills that change the core processes of the activity. ...
This study explored instructors’ perceptions, interest, self-efficacy, perceived barriers, and support needs regarding gamification in MOOCs. Both quantitative and qualitative data were collected from an online survey and follow-up interviews. Most participants showed interest in gamification and indicated that they would consider utilizing gaming elements in their future MOOCs. Interestingly, they wanted to gamify their MOOCs mostly to increase social interactions and student retention. Significant differences in self-efficacy and perceptions of gamification were found between younger participants and older participants. The results also revealed significant differences in interest and self-efficacy between participants with prior experience with gamification and those without prior experience. The major barriers to gamifying MOOCs included lack of time, limited knowledge, lack of funding, lack of fit between gamification and the course content, concerns about students’ perceptions of gamification, and concerns regarding the negative effects of gamification. Participants reported that they would need time and funding, guidance from gamification experts, examples of gamified MOOCs, more flexible MOOC platforms in order to successfully gamify their MOOCs.
... For example, students may go to class in order to experience the excitement of a group discussion. (Lieberoth, 2015) conducted a study to investigate the effect of framing an activity as a game. The survey was to giving and rate answers in response to questioning. ...
In Ho Chi Minh City (Vietnam), although the number of road traffic crashes reduced, crashes involving young people increased dramatically during 2013-2015 with the highest rate involving bikes, electric bikes, and mopeds ridden by 15 to 18-year-old students. Although road safety education has been introduced in schools for many years in Vietnam, lessons in classes and in extracurricular activities are ineffective in improving road safety knowledge and skills and then fail to change their illegal behaviour on roads. Gamification in the form of Route2school Education platform (developed by IMOB-Hasselt University) has a great potential to motivate, engage, and capture students’ imagination and make their learning more fun. The objective of the research is to study effect evaluation and process evaluation of the Route2school Education platform in learning road safety based on Vietnamese upper secondary students’ perspectives. To this end, the research focuses on adapting the Route2school Education platform for Vietnamese students. Then, measuring the effectiveness of the adapted platform in terms of students’ knowledge and skills, engagement, motivation, attitude was conducted. Sociodemographic factors were also explored at the same time with the process evaluation. The positive results found in the research were used to demonstrate the effectiveness of gamification on learning road safety education. This is a recommendation in applying this innovative and effective teaching method to road safety education in Vietnam. Moreover, the research makes a contribution to long-term efforts in reducing the number of crashes involving children in Vietnam.
Conference Paper
Full-text available
We introduce the math trail method as an opportunity to teach math outdoors with digital tools. Regardless of proven positive effects on motivation and learning, math trails are so far rarely used to teach a specific math topic. In order to promote the use of math trails as part of regular math lessons and to meet the requirements of outdoor learning, we have developed the concept of so-called theme-based math trails. They are a collection of conceptually related tasks focusing on a specific topic in the mathematics curriculum. This way we try to provide a curriculum-based outdoor learning experience for mathematics teaching. To exemplify the creation of theme-based trails, we have identified characteristic tasks for a trail around the concept of linear functions. By developing design principles, we intend to support teachers in creating a curriculum-based math trails using the MathCityMap system.
This study sets out to conduct a systematic review of the emergence and evolution of gamification in the social environment, its main components, and its application as a learning tool through the motivation and engagement it generates in people. The results were obtained by consulting two major scientific databases, namely, Scopus and the Web of Science, which provided 136 articles published on the social environment from 2011 through to mid-2016 using the term gamification. The results of this study reveal how over time gamification has been gaining importance in the social environment through the use of its components. The highest number of scientific publications come from the United States and Spain. In addition, the use of gaming components increases motivation and engagement. It shows how gamification uses (individual or group) rewards according to the context to achieve the proposed objectives, being successfully implemented in education, health, services, and social learning.
While gamification strategy has been used in many areas such as marketing, education, health and wellness, only a few projects have investigated the relevance of longer study durations. There are limited number of long-term studies in the usage of gamification elements to facilitate motivation and engagement of users in a physical activity (PA) setting, especially for the older adult demographic. We conducted a synchronous, three-condition (gamified, non-gamified and control), eight-week, experimental study which randomized 30 participants in the 50+ age group. Results from quantitative analysis indicated that the addition of motivational affordances increased engagement of participants. Perceived competence, perceived autonomy was significant for the gamified group against the non gamified (traditional PA monitor – pedometer) and control group. Results from the quantitative analysis rejects the null hypothesis that there was no change between the groups as measured by motivation, enjoyment and engagement. Furthermore, the results also support our hypotheses that enjoyment and engagement was less in groups with pedometers (non-gamified PA monitors) than in the group with gamification elements. Results highlight the possibility of adaptive engagement where gamification elements can be customized to participants for the 50+ age group to foster engagement tailored to suit their current health conditions and prevalent barriers to participate in PA.
Gamification started trending as a term around 2010 and enjoyed a rise to mainstream prominence over the following years. The trend extols the use of game elements and game thinking to support behavior and experiences in non-game contexts but has been hotly debated and is currently facing a serious limitation of evidence. This chapter critically examines the field. Combining theoretical perspectives from game design and psychology with marketing examples, the chapter develops a continuum from deep to shallow gamification as an interpretative framework where game qualities and engagement potentials are seen as a function of design richness and integration with the behavior context. The chapter strongly underscores the need for methodologically consistent data collection before conclusions can be drawn about the economic and psychological efficacy of individual design elements and the gamification fad as a whole.
Intrinsic and extrinsic types of motivation have been widely studied, and the distinction between them has shed important light on both developmental and educational practices. In this review we revisit the classic definitions of intrinsic and extrinsic motivation in light of contemporary research and theory. Intrinsic motivation remains an important construct, reflecting the natural human propensity to learn and assimilate. However, extrinsic motivation is argued to vary considerably in its relative autonomy and thus can either reflect external control or true self-regulation. The relations of both classes of motives to basic human needs for autonomy, competence and relatedness are discussed.
Many decisions are based on beliefs concerning the likelihood of uncertain events such as the outcome of an election, the guilt of a defendant, or the future value of the dollar. Occasionally, beliefs concerning uncertain events are expressed in numerical form as odds or subjective probabilities. In general, the heuristics are quite useful, but sometimes they lead to severe and systematic errors. The subjective assessment of probability resembles the subjective assessment of physical quantities such as distance or size. These judgments are all based on data of limited validity, which are processed according to heuristic rules. However, the reliance on this rule leads to systematic errors in the estimation of distance. This chapter describes three heuristics that are employed in making judgments under uncertainty. The first is representativeness, which is usually employed when people are asked to judge the probability that an object or event belongs to a class or event. The second is the availability of instances or scenarios, which is often employed when people are asked to assess the frequency of a class or the plausibility of a particular development, and the third is adjustment from an anchor, which is usually employed in numerical prediction when a relevant value is available.