Conference PaperPDF Available

Reflecting on reflection: Framing a design landscape

Authors:

Abstract

Designing for reflection is becoming of increasing interest to HCI researchers, especially as digital technologies move to supporting broader professional and quality of life issues. However, the term 'reflection' is being used and designed for in diverse ways and often with little reference to vast amount of literature on the topic outside of HCI. Here we synthesize this literature into a framework, consisting of aspects such as purposes of reflection, conditions for reflection and levels of reflection (where the levels capture the behaviours and activities associated with reflection). We then show how technologies can support these different aspects and conclude with open questions that can guide a more systematic approach to how we understand and design for support of reflection.
216
Reflecting on Reflection: Framing a Design Landscape
Rowanne Fleck
University of Sussex
Falmer, BN1 9QH, UK
r.m.m.fleck@sussex.ac.uk
Geraldine Fitzpatrick
Vienna Uni of Technology, Uni of Sussex
Favoritenstr. 9, 1040 Vienna, Austria
geraldine.fitzpatrick@tuwien.ac.at
ABSTRACT
Designing for reflection is becoming of increasing
interest to HCI researchers, especially as digital
technologies move to supporting broader professional and
quality of life issues. However, the term ‘reflection’ is
being used and designed for in diverse ways and often
with little reference to vast amount of literature on the
topic outside of HCI. Here we synthesize this literature
into a framework, consisting of aspects such as purposes
of reflection, conditions for reflection and levels of
reflection (where the levels capture the behaviours and
activities associated with reflection). We then show how
technologies can support these different aspects and
conclude with open questions that can guide a more
systematic approach to how we understand and design for
support of reflection.
Author Keywords
Reflection, reflective practice, sensecam, learning from
experience, design guidelines.
ACM Classification Keywords
H5.m. Information interfaces and presentation (e.g.,
HCI): Miscellaneous.
INTRODUCTION
Reflection, in the sense defined by the Compact Oxford
English Dictionary (Accessed 2010) as serious thought
or consideration”, is a term used frequently in everyday
language. Notions of reflection and reflective practice
have been of interest to the HCI and related communities
for some time, if not as a central notion at least as a
component of the topic of interest. For example, work on
technology support for learning (e.g. Price et al., 2003;
Yukawa, 2003) and play (e.g. Rogers & Muller, 2006)
have drawn on notions of reflection to motivate design
choices, often referencing Boud’s work on ‘reflection in
learning’ where reflection is described as “a generic term
for those intellectual and affective activities in which
individuals engage to explore their experiences in order to
lead to new understandings and appreciations” (p19,
Boud et al., 1985). Support for reflective practitioners,
particularly informed by Donald Schön’s work (1983),
has also been a focus of attention, both for supporting
professional practitioners such as teachers (e.g. Jay &
Johnson, 2002; Lee, 2005), as well as talking about
design itself as a reflective practice (e.g. Brereton &
McGarry, 2000) and reflection in the design process e.g.,
(Smith et al., 2004). Schön describes reflection as a type
of thinking about which enables a kind of problem
solving involving the construction of an understanding
and reframing of the situation to allow professionals to
apply and develop the knowledge and skills of their
profession. Sengers et al. (2005) further talk about the
emergence of ‘reflective design’ that “combines analysis
of the ways in which technologies reflect and perpetuate
unconscious cultural assumptions, with design, building,
and evaluation of new computing devices that reflect
alternative possibilities”. More recently, health has
become a focus for talking about self-reflection,
promoting healthy behaviour change (e.g. Anderson et al.,
2007) as well as promoting greater awareness and
learning to self-manage chronic conditions such as
diabetes (Mamykina et al., 2008).
With the expanding focus of digital technologies from
usability and meeting requirements to the importance of
experience and enjoyability etc., the interest in reflection
and technologies to support reflection has expanded
beyond these more traditional domains to a range of new
areas, with reflection as a topic in its own right. This is
evidenced by a workshop on technology support for
reflecting on experience at CHI2009 (Sas & Dix, 2009).
The aim of the workshop was “to explore the movement
from designing for experience as interaction with
technology, towards designing for reflection on felt-life
experience captured by technology”. One such area is
reflecting on everyday experience making use of new
sensor-based and mobile technologies, (e.g. Harper et al.,
2007; Lindström et al., 2006). Others talk about reflection
more in terms of provoking new ways of thinking and
seeing. For example, some interactive experiences are
often said to ‘provoke’ or ‘invite’ reflection e.g., (Gaver
et al., 2003; Hindmarsh et al., 2002; Sengers et al., 2002).
However, despite this growing interest, designing for
reflection is still in its infancy, as noted by Sas and Dix
(2009). What is even more in its infancy is some shared
understanding of what it is we are designing for when we
talk about reflection. From the diverse work around
reflection, it is clear that people are working with very
different definitions, and using the same term across very
different domains for very different outcomes. Given this
observation some e.g., Draper (1999) would argue that
reflection is not worthy of prominence in its own right
(talking particularly of learning): “I find there are many
senses of "reflection", and most who use it don't seem to
have reflected on this. If new practice is worth developing
there should be a clear theoretical position behind it; and
if there is a clear theoretical position then at the very least
clear definitions and discussions of how this is and is not
consistent with other usages should be available. […]
OZCHI 2010, November 22-26, 2010, Brisbane, Australia.
Copyright the author(s) and CHISIG
Additional copies are available at the ACM Digital Library
(http://portal.acm.org/dl.cfm) or ordered from the CHISIG secretary
(secretary@chisig.org)
OZCHI 2010 Proceedings ISBN: 978-1-4503-0502-0
217
This unclarity means among other things that perhaps we
all do it anyway […]. After all, "reflection" just means
"thinking", and I'm sure we all agree that thinking is
helpful to learning.
Others, for example Moon, do not agree, suggesting that
there is such a thing as reflection, which is “a form of
mental processing with a purpose and/or an anticipated
outcome that is applied to relatively complicated or
unstructured ideas for which there is not an obvious
solution” (Moon, 1999, p98). Much confusion, she
argues, lies in the fact that authors are describing different
purposes for reflection. She suggests therefore that
apparent differences in the notion of reflection across
domains are down to how it is used, applied or guided.
Therefore, while it could be possible to debate about
which definitions of reflection are better or to attempt to
synthesize one definition, neither will be particularly
useful to help inform design decisions about when, where
and how technology could support reflection. We suggest
instead that, for the purposes of design, it will be far more
important to synthesize the diverse understandings of
reflection from the literature in order to pull out aspects
of it for consideration in design.
We proceed then by returning to the literature on
reflection in order to identify a number of aspects thought
to be associated with good reflection. We go on then to
use these aspects to illustrate how technology is, and may
be used in the future, to support reflection, and finish by
drawing out some key concerns for those intending to
design for reflection. The key contribution of this paper
then is to present a theoretically-grounded framework of
reflection as a resource for design.
ASPECTS OF REFLECTION
In this section we outline a number of aspects of
reflection identified in the literature, organized as
purposes for reflection, some of the necessary conditions
for reflection, and types of behaviours and activities
thought to be associated with good reflection which we
have organized into ‘levels of reflection’.
Purpose of reflection
As stated previously, reflection can serve many different
purposes, which in turn influences how that reflection
happens. Drawing on Moon (1999, p98), examples of
different purposes include: learning and the material for
further reflection; action or other representation of
learning; reflection on the process of learning; critical
review; the building of theory; self-development;
decisions or resolutions of uncertainty; empowerment or
emancipation; and other outcomes that are unexpected
images or ideas that might be solutions.
Conditions for Reflection
There are also various points raised in the literature about
creating the right environment or conditions for reflection
that are worth mentioning here. Firstly, reflection takes
time: therefore creating or allowing time for reflection is
essential (Moon, 1999). Secondly, reflection is discussed
by many authors as a developmental process, and people
can learn to be more reflective over time and with support
(Gustafson & Bennett, 2002; Moon, 1999; Ward &
McCotter, 2004). This may not be so much the case for
some purposes of reflection (e.g. the quiet contemplation
of your old holiday snaps for pleasure). However, where
the purpose of reflection is more formal, for example in
reflective practice setting such as teacher training,
structured support or guidance of reflection is of value.
Finally, as reflection is time consuming and not
necessarily something that comes naturally to people in
all situations, they usually need a reason to reflect or at
least encouragement to do so (Gustafson & Bennett,
2002; Moon, 1999).
Levels of reflection
From the definitions presented earlier we can see how
different definitions of reflection often incorporate some
of the types of behaviours and activities associated with
reflection for a purpose. In some domains, in particular
those related with learning from experience, the
behaviours and activities thought to be associated with
reflection are often organized into different ‘levels’ of
reflection, and presented as a means to identify reflection
occurring, or to evaluate that reflection. Whilst there is
much discussion about the validity of attempting to
evaluate reflection (e.g., see Sumison & Fleet, 1996) the
idea of such levels of reflection is useful to us here as
they indicate what it is that is considered as reflection or
reflective thought and behaviours in the literature.
However there is disagreement between authors about the
levels, what falls into each ‘level’, and even at what level
reflection begins to occur. In general though, higher
levels are considered most reflective, and any example of
reflection would be judged as being at the highest level
for which there is evidence. It is also suggested that the
lower levels are prerequisites for higher levels (Hatton &
Smith, 1995). For the purposes of design, as we shall see,
these lower levels are particularly relevant as they point
to technology support opportunities from which higher
levels of reflection may follow.
We present below five different ‘levels of reflection’, R0
(the lowest) to R4 (the highest), synthesized via critical
engagement with these diverse literatures on reflection, in
particular literature about teachers’ (and professionals’)
reflective practice and learning from experience; and
further refined through the iterative application of early
versions in case studies of technology-supported
reflective practice of teachers (see Fleck 2008
(unpublished thesis) for a detailed discussion). While
developed with respect to teachers’ reflective practice, we
suggest that the general principles of the levels are
broadly applicable to other domains.
R0 Description: Revisiting
Description or statement about events without further
elaboration or explanation. Not reflective.
The R0 level is description. Many authors (e.g. Hatton &
Smith, 1995; Manouchehri, 2002) describe a category of
discussion or writing that is a purely descriptive revisiting
of events, with no indication of the types of thought
described in categories below. In fact, Hatton and Smith
218
reported that up to 60-70% of their students’ writing
fitted this category, and although Davis considered
anything their students wrote in reflective exercises as
reflective (as this was the students’ intent), much of it
was considered unproductive (Davis, 2006).
R1 Reflective Description: Revisiting with Explanation
Description including justification or reasons for action or
interpretation, but in a reportive or descriptive way. No alternate
explanations explored, limited analysis and no change of
perspective.
The R1 level occurs when explanations accompany
descriptions. Unlike R0, discussion or writing is
considered by many authors to actually be reflective only
if explanations or justifications are provided for actions in
the revisiting of events (Hatton & Smith, 1995;
Manouchehri, 2002). This first level of reflection is
variously distinguished from higher levels: for example,
Hatton and Smith (1995) include only explanations given
in a reportive or descriptive way; Ward and McCotter
(2004) state analysis is limited and there is no change of
perspective; and Lee (2005) states that no alternate
explanations are explored. Others might still not consider
this definition evidence of reflection (e.g. Davis, 2006;
Kember et al., 1999).
R2 Dialogic Reflection: Exploring Relationships
A different level of thinking about. Looking for relationships
between pieces of experience or knowledge, evidence of cycles
of interpreting and questioning, consideration of different
explanations, hypothesis and other points of view.
Level R2 goes beyond reflective description with or
without explanation, to probe relationships emergent in
the descriptions. It is often referred to as dialogic
reflection, as it primarily involves seeing things from a
different perspective (e.g., Jay & Johnson, 2002;
Manouchehri, 2002) and considering alternatives (e.g.,
Davis, 2006; Ward & McCotter, 2004), aspects of an
ideal conversation with another. Searching for
relationships between ideas and experiences in order to
generalize from them and reach a different level of
understanding is also associated with this level of
reflection (e.g. Davis, 2006; Lee, 2005).
R3 Transformative Reflection: Fundamental Change
Revisiting an event or knowledge with intent to re-organise
and/or do something differently. Asking of fundamental
questions and challenging personal assumptions leading to a
change in practice or understanding.
Whilst dialogic reflection is described as looking for
relationships, considering alternatives and seeing things
from a different perspective, level R3 is about
transformative reflection and includes the idea that the
reflector’s original point of view is somehow altered or
transformed to take into account the new perspectives
s/he has just explored. It is suggested that in order to
achieve this perspective transformation: “it is necessary to
recognise that many of our actions are governed by a set
of beliefs and values which have been almost
unconsciously assimilated from the particular
environment” (p23, Kember et al., 1999). Such a
transformation is thought to follow from and build on
earlier levels of reflection: other points of view or
alternate explanations are considered so reflectors’ own
initial assumptions are challenged and their ideas
restructured or reframed. This might ultimately lead to a
change in practice, or if the purpose of reflection is not
linked to action, at least a fundamental change in
understanding.
R4 Critical Reflection: Wider Implications
Where social and ethical issues are taken into consideration.
Generally considering the (much wider) picture.
This final level of reflection, R4, is termed here critical
reflection (a term sometimes also used to describe the
type of reflection classified as transformative above, (e.g.
see p251, Ward & McCotter, 2004)). It involves taking
into consideration aspects beyond the immediate context,
for example moral and ethical issues, and wider socio-
historical and politico-cultural contexts (Alder in Hatton
& Smith, 1995; Kember et al., 1999; Ward & McCotter,
2004). Reaching this level of reflection is reportedly very
rare (e.g., Kember et al., 1999; Moon, 1999; Ward &
McCotter, 2004).
TECHNIQUES FOR SUPPORTING REFLECTION
In presenting these aspects of reflection organized as
purpose, conditions and levels we are moving away
from defining reflection per se to highlight the issues to
consider when understanding the enabling role that
technology can play in facilitating reflection.
There are many ways to create the time for and guide and
encourage the different levels (types of behaviours and
actions) of reflection we have highlighted above, most of
which can be tailored to the specific purpose of reflection
required. Moon (1999) provides a comprehensive account
of many of these, including: writing techniques; use of
reflective questions to explicitly guide or structure
reflection; techniques for making use of dialog and
discussion; various non-verbal techniques; encouraging
review or revisiting of materials or events; using
evaluation (for example assessments) to encourage
reflection; using ill-structured material; and any other
method for creating situations which require aspects of
reflective thought such as those which challenge initial
thinking and assumptions, or require the making of
judgments or the integration of new and old learning.
Missing from her account though is a discussion of the
vast potential offered by technology to support reflection
not only via these techniques, but in new ways too. Using
the aspects defined above, we go on here to provide a
preliminary outline of ways technology can and has been
designed for reflection. Following this we present a case
study which illustrates these techniques in practice for a
particular purpose.
Supporting R0: Technology for Revisiting
R0 is the level at which technology can provide
significant support in providing informational resources
for reflection. Although, as discussed earlier, simply
stating what is known, looking at information or data, or
looking back on events or experiences is not considered
reflective on its own - it is often the foundation on which
219
later reflection is based. Any representation of existing
information or knowledge can form the basis for
reflection on that information be that oral, written or
pictorial. The non-technology technique of writing or
journaling for reflection on experience is valuable in that
it provides a record of experiences (and usually
reflections on these) over time that can be looked back
over, shared or compared. Supporting memory by
providing a record of knowledge, events, experiences and
thinking over time is the most obvious way that
technology can be used to support reflection.
Technology can be used as the tool through which
knowledge and experience is recorded in a direct
extension to the non-technology techniques above. For
example, electronic portfolios (e.g. Loh et al., 1997) can
replace pen and paper journals, allowing the addition of
all sorts of electronic data to be ‘journaled’ and
subsequently reflected on. Life-logging (e.g. Allen, 2008)
could be considered an extreme case of journaling, where
all available data from everyday life is recorded and kept
to support future reflection. The attraction of keeping
electronic records, in terms of reflection, is that they can
be more easily searched, reorganised and shared (and they
take up less space). Other non-technology techniques for
representing knowledge, including spatial-mapping
techniques like mind-mapping can similarly benefit from
digitisation.
In addition, a record of events is often the automatic
outcome of using technology. For example, Seale and
Cann (2000) promoted the use of online discussion
forums to support students’ reflection precisely because
they provide a record of discussions that can be returned
to in the future in a way face-to-face discussions cannot.
Similarly, technology can be used to create visual/audio
records of experience with the use of video, photography,
audio recording technologies. New forms of information
can also be captured through the use of sensor devices,
wearables and additional context information giving
access to information that otherwise might not be
perceptible or available to normal memory.
Supporting R1: Technology to Prompt Explanation
Most authors agree that providing justifications or
explanations for knowledge, events or one’s actions is an
indication of at least low-level reflective thinking. Often
when looking over a representation of one’s information
or knowledge, or looking back at actions or events either
from memory or from a record of those events, people
spontaneously think or reflect in this way. However, a
standard non-technology technique for encouraging more
of this in situations where useful reflection for the
intended purpose is not so natural, is the asking of
reflective questions. These are designed to get reflectors
to think specifically about issues that are considered
important for the particular purpose of their reflection.
Essay questions, for example, are broad reflective
questions to direct thought to the subject matter being
covered. More specific questions might be to direct
attention on the process of what you are doing in order to
learn from it (meta-cognition, self-reflection or reflective
practice.)
Therefore, one way to prompt reflectors to think about
what they are doing and provide justifications or
explanations for knowledge, actions or events, is to ask
them to do this. Such reflective questions can be
incorporated in various ways to technology to promote
this aspect of reflection. For example, in interactive
learning environments, such as Gama (2001), questions
can be used to prompt students as they work through the
system to answer various reflective questions about their
understanding of the problem, their related previous
knowledge and strategies used to answer the problem.
Similarly, annotation technologies could promote
reflection through the use of reflective questioning. For
example Storytellr (Landry in Sas & Dix, 2009)
encourages people to tag their digital photographs with
experience based tags through prompting with reflective
questions such as What emotions (positive or negative)
do looking at this image evoke?” for the purpose of
storytelling with the images later. Experience sampling
techniques can also be used to encourage reflection,
sending prompt questions to mobile devices, triggered for
example by context-sensitive settings (Intille et al., 2003).
Interactive concept mapping tools such as Belvedere
(Paolucci et al., 1995) or Convince me (Schank &
Ranney, 1995) also prompt for justifications and
explanations. They do this by providing skeleton
structures that encourage participants to organise their
knowledge into nodes of information and think about
whether these nodes support each other or contradict
them, and the technology (acting almost like another
person) prompts them to do this if they have not
adequately achieved this.
The presence of another person is also beneficial in
encouraging the giving of justifications or explanations,
as it makes sense to explain things to other people,
especially if they do not share the same knowledge,
understanding or experience as you. Any kind of record
of events or representation of knowledge can form the
basis for discussion between two people allowing each
to ask the other for explanations or justifications where
needed. For example, in the eScience project, children
worked in groups to collect data about their environment,
then talked to real expert scientists via web-chat who
were able to ask them questions of their data (Smith et al.,
2005).
Supporting R2: Technology to See More
We have described how this level of reflection involves a
questioning of events or knowledge, and a consideration
of different explanations, hypotheses or points of view.
This type of thinking can follow from lower levels of
reflection prompted by the techniques already discussed.
It can also be encouraged through the use of techniques
that can enable the ‘seeing of things from multiple
perspectives’ a theme which crops up throughout the
literature on reflection again and again (Ackerman, 1996,
Boud et al., 1985; Schön, 1983).
Technology has the potential to do this in many ways. For
example it can be used to produce a record of events
which can be looked at again; there may be things that
220
have been forgotten and a recording can provide time to
focus attention on different aspects of the experience on
each return, especially if some guidance as to what to
focus on is provided (Hutchinson & Bryson, 1997; Sherin
& van Es, 2002), possibly through the use of reflective
questioning.
Also technology has the potential to allow you to see
more than you could possibly see alone, for example
sensor technologies can record, detect and represent data
or aspects of experiences not otherwise available to
human perception. This aspect of seeing from a different
perspective can mean that more information is available
to the reflector in order to make sense of events, or
consider the implications of their actions. This extra
perspective may be available at the time of the
experience: Back et al. (in Sas & Dix, 2009) describe
anecdotally how wearing a heart beat monitor allowed
them to reflect on the immediate impact of the exercise
they were conducting (running on a treadmill) on their
body. Similarly, in the Ambient Wood project (Rogers et
al., 2004) an Ambient Horn was developed to ‘make the
invisible visible’ by playing abstract sounds to represent
hidden processes, such as photosynthesis, in the wood to
encourage children to consider various different
hypotheses for what was going on in the wood.
Looking back on any visual/audio recording of events is
always literally going to let you see the experience from a
different view-point to your own which can allow you to
see and hear things out of your own scope of awareness at
the time (Fleck and Fitzpatrick, 2009). A record of
collected sensor data can also allow you to look back on
experience with the added extra perspective of more
information available to understand events. In addition,
such records allow you to relate different views to each
other, or to look for patterns that are only observable by
stepping back to get an overview. For example, in the
eScience project students collected wind direction,
strength and carbon monoxide readings at various
locations and put these things together in a replay tool to
try to explain what was going on. Also, Clippingdale et
al. (in Sas & Dix, 2009) suggested the use of sensors to
analyse the patterns of movement of patients suffering
from depression in order to infer information about their
mood states over the day. By encouraging these patients
to log other information throughout the day, it was hoped
that the patents would be able to relate their mood to
other events in their lives, and therapists would be able to
monitor their response to treatment. The purpose of
reflection in the above examples is quite clear cut: the
extra perspective offered by the technology directly lends
itself to the kind of abstractions or links that can lead to
the reflection/understandings intended by the designers. A
similar technique was successfully used to help diabetic
patients monitor and relate their blood sugar levels to
their diet and exercise in order for them to begin to
develop an understanding of this relationship (Mamykina
et al., 2008).
However, similar techniques can be used to encourage
much more contemplative reflection, where designers
have a less clear purpose in mind. For example the Home
Health Monitor (Gaver et al., 2003) is embedded with
various sensors such as light, temperature and door
sensors to monitor people’s activities around the home,
the results of which are then used to give feedback in the
form of a horoscope to allow people ‘to reflect on the
emotional state of their home’. Similarly, the ambient
display ‘dangling string’ (Weiser & Seely Brown, 1997)
consists of a string dangling from the corner of hallway
that whirs and moves in response to network activity,
without any explicit design intention as to what being
peripherally aware of this information will lead to.
An alternate perspective can also be provided by another
person: therefore any record of knowledge or experience
can be used to share that knowledge and experience with
others. As well as encouraging the generation of
explanations and justifications as described earlier, their
interpretation of data or events may differ from yours,
providing a different perspective. Therefore the
techniques discussed earlier which support conversation
can also provide reflectors with this alternative
perspective. In addition, sharing and comparing different
experiences can provide more material for generating
alternate explanations or hypotheses or to the questioning
of knowledge/events, the other aspects of level 2
reflection.
Technology can also provide the means by which
reflectors reorganize their knowledge to see it from
multiple perspectives. For example, digital concept-
mapping software can both allow reflectors to move
nodes around to reorganize their ideas, and to
automatically re-represent ideas in a different format: for
example commercial mind mapping software usually
includes features where a spatial diagram of mixed nodes
can, at the click of a button, be transformed to say a
bulleted list. Visualisation tools can allow the exploration
of data in different formats.
In terms of supporting the aspects of reflection at this
level, seeing from another perspective in the ways
described above can lead to consideration of different
points of view. The extra information about events
provided by these other perspectives can lead to the
consideration of multiple hypotheses to explain what’s
going on. Finally, where this extra information does not
fit with existing hypotheses or explanations of events,
multiple perspectives can prompt a questioning of
knowledge and even a questioning of events.
Simulation environments (and other similar interactive
learning environments) can also support reflection
through allowing the quick and relatively cost free
exploration of these environments, allowing participants
to experience different possible outcomes, and
reflect/hypothesize as to what might be causing them. In
addition, they can improve on real life environments by
making more information visible (as sensor technologies
can in real life) and allowing for various re-
representations of that data.
Supporting R3 & 4: Transformation
Levels 3 and 4 build on the processes of levels 0-2 where
the resources available for reflection are engaged with at
221
deep levels. For example seeing from multiple
perspectives (discussed as a technique to encourage R2)
can also lead to a challenging of original assumptions or
interpretations of data as reflectors question and consider
alternative explanations and hypotheses. Challenging of
original assumptions can in turn lead to a fundamental
change in understanding, which can lead in practice
settings to a change in that practice. Because these levels
are much more about what people are doing with the
information for change and transformation, i.e., more as
internal processes, we will not include any further
specific technology examples here. This is not to say that
technology will not have a role to play in the actual
practice of transformation but that arguably the main role
for technology is in supporting the foundational resources
and processes of reflection.
EXEMPLAR CASE: SENSECAM
To illustrate more clearly how technology can be
designed to support reflection in practice, encouraging a
whole range of behaviours at different levels
simultaneously, we present here a case study of a
technology, SenseCam, that was not explicitly designed
to support reflection but was used to support trainee
teachers’ reflection on practice (Fleck and Fitzpatrick,
2009).
SenseCam is a wearable digital camera augmented with a
number of sensors, such as light, sound and movement,
which automatically trigger it to take photographs as it is
worn around the user’s neck somewhat like a pendant
(see Hodges et al., 2006). When worn by trainee teachers
as they teach a lesson, SenseCam provides a photographic
record of that lesson which can then form the basis for
returning to the lesson experience in order to reflect upon
it. The hope is this will enable the trainees to learn from
this experience and ultimately become better teachers. In
(Fleck, 2008) and (Fleck and Fitzpatrick, 2009) we
describe how SenseCam images were used in a variety of
settings to support this reflection. For example, some
teachers looked through images alone and used them to
self-reflect on their lessons, whilst others reflected
alongside peers or with support from a more experienced
teacher as mentor.
Across these settings, the teachers’ SenseCam recordings
of their lessons were able to support their reflection by
making use of a number of the techniques described in
the section above. Primarily, images provided a record of
events for the teachers to return to (R0), and formed the
basis for discussion with a peer or mentor, with the
opportunity to provide explanations and justifications for
observed events (R1). Secondly, the images were reported
to support a number of the aspects of ‘seeing from
another perspective’ (R2) described above. For example
the images recorded and reminded participants of things
they had forgotten or had not noticed at the time, and
allowed them to notice patterns in their behaviour which
were only observable through taking a step back from
immediate events. In addition, some participants placed a
SenseCam in the room allowing them to capture things
they literally could not see at the time (for example what
went on behind their backs). Further, when reflection
occurred between two or more people, as images were
discussed, participants shared their different perspectives
on events in the classroom. In some cases, such
mechanisms led to higher levels of reflection including
the challenging of original assumptions and a
fundamental change in understanding (R3). These
observations highlight that there is often no clear
distinction between a technique for encouraging one
aspect of reflection and a technique for encouraging
another: and there is a certain circularity to it all with
higher levels of reflection following from lower levels by
making use of the same techniques.
Also, one important way in which the various settings
SenseCam was explored in differed from each other was
in the amount of structure and support given to the
reflectors as they looked through and discussed the
captured images. Mentors were able to use the images as
a prompt to drive the trainees thinking through the use of
reflective questioning, and in general these sessions saw
higher levels of reflection reached than the more open-
ended self-reflection sessions. Following from this, future
trainee teachers’ reflection with SenseCam may be
improved with the implementation of a set of guidelines
for its use, particularly a clear framework for structuring
discussion around images. Looking at other techniques
we have suggested, it is also possible that making some
of the sensor data captured available alongside images
may further enable participants to ‘see more’, which may
in turn encourage further reflection.
DESIGNING FOR REFLECTION
In this paper we set out to synthesize and build upon the
diverse work in the various literatures around reflection in
order that we may better inform design. A review of the
HCI literature highlights the fuzziness in which the term
‘reflection’ is used within the HCI community as it
begins to embrace the concept of reflection as a new
design goal in its own right. However, there is also
fuzziness in the definitions of reflection in the broader
literature. Therefore, rather than trying to precisely define
reflection, we have focused instead on drawing out a
number of aspects - including purposes and conditions for
and types of activities and behaviours associated with -
reflection, which we suggest is a more useful approach
for HCI and design purposes. Based on these we have
suggested various roles for technology in supporting
reflection.
We now go on to draw from these observations a set of
questions (guidelines) that can support HCI designers in
thinking about designing for reflection.
1. What is the purpose for the reflection?
An observation made of many of the papers in Sas and
Dix’s workshop on designing for reflection on experience
(2009) was that the authors did not convey a clear
purpose for reflection, rather phrases such as ‘the analysis
of our identity (Byrne and Jones in Sas & Dix, 2009)
were used. This is perhaps fine: Moon does list ‘other
outcomes that might be unexpected’ (1999, p98) as one of
her purposes for reflection, and often the intention of art
is to promote new ways of thinking and seeing without
222
making any claims as to what this may lead to (e.g. Gaver
et al., 2003; Weiser & Seely Brown, 1997). However, key
to providing a structure for reflection is being aware of
the purpose of that reflection and guiding thinking to that
end: having no clear purpose then might limit technology
only to (providing time for and) provoking reflection -
not to structuring and encouraging it. In this way
opportunities for reflection may be lost.
2. What reflective behaviours do you want to
encourage? Which technologies and techniques can
support these behaviours?
With a clear purpose for reflection, it becomes easier to
identify types of behaviours or thought associated with
that purpose (i.e. those aspects outlined in the ‘levels of
reflection’ framework). The next step then is to identify
techniques (and technologies) for encouraging these
behaviours: either by considering which techniques an
available technology can support, or by identifying new
technologies for a particular technique.
3. Are the conditions for reflection (time, structure,
encouragment) being met?
With the exception of the techniques which make use of
reflective questioning, most of the technology
opportunities we have discussed could be considered as
techniques for enabling reflection by making material
available for reflection and sometimes suggesting links
that could be made. In our case study too, the technology
primarily provided a record of events that formed the
basis of reflection (which was then encouraged through
discussion with others and guided and supported by
experts). We suggest then that it is not just the technology
that needs to be designed to promote good reflection: it is
the whole framework and structure within which the
technology is used. As we discussed earlier, reflection
requires time, benefits from guidance or support, and in
many situations needs to be encouraged. Some of these
aspects may not be achievable by technology alone.
CONCLUSION
In this paper we have highlighted the fuzziness in which
the term ‘reflection’ is used within the HCI community as
it begins to embrace the concept of reflection on
experience as a new design goal in its own right. As a
resource for thinking about designing for reflection, we
have presented a framework which encompasses a
number of aspects of reflection synthesized from existing
literature. We have then used this to illustrate how
technology has been and could be used to support
reflection, concluding with a set of guiding questions for
designers intending to do this in the future. This should
be considered a theoretical starting point for those
interested in designing for reflection especially in
situations such as reflective practice where there is a clear
purpose for reflection. As noted previously though, there
can be a certain circularity in the way reflection occurs:
higher levels of reflection often follow from lower levels
by making use of the same techniques. It is worth
reminding ourselves that in all situations, the technologies
and techniques can provide only the resources and
support the conditions for reflection, but it is ultimately
people who do the reflection.
ACKNOWLEDGMENTS
We thank the teachers at our schools who participated in
the case studies, from which the framework evolved.
REFERENCES
Ackerman E. Perspective-Taking and Object
Construction, in Constructionism in practice. Edited by
Y Kafai, M Resnick. Mahwah, NJ, Laurence Erlbaum
Associates (1996) 25-36.
Allen AL: Dredging up the past: Lifelogging, Memory,
and Surveillance. The University of Chicago Law
Review 75 (2008) 47-74.
Anderson I, Maitland J, Sherwood S, Barkhuus L,
Chalmers M, Hall M, Brown B, Muller H. Shakra:
Tracking and Sharing Daily Activity Levels with
Unaugmented Mobile Phones. Mobile Networks and
Applications 12 (2007) 185-199.
Boud D, Keogh R, Walker D. Promoting reflection in
learning, in Reflection: Turning experience into
learning. Edited by D Boud, R Keogh, D Walker.
London, Kogan Page (1985)18-40.
Brereton M, McGarry B: An observational study of how
objects support engineering design thinking and
communication: implications for the design of tangible
media. In Proc. CHI 2000, ACM Press (2000), 217-
224.
Concise Oxford English Dictionary Last accessed June 29
2010 from http://www.askoxford.com/ (2010).
Davis EA. Characterizing productive reflection among
preservice elementary teachers: Seeing what matters.
Teaching and Teacher Education 22 (2006) 281.
Draper SW. Notes on reflection. Last accessed June 28
2010, from
http://www.psy.gla.ac.uk/~steve/reflection.html (1999)
Fleck R: Exploring the potential of passive image capture
to support reflection on experience. Unpublished DPhil
thesis, University of Sussex (2008).
Fleck R, Fitzpatrick G. Teachers' and tutors' social
reflection around SenseCam images. Int. J. Hum.-
Comput. Stud. 67 (2009) 1024-1036.
Gama C. Helping students to help themselves: A pilot
experiment on the ways of increasing metacognitive
awareness in problem solving, In Proc. CINTEC'01,
(2001) 175-182.
Gaver WW, Beaver J, Benford S. Ambiguity as a
resource for design. In Proc CHI2003, ACM Press
(2003) 233-240.
Gustafson KL, Bennett WJ. Issues and difficulties in
promoting learner reflection: Results from a three-year
study. Last accessed, June 29th 2010 from
http://www.dtic.mil/cgi-
bin/GetTRDoc?AD=ADA472616&Location=U2&doc
=GetTRDoc.pdf (2002)
223
Harper R, Randell D, Smythe N, Evans C, Heledd L,
Moore R: Thanks for the memory. In Proc. BHCI 2007,
British Computer Society (2007) 39-42.
Hatton N, Smith D: Reflection in teacher education:
Towards definition and implementation. Teaching and
Teacher Education 11 (1995) 33-49.
Hindmarsh J, Heath C, Lehn Dv, Cleverly J: Creating
assemblies: Aboard the Ghost Ship, in Proc CSCW
2002, ACM Press (2002) 56-165.
Hodges S, Williams L, Berry E, Izadi S, Srinivassan J,
Butler A, Smyth G, Kapur N, Wood K: SenseCam: A
retrospective memory aid, In Proc Ubicomp2006,
Springer-Verlag (2006) 177-193.
Hutchinson B, Bryson P. Video, reflection and
transformation: Action research in vocational education
and training. Educational action research 5 (1997) 283-
303.
Intille, S. S., Rondoni, J., Kukla, C., Ancona, I., and Bao,
L. A context-aware experience sampling tool. Ext.
Abstracts CHI 2003 ACM Press (2003) 972-973.
Jay JK, Johnson KL: Capturing complexity: a typology of
reflective practice for teacher education. Teaching and
Teacher Education 18 (2002) 73-85.
Kember D, Jones A, Loke A, McKay J, Sinclair K, Tse
H, Webb C, Wong F, Wong M, Yeung E: Determining
the level of reflective thinking from students' written
journals using a coding scheme based on the work of
Mezirow. Int J of Lifelong Education 18 (1999) 18-30.
Lee H-J: Understanding and assessing preservice
teachers' reflective thinking. Teaching and Teacher
Education 21 (2005) 699-715.
Lindström M, Stahl A, Höök K, Sundström P,
Laaksolathi J, Combetto M, Taylor A, Bresin R:
Affective diary: designing for bodily expressiveness
and self-reflection, in Ext. Abstracts CHI 2006, ACM
Press, (2006).
Loh B, Radinsky J, Reiser BJ, Gomez LM, Edelson DC,
Russell E: The progress portfollio: Promoting reflective
inquiry in complex investigation environments, In Proc
CSCL 97 (1997) 169-178.
Mamykina L, Mynatt E, Davidson P, Greenblatt D:
MAHI: investigation of social scaffolding for reflective
thinking in diabetes management, In Proc. CHI 2008,
ACM Press (2008).
Manouchehri A: Developing teaching knowledge through
peer discourse. Teaching and Teacher Education 18
(2002) 715-737.
Moon JA: Reflection in learning and professional
development. London: Kogan Page Limited (1999).
Paolucci M, Suthers D, Weiner A: Belvedere: stimulating
students' critical discussion, In Proc CHI 1995, ACM
Press (1995).
Price S, Rogers Y, Stanton D, Smith H: A New
Conceptual Framework for CSCL: Supporting Diverse
Forms of Reflection through Multiple Interactions, in
Designing for Change in Networked Learning
Environments. Proc. CSCL 2003, Kluwer (2003) 513-
522.
Rogers Y, Price S, Fitzpatrick G, Fleck R, Harris E,
Smith H, Randell C, Muller H, O'Malley C, Stanton D,
Thompson M, Weal M: Ambient Wood: Designing
new forms of digital aumentation for learning outdoors,
In Proc IDC 2004, ACM Press (2004) 3-10.
Rogers Y, Muller H: A framework for designing sensor-
based interactions to promote exploration and refelction
in play. Int J Human-Computer Studies 64 (2006) 1-14.
Sas C, Dix A: Designing for reflection on experience, in
Proc. CHI 2009 Ext Abstracts ACM Press, (2009)
4741-4744. See workshop papers at
http://www.comp.lancs.ac.uk/~corina/CHI09Workshop
/Papers/.
Schank P, Ranney M: Improved reasoning with Convince
Me, In CHI 2005, ACM Press (2005) 276-277.
Schön DA: The reflective practitioner: How professionals
think in action. London: Temple Smith (1983).
Seale JK, Cann AJ: Reflection on-line or off-line: The
role of learning technologies in encouraging students to
reflect. Computers and Education 34 (2000) 309-320.
Sengers P, Liesendahl R, Magar W, Seibert C, Muller B,
Joachims T, Geng W: The Enigmatics of Affect, In
Proc. DIS 2002, ACM Press, (2002) 86-98.
Sengers P, Boehner K, David S, Kaye JJ: Reflective
design, In Proc. Critical Computing 2005, ACM Press
(2005) 49-58.
Sherin MG, van Es EA: Using video to support teachers'
ability to interpret classroom interactions, In Proc.
Society for Information Technology and Teacher
Education AACE (2002) 2532-2536.
Smith H, Fitzpatrick G, Rogers Y: Eliciting reactive and
reflective feedback for a social communication tool: a
multi-session approach, In Proc. DIS 2004, ACM Press
(2004) 39-48.
Smith H, Luckin R, Fizpatrick G, Avramides K,
Underwood J: Technology at work to mediate
collaborative scientific enquiry in the field, In Proc.
AIED (2005) 603-610.
Sumison J, Fleet A: Reflection: Can we assess it? Should
we assess it? Assessment and evaluation in higher
education 21 (1996) 121-130.
Ward JR, McCotter SS: Reflection as a visible outcome
for preservice teachers. Teaching and Teacher
Education 20 (2004) 243-257.
Weiser M, Seely Brown J: The coming of age of calm
technology, in Beyond Calculation: The Next Fifty
Years of Computing. Edited by PJ Denning, RM
Metcalfe. New York, Springer-Verlag (1997) 75-85.
Yukawa J: Co-reflection in online learning envrionments.
SIGGROUP Bull 24 (2003) 49-58.
... Previous research on workplace learning has shown that the intensity of reflection can vary, i.e. the extent to which the issue is scrutinised in the reflection process (Høyrup, 2004;Fleck & Fitzpatrick, 2010). Therefore, we distinguish four levels of reflection intensity in projects: ...
... Engaging in reflection processes often requires a specific reason to reflect, and that reason is often found in ongoing projects (Hartmann & Dorée, 2015). It may also need encouragement, support, and guidance by single project team members who initiate reflection processes, structure them efficiently, and increases their quality (Fleck & Fitzpatrick, 2010;Koole et al., 2011;Chang et al., 2021). Whether a project environment provides challenges is another condition for reflection since it allows for opportunities to create experiences outside someone's comfort zone (Eraut & Hirsh, 2010). ...
... Reflection practices of intrinsically motivated team members are triggered by discrepancies between the experienced issue and their mental models that create a particular curiosity to explore and understand the experience (Høyrup & Elkjaer, 2006;Chang et al., 2021). Extrinsic motivation relates to an external stimulus that encourages team members to participate actively in reflection (Fleck & Fitzpatrick, 2010). Related to motivation is trust. ...
... Provided that the narrative has been discussed and identified as a key game element to elicit eudaimonic responses among players (e.g., Roth and Koenitz, 2016;Rogers et al., 2017;Daneels et al., 2020;Jacobs, 2021;Stenseng et al., 2021), it is unsurprising that much prior theorizing has focused on this specific game layer. For example, Fleck and Fitzpatrick's (2010) theory of transformative reflection argues that people's reflections occur on a continuum from superficial to transformative, and this has been used to categorize different levels of reflective experiences when playing video games. Prior research showed that most players reflect rather superficially on aspects related to the game itself, while few make reflections that change players' own behavior or which provide them with new insights on broader social issues outside of the game (Mekler et al., 2018;Whitby et al., 2019). ...
Article
Full-text available
Over the past years, scholars have explored eudaimonic video game experiences—profound entertainment responses that include meaningfulness, reflection, and others. In a comparatively short time, a plethora of explanations for the formation of such eudaimonic gaming experiences has been developed across multiple disciplines, making it difficult to keep track of the state of theory development. Hence, we present a theoretical overview of these explanations. We first provide a working definition of eudaimonic gaming experiences (i.e., experiences that reflect human virtues and encourage players to develop their potential as human beings fully) and outline four layers of video games—agency, narrative, sociality, and aesthetics—that form the basis for theorizing. Subsequently, we provide an overview of the theoretical approaches, categorizing them based on which of the four game layers their explanation mainly rests upon. Finally, we suggest the contingency of the different theoretical approaches for explaining eudaimonic experiences by describing how their usefulness varies as a function of interactivity. As different types of games offer players various levels of interactivity, our overview suggests which theories and which game layers should be considered when examining eudaimonic experiences for specific game types.
... Reflective level detection. Under the supervision of Didactics specialists two annotators labelled 600 texts according to Fleck & Fitzpatrick's scheme [11], achieving moderate inter-annotators agreement of 0.68. The coding scheme includes 5 levels: description, reflective description, dialogical reflection, transformative reflection and critical reflection; With 70% of the data used for the training and 30% for evaluation, we used pre-trained BERT large and complete document embeddings for the English and German, resulting in QWK score of 0.71 in cross-validation. ...
Preprint
Full-text available
Written reflective practice is a regular exercise pre-service teachers perform during their higher education. Usually, their lecturers are expected to provide individual feedback, which can be a challenging task to perform on a regular basis. In this paper, we present the first open-source automated feedback tool based on didactic theory and implemented as a hybrid AI system. We describe the components and discuss the advantages and disadvantages of our system compared to the state-of-art generative large language models. The main objective of our work is to enable better learning outcomes for students and to complement the teaching activities of lecturers.
Chapter
Written reflective practice is a regular exercise pre-service teachers perform during their higher education. Usually, their lecturers are expected to provide individual feedback, which can be a challenging task to perform on a regular basis. In this paper, we present the first open-source automated feedback tool based on didactic theory and implemented as a hybrid AI system. We describe the components and discuss the advantages and disadvantages of our system compared to the state-of-art generative large language models. The main objective of our work is to enable better learning outcomes for students and to complement the teaching activities of lecturers.
Conference Paper
Full-text available
Informal caregivers play an essential role in caring for persons who require assistance and in managing the health of their loved ones. Unfortunately, they need more health, leisure, and relaxation time. Nature interaction is one of many kinds of self-care intervention. It has long been regarded as a refreshing break from stressful routines, and research suggests exposure to nature interventions to improve the quality of life of caregivers. Despite not being the real thing, technology allows us alternatives that can still have some beneficial effects. In this preliminary study, we explore the benefits of natural environment videos on informal caregivers as an alternative to exposure to nature. Specifically, we are interested in the effects of their own choices versus a random video. We found that natural environment videos improve the well-being of informal caregivers in at least three key areas: valence, arousal, and negative affect. Furthermore, the effect increases when they choose the video they want to watch instead of a random video. This effect benefits the studied subjects because they need more time and energy to visit real natural environments.KeywordsInformal caregiversSelf-careWell-beingNature videos
Chapter
Promoting resilience is crucial to support people in the face of traumatic experiences caused by existential crises. Virtual Reality (VR) can support resilience as it allows for embodied experiences and experiential learning. We present the design and initial user evaluation of an immersive VR experience for strengthening resilience, inspired by Viktor Frankl’s psychotherapy, ‘logotherapy and existential analysis’ (LTEA). The prototype immerses users in two experiences related to guilt or suffering and guides them through an interactive reflection, encouraging them to consider their potential for finding meaning even in adverse circumstances. Although the self-reported resilience measures did not indicate increased resilience, qualitative data suggest that the users were able to use the prototype to reflect on meaning in life. This paper contributes to the field of VR for well-being by introducing the under-explored approach of LTEA to facilitate resilience. We discuss aspects of resilience support in VR by addressing the relevance of identifying and utilising technology-specific affordances to enhance reflective practice and the potential of peer support for promoting resilience.KeywordsVirtual RealityResilienceReflectionExistential HCILogotherapy and Existential Analysis
Chapter
Designing for reflection and journaling have been prominent research areas in HCI and Interaction Design. However, designing for the experience of journaling that is supported by conversations with AI–Conversational Agent (CA)–to foster reflection seems to be a relatively unexplored area. Furthermore, while there are an abundant number of general guidelines and design principles for designing human-AI interactions, a set of guidelines for designing an interactive and reflective journaling experience with AI is lacking. This paper is a first attempt to address that need. We present the result of a qualitative user study on interactive and reflective journaling. We were interested in attending to our participants’ experiences and finding out their needs regarding the interactive journaling experience with CA. The user needs then were translated to design requirements and thereafter to themes or design principles. Some of our findings suggest that one of the important factors in journaling is the personal aesthetics of writing, by using carefully selected personal tools, specific materiality and interactions. Further, the flow of writing is considered sacred, hence it is almost like an untouchable, reflective ritualistic flow. Reflecting on the findings, we believe the outcome of this study can create opportunities for designing for human-AI interactions that are generative and reflective for activities that require such qualities, such as journaling or creativity.KeywordsJournalingReflectionInteraction DesignHuman-AI InteractionConversational Design
Chapter
Designing and studying computationally-supported roleplaying for changing social perspectives of players is a complex and challenging problem. As indispensable components of roleplaying games (RPGs), narratives have the potential to promote successful perspective-taking. In this paper, we first present the design of a visual novel style RPG scenario addressing xenophobia and bullying, using an interactive narrative powered by a computational narrative engine. We then report on a usability evaluation of our interactive narrative system and an empirical evaluation of the RPG’s effectiveness in promoting successful perspective-taking through a crowdsourced online experiment.KeywordsRoleplayingRoleplaying GamesNarrative GamesXenophobiaBullying
Article
Full-text available
This paper examines how video can be used to help pre-service and in-service teachers learn to notice what is happening in their classrooms. Data from two related studies are presented. In the first study, middle-school mathematics teachers met monthly in a video club in which they shared and discussed excerpts of videos from their classrooms. In the second study, a group of pre-service high-school mathematics and science teachers used a new video analysis support tool called VAST to examine excerpts of video from their own and others' classrooms. In both cases, there were changes over time in what the teachers noticed and in how they interpreted these events. This research adds to our theoretical understanding of the role of video in teacher education and also provides direction for the development of new forms of video-based professional development activities.
Article
To determine whether students are engaged in reflective practice it is necessary to have some means of identifying reflective thought and a measure of the depth of reflective thinking. Several measures of reflectivity have been proposed but there appears to be no widely accepted and clearly formulated procedure for determining levels of reflective thinking from students' written reflective journals. In this study we propose a scheme for estimating the quality of reflective thinking in students' writing in reflective journals, using categories based on Mezirow's work on reflective thinking. In an initial test of the scheme, reasonable levels of agreement were obtained from eight judges. Disagreements over coding resulted from differing interpretations of the significance of what students had written rather than from a lack of precision in the guidelines for coding categories. A second test, using students' reflective papers, showed acceptable levels of reliability between four assessors. The method is recommended for both assessing students and evaluating courses in programs which aim to develop reflective thinking.
Article
While peer collaboration is the basis for co-learning in many groups, in the classroom the prevailing assumption is that teachers facilitate student learning, through course structure, setting learning tasks and outcomes, presentation, discussion, facilitating small group learning, coaching, and mentoring, among others. Though instructional design models have recognized that learning builds on interactions between learners and their environments (teachers have moved from "sage on the stage" to "guide on the side"), these models tend to focus on individual student learning rather than group learning.