ArticlePDF Available

Learning-Oriented Assessment: Conceptual Bases and Practical Implications

Authors:

Abstract and Figures

This paper focuses on the potential of the learning aspects of assessment. The term 'learning-oriented assessment' is introduced and three elements of it are elaborated: assessment tasks as learning tasks; student involvement in assessment as peer- or self-evaluators; and feedback as feedforward. I also indicate how learning-oriented assessment was promoted at the institutional level through a reflective analysis of a major funded project. Implications for practice are discussed through a focus on how learning-oriented assessment can be implemented at the module level.
Content may be subject to copyright.
Innovations in Education and Teaching International
Vol. 44, No. 1, February 2007, pp. 57–66
ISSN 1470–3297 (print)/ISSN 1470–3300 (online)/07/010057–10
© 2007 Taylor & Francis
DOI: 10.1080/14703290601081332
Learning-oriented assessment: conceptual
bases and practical implications
David Carless
*
University of Hong Kong, Hong Kong
Taylor and Francis LtdRIIE_A_208072.sgm10.1080/14703290601081332
Innovations in Education and Teaching International1470-3297 (print)/1470-3300 (online)Original Article2007Taylor & Francis441000000February 2007DavidCarlessdcarless@hkucc.hku.hk
This paper focuses on the potential of the learning aspects of assessment. The term ‘learning-oriented
assessment’ is introduced and three elements of it are elaborated: assessment tasks as learning tasks; student in-
volvement in assessment as peer- or self-evaluators; and feedback as feedforward. I also indicate how learning-
oriented assessment was promoted at the institutional level through a reflective analysis of a major funded
project. Implications for practice are discussed through a focus on how learning-oriented assessment can be
implemented at the module level.
Introduction
Assessment in higher education faces a number of challenges. Knight (2002) asserts that
summative assessment is in ‘disarray’, for example, in terms of reliability or in judging the kind
of complex learning to which higher education aspires. Formative assessment is also said to be
in decline (Gibbs & Simpson, 2004) or failing to fulfil its potential (Knight & Yorke, 2003). All
assessments lead to some kind of student learning (Boud, 1995), but a fundamental challenge
is to stimulate the right kind of learning. Assessment tasks often distribute effort unevenly across
a course (Gibbs & Simpson, 2004) and examinations are frequently critiqued for encouraging
memorisation or surface approaches to learning (Ramsden, 2003). Assessment may also fail to
support students in developing dispositions for lifelong learning, such as the ability to self-
evaluate (Boud, 2000). Feedback is often ineffective, principally because it comes too late for
students to use it productively (Carless, 2006) and it generally fails to include iterative cycles of
feedback and revision that normally characterise academic writing (Taras, 2006).
One of the core problems is that assessment is about several things at once (Ramsden, 2003)
or what Boud (2000) refers to as ‘double duty’. It is about grading and about learning; it is about
evaluating student achievements and teaching them better; it is about standards and invokes
comparisons between individuals; it communicates explicit and hidden messages. Assessment
thus engenders tensions and compromises. Its multiple demands make its reform difficult to
*
Faculty of Education, University of Hong Kong, Pokfulam, Hong Kong. Email: dcarless@hkucc.hku.hk
58
D. Carless
achieve, but in view of the centrality of assessment to the student experience, it is crucial that
the area be handled well.
This paper seeks to address the issue of how assessment could be more effectively focused on
enhancing student learning. Learning-oriented assessment (LOA) represents an attempt to
emphasise these learning features of assessment and promote their development. This paper has
three main strands. Firstly, I introduce the term LOA and discuss its conceptual foundations.
Secondly, through a reflective account of a funded project managed in the Hong Kong Institute
of Education (HKIEd), I describe how LOA was promoted at an institutional level. In the third
main section, I move to the module level and indicate how LOA can be implemented in practice.
In terms of my own lived experience, these three strands interacted as my work oscillated
between the wider project management, its emerging conceptual underpinnings, engagement
with the relevant literature and my own teaching.
Conceptual basis of learning-oriented assessment
This section describes firstly the genesis of the term LOA in terms of how it originated from
challenges associated with the terminology and practice of formative assessment. An initial
starting point for our institutional focus on the learning aspects of assessment was stimulated
by a high-stakes quality audit with a specific focus on assessment. In-depth preparation for
this review led us to discuss differing interpretations, misconceptions or doubts about forma-
tive assessment. As Yorke (2003) points out, formative assessment is more complex than it
appears at first sight. The different conceptions of colleagues in the HKIEd fell roughly into
two camps: one group who viewed formative assessment as mainly involving formal struc-
tured tasks, similar to Bell and Cowie’s (2001) planned formative assessment. Another
group, of a more constructivist orientation, considered formative assessment as mainly
informal and ad hoc, what Bell and Cowie refer to as interactive formative assessment. When
each party had its own view of what formative assessment is or should be, dialogue was
constrained by the fact that individuals were actually talking about different conceptions even
when using the same term.
Practical impediments to formative assessment were also raised. Some staff, particularly those
that favoured a formal and planned approach to formative assessment, believed that lecturers
did not have the time to conduct formative assessments, whilst those with the more constructiv-
ist interactive orientation felt that formative assessment was just a fundamental part of good
teaching. A further concern was students’ responses to formative assessment and in particular
whether it may unduly increase their workload burden. Instrumental students may interpret
some types of formative assessment as extra work for no marks or regard them as non-essential
(Yorke, 2003).
A few months subsequent to these debates I became the principal investigator of a teaching
development project which sought to enhance the learning elements of assessment. To avoid the
confusions and doubts about formative assessment processes outlined above, I coined the term
LOA. In LOA, learning comes first, both in the way the term is literally constructed, and as a
matter of the principle of emphasising the learning aspects of assessment. A starting point for
LOA was thus to characterise it as denoting assessment processes in which learning elements are
emphasised more than measurement ones (Carless
et al
., 2006). Our framework for LOA
Learning-oriented assessment
59
(adapted from Joughin, 2005), summarised in Figure 1, seeks to reconfigure current thinking
about assessment and learning in a productive form.
Figure 1. Framework for learning-oriented assessment
The starting point of the figure is the two main purposes of assessment, the certification element
which focuses principally on evaluating student achievement, and the learning element. The inter-
secting circles indicate that when assessment is functioning efficiently, there should be substantial
overlap between these two functions. The aim of LOA is strengthening the learning aspects of
assessment and we believe that this can be achieved through either formative or summative assess-
ments as long as a central focus is on engineering appropriate student learning. For formative
assessments that learning purpose is an inherent characteristic, for summative assessments they
develop productive student learning when the features described below are present.
The first and most crucial strand of LOA is represented by the term assessment tasks as learn-
ing tasks. This conceptualisation holds that when assessment tasks embody the desired learning
outcomes, students are primed for deep learning experiences by progressing towards these
outcomes, akin to what Biggs (1999) describes as constructive alignment of objectives, content
and assessment. The tasks should promote the kind of learning dispositions required of
graduates and should mirror real-world applications of the subject matter. In addition, the tasks
should aim to spread attention across a period of study, not lead to short-term bursts of
sustained study for an end of module assignment; or in the case of examinations the memorising
of material which is soon forgotten.
The second component of LOA is student involvement in assessment so that they develop a
better understanding of learning goals and engage more actively with criteria and standards.
Within this strand, we include drafting criteria (Orsmond
et al
., 2002); engaging with quality
exemplars (Sadler, 2002); peer feedback (Liu & Carless, 2006) or peer assessment (Falchikov,
2005); and the development of self-evaluation skills or ‘evaluative expertise’ amongst students
(Sadler, 1989). Through these activities, it is hoped that both the standards required and the
transparency of the whole assessment processes can be enhanced.
Thirdly, for assessment to promote learning, students need to receive appropriate feedback
which they can use to ‘feedforward’ into future work. Feedback in itself may not promote
learning, unless students engage with it and act upon it (Gibbs & Simpson, 2004). Timeliness
and promoting student engagement with feedback are thus key aspects. Although it is antici-
pated that the tutor would often provide feedback, peers can also be usefully deployed as givers
of feedback (Falchikov, 2001).
The three strands are intended to be seen as a unified whole, rather than composed of discrete
elements. For example, feedback is likely to be more effective when students are cognisant of
criteria and are monitoring their progress towards the stated standards. Impacting on these
strands are staff and student perspectives on assessment, represented at the right and left of
Figure 1, as part of contextual influences impinging on the assessment process. For example,
tutors’ capacity to implement LOA may be constrained by their own limited experience of differ-
ent assessment formats. Students may be initially reluctant to accept innovative assessment
methods unless their rationale and potential advantages to them are clear.
The above framework of LOA is summarised by the following principles:
Principle 1: Assessment tasks should be designed to stimulate sound learning practices
amongst students.
60
D. Carless
Principle 2: Assessment should involve students actively in engaging with criteria, quality,
their own and/or peers’ performance.
Principle 3: Feedback should be timely and forward-looking so as to support current and
future student learning.
Institutional promotion of learning-oriented assessment
Here I focus on LOA at the institutional level through a reflective account of a four-year (Octo-
ber 2002 to September 2006) funded initiative entitled learning-oriented assessment project
(LOAP). My intention, in this section, is to examine some of the issues in promoting improve-
ment in assessment through the discussion of the specific case of LOAP. One of the justifications
for this discussion is that the development of the conceptual side of LOA outlined above would
not have taken place without the pressure and support from the wider project.
The main aim of LOAP was to identify, promote and disseminate good practices in LOA in
higher education in Hong Kong. The project was based in the HKIEd but also involved collab-
oration with other universities and participation of overseas consultants. LOAP was a staff devel-
opment initiative, rather than one with a specific remit for university-wide change, but we
naturally sought impact at the institutional level. One of the challenges for any project which
seeks to have a wider institutional impact is how to motivate staff to become involved. There are
many competing demands on staff so why would they commit themselves to LOAP rather than
any other project, their own teaching or research? We found this a particular challenge for a
project focused on assessment because our interactions with colleagues indicated that many
found assessment a domain that carried negative overtones: concerns about the pernicious influ-
ences of assessment as accountability; a perception of assessment as a difficult and problematic
field; and heavy marking loads. In essence, assessment seems to have a negative image amongst
many academics. The use of the term LOA was one modest attempt to attract colleagues who
perceived themselves as being interested in learning but less so in assessment.
Tutors understandings and
experiences of assessment
Students understandings and
experiences of assessment
Assessment tasks
as learning tasks
Student
involvement, e.g. as
peer- or self-
evaluators
Feedback as
feedforward
Learning-oriented assessment
Learning
purpose
Certification
purpose
Figure 1. Framework for learning-oriented assessment
Learning-oriented assessment
61
The LOAP team attempted a number of other strategies to involve colleagues in the project,
albeit with varying degrees of success. Our main strategies, discussed further below, were
essentially fourfold: using a combination of bottom-up and top-down processes; building the
project around a series of both traditional academic and ‘scholarship of teaching’ products;
utilising prestigious overseas consultants to raise the profile of the project and provide input; and
collaborating with the educational development unit in the university.
The project was launched with an essentially bottom-up strategy, using a core team of faculty
representatives to disseminate its aims to colleagues. The first stage of this process sought to
identify current practices employed by HKIEd staff. Our first modest product was thus a collec-
tion of summaries of useful LOA practices via a user-friendly two-page pro-forma, using a
collection of classroom assessment techniques (Angelo & Cross, 1993) and the ASSHE (Assess-
ment Strategies in Higher Education) inventory (Hounsell
et al
., 1996) as inspirations. These
summaries provided a means of publicising the project and involving staff in a way that was
neither time-consuming nor onerous. The active support of the university President married the
bottom-up approach with some top-down impetus and helped to encourage colleagues to
submit their practices. Around 40 summaries were initially received from a total academic staff
of nearly 400, an encouraging response. These contributions were posted on the project website
(LOAP, 2004) so there was an opportunity for immediate small-scale recognition and exposure.
By extending the collection to the other universities in Hong Kong, we subsequently developed
these contributions into a sourcebook of LOA practices (Carless
et al
., 2007). This sourcebook
contains chapters reviewing key challenges and progress in assessment; outlines the conceptual
basis of LOA; and showcases 39 short accounts of LOA practice, each including commentary
and further suggestions.
A content analysis of the summaries of practice led to the identification of a number of themes
with relevance to LOA: self-assessment; peer assessment; technology-enhanced assessment;
feedback; and portfolio assessment. LOAP set up action research teams to explore these themes
further in developmental work with their own classes (e.g. Keppell
et al
., 2006; Mok
et al
.,
2006). We believed that action research was a suitable strategy as it involved staff in a bottom-
up way whilst also providing structure and resources from LOAP. The action research processes
included working gradually towards tangible products, including two one-day LOAP
conferences (June 2004 and June 2005) and the subsequent publication in 2006 of a special
issue of
Assessment and Evaluation in Higher Education
. Action research processes have been seen
to be a particularly suitable strategy for exploring the renewal of assessment practices in higher
education (e.g. McDowell & Sambell, 1999; Swann & Ecclestone, 1999).
One of the most productive strategies in the project was the deployment of overseas consult-
ants as scholars in residence, conducting a series of short intensive visits. These consultancy
visits formed the basis of the LOAP lecture and seminar programme, helped to establish a high
profile for the project and provided valuable insights, both with respect to views of assessment
and thoughts on how the project could be managed to maximise its impact.
A further strategy was the involvement of members of the educational development unit in the
HKIEd. Their roles as staff developers made them natural partners and highly aware of the
challenges and possibilities in the enhancement of university practice. As Knight and Yorke
(2003) argue, a profitable strategy for assessment change involves educational development
units working in partnership with institutional teams.
62
D. Carless
LOAP hopes over the medium term to have an impact in contributing to some change in
the assessment culture in the HKIEd and the wider Hong Kong context, yet there is
evidence from a LOAP questionnaire survey (Liu, 2004) that staff views of assessment are
sometimes relatively entrenched. A major challenge to a learning-oriented perspective on
assessment is the dominance of viewpoints which simply equate assessment with grading or
measurement. Formative approaches to assessment risk being drowned by the power of
summative assessment. Potential ways forward appear to be developing productive synergies
between formative and summative assessment; and developing the kinds of summative
assessment that fulfil the characteristics of assessment tasks as learning tasks as discussed
earlier in the paper. Summative assessment is powerful and necessary so handling it effec-
tively remains paramount.
My reflection on LOAP is that it has been most successful in its deployment of external
consultants and in its development of tangible products, such as the sourcebook and the journal
special issue. These ensure some form of project legacy and facilitate impact beyond the
individual level. The combination of bottom-up strategies mixed with some top-down support
from senior management and/or the project team has also been generally effective. The method
of drawing people into the project in various ways has had some successes and via the journal
special issue and the collection of practices in the sourcebook, around 50 staff members have
achieved some form of publication. Impact on what goes on in the classroom is more difficult to
judge, but the sourcebook does provide tentative evidence of tutors reflecting on and refining
their LOA practices.
LOAP has been less successful in trying to promote wider institutional change. In this case,
LOAP’s position as a project does not afford it any clear authority or role in the committee struc-
ture of the HKIEd. Senior managers may be pre-occupied with crisis management or externally
generated priorities so developments in teaching, learning and assessment may sometimes be
prioritised lower than other more urgent tasks. A failure to mobilise middle management, such
as heads of department or programme leaders (cf. Knight, 2000), also limits the influence of the
project. LOAP as a staff development initiative has mainly impacted on those who were already
relatively receptive to the ideas being promoted. How to stimulate staff on the periphery is an
ongoing challenge meriting further attention. One potential way forward is working with subject
groups or course teams rather than just enthusiasts.
In sum, LOAP achieved a strong profile both institutionally and further afield, through its
activities and academic products. A high profile does not, however, naturally lead to improve-
ment beyond the individual level. A relevant question with which to end this section is that posed
by Yorke (2001): how does an institution learn from its diverse experiences of assessment and
develop further?
Module-level implementation of learning-oriented assessment
In the first section of the paper, I argued that LOA is underpinned by three key elements,
appropriate tasks, student involvement in assessment and feedback that can be productively
acted upon. Here, I indicate how this LOA framework can be implemented in practice through
an example of a 12-week 30-hour module, with a class of 35 pre-service students in a Bachelor
of education programme. My purpose here is not to claim that the teaching of the module is
Learning-oriented assessment
63
innovative or represents best practice, but more modestly to illustrate some of the practical
possibilities inherent in the LOA model.
The module is itself on the topic of Assessment and has objectives for students to demonstrate
their understanding of formative and summative approaches to assessment; and construct
appropriate assessment tools. Two assessment tasks were set for the module, both of them
involving the design of assessment instruments suitable for use in schools. Grading was criteria-
based with each assignment carrying equal weighting. The first assignment was for students to
design a formative assessment task for school pupils (handed in mid-way through the module),
the second to design a summative assessment task (handed in at the end of the module). In each
case, students were also asked to state the rationale for the task and how it supported student
learning. For both assignments, students were required to include a self-evaluation of their
work.
I believe that the assessment tasks are well-aligned with curriculum objectives and allow for
effort to be distributed evenly through the duration of the module. They are also designed so as
to facilitate improvement between one assignment and the other, particularly as some of the
features: rationale, support for student learning and self-evaluation are common to both. The
limitations of the tasks include a minimum of student choice and that they are not strongly
integrated with actual school experience with real pupils.
I turn now to involvement of students in the assessment process and the development of
evaluative expertise. Institutional quality assurance guidelines encourage tutors to distribute
assignment information and grade-related criteria in the first session of a module. This was
done, although it misses an opportunity for students to be actively involved in the generation
of criteria (cf. Rust
et al
., 2003). Instead, a class activity was done in week 3, in which students
tried to identify, and summarise in their own words, the key elements of the criteria. The
purpose of this was for students to try to unpack the discourse of assessment criteria and
develop a deeper understanding of the qualities of a good assignment. This also helped them
to prepare for their self-evaluation, which could be completed with reference to the criteria
and/or by adding their own self-identified features. My purpose in encouraging self-assessment
of this kind is to push students to engage actively with the required standards and to self-
monitor their own work.
A modest further attempt to promote evaluative expertise involved the use of student exem-
plars. Samples of previous student work were discussed briefly in class. If further time had been
available a worthwhile activity would have been for students themselves to assess against the
stated criteria samples or extracts from previous student work. After the first assignment had
been marked, I copied for the class extracts from the work of two students who had produced
the best sections on how their assessment supports pupils’ learning, an aspect of the assignments
that many of the students found difficult. Sadler (2002) suggests that analysing high-quality
exemplars is more effective than focusing on criteria and recounts the potent impact on his
students of being exposed to outstanding assignments.
Feedback in the module was arranged so as to maximise its potential for student action in
line with the LOA framework. One form of feedback came two weeks before the due date of
the first assignment. At this stage, student individual tutorials were held instead of the
regular taught class. This enabled students to collect feedback on the draft of their first
assignments, receive reassurance that they were on the right track and collect feedback which
64
D. Carless
could help them obtain a higher mark on the assignment. The students themselves expressed
the view that feedback on drafts is more useful to them than feedback on completed assign-
ments. Yorke (2003) warns, however, that feedback on drafts helps students to produce
better performance, but subsequently they may not be able to succeed independently on
analogous tasks.
The first assignment was handed in mid-way through the module and marked promptly so
that students could receive their feedback on it before they completed the second assignment.
To encourage engagement with feedback, students were required to write a response to the
feedback at the beginning of the second assignment. This represented attempts to fulfil two
conditions under which feedback supports learning (Gibbs & Simpson, 2004), pertaining to
timeliness and feedback that can be acted upon. An alternative form of timely interactive
feedback, used in a previous delivery of the module, involved oral ‘mini-vivas’ (Carless,
2002).
A further form of feedback was provided in class before the second assignment was due. This
involved focused input on problem areas that had either been exhibited in the first assignment
or by previous students of the module. This was an attempt to deal with likely problems pre-
emptively rather than after they had occurred. Much feedback in higher education comes too
late for it to be useful to students.
In sum, a variety of timely written and verbal feedback was provided during the module, albeit
with the limitation that most of it was tutor-led and may result in students becoming somewhat
dependent on the support of their lecturer. In order to make the tutor workload manageable, for
the second assignment less detailed written annotations were provided in view of the fact that as
this was the end of the module, there was little direct opportunity for further improvement. At
the risk of seeming to preach laziness, a wider speculation is whether detailed annotations on
terminal assessments are a productive use of lecture time and might sometimes be replaced
simply by a few concise points for further development.
Overall, within the limited time available, the module described here attempted to exemplify
the elements of the LOA framework, admittedly without pursuing any of the elements in great
detail. In summary, the main LOA aspects of the module were: assessment tasks that spread
effort across different periods of the module and through commonalities facilitated the possibil-
ity of improvement; engagement with criteria allied with self-evaluations carried out by students
as part of the process of developing evaluative expertise; formative feedback on drafts for the first
assignment; and feedforward from the first assignment to the second one.
The learning outcomes of students were generally impressive as evidenced by their
assignments and the module was very positively evaluated by participants. Some of their open-
ended evaluation comments which illustrate their response to LOA are as follows:
When designing the self-evaluation sheet, I have to refer back to the criteria and then check with my
assignment. I think this acts as a double checking. Before, I seldom checked my assignments deeply.
Before we do the second assignment, you used half a lesson to tell us the things we should be aware of.
Then we can have less mistakes or misunderstandings.
The module assignments allow me to practise what I learned in the module. I received concrete feed-
back in the consultation and useful comments in my first assignment, so that I know what aspects I
should improve in the second assignment.
Learning-oriented assessment
65
Conclusion
This paper has put forward a case for assessment discourse focused on learning rather than
measurement. LOA is conceptualised as focusing on three core elements: assessment tasks
which promote the kind of learning which is sought; the involvement of students in the
assessment process as exemplified by the development of evaluative skills; and feedback which
feeds forward by prompting student engagement and action. A potential strength of LOA is that
it can be applied to formative or summative tasks, particularly when the latter are designed in
terms of ‘assessment tasks as learning tasks’. The paper has also discussed attempts to promote
LOA at an institutional level and at the practical level of a specific module.
Acknowledgements
I am endebted to Gordon Joughin for his input to the conceptual aspects of LOA. I would
also like to thank David Boud, Peter Knight and Liu Ngar-Fun for their contributions to
LOAP.
Note on contributor
David Carless is an Associate Professor in the Faculty of Education at the University of Hong
Kong. He was the principal supervisor of the learning-oriented assessment project in his
previous post as Senior Lecturer in the Hong Kong Institute of Education.
References
Angelo, T. & Cross, K. P. (1993)
Classroom assessment techniques: a handbook for college teachers
(2nd edn) (San
Francisco, CA, Jossey Bass).
Bell, B. & Cowie, B. (2001) The characteristics of formative assessment in science education,
Science
Education,
85, 536–553.
Biggs, J. (1999)
Teaching for quality learning at university
(London, Society for Research into Higher Education
and the Open University Press).
Boud, D. (1995) Assessment and learning: contradictory or complementary? in: P. Knight (Ed.)
Assessment for
learning in higher education
(London, Kogan Page), 35–41.
Boud, D. (2000) Sustainable assessment: rethinking assessment for the learning society,
Studies in Continuing
Education,
22(2), 151–167.
Carless, D. (2002) The ‘mini-viva’ as a tool to enhance assessment for learning,
Assessment and Evaluation in
Higher Education,
27(4), 353–363.
Carless, D. (2006) Differing perceptions in the feedback process,
Studies in Higher Education,
31(2),
219–233.
Carless, D., Joughin, G. & Liu, N. F. (2007)
How assessment supports learning: learning-oriented assessment in
action
(Hong Kong, Hong Kong University Press).
Carless, D., Joughin, G. & Mok, M. (2006) Learning-oriented assessment: principles and practice,
Assessment
and Evaluation in Higher Education,
31(4), 395–398.
Falchikov, N. (2001)
Learning together: peer tutoring in higher education
(London, Routledge Falmer).
Falchikov, N. (2005)
Improving assessment through student involvement
(London, Routledge Falmer).
Gibbs, G. & Simpson, C. (2004) Conditions under which assessment supports students’ learning,
Learning and
Teaching in Higher Education,
1, 3–31. Available online at: http://www.glos.ac.uk/departments/clt/lathe/
issue1/index.cfm (accessed 5 June 2005).
66
D. Carless
Hounsell, D., McCulloch, M. & Scott, M. (1996)
The ASSHE inventory: changing assessment practices in Scottish
Higher Education.
Available online at: http://www.ltsn.ac.uk/genericcentre/asshe/ (accessed 13 January
2005).
Joughin, G. (2005) Learning-oriented assessment: a conceptual framework, in: G. Crebert, L. Davies & S.
Phillips (Eds)
Conference proceedings, Effective Learning and Teaching Conference, Brisbane, 4–5 November
[CD-ROM].
Keppell, M., Au, E., Ma, A. & Chan, C. (2006) Peer learning and learning-oriented assessment in technology-
enhanced environments,
Assessment and Evaluation in Higher Education,
31(4), 453–464.
Knight, P. (2000) The value of a programme-wide approach to assessment,
Assessment and Evaluation in Higher
Education,
25(3), 237–251.
Knight, P. (2002) Summative assessment in higher education: practices in disarray,
Studies in Higher Education,
27(3), 275–286.
Knight, P. & Yorke, M. (2003)
Assessment, learning and employability
(Maidenhead, Society for Research into
Higher Education and the Open University Press).
Liu, N. F. (2004) Hong Kong tertiary teachers’ and students’ perceptions of assessment purposes and
practices, paper presented to
LOAP Conference
, Hong Kong, 10 June.
Liu, N. F. & Carless, D. (2006) Peer feedback: the learning element of peer assessment,
Teaching in Higher
Education,
11(3), 279–290.
LOAP (2004) Learning-oriented assessment project website. Available online at: http://www.ied.edu.hk/loap/
(accessed 27 November 2004).
McDowell, L. & Sambell, K. (1999) The experience of innovative assessment: student perspectives, in: S.
Brown & A. Glasner (Eds)
Assessment matters in higher education
(Maidenhead, Society for Research into
Higher Education and the Open University Press), 71–82.
Mok, M., Lung, C. L., Cheng, P. W., Cheung, H. P. & Ng, M. L. (2006) Self-assessment in higher education:
experience in using a metacognitive approach in five case studies,
Assessment and Evaluation in Higher
Education,
31(4), 415–434.
Orsmond, P., Merry, S. & Reiling, K. (2002) The use of exemplars and formative feedback when using student
derived marking criteria in peer and self-assessment,
Assessment and Evaluation in Higher Education,
27(4),
309–323.
Ramsden, P. (2003)
Learning to teaching in higher education
(2nd edn) (London, Routledge).
Rust, C., Price, M. & O’Donovan, B. (2003) Improving students’ learning by developing their understanding
of assessment criteria and processes,
Assessment and Evaluation in Higher Education,
28(2), 147–164.
Sadler, R. (1989) Formative assessment and the design of instructional systems,
Instructional Science,
18, 119–144.
Sadler, R. (2002) Ah! … So that’s ‘quality’, in: P. Schwartz & G. Webb (Eds)
Assessment: case studies, experience
and practice from higher education
(London, Kogan Page), 130–136.
Swann, J. & Ecclestone, K. (1999) Improving lecturers’ assessment practice in higher education: a problem-
based approach,
Educational Action Research,
7(1), 63–84.
Taras, M. (2006) Do unto others or not: equity in feedback for undergraduates,
Assessment and Evaluation in
Higher Education,
31(3), 365–377.
Yorke, M. (2001)
Assessment: a guide for senior managers
(York, Higher Education Academy).
Yorke, M. (2003) Formative assessment in higher education: moves towards theory and enhancement of
pedagogic practice,
Higher Education,
45, 477–501.
... It may be difficult for other academics to identify relevant principles and transferable insights from individual case studies (see Gray et al, 2010, for a review). Carless (2007) noted that it is particularly difficult to encourage academics to talk about assessment because, for many, assessment carries "negative overtones." Bloxham (2009) has argued that assessment practices need to be made more explicit and shared beyond disciplinary boundaries: "[assessment] remains essentially an individual construct, heavily influenced by traditions in the subject discipline. ...
... 218). As there appears to be a common perception that assessment is difficult and problematic (Carless, 2007), innovative assessment practices need to be shared and made more explicit to facilitate learning across the sector. Those involved in innovative practice may need encouragement to discuss and share their experiences in order to inform good practice in the transformation of assessment practices in settings other than their own. ...
... A participatory approach can facilitate the broad institutional impact of academic development projects (Carless, 2007). Our project aims to identify principles that have relevance across a range of settings; it is therefore important that staff from various disciplines are encouraged to participate. ...
Article
Full-text available
Social web technologies, such as blogs, wikis, social networking and photo/video sharing sites, are increasingly being used in innovative learning activities in higher education. While there has been much discussion about the pedagogical rationale for using social web technologies in higher education, there has been little examination of the challenges involved in assessing the work students create or the activities they undertake using these tools. The transformation of academic authoring in a social web environment poses complex and urgent assessment-related challenges for policy-makers and educators alike. In this paper we describe the participatory approach we have taken in a project that aims to identify issues and support good assessment practices when students are asked to use social web technologies in medium to high-stakes assessment. In this paper, we outline the design rationale for the research, and describe the methods used in the three stages of this project: 1) documenting current practice through a nationwide survey and interviews; 2) initiating broad discussion across the sector about the issues raised; and 3) field-testing a draft good practice framework in 17 diverse teaching and learning settings. Our initial findings indicate that there are a range of complex student, teacher and institutional issues to consider. We conclude that bottom-up input from practitioners and students, combined with a policy-driven top-down approach is more likely to succeed in bringing about transformation and supporting good practice in the assessment of students’ social web activities.
... As defined by Black and Wiliam (1998), assessment as learning is 'tackling assignments and revision is when higher education students do much of their learning' and 'is a subset of assessment for learning and sees student involvement in assessment, using feedback, participating in peer assessment, and self-monitoring of progress as moments of learning in themselves' (Bloxham & Boyd, 2007). Further, assessment as learning helps students know what the standard or goal is that they are trying to achieve, how their current achievement compares to those goals, and act to reduce the gap between the first two (Sadler, 1989 literature (e.g., Black & Wiliam, 1998;Bloxham & Boyd, 2007;Carless, 2007;Darling-Hammond et al., 2013;Earl, 2003;Poudel, 2016;Wiliam, 2011), in addition to technical qualities such as validity, reliability, fairness, and practicality. ...
... Additionally, a learning-focused assessment approach enhances student learning (Carless, 2007). To make assessments more effective for improving student learning outcomes, student engagement and constructive feedback are crucial. ...
Article
Assessment for learning plays a crucial role in enhancing student learning by integrating student assessment into the teaching-learning process. Taking a case from Tribhuvan University, we conducted a study on the practice of assessment for learning in higher education in Nepal. In this study, we analyzed the perceptions and practices of teaching faculty regarding assessment for learning. The primary research question focused on faculty members’ perceptions and practices related to assessment for learning and how these practices contribute to student learning. We employed both quantitative (an online survey) and qualitative (in-depth interviews) methods for data collection. This study utilized descriptive analysis for the quantitative data, supplemented by qualitative analysis of the interviews. Our findings revealed that faculty members have a limited understanding of assessment for learning, and their practices are inadequate in this regard. To enhance the overall quality of higher education, there is a need to improve student assessment practices by adopting assessment for learning. This requires changes in assessment policies, enhancement of faculty capacities, and improvement in institutional environment.
... This could not only increase test takers' chances to attain a high test score, but can also help them to reach their long term goal of studying in Germany. Hence, an approach for test preparation that is based on the principles of learningoriented assessment (LOA) as described by Carless (2007) seemed useful for this intention. Among the three principles of LOA are 1) "assessment tasks as learning tasks", 2) "student involvement", and 3) "feedback as feedforward" (p. ...
... According to this principle, students should be involved in the assessment by "actively engaging with criteria, quality, their own and/or peers' performance" (Carless 2007, p. 60). Self and peer evaluation activities might be good ways to encourage students to actively seek, give and engage with feedback (Carless, 2007;Lam, 2021) and guide students towards more independence within their learning processes. ...
... This reflects the critical importance of the learner's understanding of their current level, the target level, and how to close the gap between the two to facilitate learning (Hattie & Timperlay, 2007;Sadler, 1989). Previous studies have proposed various features of effective feedback (Boud & Molloy, 2013;Carless, 2007;Keppell & Carless, 2006;Lam, 2021). For instance, according to the principles of effective feedback practice summarized by Lam (2021), it is specific, forward-looking, and appropriate in level; it also relates to success criteria, engages the learner in a proactive role, and promotes self-regulated learning. ...
... One is to conceptualize feedback practice as a curriculum issue, where careful planning is required to determine how feedback should be embedded in a larger cycle(s) of learning tasks to create an environment that facilitates learner uptake (Boud & Molloy, 2013;Carless, 2007). One way to do this would be to devise a module comprising multiple parallel writing tasks, where the learner is encouraged to utilize automated feedback presented during the revision stage of a given task to do better on subsequent tasks. ...
Article
The present mixed-methods study examined the efficacy of W-Writing, an online formative assessment module for summary writing designed for supplemental use in undergraduate introductory academic writing courses in Japan to enhance summary writing instruction under the new normal that emerged after the COVID pandemic. This module automatically delivered four types of content feedback inspired by the formative assessment and learning-oriented assessment (LOA) literature during the revision stage of a summary writing task. The efficacy of the immediate content feedback was examined from two perspectives: students’ revision behaviors and students’ and instructors’ perceptions of the W-Writing module. Students enrolled in the course and four course instructors participated in this study. A frequency analysis of revision operations applied to the initial summary draft of 60 randomly selected students during revisions suggested that they were engaged in meaningful revision activities. The students’ rating of the usefulness of W-Writing (n = 81) was also high. These results were corroborated by results from a thematic analysis conducted on instructors’ interview data, which suggested the instructors’ high endorsement of W-Writing’s usefulness and their perceptions of students’ high engagement in W-Writing activities. The above results provide initial empirical support for the efficacy of the W-Writing feedback design.
... Another sign of good feedback is that it gives students information that can help them in future assignments, rather than only commenting on the assignment being graded. This type of feedback has been termed feed-forward (Higgins, Hartley, and Skelton, 2001;Duncan, 2007;Carless 2007). ...
Conference Paper
Full-text available
This paper presents the Action-oriented Approach (AoA), which responds to current societal needs by preparing learners to act as informed social agents who strategically employ their diverse linguistic and cultural resources to achieve collaborative goals. Rooted in scenario-based learning, the AoA prioritizes learner agency, mediation, and plurilingualism in a dynamic and holistic view of language and language users that recognize the complex nature of language learning and the collaborative communicative processes involved. Action-oriented scenarios contextualize a series of sub-tasks in a logical progression with realistic conditions and constraints in the pursuit of a goal which is not solely language-focused, Scenarios enhance learners’ language awareness, as well as their agency and ability to use languages effectively. Furthermore, the AoA underscores the social and mediated nature of language, promoting collaborative, reflective, and autonomous learning. The authors first explore the emergence of the AoA and its theorization. They then present in detail two action-oriented scenarios from a research study conducted in Italy, depicting the various steps and constraints involved in the creation of a culminating artefact, together with the voices of some of the teachers involved in the study. The authors conclude with implications and recommendations for educators to take into account when implementing action-oriented scenarios in the language classroom.
... On the contrary, it is found that some students are completely outcorrelated (see dashed green and red rectangles), refuting the idea that students with more activity obtain better marks in the practical sessions (or the opposite). These results suggest that laboratory sessions should be redefined towards a more learning-oriented activity (Carless, 2007), helping the students to assimilate the fundamental concepts that are necessary for the final exam. ...
Article
Full-text available
Learning Analytics tools are employed to assess student engagement with the Virtual Campus in an undergraduate Fluid Mechanics course at university level in Spain. This is aimed at obtaining a diagnosis of the course problematics which include low attendance rates, poor performance on activity tests and exams and a high number of re-enrolments. A total amount of 67,902 records from the online platform are analyzed to understand activity trends and information distribution. Specific indicators like percentage gap are defined and correlated with evaluation data for deeper insights. Different profiles of students are identified as a function of the interaction level with the platform. Significant correlation has been found between the level of interaction and the academic results of the students. While proactive profiles exhibit remarkable performance rates, no low-activity profiles were capable of passing the course. The continuous evaluation was found neither correlated with the interaction nor with the final exam marks, so its redefinition is suggested as future work. It is also shown that the higher the average number of student enrolments, the lower the participation and performance in the course. No bias was observed with respect to the gender variable. Moreover, the daily analysis of the records has discovered overall trends about the students’ habits. Learning Analytics is demonstrated as a useful tool for the specified purpose. It is also proposed to evaluate the effectiveness of further actions for the improvement of the course in future academic years.
... Hierdie uitdaging kan egter oorkom word indien onderwysers en dosente proaktief ondersoek instel (Van Staden 2023b) om te weet wat ChatGPT-4V kan doen en waartoe dit nie in staat is nie. Akademiese oneerlikheid kan beperk word indien 'n leergeoriënteerde benadering tot assessering (Carless 2007) gevolg word weens die fokus op leer (Van Staden 2023b). ...
... Despite their awareness of the need for assessment reform, teachers still adhere to traditional forms of assessment, thereby failing to promote learning in any possible way (Benettayeb-Ouahiani, 2016). Scholars, however, point to a framework that has gained considerable attention lately: Learning-Oriented Assessment (LOA) (Carless, 2007;Jones & Saville 2016;Turner & Purpura;2016). It is an approach to assessment that prioritizes students' learning in all types of assessment activities, whether formative or summative. ...
Article
Full-text available
The quality of assessment practices in higher education profoundly influences students' learning experiences and academic outcomes. A recent trend gaining popularity is Learning-Oriented Assessment, which tailors assessment practices to enhance student learning. This study explores Algerian EFL University teachers' comprehension of Learning Oriented Assessment and the extent to which their practices align with it. Through an online mixed questionnaire administered to 56 EFL teachers from different Algerian universities including Batna 2 University, M'sila University, University of Constantine 1 and Eloued University, the research uncovered a range of assessment practices. While some educators embrace some principles of Learning Oriented Assessment, others adhere to conventional assessment methods. Teachers also reported significant factors influencing their assessment choices, including class size and resource constraints. Given the recent shifts, proficiency in contemporary assessment methodologies is imperative for effective teaching and learning. By exploring how EFL instructors in Algeria view assessment, their practices, and the challenges they face, this paper highlights the need for pedagogical innovation in assessment and its practical application in the context of higher education.
Article
Industry-sponsored capstone experiences that involve developing software solutions create valuable opportunities for students to engage in teamwork and learn important career skills just prior to joining the software workforce. The collaboration and communication in capstone projects, which typically happen in person, were forced to move online during the COVID-19 pandemic. We leveraged the transition to conduct a two-stage mixed-methods study that compared the in-person and online capstone experiences of students (novice software developers) and project sponsors (experienced industry professionals) to understand how novices engage in online collaboration. We uncovered that novices find online collaboration more challenging compared to experienced professionals. The challenges faced by the novices and the misalignment with experienced professionals point to a number of avenues for training novice software professionals on effective engagement in geographically distributed collaboration, which is increasingly the norm in the software industry.
Chapter
This chapter examines the transformative potential of AI-enhanced formative assessment in higher education, focusing on fostering inspirational learning experiences. The authors explore how artificial intelligence can revolutionize traditional assessment practices, enabling more personalized, efficient, and effective learning environments. The chapter discusses benefits and challenges of implementation, including potential improvements in student engagement, motivation, and academic achievement. It analyzes AI's role in facilitating real-time feedback, automating grading, and enhancing teacher-student interactions. A comprehensive review of the current state of AI-enhanced formative assessment in higher education is provided, highlighting best practices, strategies, and challenges. The chapter concludes by outlining future research directions, emphasizing collaboration among educators, policymakers, and technologists to harness AI's potential in inspiring and empowering learners.
Article
Full-text available
This paper focuses on peer feedback in relation to assessment processes. It examines the rationale for peer feedback, emphasizing its potential for enhanced student learning. We draw on relevant literature to argue that the dominance of peer assessment processes using grades can undermine the potential of peer feedback for improving student learning. The paper throws further light on the issue by drawing on a large-scale questionnaire survey of tertiary students (1740) and academics (460) in Hong Kong, supplemented by interview data. The findings indicate that a significant number of academics and students resist peer assessment using grades and that the majority report that students never or rarely grade each other in assessment activities. This paper explores why there is resistance, in particular, by academics to peer assessment and argues the case for a peer feedback process as an end in itself or as a precursor to peer assessment involving the awarding of marks. It also recommends some strategies for promoting peer feedback, through engaging students with criteria and for embedding peer involvement within normal course processes.
Article
Full-text available
Group work, group projects and collaborative learning encourage students to learn from other students as well as from the lecturer. Peer learning may involve cooperation, communication and the giving and receiving of peer feedback. In addition peer learning emphasises the sharing of knowledge and ideas between students in a reciprocal partnership. However, some educators ask individual students to formally assess each other within the context of a group project which may inhibit the very process of peer learning that they are attempting to promote. This paper, through the voices of three lecturers and their students, has attempted to reinforce the importance of learning‐oriented peer assessment within technology‐enhanced environments. This paper advocates the concept of learning‐oriented peer assessment strategies to enhance student learning.
Article
Full-text available
This article reports on a project based on the authors' concerns about assessment practice in higher education in the United Kingdom. These concerns stem from their experience as university lecturers, and from knowledge of research evidence and policy issues relating to assessment in higher education. Given the complex nature of higher education, improvement rather than mere change in assessment procedures will require the full participation of people who possess intimate day-to-day contextual knowledge, including an understanding of those aspects of the situation which are not easily measurable or even readily observable. The article details (a) a Popperian problem-based approach to action research designed to facilitate improvements in higher education assessment practice, and (b) how this methodology was adopted, tested and developed at the University of Sunderland. The authors’ aim is to encourage colleagues in other higher education institutions to adopt and further test this methodology in subsequent research.[1]
Book
How Assessment Supports Learning: Learning-oriented Assessment in Action invites teachers in higher education to rethink the purposes of assessment and to revise their assessment practices in the interests of improved student learning. It combines practice, theory, research and extensive examples of assessment techniques to support academics in this vital part of their multi-faceted role. This book presents 39 innovative assessment practices from a range of disciplines and located in a clearly articulated theoretical framework. This framework is congruent with outcomes-based approaches, currently being implemented in universities in Hong Kong and elsewhere. The practices, which can be modified for use in a wide range of contexts, illustrate how assessment can be used to engage students in productive learning, provide genuinely helpful feedback efficiently, and help students learn to evaluate and improve the quality of their own work. The book concludes with suggestions for responding to challenges at the interface between assessment and learning.
Article
This study describes the use of a metacognitive approach for self‐assessment of teacher education students. The design of the study was guided by the principles of learning‐oriented assessment and the centrality of reflection for teachers. The study comprised five case studies undertaken in five teacher education programmes. In each programme, students self‐assessed at the beginning, middle and end of learning. Subgroups of students were invited to represent their learning using concept maps and were interviewed on their progression in self‐assessment. Analysis indicated that students found the metacognitive approach supportive of their learning and self‐assessment. Students were more aware of their learning and thinking processes at the end of the study. Further, teachers involved in the project found the method demanding yet generating useful feedback which enhanced their teaching.
Article
Introduction 1. What is peer tutoring? 2. Beneficial effects: why teachers use peer tutoring 3. Theoretical frameworks for peer tutoring 4. How theory can inform practice 5. Planning and promoting peer tutoring 6. Helping students become peer tutors 7. Evaluation of peer tutoring schemes 8. Problems associated with peer tutoring 9. Technology-supported collaborative learning 10. Benefiting from hindsight: practitioners reflect on peer tutoring 11. Reflections and prospects
Article
This is a book review--written by Nancy Van Note Chism and published in the Journal of Higher Education--of the 1993 book written by Thomas A. Angelo and K. Patricia Cross entitled Classroom Assessment Techniques: A Handbook for College Teachers, 2nd Edition, published by Jossey-Bass. It is, therefore, not the correct citation for that handbook.