ArticlePDF Available

Enhancing Teaching Through Constructive Alignment

Authors:

Abstract

Two lines of thinking are becoming increasingly important in higher educational practice. The first derives from constructivist learning theory, and the second from the instructional design literature. Constructivism comprises a family of theories but all have in common the centrality of the learner's activities in creating meaning. These and related ideas have important implications for teaching and assessment. Instructional designers for their part have emphasised alignment between the objectives of a course or unit and the targets for assessing student performance. "Constructive alignment" represents a marriage of the two thrusts, constructivism being used as a framework to guide decision-making at all stages in instructional design: in deriving curriculum objectives in terms of performances that represent a suitably high cognitive level, in deciding teaching/learning activities judged to elicit those performances, and to assess and summatively report student performance. The "performances of understanding" nominated in the objectives are thus used to systematically align the teaching methods and the assessment. The process is illustrated with reference to a professional development unit in educational psychology for teachers, but the model may be generalized to most units or programs in higher education.
Enhancing learning
through constructive alignment
Professor John Biggs
Open University 14 May, 2009
Outcomes-based Approaches
Three main forms of outcomes-based approaches. All focus
on educational outcomes, each based on a different
philosophy.
1. Outcome-based approaches at school level. Originally
devised by William Spady for disadvantaged children,
but later used generally e.g. Target Oriented Curriculum
(TOC) for individualising teaching.
2. Outcomes-based approaches at institutional level, used
for benchmarking, credit-transfer. Have little directly to
do with enhancing teaching and learning.
3. Outcomes-based Approaches to Student Learning
(OBASL). Defining learning outcomes at programme
and course level, to enhance teaching and learning.
What the UGC said
“The UGC’s goal in promoting outcome-
based approaches is simple and
straightforwardimprovement and
enhancement in student learning and
teaching quality.” (Alice Lam, May 05)
The UGC has asked local universities to
show that they have thought through the
"learning outcomes" they expect their
students to achieve, and that they are
organising educational experiences to
enable students to achieve these
outcomes. …
Outcome-based Approaches to
Student Learning (OBASL):
the Intended Learning Outcome (ILO)
is central
ILO:
What the
student has
to do
Teaching:
To facilitate
attaining the
ILOs
Assessment:
How well
the student
has attained
the ILOs
Implementing OBASL using
Constructive Alignment
ILO:
What the student
has to learn
Teaching:
Engaging the
student in the
verb in the ILO
Assessment:
How well
the student
has met the
ILO
Constructive Alignment
Intended Learning Outcomes (ILOs)
expressed as verbs students have to enact
A
The very best understanding that could be
reasonably expected: verbs such as
hypothesise, apply to “far” domains,
generate, relate to principle, etc.
B
Highly satisfactory understanding: verbs
such as explain, solve, understand main
ideas, analyze, compare, etc.
C
Quite satisfactory learning, with under-
standing at a declarative level: verbs such
as elaborate, classify, cover topics a to n,
D
Understanding at a level that would
warrant a Pass: low level verbs, also
inadequate but salvageable higher level
attempts.
Teaching / Learning
Activities
Designed to
elicit desired
verbs
May be:
Large class activities
Small class activities
Teacher-managed
Peer-managed
Self-managed
as best suits context
Assessment Tasks
Format such that
the target verbs are
elicited and
deployed
in context.
Criteria clearly allow
judgement as to the
quality of the
student's
performance
How constructive alignment started
Constructive alignment was born at HKU.
I was teaching psychology not so that the students could
tell me what psychology they had learned, but how they
could use psychology in order to teach better. They
should be telling me if and how it had, not me telling
them how I thought it should.
They placed their evidence and reflections in a portfolio.
Lecturing to them and giving them an MCQ was obviously
irrelevant to the real aims of the course: teachers would
use psychology to teach more effectively.
If students are to learn desired outcomes in a reasonably
effective manner, then the teacher’s fundamental task is to
get students to engage in learning activities that are likely
to result in their achieving those outcomes… It is helpful to
remember that what the student does is actually more
important in determining what is learned than what the
teacher does. (Shuell, 1986: 429)
This is in fact a design for teaching:
1. Define the intended learning outcomes that refer not
only to content to be learned, but what is to be done
with that content and to what standards.
2. Create a learning environment that is likely to engage
the student in learning activities that will bring about the
intended outcomes.
3. Use assessment tasks that directly address the outcome
and that enable you to judge if and how well students’
performances meet the criteria.
4. Transform these judgments into summative grades.
Intended Learning Outcomes (ILOs)
. Statements of what students are expected to be
able to do after studying a course/programme.
. Expressed from the students' perspective.
. Expressed in the form of action verbs leading to
observable and assessable behaviour.
. Related to criteria for assessing student performance.
Intended Learning Outcomes (ILOs)
University level
What are the attributes of an ideal graduate of Open U?
Programme level
What are the intended learning outcomes for students
enrolled in the degree programme?
Course level
What are the intended learning outcomes for students taking
a particular course at a particular level within the
programme?
Distinguish the kind of knowledge you want
Declarative knowledge:
. Knowing about things
. Knowledge we can declare to someone in
writing or telling
e.g. ‘Distinguish between topic-based and
outcomes-based teaching’
Functioning knowledge:
. Knowledge we put to work in solving a
physics problem, analysing a case study,
designing a building, making an argument
e.g. ‘Write an ILO for a subject you are
currently teaching’
Alignment with teaching and assessment is
created by the verbs in the ILOs
For example: “Explain the historical evolution of nursing
science”
Teaching is specifically aimed at activating the verb
students do the explaining, say to each other providing
feedback from rubrics defining aspects of a good
explanation. They don’t just listen to the teacher doing the
explaining.
Students should be unable to complete the assessment
tasks unless they enact the same verb that is in the ILO.
Students individually explain to the class how they see the
historical evolution of nursing. The teacher, perhaps using
peer assessment too, assess each on the same rubrics.
Weak form of alignment: ‘congruence with’ ILO.
Programme and Course ILOs
Alignment between the programme and course ILOs
Programme ILOs
1. Are the ILOs aligned?
2. Do the course ILOs appropriately address the programme
ILOs?
3. Are the weightings appropriate?
4. Are there any gaps?
Course ILOs
Course 1Course 2Course 3
Procedures in designing Course ILOs
1. Decide what kind of knowledge is to be taught -
Declarative or functioning.
2. Select the topics to be taught.
3. Decide the levels of understanding/performance the
students are expected to achieve for the different topics.
4. Consider if all the ILOs are of equal importance.
5. Ensure a clear understanding and agreement of the
ILOs within the teaching team and other relevant
parties, e.g. External Reviewer.
6. Communicate the ILOs to students.
The SOLO Taxonomy with sample verbs indicating
levels of understanding/performance
Competence
Prestructural Unistructural Multistructural Relational Extended Abstract
one relevant several relevant integrated into generalized to
aspect independent aspects a structure new domain
Identify
Name
Follow simple
procedure
Combine
Describe
Enumerate
Perform serial skills
List
Analyze
Apply
Argue
Compare/
contrast
Criticize
Explain causes
Relate
Justify
Create
Formulate
Generate
Hypothesize
Reflect
Theorize
Incompetence
Fail
Incompetent
Misses point
. . . .
Designing Teaching/Learning Activities
(TLAs) to Align with Intended Learning
Outcomes
Having designed Programme ILOs and the
Course ILOs, we now need to design
suitable Teaching/Learning Activities that
will facilitate students achieving the ILOs.
The best to do this is to activate the verbs
or learning activities embedded in the
ILOs.
NB: there are many alternatives to lectures
and tutorials, even in large classes.
Typical ILO Possible TLAs
Describe reading/lecture followed by presentation
Explain tutorial, written essay
Integrate project, assignment
Apply project, case study
Solve problem PBL, case study
Design, create project, creative writing
Hypothesise experiment, project
Reflect reflective diary
The point is not how you are going to teach but how and what you
want your students to learn.
NOTE! Many of these TLAs can be assessments tasks as well. Then
you have excellent alignment.
Assessment Tasks (ATs)
.provide students the opportunity to demonstrate
whether or not they have achieved the ILOs and what
level their performance is in those ILOs.
.should be appropriately designed or selected to
address the ILOs that we want to assess.
.different assessment methods (tasks) address different
ILOs. There should therefore be several kinds of task.
.provide the evidence allowing teachers to make a
judgment about the level of a student’s performance
against the ILOs and to award a final grade.
Designing Assessment Tasks (ATs)
Steps:
1. Select a practicable task that embodies the
target ILO verb. (Try the TLA first).
2. Develop grading criteria so that you can make
a judgment on how well the ILO has been met
by a student’s performance on each
assessment task.
3. Decide how the graded performances can be
combined to give a final grade.
Common ILOs Possible Assessment Tasks
Describe essay question, exam, oral
presentation (peer assessment)
Explain assignment, essay question
exam, oral, letter-to-a-friend
Integrate project, assignment
Analyse case study, assignment
Apply project, case study, experiment
Solve problem case study, project, experiment
Design, create project, experiment
Reflect reflective diary, portfolio,
self-assessment
Communicate a range of oral, writing or
listening tasks, e.g. presentation,
debate, role play, reporting,
assignment,precis, paraphasing,
answering questions etc.
Assessing quantitatively by
using marks
or
qualitatively by
using rubrics?
Assessing by Marks
For:
.Used to it.
.Seems to be the logical way to assess in certain
courses.
.Logistically easy.
Against:
.Defines quality in terms of accumulating small
quantities.
. Measurement error also accumulates, thus invalidating
fine discriminations. E.g. there is no valid difference
between 74 and 75, yet to the student it can make a BIG
difference -an A or a B, or worse, a pass or fail.
.Sends undesirable messages to students (backwash).
Assessing by grading with Rubrics
For:
Student’s performance is appropriately assessed
against what they are intended to learn criterion-
referenced.
Backwash is positive.
The final grade tells students what they have
achieved and what they need for a better grade.
Against:
Requires a different mind set for some teachers.
Initially more work in designing ILOs, suitable
assessment tasks and rubrics, but once established
is no more extra work than marking.
Qualitative assessment involves making
judgments against criteria (rubrics), not
by counting ‘marks’
If ILOs are to reflect workplace or ‘real
world’ standards it is not appropriate
to state and assess them in terms of
marks obtained.
Assessment tasks should likewise
reflect the ‘real world’ ILOs.
Grading ILOs or Assessment Tasks?
Normally we grade the task (assignment, project,
etc.) but logically we should grade the ILO directly.
Question becomes: how well did the student do in
the ILO (explain …; reflect …; create …), not on how
well did the student do in the project, the exam, …
The student’s transcript might then present a profile
in terms of learning outcomes, which would
probably be of more use to an employer than a GPA,
or profile of marks.
Some Rubrics for Direct Grading of ILOs
Marginal Pass Satisfactory Good Excellent
D C- C C+ B- B B+ A-A
Grade 1.00 1.70 2.00 2.30 2.70 3.00 3.30 3.70 4.00
point/unit
ILOs
Explain Able to identify and briefly Able to identify a number Able to identify a full As in “Good” but
write about limited points. relevant points with some range of relevant provides views on
Very little evidence of details. Uses these points Points with details. possible alternative
using these points to to provide a fair reasoning Supported by relevant causes and/or results
provide reasoning to or causality. No evidence literature. Points are under changing
why they are inter-of a comprehensive organized to provide a conditions. Able to
related. overview of reasoning comprehensive and link current
or causality. cohesive reasoning or reasoning to
causality. situations in real-
life professional
contexts.
Reflect Able to use available Able to use available Able to use available As in “Good”. Able
information to self-information to self-information to self-to generalize self-
evaluate and identify evaluate and identify evaluate and identify evaluation to beyond
limited aspects of own more aspects of own the full range of owm existing context.
strengths and weaknesses strengths and weaknesses strengthes and weak-Suggest ways of
in a general sense. No in a general sense. Little nesses. Self-evaluation improving perform-
evidence of suggestions application of theory in is based on theory. ance to real-life
of ways to improve self-evaluation and limited Increasingly able to professional
performance. No evidence suggestions of ways to suggest ways to contest.
of theory being used in improve performance. improve performance
self-evaluation. in a specific context.
Grading of Assessment Tasks
in a Portfolio (addressing whatever ILOs apply)
Marginal Adequate Good Excellent
D C- C C+ B- B B+ A-A
The pieces of evidence The evidence is relevant, The evidence presents a As in “B” but with
are relevant and accurate and covers good appreciation of higher degree of
accurate, but are several aspects of the the general thrust of the originality and
isolated, addressing course. Little evidence of course. Good coverage evidence of inter-
one aspect of the an overall view of the with relevant and nalization into
course. Demonstration course. Demonstrates accurate support. A clear personalized model
of understanding in a declarative understanding view of how various of practice. Good
minimally acceptable of a reasonable amount of aspects of the course evidence of reflect-
way. Poor coverage, no content. Able to discuss integrate to form a ion on own
originality, weak content meaningfully. thrust or purpose. performance based
justification of portfolio Good coverage but little Good evidence of on theory.
items. Inappropriate Application or integration. application of course Generalizes course
self-evaluation. Fair justification of items. Content to practice. content to new and
Attempted realistic self-Portfolio items well unfamiliar real-
evaluation justified. Realistic life contexts.
self-evaluation.
For OBASL to work, impediments to
successful implementation must be
removed
all references in policies and
procedures to norm-referencing and
grading on the curve. ILOs are meant to
establish what students know and can
perform and at what level of
competence. Grading by comparing
students is incompatible with
constructive alignment.
all references in policies and
procedures to quantitative marking, in
percentages or anything else.
Bibliography and some websites on
constructive alignment
Biggs, J. B. and Tang, C. (2007, 3rd edition) Teaching for
Quality Learning at University, Maidenhead, UK: Open
University Press/McGraw Hill, 2007.
General Descriptions of CA
www.scu.edu.au/services/tl/sd_online/consalign.html
www.engsc.ac.uk/er/theory/constructive_alignment.asp
Applied to a Web course in botany
google.com.hk/search?q=%22Constructive+alignment%22&hl=en&lr=&
start=10&sa=N
Economics
ideas.repec.org/a/che/ireepp/v2y2004i1p9-38.html
Advanced physiology
advan.physiology.org/cgi/content/full/27/3/146
MORE IF YOU GOOGLE “CONSTRUCTIVE ALIGNMENT”
... Effective teaching and learning require a close alignment between the intended learning outcomes, the learning activities and assessment methods, and the content of a course (e.g. [2,5]). Thinking in terms of alignment leads to a more focused and effective learning experience, as students are able to see the connections between what they are learning, how they are learning it, and how they are being evaluated. ...
Conference Paper
Full-text available
0000−0002−1748−8837] , Justyna Szynkiewicz 2[0000−0001−9118−0059] , Majid Rouhani 2[0000−0002−9083−4409] , and Kateryna Osadcha 2[0000−0003−0653−6423] Abstract. The increasing integration of computer science and programming into formal school education is a commendable endeavor that has seen different implementation solutions. Sweden and Norway have opted for a cross-curricular model, incorporating the task of teaching and learning computing into already existing subjects, mainly within STEM modules. In-service teachers often struggle with teaching programming effectively and integrating acquired programming knowledge into their educational settings. Additionally, instructors need to understand and evaluate programming learning outcomes, taking into account the new curriculum requirements. There is a lack of clear guidance regarding how teachers could assess students' knowledge and skills when programming becomes a part of their subject. This study investigates the assessment approaches of in-service teachers who have undergone a university-level professional development program. The qualitative analysis of the teachers' assessment plans reveals that traditional assessment strategies are adjusted for the sake of programming , leaning towards formative initiatives featuring discussions, presentations , and student projects, and to a lesser extent, tests and exams. With respect to programming, teachers' assessment initiatives cover a broad spectrum of knowledge with different degrees of abstraction and granularity, from the particularities of coding and debugging to more abstract issues of algorithmic thinking and even program quality such as robustness or reliability. Higher Education courses addressing teacher professional development in programming might therefore integrate these strategies to support teachers' assessment in programming.
... Additionally, there is little agreement between instructors as to which components should go into a grade with different instructors varying greatly in relation to how assessment is conducted (Cizek et al., 1996). Research has also shown that grades can vary in relation to variables such as instructors, departments, disciplines, and institutions (Lipnevich et al., 2020) and in relation to specific student characteristics such as physical attractiveness (Baron and Byrne, 2004) and ethnicity (Fajardo, 1985). ...
Article
Full-text available
Course-based research pedagogy involves positioning students as contributors to authentic research projects as part of an engaging educational experience that promotes their learning and persistence in science. To develop a model for assessing and grading students engaged in this type of learning experience, the assessment aims and practices of a community of experienced course-based research instructors were collected and analyzed. This approach defines four aims of course-based research assessment—(1) Assessing Laboratory Work and Scientific Thinking; (2) Evaluating Mastery of Concepts, Quantitative Thinking and Skills; (3) Appraising Forms of Scientific Communication; and (4) Metacognition of Learning—along with a set of practices for each aim. These aims and practices of assessment were then integrated with previously developed models of course-based research instruction to reveal an assessment program in which instructors provide extensive feedback to support productive student engagement in research while grading those aspects of research that are necessary for the student to succeed. Assessment conducted in this way delicately balances the need to facilitate students’ ongoing research with the requirement of a final grade without undercutting the important aims of a CRE education.
... Adhering to Biggs (1996) constructive alignment theory, our assessment strategy was designed to mirror the pedagogical approach implemented. Evaluations of the SSK initiative's outcome-based learning objectives were conducted through infield assessments of learning traits, encompassing critical reasoning, proficiency in techniques and equipment, predictive abilities, cause-identification, structured argumentation, proposal of solutions with their justifications, and innovative thinking, among others. ...
Article
Full-text available
Innovative pedagogical approaches that integrate classroom learning from diverse soil science courses with practical skills and field-based competencies are needed. This paper suggests merging our own “Soil Skills” (SSK) pedagogical method with the “Soil Judging Contest” (SJC), a teaching approach supported by the American Society of Agronomy and the Soil Science Society of America since 1961. This integration aims to enhance the holistic, harmonized, interdisciplinary, and enthusiastic nature of soil science education. Both the SSK and SJC approaches received positive feedback from students and demonstrated significant improvements in academic performance. Our findings underscore the unique advantages of combining SSK and SJC approaches in delivering comprehensive, problem-based, and practical field-learning experiences. This combination approach closely aligns with applied scenarios that demand multidisciplinarity and interdisciplinarity perspectives, preparing students for their future professional careers, and enabling the practical application of their soil science knowledge in real-world contexts.
... According to Saunders and Machell (2000), one of the purposes of higher education is to help students decide on their chosen, future career. It is therefore vital for higher education courses to be designed to fulfil certain objectives (Biggs, 1996). Students should be taught in a way that provides them with the skills and knowledge that employers need in the workplace (Tiwari & Debnath, 2017). ...
Article
Full-text available
This paper presents a comprehensive review of the teaching and practice of forensic accounting in a global context. The methodology involved a systematic review of published studies on forensic accounting from different regions and cultures, with a focus on identifying the strengths and weaknesses of current teaching and practice. The main findings of the paper highlight the importance of effective teaching methods and the need for standardized regulatory structures and academic qualifications to enhance the credibility of the profession. Additionally, the review identifies cultural nuances that impact the practice of forensic accounting and the growing significance of emerging technologies in the field. The relevance of this paper lies in its practical and managerial implications for practitioners, educators, and policymakers in the field of forensic accounting. The findings can inform the development of strategies and policies that address the gaps and challenges in current teaching and practice, and can help ensure that practitioners are prepared to meet the demands of a global context.
... It Depending on the nature of the teaching challenge or experiment, the relevant starting point will be different. Otherwise, to promote inclusion, student centeredness and community building with students, further reflection on constructive alignment between activities and assessment (Biggs, 1996) and students explore and search for alternative digital technologies outside of the institutional ecologies and thereby supporting acquisition of conceptual, procedural, technical and societal learning aspects. ...
Research
Full-text available
The HIP framework aims to guide higher education (HE) teachers and researchers to reconsider and reflect on how to rethink HE pedagogy in new and different ways. It builds on insights from the report Hacking Innovative Pedagogy: Innovation and Digitisation to Rewild Higher Education. A Commented Atlas (Beskorsa, et al., 2023) and incorporates the spirit of rewilding and hacking pedagogies to inspire new professional communities focused on innovating digital education. The framework considers and guides the development of teachers’ digital pedagogy competences through an inclusive bottom-up approach that gives space for individual teacher’s agency while also ensuring a collective teaching culture. The framework emphasizes how pedagogical approaches can address the different needs that HE teachers and student communities have that reflect disciplines cultures and/or the diversity of learners. Only a framework mindful of heterogeneity will be able to address questions of justice and fair access to education. Likewise, in the spirit of rewilding, the framework should not be considered a static “one size fits all” solution. We aim for an organic and dynamic framework that may be used to pause and reflect to then turn back to one’s own teaching community to consider (learn from, listen to and respond to the teaching and learning of different communities). Therefore we plan that this framework will be a living document throughout the HIP-project’s lifetime.
... Since the seminal work by Biggs (1996), constructive alignment has been widely applied in higher education because it combines a practical framework for decision-making in instructional design with objective goal-setting for assessing and reporting on student performance. In a thematic analysis of research on higher education feedback from 2000 to 2012, Evans (2013) found a few research studies, in the United Kingdom and Australia, where methods of assessment and feedback were being constructively aligned with learning objectives (e.g., Boud & Associates, 2010). ...
Article
Full-text available
Student and teacher perceptions of feedback practices, preferences and awareness of feedback needs may differ and detract from learning. This article explores alignment or misalignment in higher education to argue alignment suggests needs are being met on these issues via technology-enabled feedback on writing. Within the context of academic training, we take a broad view of writing supervision along a continuum that comprises digital feedback on writing assessments at an Australian university. We used a survey comparison of teachers’ and students’ self-reported data to answer the following questions: (1) What digital feedback and assessment practices are reported by teachers and students in Australian higher education? (2) What e-feedback needs are self-declared through teachers’ and students’ self-awareness of assessment practices in that context? (3) What e-feedback preferences are reported by teachers and students? Students and teachers from different academic programmes and levels from social science self-reported their experiences of digital feedback on writing assessments. The quantitative and open-ended responses covered technology-enabled feedback experiences up to PhD supervision. The results on alignment and misalignment of participants’ needs and preferences suggest a need to increase dialogue and incorporate student agency into feedback processes. We discuss further implications for feedback experiences in this context. Implications for practice or policy Programme assessment designers might reconsider policies requiring online collaborative work since teachers and students prefer individual assignments. Assessors might improve digital assessment tools, to increase teacher and student interaction and expediency, without losing individual feedback, in line with unanimous claims that such tools support feedback processes on writing. Course leaders could implement practices buffering the effect of negative feedback because teachers perceive few complaints, but students react badly to negative comments through digital channels.
Chapter
Digital exams were completely uncharted territory for many Higher Education institutions and university lecturers before the corona pandemic. Even after two semesters of online-learning, many university lecturers and education experts still debate how digital assessments can be organised technically and designed according to accepted didactical and administrative standards. Digital assessments do not only have to follow the requirements of the examination regulations. The technical requirements and possibilities of the university also play a role. And last but not least, from a didactic perspective, the question arises, which exam format should be chosen and is compatible with the imparted learning content and according learning objectives and, above all, how the precise exam questions should be designed. The paper presents various approaches to planning and designing exams and exam questions in digital space and formulates initial principles for designing exam questions in digital surroundings.
Article
Die Klimakrise ist eine Gesundheitskrise. Das Gesundheitswesen trägt als Emittent dazu bei. Als ‚Hüter:innen‘ der Gesundheit im Zentrum der Gesellschaft besteht für Ärzt:innen ein ethischer Handlungsimperativ. Um der zunehmenden Krankheitslast zu begegnen und das Gesundheitssystem nachhaltig zu gestalten, ist eine entsprechende Aus- und Weiterbildung fundamental. Derzeit sind Lehrformate überwiegend freiwillig oder studentisch organisiert, wie auch das vorgestellte Wahlfach ‚Klimasprechstunde‘. Eine zeitnahe, verpflichtende Verankerung im Medizinstudium ist unabdingbar.
Article
Full-text available
Objective To explore medical student and school pupil experiences of an outreach school teaching project. Setting Community engagement is increasingly commonplace within medical school. Secondary schools offer ample opportunities for community engagement as medical students teach and engage in service learning. There is a lack of research regarding the impact of school community engagement projects and the impact on pupils, as critical stakeholders in the service medical students provide. In this qualitative study, we explore the perspectives of medical students and school pupils involved in a school teaching project. Participants Ten medical students participated in individual interviews, and 17 school pupils across three schools participated in group interviews. Data were analysed using thematic analysis and the concept of service learning. Results For medical students, the project fostered communication and teaching skills, but a lack of reflection hampered further benefit. For school pupils, experiences varied – learning about careers in medicine could be inspiring, but content pitched at the incorrect level disengaged some pupils. The conflict between session timing and medical students’ exams negatively influenced engagement. Conclusions To shift the focus of community engagement projects that promote service-learning towards mutual benefit, designing in partnership with relevant community stakeholders and integrating opportunities to reflect on these experiences are critical.
Chapter
The original purpose of this chapter was to provide an account of student thinking in the classroom. There was a time, some years ago, when the content of such a chapter would have been self-evident. It would have included research on the development of problem solving skills and on the ways in which teachers could encourage students to use higher-order cognitive skills by asking appropriate questions and setting appropriate problems. My own early studies of ‘classroom interaction’ were concerned with the logical demands made by teachers’ questions and the effects these had on students. The results were published under the title of Thinking in the Classroom (Nuthall & Lawrence, 1965). The categories and concepts that were used to set clear boundaries around different types of classroom behaviour were largely borrowed from research in the psychological laboratory (e.g., Bruner, Goodnow, & Austin, A Study of Thinking, 1956; Skinner, Verbal Behaviour, 1957) or from logic and analytic philosophy (e.g., Hirst & Peters, The Logic of Education, 1970; Smith & Ennis, Language and Concepts in Education, 1961).
Article
Our concern in this paper is with the validity of educational tests when they are employed as critical measures of educational outcomes within a dynamic system. The problem of validity arises if an educational system adapts itself to the characteristics of the outcome measures. We introduce the concept of systemically valid tests as ones that induce curricular and instructional changes in education systems (and learning strategy changes in students) that foster the development of the cognitive traits that the tests are designed to measure. We analyze some general characteristics that contribute to or detract from a testing system's systemic validity, such as the use of direct rather than indirect assessment. We then apply these characteristics in developing a set of design principles for creating testing systems that are systemically valid. Finally, we provide an illustration of the proposed principles, by applying them to the design of a student assessment system. This design example addresses not only specifications for the tests, but also the means of teaching the process of assessment to users of the system.