ArticlePDF Available

Enhancing Teaching Through Constructive Alignment

Springer Nature
Higher Education
Authors:

Abstract

Two lines of thinking are becoming increasingly important in higher educational practice. The first derives from constructivist learning theory, and the second from the instructional design literature. Constructivism comprises a family of theories but all have in common the centrality of the learner's activities in creating meaning. These and related ideas have important implications for teaching and assessment. Instructional designers for their part have emphasised alignment between the objectives of a course or unit and the targets for assessing student performance. "Constructive alignment" represents a marriage of the two thrusts, constructivism being used as a framework to guide decision-making at all stages in instructional design: in deriving curriculum objectives in terms of performances that represent a suitably high cognitive level, in deciding teaching/learning activities judged to elicit those performances, and to assess and summatively report student performance. The "performances of understanding" nominated in the objectives are thus used to systematically align the teaching methods and the assessment. The process is illustrated with reference to a professional development unit in educational psychology for teachers, but the model may be generalized to most units or programs in higher education.
Enhancing learning
through constructive alignment
Professor John Biggs
Open University 14 May, 2009
Outcomes-based Approaches
Three main forms of outcomes-based approaches. All focus
on educational outcomes, each based on a different
philosophy.
1. Outcome-based approaches at school level. Originally
devised by William Spady for disadvantaged children,
but later used generally e.g. Target Oriented Curriculum
(TOC) for individualising teaching.
2. Outcomes-based approaches at institutional level, used
for benchmarking, credit-transfer. Have little directly to
do with enhancing teaching and learning.
3. Outcomes-based Approaches to Student Learning
(OBASL). Defining learning outcomes at programme
and course level, to enhance teaching and learning.
What the UGC said
“The UGC’s goal in promoting outcome-
based approaches is simple and
straightforwardimprovement and
enhancement in student learning and
teaching quality.” (Alice Lam, May 05)
The UGC has asked local universities to
show that they have thought through the
"learning outcomes" they expect their
students to achieve, and that they are
organising educational experiences to
enable students to achieve these
outcomes. …
Outcome-based Approaches to
Student Learning (OBASL):
the Intended Learning Outcome (ILO)
is central
ILO:
What the
student has
to do
Teaching:
To facilitate
attaining the
ILOs
Assessment:
How well
the student
has attained
the ILOs
Implementing OBASL using
Constructive Alignment
ILO:
What the student
has to learn
Teaching:
Engaging the
student in the
verb in the ILO
Assessment:
How well
the student
has met the
ILO
Constructive Alignment
Intended Learning Outcomes (ILOs)
expressed as verbs students have to enact
A
The very best understanding that could be
reasonably expected: verbs such as
hypothesise, apply to “far” domains,
generate, relate to principle, etc.
B
Highly satisfactory understanding: verbs
such as explain, solve, understand main
ideas, analyze, compare, etc.
C
Quite satisfactory learning, with under-
standing at a declarative level: verbs such
as elaborate, classify, cover topics a to n,
D
Understanding at a level that would
warrant a Pass: low level verbs, also
inadequate but salvageable higher level
attempts.
Teaching / Learning
Activities
Designed to
elicit desired
verbs
May be:
Large class activities
Small class activities
Teacher-managed
Peer-managed
Self-managed
as best suits context
Assessment Tasks
Format such that
the target verbs are
elicited and
deployed
in context.
Criteria clearly allow
judgement as to the
quality of the
student's
performance
How constructive alignment started
Constructive alignment was born at HKU.
I was teaching psychology not so that the students could
tell me what psychology they had learned, but how they
could use psychology in order to teach better. They
should be telling me if and how it had, not me telling
them how I thought it should.
They placed their evidence and reflections in a portfolio.
Lecturing to them and giving them an MCQ was obviously
irrelevant to the real aims of the course: teachers would
use psychology to teach more effectively.
If students are to learn desired outcomes in a reasonably
effective manner, then the teacher’s fundamental task is to
get students to engage in learning activities that are likely
to result in their achieving those outcomes… It is helpful to
remember that what the student does is actually more
important in determining what is learned than what the
teacher does. (Shuell, 1986: 429)
This is in fact a design for teaching:
1. Define the intended learning outcomes that refer not
only to content to be learned, but what is to be done
with that content and to what standards.
2. Create a learning environment that is likely to engage
the student in learning activities that will bring about the
intended outcomes.
3. Use assessment tasks that directly address the outcome
and that enable you to judge if and how well students’
performances meet the criteria.
4. Transform these judgments into summative grades.
Intended Learning Outcomes (ILOs)
. Statements of what students are expected to be
able to do after studying a course/programme.
. Expressed from the students' perspective.
. Expressed in the form of action verbs leading to
observable and assessable behaviour.
. Related to criteria for assessing student performance.
Intended Learning Outcomes (ILOs)
University level
What are the attributes of an ideal graduate of Open U?
Programme level
What are the intended learning outcomes for students
enrolled in the degree programme?
Course level
What are the intended learning outcomes for students taking
a particular course at a particular level within the
programme?
Distinguish the kind of knowledge you want
Declarative knowledge:
. Knowing about things
. Knowledge we can declare to someone in
writing or telling
e.g. ‘Distinguish between topic-based and
outcomes-based teaching’
Functioning knowledge:
. Knowledge we put to work in solving a
physics problem, analysing a case study,
designing a building, making an argument
e.g. ‘Write an ILO for a subject you are
currently teaching’
Alignment with teaching and assessment is
created by the verbs in the ILOs
For example: “Explain the historical evolution of nursing
science”
Teaching is specifically aimed at activating the verb
students do the explaining, say to each other providing
feedback from rubrics defining aspects of a good
explanation. They don’t just listen to the teacher doing the
explaining.
Students should be unable to complete the assessment
tasks unless they enact the same verb that is in the ILO.
Students individually explain to the class how they see the
historical evolution of nursing. The teacher, perhaps using
peer assessment too, assess each on the same rubrics.
Weak form of alignment: ‘congruence with’ ILO.
Programme and Course ILOs
Alignment between the programme and course ILOs
Programme ILOs
1. Are the ILOs aligned?
2. Do the course ILOs appropriately address the programme
ILOs?
3. Are the weightings appropriate?
4. Are there any gaps?
Course ILOs
Course 1Course 2Course 3
Procedures in designing Course ILOs
1. Decide what kind of knowledge is to be taught -
Declarative or functioning.
2. Select the topics to be taught.
3. Decide the levels of understanding/performance the
students are expected to achieve for the different topics.
4. Consider if all the ILOs are of equal importance.
5. Ensure a clear understanding and agreement of the
ILOs within the teaching team and other relevant
parties, e.g. External Reviewer.
6. Communicate the ILOs to students.
The SOLO Taxonomy with sample verbs indicating
levels of understanding/performance
Competence
Prestructural Unistructural Multistructural Relational Extended Abstract
one relevant several relevant integrated into generalized to
aspect independent aspects a structure new domain
Identify
Name
Follow simple
procedure
Combine
Describe
Enumerate
Perform serial skills
List
Analyze
Apply
Argue
Compare/
contrast
Criticize
Explain causes
Relate
Justify
Create
Formulate
Generate
Hypothesize
Reflect
Theorize
Incompetence
Fail
Incompetent
Misses point
. . . .
Designing Teaching/Learning Activities
(TLAs) to Align with Intended Learning
Outcomes
Having designed Programme ILOs and the
Course ILOs, we now need to design
suitable Teaching/Learning Activities that
will facilitate students achieving the ILOs.
The best to do this is to activate the verbs
or learning activities embedded in the
ILOs.
NB: there are many alternatives to lectures
and tutorials, even in large classes.
Typical ILO Possible TLAs
Describe reading/lecture followed by presentation
Explain tutorial, written essay
Integrate project, assignment
Apply project, case study
Solve problem PBL, case study
Design, create project, creative writing
Hypothesise experiment, project
Reflect reflective diary
The point is not how you are going to teach but how and what you
want your students to learn.
NOTE! Many of these TLAs can be assessments tasks as well. Then
you have excellent alignment.
Assessment Tasks (ATs)
.provide students the opportunity to demonstrate
whether or not they have achieved the ILOs and what
level their performance is in those ILOs.
.should be appropriately designed or selected to
address the ILOs that we want to assess.
.different assessment methods (tasks) address different
ILOs. There should therefore be several kinds of task.
.provide the evidence allowing teachers to make a
judgment about the level of a student’s performance
against the ILOs and to award a final grade.
Designing Assessment Tasks (ATs)
Steps:
1. Select a practicable task that embodies the
target ILO verb. (Try the TLA first).
2. Develop grading criteria so that you can make
a judgment on how well the ILO has been met
by a student’s performance on each
assessment task.
3. Decide how the graded performances can be
combined to give a final grade.
Common ILOs Possible Assessment Tasks
Describe essay question, exam, oral
presentation (peer assessment)
Explain assignment, essay question
exam, oral, letter-to-a-friend
Integrate project, assignment
Analyse case study, assignment
Apply project, case study, experiment
Solve problem case study, project, experiment
Design, create project, experiment
Reflect reflective diary, portfolio,
self-assessment
Communicate a range of oral, writing or
listening tasks, e.g. presentation,
debate, role play, reporting,
assignment,precis, paraphasing,
answering questions etc.
Assessing quantitatively by
using marks
or
qualitatively by
using rubrics?
Assessing by Marks
For:
.Used to it.
.Seems to be the logical way to assess in certain
courses.
.Logistically easy.
Against:
.Defines quality in terms of accumulating small
quantities.
. Measurement error also accumulates, thus invalidating
fine discriminations. E.g. there is no valid difference
between 74 and 75, yet to the student it can make a BIG
difference -an A or a B, or worse, a pass or fail.
.Sends undesirable messages to students (backwash).
Assessing by grading with Rubrics
For:
Student’s performance is appropriately assessed
against what they are intended to learn criterion-
referenced.
Backwash is positive.
The final grade tells students what they have
achieved and what they need for a better grade.
Against:
Requires a different mind set for some teachers.
Initially more work in designing ILOs, suitable
assessment tasks and rubrics, but once established
is no more extra work than marking.
Qualitative assessment involves making
judgments against criteria (rubrics), not
by counting ‘marks’
If ILOs are to reflect workplace or ‘real
world’ standards it is not appropriate
to state and assess them in terms of
marks obtained.
Assessment tasks should likewise
reflect the ‘real world’ ILOs.
Grading ILOs or Assessment Tasks?
Normally we grade the task (assignment, project,
etc.) but logically we should grade the ILO directly.
Question becomes: how well did the student do in
the ILO (explain …; reflect …; create …), not on how
well did the student do in the project, the exam, …
The student’s transcript might then present a profile
in terms of learning outcomes, which would
probably be of more use to an employer than a GPA,
or profile of marks.
Some Rubrics for Direct Grading of ILOs
Marginal Pass Satisfactory Good Excellent
D C- C C+ B- B B+ A-A
Grade 1.00 1.70 2.00 2.30 2.70 3.00 3.30 3.70 4.00
point/unit
ILOs
Explain Able to identify and briefly Able to identify a number Able to identify a full As in “Good” but
write about limited points. relevant points with some range of relevant provides views on
Very little evidence of details. Uses these points Points with details. possible alternative
using these points to to provide a fair reasoning Supported by relevant causes and/or results
provide reasoning to or causality. No evidence literature. Points are under changing
why they are inter-of a comprehensive organized to provide a conditions. Able to
related. overview of reasoning comprehensive and link current
or causality. cohesive reasoning or reasoning to
causality. situations in real-
life professional
contexts.
Reflect Able to use available Able to use available Able to use available As in “Good”. Able
information to self-information to self-information to self-to generalize self-
evaluate and identify evaluate and identify evaluate and identify evaluation to beyond
limited aspects of own more aspects of own the full range of owm existing context.
strengths and weaknesses strengths and weaknesses strengthes and weak-Suggest ways of
in a general sense. No in a general sense. Little nesses. Self-evaluation improving perform-
evidence of suggestions application of theory in is based on theory. ance to real-life
of ways to improve self-evaluation and limited Increasingly able to professional
performance. No evidence suggestions of ways to suggest ways to contest.
of theory being used in improve performance. improve performance
self-evaluation. in a specific context.
Grading of Assessment Tasks
in a Portfolio (addressing whatever ILOs apply)
Marginal Adequate Good Excellent
D C- C C+ B- B B+ A-A
The pieces of evidence The evidence is relevant, The evidence presents a As in “B” but with
are relevant and accurate and covers good appreciation of higher degree of
accurate, but are several aspects of the the general thrust of the originality and
isolated, addressing course. Little evidence of course. Good coverage evidence of inter-
one aspect of the an overall view of the with relevant and nalization into
course. Demonstration course. Demonstrates accurate support. A clear personalized model
of understanding in a declarative understanding view of how various of practice. Good
minimally acceptable of a reasonable amount of aspects of the course evidence of reflect-
way. Poor coverage, no content. Able to discuss integrate to form a ion on own
originality, weak content meaningfully. thrust or purpose. performance based
justification of portfolio Good coverage but little Good evidence of on theory.
items. Inappropriate Application or integration. application of course Generalizes course
self-evaluation. Fair justification of items. Content to practice. content to new and
Attempted realistic self-Portfolio items well unfamiliar real-
evaluation justified. Realistic life contexts.
self-evaluation.
For OBASL to work, impediments to
successful implementation must be
removed
all references in policies and
procedures to norm-referencing and
grading on the curve. ILOs are meant to
establish what students know and can
perform and at what level of
competence. Grading by comparing
students is incompatible with
constructive alignment.
all references in policies and
procedures to quantitative marking, in
percentages or anything else.
Bibliography and some websites on
constructive alignment
Biggs, J. B. and Tang, C. (2007, 3rd edition) Teaching for
Quality Learning at University, Maidenhead, UK: Open
University Press/McGraw Hill, 2007.
General Descriptions of CA
www.scu.edu.au/services/tl/sd_online/consalign.html
www.engsc.ac.uk/er/theory/constructive_alignment.asp
Applied to a Web course in botany
google.com.hk/search?q=%22Constructive+alignment%22&hl=en&lr=&
start=10&sa=N
Economics
ideas.repec.org/a/che/ireepp/v2y2004i1p9-38.html
Advanced physiology
advan.physiology.org/cgi/content/full/27/3/146
MORE IF YOU GOOGLE “CONSTRUCTIVE ALIGNMENT”
... This study was grounded in Biggs' principle of constructive alignment, rooted in the constructivist theory of learning [8]. This principle proposes that knowledge is built through individual experiences and social interactions and emphasizes aligning intended learning outcomes (ILOs), teaching activities, and assessment tasks to foster deep learning [8]. ...
... This study was grounded in Biggs' principle of constructive alignment, rooted in the constructivist theory of learning [8]. This principle proposes that knowledge is built through individual experiences and social interactions and emphasizes aligning intended learning outcomes (ILOs), teaching activities, and assessment tasks to foster deep learning [8]. In higher education, a contextual learning approach is employed to develop independent learners capable of adapting to diverse learning environments. ...
... Online activities allow incorporation of constructivist practices and with appropriate planning and delivery, educators can ensure that students not only achieve the ILOs but also engage meaningfully with the learning process. Our results suggest that online learning supports flexible, self-directed learning, which promotes autonomy, critical thinking, and deeper learning [8]. Tools like video tutorials and online question banks, perceived in our study as highly effective, have been previously shown to enhance understanding and accommodate different learning styles, paving the way for a more inclusive and learner-centered educational experience [16]. ...
Article
Full-text available
Background Blended learning is a key educational methodology, particularly in medical education, and involves integration of online and face-to-face interactions to enhance flexibility and engagement. Blended learning gained increased popularity during the COVID-19 pandemic due to social restrictions. Following control of the pandemic, face to face teaching and learning activities have been restored. However, some institutions continue to deliver some teaching online. This study explores the perceptions and experiences of undergraduate medical students from 15 institutions across seven countries regarding remote online learning in the post-pandemic era. Methods This cross-sectional study utilized an online survey to gather insights into the use of learning resources, interactivity in online sessions, barriers to online learning, and preferences for learning modalities. Descriptive data were summarized by frequency, categorical comparisons were assessed with chi-squared tests, and t-tests were used for continuous data. Results The findings of the current study show a general preference for blended learning (47.78%) over traditional face-to-face instruction (41.48%). Key benefits of blended learning reported by the participants by comfort, flexibility, reduced travel, and ability to learn at own pace. The key barriers identified were internet connectivity issues and family distractions. The study also highlighted the limitations of online learning in replacing clinical experience and practical skills acquisition, with 69.26% of respondents affirming that online learning does not sufficiently substitute for direct patient contact. Conclusion The findings underscore the importance of integrating face to face and remote online teaching and learning frameworks to align with educational objectives, particularly in fostering interactivity and practical skill development. The study suggests that while blended learning has many benefits, its effectiveness is highly context-dependent and requires thoughtful implementation to meet the diverse needs of medical education.
... Los objetivos formativos deben estar relacionados con las competencias que se desarrollan en la asignatura, y la asignatura debe diseñarse para que los estudiantes alcancen estos objetivos (Sánchez et al., 2006). Así, las metodologías docentes y el sistema de evaluación deben seguir el principio de alineamiento constructivo (Biggs, 1996;Biggs y Tang, 2011), que indica que el estudiantado debería hacer lo mismo para aprender que para aprobar. ...
Chapter
Full-text available
La pandemia provocada por la covid-19 durante los años 2020 y 2021 obligó a los centros de enseñanza universitaria de todo el mundo a realizar una adaptación urgente, en la que no fue posible realizar una reflexión profunda. Algunos autores han denominado a esta docencia remota de emergencia. En su transcurso se cometieron muchos errores, la mayoría de ellos debido a la falta de formación de los equipos directivos y del propio profesorado, que no tuvieron claras las dimensiones que debían considerarse en las actividades de enseñanza- aprendizaje. Este capítulo presenta un marco de referencia donde se definen dichas dimensiones. A continuación, se analizan algunos errores habituales que se cometieron en los centros universitarios durante la emergencia sanitaria. Finalmente, se reflexiona sobre las oportunidades que se presentan en la actualidad para llevar a cabo una transformación real y profunda de la educación universitaria teniendo en cuenta las lecciones aprendidas.
... Developing a robust, transformative approach to sustainability requires a constructive alignment between the curriculum elements (What is to be taught?), the curriculum goal (What is the aim of instruction?) and the curriculum outcomes (What will we be looking for as evidence of learning?) as represented in Table 9.2.3. In the spirit of Biggs's (1996) original intentions for constructive alignment, the focus moves from the teaching input, to student learning. ...
... As this theory explains, the threshold of any activity is working hours which could significantly affect the academic performances of OUSL students in an ODL setting. Presage-Process-Product Model 3P model was proposed by Biggs and Moore in 1993 which explains the deep learning of students (Biggs, 1996). A correlation between Biggs' Presage-Process-Product model and extra-curricular activities was validated by Chan, 2016 using the Revised Two-Factor Study Process Questionnaire with 131 full-time students. ...
Article
Full-text available
Involvement in academic and extracurricular activities (ECA) has facilitated students to learn and thrive during their university period. The present study investigated the learner perceived impact of engagement of ECAs for academic success, skill development, and wellbeing in an open and distance learning environment. The study cohort was 435 BSc undergraduates of the Open University of Sri Lanka. A self-administered questionnaire was administered online to obtain demographic and learners' perceptions of ECAs. The responses were analyzed using SPSS version 23. Results revealed that 72.9% of the respondents were female, 41.2% of the respondents aged 29-39 years, 63% were unemployed and 65% engaged in university clubs as their ECAs. Younger students believed ECA leads to a neglected personal life (p=0.01). In general, ECA has helped male students to reduce social isolation 2 PJER, Vol 7, Issue 4 (2024) Extracurricular activities and … (p=0.01), improve future career prospect (p<0.05), improve intellectual capacity (p=0.01), and explore and nurture talents overall (p=0.03). The study level and the time they spent on ECA had no significant impact on their academic performances (p>0.05). However, students utilizing more study hours considered ECA has reduced their time for academic and career activities (p=0.01). The present study highlights the importance of student engagement in ECAs for their personal development and student retention in an ODL system.
Article
Purpose The purpose of this research is to explore the perceived concept of “going gradeless” among education master’s students and academics within a Hong Kong university. This study aims to explore differing perspectives on “going gradeless” and identify the key potential issues associated with its implementation in higher education. Design/methodology/approach The research employed a qualitative method using purposive sampling to select participants for semi-structured focus interviews, and the sample consisted of nine education master’s students and two academics. The data collected from these interviews were systematically analyzed using NVivo software, and the codes were developed into themes within the participants' perceptions of “going gradeless.” Findings The findings reveal that students and academics view going gradeless differently. Students have mixed feelings about a gradeless system. Most recognize the problems associated with an overemphasis on grades and the potential benefits of going gradeless, and they also express concerns about the personal advantages of recognized credentials, differentiation from peers and resistance to implementation. Conversely, academics call for a change in grading policy, citing the negative impact of grade-driven approaches on learning. However, they also raise concerns about institutional and cultural factors that could pose challenges to a gradeless system. Originality/value This paper contributes to the underexplored area of gradeless learning in higher education, particularly within Confucian societies. By revealing differing perspectives between students and academics, offering critical considerations for policymakers and educators seeking to reform grading practices and enhance learning outcomes.
Article
Orthopaedic researchers need new strategies for engaging underrepresented minority (URM) students. Our field has demonstrated noticeable gaps in racial, ethnic, and gender diversity, which inhibit our ability to innovate and combat the severe socioeconomic burden of musculoskeletal disorders. Towards this goal, we designed, implemented, and evaluated Learning on a Limb (LoaL), an orthopaedic research outreach module to teach URM high school students about orthopaedic research. During the 4‐h module, students completed hands‐on activities to learn how biomechanical testing, microcomputed tomography, cell culture, and histology are used in orthopaedic research. Over 3 years, we recruited 32 high school students from the Greater Philadelphia Area to participate in LoaL. Most participants identified as racial/ethnic or gender minorities in orthopaedic research. Using pre/post‐tests, we found that students experienced significant learning gains of 51 percentage points from completing LoaL. In addition to teaching students about orthopaedic research, post‐survey data demonstrated that participating in LoaL strongly influenced students' interest in orthopaedic research and scientific confidence. Several students acted on this interest by completing summer research experiences in the McKay Orthopaedic Research Laboratory at the University of Pennsylvania. LoaL instructors also benefited by having the opportunity to “pay it forward” to the next generation of students and build community within their department. Empowering institutions to host modules like LoaL would synergistically inspire URM high school students and strengthen community within orthopaedic departments to ultimately enhance orthopaedic research innovations.
Article
The article presents a case exercise that teaches students how to apply mathematical programming to a real-life context. The case deals with the management of the food donation supply chain. The case, using a project-based approach, proposes a realistic scenario that simulates the consulting interaction with a nonprofit company, Logica&Co, which acts as a two-sided platform connecting supply and demand. The objective is to define an effective strategy to collect and deliver food donations, using either bike or e-bike, from local businesses to soup kitchens, covering a semester-long timeframe. The form of the problem exhibits nonlinear characteristics, but the design allows for adjustable difficulty levels. Students can assess their performance during the class period thanks to an interactive offline tool, the SoS simulator, which is publicly available for download and can be customized by instructors. The case was proposed as a competitive group challenge for students of the bachelor’s or master’s program in management engineering at Sapienza University of Rome. However, given the embedded characteristics of flexibility, it can be easily adjusted for heterogeneous curricula of undergraduate- and graduate-level courses in engineering programs (this opportunity is extensively discussed in the Case Article and the Teaching Note). The students appreciated both the teaching methodology and the teamwork aspects and highlighted the utility of the SoS simulator tool. Supplemental Material: The Teaching Note and its supplemental material are available at https://www.informs.org/Publications/Subscribe/Access-Restricted-Materials .
Thesis
Full-text available
The aim of this study is to determine the effects of group bağlama instruction with cooperative learning approach on the performance of students’ playing bağlama and attitude towards bağlama course.
Chapter
The original purpose of this chapter was to provide an account of student thinking in the classroom. There was a time, some years ago, when the content of such a chapter would have been self-evident. It would have included research on the development of problem solving skills and on the ways in which teachers could encourage students to use higher-order cognitive skills by asking appropriate questions and setting appropriate problems. My own early studies of ‘classroom interaction’ were concerned with the logical demands made by teachers’ questions and the effects these had on students. The results were published under the title of Thinking in the Classroom (Nuthall & Lawrence, 1965). The categories and concepts that were used to set clear boundaries around different types of classroom behaviour were largely borrowed from research in the psychological laboratory (e.g., Bruner, Goodnow, & Austin, A Study of Thinking, 1956; Skinner, Verbal Behaviour, 1957) or from logic and analytic philosophy (e.g., Hirst & Peters, The Logic of Education, 1970; Smith & Ennis, Language and Concepts in Education, 1961).
Article
Our concern in this paper is with the validity of educational tests when they are employed as critical measures of educational outcomes within a dynamic system. The problem of validity arises if an educational system adapts itself to the characteristics of the outcome measures. We introduce the concept of systemically valid tests as ones that induce curricular and instructional changes in education systems (and learning strategy changes in students) that foster the development of the cognitive traits that the tests are designed to measure. We analyze some general characteristics that contribute to or detract from a testing system's systemic validity, such as the use of direct rather than indirect assessment. We then apply these characteristics in developing a set of design principles for creating testing systems that are systemically valid. Finally, we provide an illustration of the proposed principles, by applying them to the design of a student assessment system. This design example addresses not only specifications for the tests, but also the means of teaching the process of assessment to users of the system.