ArticlePDF Available

PISA for scandalisation, PISA for projection: the use of international large-scale assessments in education policy making – an introduction

Taylor & Francis
Globalisation, Societies and Education
Authors:

Abstract

The introductory article of the GSE special issue ‘PISA for scandalization, PISA for projection: the use of international large-scale assessments in education policy making’ contextualises the four articles of the special issue in the broader context of comparative policy studies in education. It reflects in particular on the question of why cross-national comparison is relevant for the study of ILSA (international large-scale assessment) policy reception and how ‘methodological nationalism’ may be avoided when using national education systems as units of analysis.
Full Terms & Conditions of access and use can be found at
https://www.tandfonline.com/action/journalInformation?journalCode=cgse20
Globalisation, Societies and Education
ISSN: 1476-7724 (Print) 1476-7732 (Online) Journal homepage: https://www.tandfonline.com/loi/cgse20
PISA for scandalisation, PISA for projection: the
use of international large-scale assessments in
education policy making – an introduction
Gita Steiner-Khamsi & Florian Waldow
To cite this article: Gita Steiner-Khamsi & Florian Waldow (2018) PISA for scandalisation,
PISA for projection: the use of international large-scale assessments in education policy
making – an introduction, Globalisation, Societies and Education, 16:5, 557-565, DOI:
10.1080/14767724.2018.1531234
To link to this article: https://doi.org/10.1080/14767724.2018.1531234
Published online: 11 Oct 2018.
Submit your article to this journal
Article views: 193
View Crossmark data
PISA for scandalisation, PISA for projection: the use of
international large-scale assessments in education policy making
an introduction
Gita Steiner-Khamsi
a
and Florian Waldow
b
a
Teachers College, Department International & Transcultural Studies, Columbia University, New York, NY, USA;
b
Berlin, Comparative and International Education, Humboldt University, Berlin, Germany
ABSTRACT
The introductory article of the GSE special issue PISA for scandalization,
PISA for projection: the use of international large-scale assessments in
education policy makingcontextualises the four articles of the special
issue in the broader context of comparative policy studies in education.
It reects in particular on the question of why cross-national comparison
is relevant for the study of ILSA (international large-scale assessment)
policy reception and how methodological nationalismmay be avoided
when using national education systems as units of analysis.
ARTICLE HISTORY
Received 29 September 2018
Accepted 29 September 2018
KEYWORDS
Comparative policy studies;
international large-scale
assessment; PISA; reception;
comparative method
An ever-increasing number of countries participate in Program for International Student Assess-
ment (PISA), Trends in International Mathematics and Science Study (TIMSS), Progress in Inter-
national Reading Literacy Study (PIRLS), and other international large-scale-assessments (ILSAs).
Unsurprisingly, the exponential growth of ILSAs has triggered an avalanche of publications on
the reasons for this growth and its impact on national school reforms.
The perspectives from which the phenomenon has been dissected are manifold. A great number
of studies focus on the global-level. Some of them scrutinise the global ILSA network, a coalition of
states, professional associations, international organisations, and the global education industry that
advocates for, funds, designs, administers, or sells these international tests (Benavot and Meyer 2013;
Martens, Knodel, and Windzio 2014; Hamilton, Maddox, and Addey 2016). The core beliefs that
hold this coalition together and the question of what the Organisation for Economic Co-operation
and Development (OECD), the World Bank, Pearson PLC, Cambridge Assessment International
Education, and other global actors each gain individually from nurturing the growth of a global test-
ing culture have become topics of academic scrutiny. Periodically, the global testing industry has
come under siege for developing tests while simultaneously selling the books and the teacher training
materials in preparation for the tests (Hogan, Sellar, and Lingard 2016). Unsurprisingly, the com-
mercialisation of test-based accountability has become an object of intense academic curiosity and
inquiry (Verger and Parcerisa 2017). Some have shown how the global education industry has suc-
ceeded in extending its reach by brokering education policies that require periodical testing of stu-
dents, such as standards-based curriculum and accountability reforms; once the demand has been
created, global actors sell their tests for an ever-increasing number of subjects, grade levels, and edu-
cational systems. Without a doubt, the rise of ILSAs has recongured power relations among global
policy actors, giving great weight to global actors both public and private that control the means
of test production. An analysis of global actors is relevant for understanding how global monitoring
© 2018 Informa UK Limited, trading as Taylor & Francis Group
CONTACT Gita Steiner-Khamsi gs174@columbia.edu
GLOBALISATION, SOCIETIES AND EDUCATION
2018, VOL. 16, NO. 5, 557565
https://doi.org/10.1080/14767724.2018.1531234
and comparison of national development is used as a vehicle to spread certain global education pol-
icies at the expense of others.
1. ILSA research and the re-emergence of the nation-state in cross-national
comparison
Equally important to analysing global actors, is the analysis of national and local actors. National
governments, school districts, and local politicians are not passive victims of the global accountabil-
ity lobby and the testing industry. The semantics of globalisation (Schriewer and Martinez 2004)
have produced political pressure on national policy actors to invoke the larger international edu-
cational space, represented by PISA, TIMSS, and other ILSAs, when justifying national policy
decisions. It is therefore necessary to draw attention to actors involved at the national- and subna-
tional-levels in order to explain how the exponential growth of ILSAs has changed power relations
among the many policy actors in a country.
To ll this gap in the literature on national and local actors, the authors of this half special issue
ask questions such as when, how, and with what impact national policy actors have mobilised ILSAs
as a national norm setting device. Of course, these types of research questions are not new. They
constitute core research objectives of policy borrowing research, a subeld of comparative policy
studies. In the early days of this particular subeld, the question was which educational systems
have borrowed, transferred, or learned which reforms from which systems. For a long time, the
focus of policy borrowing research was on the relationship between two countries; for example,
the British interest in German education (Phillips 2015) or the United States interest in neoliberal
United Kingdom policies of the 1980s, and vice-versa (Whitty 2012). However, in the new millen-
nium, this traditional focus was dropped and replaced with studies of traveling reformsor global
education policies (e.g., Robertson et al. 2012; Steiner-Khamsi and Waldow 2012; Larsen and
Beech 2014; Edwards 2018). The twenty-rst century intellectual kinship among policy borrowing
researchers and global education policy researchers is not coincidental; neoliberal, quasi-market
reforms of the late 1980s have spread like wildre to every corner of the world over the past three
decades. The fundamental changes in how educational systems are regulated, notably, the shifts
from input to output, from government to governance, from external inspection to self-evaluation
by numbers, and nally from state actors to public-private as well as national-international networks,
have been convincingly documented (Ball and Junemann 2012; Jules 2017). The globally structured
neo-liberal agenda (Dale 2000; Robertson and Dale 2015) has indeed replaced punctual bilateral,
cross-national policy attraction with ubiquitous policy transfer processes in which one global edu-
cation policy diuses across a large number of educational systems. As a corollary, when it comes
to the global spread of, for example, the accountability regime, accreditation in higher education,
or other global education policies, the directionality of transfer has become obsolete.
Strikingly, precisely at a stage in policy borrowing research when scholars have put the study of
cross-national policy attraction to rest and instead directed their attention to the ubiquitous diusion
processes of global education policies, the cross-national dimension and by implication the focus
on the nation-state and its national policy actors has regained importance in ILSA policy research.
In the case of PISA, the preoccupation of national policy actors is, at least rhetorically, how their own
system scores as compared to others, and what there is to learnfrom the league-winners, league-
slippers, and league-losers, in terms of PISAs twenty-rst century skills. Because policy actors
often attribute best practicesto particular national educational systems, the national-level regained
importance as a unit of analysis. ILSA policy researchers therefore found themselves in a position of
having to bring back the focus to national systems; a focus which if used naively, should be cause for
concern. The risks of methodological nationalism are reiterated here to demonstrate how the authors
of this half special issue distance themselves from the homogenising eects that cross-national com-
parison tends to have.
558 G. STEINER-KHAMSI AND F. WALDOW
In acknowledgement of the widespread critique of methodological nationalism, forcefully put for-
ward by scholars in sociology, social anthropology, and the comparative social sciences (Giddens
1995; Wimmer and Glick Schiller 2003; Dale 2005; Robertson and Dale 2008), the editors of this
issue feel that the choice of national education systems as the unit of analysis requires justication.
In a seminar article on methodological nationalism, Andreas Wimmer and Nina Glick Schiller assert
that [m]ethodological nationalism is the naturalization of the nation-state by the social sciences
(Wimmer and Glick Schiller 2003, 576). They identify three variants of methodological nationalism
within the social sciences: (i) disregard of the power of nationalism for modern societies, (ii) natu-
ralisation, that is, taking for granted the boundaries of the nation-state and using them to dene the
unit of analysis, and (iii) territorial limitation of social research in that phenomena are only exam-
ined within the political and geographic boundaries of particular nation-states rather than transna-
tionally. In comparative education, the critique of methodological nationalism has greatly resonated
with scholars who draw on political economy thought, world systems theories, or critical globalisa-
tion studies to demonstrate the unequal transnational ows of educational goods, services and best
practices.
For these reasons, current intellectual projects that bring backthe nation as the unit of analysis
must explain the dierence--and in our opinion should explicitly distance themselves--from earlier
projects, which framed national educational systems as bounded and homogenous entities that could
be easily compared, or contrasted, to other systems. These earlier studies oftentimes ended up being
tautological or engaged in a self-reinforcing way of looking at and describing the social world
(Wimmer and Glick Schiller 2003, 578). They predicted the existence of vast dierences among
national systems and unsurprisingly, as an artifact of their method of inquiry, found these dierences
and described them in an essentialising manner (see Steiner-Khamsi 2002).
Our own interest in comparing PISA reception across systems as well as across dierent reform
periods within a system, stems from a diametrically opposed research interest. Our preoccupation
with the national-level attempts to bring to light the performative act of systems. At particular
moments, systems generate national boundaries and reassert themselves as national entities in
order to make it appear that there is (global) external pressure for reform or change. In the same
vein, they construct other national systems as reference societies at particular moments to suggest
that lessons should be drawn from these systems. The political act of externalisationserves to
unify or to use the proper term to build coalitions in support of an educational policy. It is impor-
tant to point out here that every political act of externalisation necessitates, but also contributes to,
the social construction of the nation as an acting subject. Our attention is directed to how govern-
ments deal with policy contestation, at what moments they resort to the semantics of the national
and the global, and what impact their acts of externalisation have on authorising controversial edu-
cational policies in their country.
Having said this, it is also important to keep in mind that in some countries the government has
ceased to be the main national policy actor. In an era of network governance(Ball and Junemann
2012), businesses, churches, and parent groups as well as international organisations exert enormous
pressure on governments to further deregulate the system and delegate the provision of education
and the creation of new policies to the private sector. In some educational systems, such as in Eng-
land, the provision of education has been diversied and the role of the government minimised to the
extent that Stephen Ball suggests that we use the term systemwith precaution (Ball 2018). As is
explained in the following section, PISA lends itself to such boundary work because public policy,
including educational policies, are by denition controversial, that is, supported by some, and con-
tested by others.
2. Interpreting scandalisation and projection as idiosyncratic responses to ILSAs
This half special issue deals with cross-national policy attraction, but it studies the phenomenon in
two new ways: It is analytical rather than normative and it critically reects on how policy actors use
GLOBALISATION, SOCIETIES AND EDUCATION 559
the method of comparison for national policy setting. First, rather than normatively postulating that
the best-performingeducational systems of Finland, China, Singapore, or other league-winners
should be used for lesson-drawing (Liang, Kidwai, and Zhang 2016), the analytical focus of this
group of authors is on how national policy actors have actually used ILSAs for national agenda set-
ting or policy formulation. Second, the cross-national dimension of ILSA policy research begs for an
additional objective of inquiry: Which countries do policy actors select as a reference society
(Bendix 1978, 292) and which countries do they consider as negative reference societies(Waldow
2017, 647) or counter-reference societies(Takayama in this issue), respectively? The concept of
reference or counter-reference society is based on commensurability. How do national policy actors
make the educational systems of league winners appear to be comparable to their own educational
system, in order to suggest that lessons could be drawn? The inverse also applies when negative refer-
ences to league-losers are made, begging the question: How do policy actors use comparison as a tool
to dierentiate themselves from low-performing systems? The question of how commensurability is
constructed and to whose benet or at whose expense, has been an important eld of study in his-
torical sociology (McAdam, Tarrow, and Tilly 2001) as well as, more recently, in the sociology of
measurement (Gorur 2014). Thus, the analysis of how commensurability is established is another
research topic that ILSA policy research has brought to focus.
In this collection of articles, two particular national policy strategies, both closely associated with
the reception and translation of ILSA results, are examined in greater detail: (i) the scandalisation of
public education and (ii) projections into ILSA league-leaders, league-slippers, and league-losers.
According to Gita Steiner-Khamsi (2003), scandalizationmeans highlighting the weaknesses of
ones own educational system as a result of comparison.This does not necessarily mean that low
scores are the reason for the scandalisation. Comparison is a complex process of meaning-making,
and dierent ways of framing success and failure play an important role in that process. Thus, scan-
dalisation can even occur when ILSA results are very good, e.g., if there is a perception that good
results have been bought at too high a price, as claimed by some observers, e.g., in Korea (see Lee
and Sung forthcoming).
Research on policy borrowing and lending has shown again and again that references to else-
wheredepend mostly on the perspective prevalent in the context from where the referencing is
being done, not on the context serving as the reference (see Zymek 1975; Steiner-Khamsi 2004).
The concept of projection (Waldow 2017) takes this insight one step further, stressing that actual
conditions in the place that is being referred to are often of minor importance. Rather, what is impor-
tant is what observers want to see, to the extent that what is observed may not actually exist in the
place serving as the reference. Projections serve to legitimate or de-legitimate educational policies
and agendas in the place from where the projection is made. Conceptions of goodand badedu-
cation are projected onto countries or regions like a slide or lm is projected onto a projection screen.
Reference societies will thus usually be depicted in a very selective way, with certain aspects being
emphasised out of proportion and complex or contradictory aspects being presented in a simplied
way.
The four articles comprising this half special issue have employed the concepts of scandalisation
and projection in fruitful and original ways, generating important insights into the ways in which
ILSAs and their results are used as a national policy device in various locations. The authors are
part of a larger community of globalisation scholars who acknowledge the intellectual value of ana-
lysing local meaning-making of global policies and devices. They use the national actors as their unit
of analysis to understand why, when, and with what impact these actors engage with the ILSA global
policy device, and how they establish commensurability or non-commensurability with other edu-
cational systems that participate in global testing. The methodological tool of the authors of this half
special issue is comparison in its most comprehensive sense; that is, comparison across dierent
national educational systems, comparison across dierent time periods within the same educational
system, as well as comparison of national educational systems against constructed international stan-
dards or benchmarks. This comparative method of inquiry enables the authors to show the varied
560 G. STEINER-KHAMSI AND F. WALDOW
national policy uses of ILSAs. It is through comparisons of dierent national contexts as well as tem-
poral comparisons within a singular national context that the conceptual link between the varied
local encounters with global education policies and devices may be made.
3. The wide range of comparative methodology
The four articles in this collection use a comparative methodology to demonstrate how the same
ILSA result can be interpreted dierently, reecting varied political agendas and stakeholder inter-
ests. Joakim Landahl focuses on the early stage of ILSAs in the early 1970s and examines the policy
impact of the Six Subject Survey on curriculum reform in Sweden. The International Association for
Educational Assessment (IEA) released the results of the Six Subject Survey in 1973. A total of 21
countries, including Sweden, participated in the ILSA. The release occurred a decade after a
major school reform in Sweden was launched: The comprehensive school reform. The reform
replaced older forms of secondary education such as grammar schools, girlsschools, and vocational
schools with a system that was less selective and therefore deemed more democratic. The reform was
controversial and was heavily criticised by conservative parties in Sweden, who claimed that aca-
demic standards had declined and that students were learning less as a result of the reform. However,
in 1973, the Six Subject Survey results were released for three of the six subjects (literature education,
reading comprehension, and science) suggesting that the 10-year students in Swedish schools were
high performing. The results stunned both proponents and opponents of the comprehensive school
reform.
Landahl writes that in the early days of ILSAs, IEA condemned the competitive nature of cross-
national comparison and refused to provide league tables. Instead, the results of the Six Subject Sur-
vey were used as a tool to evaluate the common school reform in Sweden. Despite the warnings of
academics against using the results in a competitive manner, the Swedish media referred to the test as
the knowledge Olympicsand spread the news that students in Sweden were the best in the worldin
reading and comprehension (Landahl, in this issue). Landahl compares the medias depiction of the
Swedish fundamental common school reform before and after the release of the spectacular Six Sub-
ject Survey results, enabling him to examine the impact of an international standardised test on
national reform debates. He asserts that the national reading or translation of the ILSA results led
to a de-scandalisation of the common school reform. The proponents of the grundskolan (common
school), including the minister who initiated the reform, used the ILSA results as political leverage to
reassert the reform path taken with the common school reform. Landahl notices a discursive shift in
how the quality of Swedish education was assessed. Prior to the Six Subject Survey, the unit of com-
parison was the national past, whereas beginning in the 1970s, developments abroad became the
object of study for national policy actors in Sweden.
Dennis Niemann, Sigrid Hartong, and Kerstin Martens draw attention to the subnational-level,
which is often neglected in ILSA research. They compare two federal political systems; the one in
the United States with its large decision-making authority at school-level, with the one in Germany,
where power is geographically decentralised to the Länder (sub-national state)-level. Through this
comparison the authors examine how PISA results are received and translated in contexts where
the national-level is of limited relevance for decision-making. Embedded in the interpretive frame-
work of historical institutionalism, the authors use the concept of path dependency to explain why
the policy responses to PISA dier so widely in the United States and Germany. German stake-
holders at Länder-level actively used the PISA results to generate reform pressure and advance
their own reform agenda. In contrast, interest in the PISA results was strikingly absent in the United
States, where PISA became moderately interesting only when China entered the race (2009) and
when PISA For Schools entered the ILSA market (2015).
Self-proclaimed as the gold standardfor evaluating school reform, how are the PISA results in
fact used in highly decentralised federal systems such as the United States and Germany? Niemann
et al. identify the key features of the PISA technology that actually encourage stakeholders to make
GLOBALISATION, SOCIETIES AND EDUCATION 561
projection to other education systems, derive concise reform strategies, and justify policy changes.
The largest global database on educational performance, the PISA dataset is rich both in terms of
variables (indicators) and cases (educational systems). As Niemann et al.assert, the dataset is
made easily accessible for non-experts though visualisations, rankings, summaries, and interpret-
ations of main ndings. What is more, the league tables create a test-specic international commu-
nity, composed of countries that agree to having their students take the particular test. However,
PISA has had a limited impact on school reform in the two federally governed countries of the Uni-
ted States and Germany. It was instead most inuential as a monitoring device. It popularised the
tool of standardised testing and monitoring learning outcomes. Thus, what mattered in the United
States and Germany were neither the results nor the best practicesfrom cross-national comparison
undertaken by PISA, but the device itself. The global test helped to accelerate and institutionalise
test-based accountability or, as Radhika Gorur would say, made policy actors at Länder-level
but also at school-level –‘see like PISA(Gorur 2016).
Keita Takayama compares the reception of the two ILSA league leaders, Finland and Singapore,
in Australia. He nds that the media in Australia attributes the high performance of students in Sin-
gapore to the overly protective, ambitious, and stressful childrearing practices in Asian societies. Sin-
gapore is not the only Asian country that is depicted negatively despite its high scores in terms of
studentslearning outcomes. Two out-of-school factors, notably tiger parentingand private coach-
ing, are the most commonly used explanations for studentshigh performance in Singapore, Korea,
Japan, Peoples Republic of China, and Taiwan. Cummings (1989) observed a similar negative reac-
tion to education in Japan. When the report Nation at Risk suggested that policy analysts should
learn from Japan, Cummings notes that American researchers tended to use a yes, but …’approach.
This approach acknowledges the successes in the other educational system, but at the same time
argues that these successes come at too high a price, a price Americans are unwilling to pay(Cum-
mings 1989, 296). At the time, the exaggerated statements or myths about Japanese education
included an inverted socialisation paradigm (indulgence in early childhood, discipline in adoles-
cence, and early adulthood), education for the nation and the state, kyoiku mama (education-
oriented mother), rote learning in schools, competition and suicide, elitist higher education, and
social inequality. These generalised judgments of Japanese society and education helped to fence
opublic pressure to learn from Japan.
The American stereotypes used to describe education in Japan in the 1980s are remarkably similar
to the stereotypical, negative explanations Australians use in the new millennium to explain why
Asian countries score so high on ILSAs. Takayama asserts that the negative stereotypes serve as a
device for Australians to distance themselves from education systems they consider to be bad.
They project the opposite of what they consider to be good education onto Asian education systems.
By doing so, they generalise and essentialise. The Australian media lumps together the league-leaders
in the region and uses identical, negative explanations for PISA successin Asian countries. Finally,
the assumption is made that Asian education practices are biologically determined and hereditary,
that is, passed on from one generation to the next. As Takayama contends, the projections onto
Asian education systems are racist and the Pan-Asian stereotype only serves to create the generalised
Pan-Asian Other.
Oren Pizmony-Levy examines how national debates on PIRLS, PISA, and TIMSS have created a
sentiment of achievement crisisin Israel. He compares actual ILSA results with how they are pre-
sented in the media and how they are used politically by national stakeholders. The scandalisation of
the Israeli school system is reected both in headlines such as Disappointing performance,Israel
repeats a grade,orThe grade: failing, as well as in how the results are visually manipulated in
national newspapers. In one newspaper illustration, the ranking table of the countries that partici-
pated in TIMSS 1995 is cut oafter the names of the rst twenty participating countries (from a
total of 45 countries). The partial list of countries was meant to make readers believe that only 20
countries participated in TIMSS and that Israels rank of 17 was near the bottom.
562 G. STEINER-KHAMSI AND F. WALDOW
This dramatisation in the media has remained constant over the period 1996 to 2016, even though
the Israeli school system is positioned near the middle on the PISA, TIMSS, and PIRLS ranking
tables. The 2015 TIMSS results in mathematics and science are similar to the ones in the mid-
1990s, with a slump in test results between 1990 and 2003, followed by a recovery between 2007
and 2015. Similar to the TIMSS ndings, the PISA results suggest that Israels performance in math-
ematics and science uctuates somewhere around the international average. In reading literacy, the
country improved its position on the ranking tables of both PIRLS and PISA. Clearly, the national
average scores alone do not warrant the crisis scenario depicted in the media. What does deserve
attention, however, are the signicant dierences in ILSA results between Jewish and Arab students
and between students from high and low socio-economic backgrounds. The vastly dierent results
provide a wide spectrum of possible interpretations. As Pizmony-Levy points out (in this issue),
These patterns provide local actors with ample opportunities to interpret ILSA results in dierent ways. Some
actors could draw on the average achievement scores to characterise the Israeli educational system as mediocre,
but stable in terms of performance. Others could use the ranking tables to characterise the Israeli educational
system as going downward with regard to performance. Yet, other actors could simply ignore ILSA results and
delegitimise them as relevant, appropriate, and useful evidence.
In addition to the media analysis, Pizmony-Levy compellingly demonstrates how different stake-
holders in Israel have interpreted the ILSA results in ways that advance their own agendas. Members
of the Knesset used the release of the ILSA results to mobilise nancial resources for the education
sector by presenting the mediocre performance as a security risk and a national defense issue for the
country. The Ministry of Education used the political momentum to break teachersstrikes, revise
the national curriculum, establish system-wide standards, introduce new textbooks, and institute
the National Task Force for the Advancement of Education in Israel. The Teachers Union, in
turn, used the political attention being given to the education sector to demand salary increases.
Both Pizmony-Levy (in this issue) and Resnik (2011) observe that several groups in Israel used
the ILSA results to rst construct a new social problem, labelled as interstate achievement gap,
only to then promote managerialism as a global solution for the national problem.
4. Invoking ILSAs as a quasi-external source of authorisation
As the four articles in this collection demonstrate, a comparative perspective is needed to examine
why ILSAs are attractive to local policy actors and how local policy actors translate ILSA results into
their own context. Such a dual focus on reception and translation is core to comparative policy
studies in education.
In recent years, an interesting new body of research has emerged that analyses why the same glo-
bal policy resonates and is adopted dierently in dierent local contexts. The assertion that global
education policies resonate for dierent reasons in dierent contexts has also been made in recent
studies on why governments participate in ILSAs, such as PISA or TIMSS. The most widely
advanced rationales concern the claim that valuable lessons can be derived from comparing edu-
cational systems both at a certain point in time and over time. Addey et al. (2017), however,
move beyond these rationales and present instead a sophisticated analytical framework that allows
them to identify the wide array of reasons why national governments participate in ILSAs. The seven
most common reasons for governmentsengagement with ILSAs are: (1) evidence for policy; (2)
technical capacity building; (3) funding and aid; (4) international relations; (5) national politics;
(6) economic rationales; and (7) curriculum and pedagogy. With a similar focus on national policy
context and an interpretive lens of historical institutionalism, Antoni Verger and his associates trace
the pathways to privatisation in dierent countries (Verger, Fontdevila, and Zancajo 2016). They
identify six dierent pathways: (i) privatisation as a reform in which the state was systematically
restructured along market lines and services previously provided by the public sector were out-
sourced to the private sector (e.g., Chile; the United Kingdom), (ii) as an incremental reform in
which the decentralised system scaled-up privatisation by means of vouchers, charter schools and
GLOBALISATION, SOCIETIES AND EDUCATION 563
choice policies (e.g., the United States), (iii) as a continuation of an already existing, long held pub-
licprivate partnership between, for example, faith-based institutions and the state (e.g., Nether-
lands, Spain), (iv) as a stated public administration reform to make the public sector act more
like businesses by selectively adopting principles of the private sector, also known as endo-privatiza-
tion(e.g., prevalent in many social-democratic governments of Scandinavia and continental
Europe), (v) as de facto privatisation in low-income countries, and nally (vi) as privatisation by cat-
astrophe (e.g., New Orleans after Hurricane Katrina, aftermaths of wards in El Salvador and Iraq).
The global neoliberal wave of privatisation has encountered varied degrees and variants of privatisa-
tion in various national contexts. The receptiveness or resistance towards the new neoliberal wave of
privatisation can only be captured adequately against the backdrop of past adaptations of privatisa-
tion in a national context.
Similarly, there also exist a plethora of studies on how PISA results are discussed or translatedat
country-level, mostly in the media. However, rarely do these studies adopt a critical comparative per-
spective that allows them to see how PISA translation relates to ongoing policy debates and power
relations among the various policy networks in a country. In particular, these studies fail to examine
which kind of discursive power is associated with ILSAs that eclipses, or exacerbates, conict over
agenda setting at the national-level. ILSA top-scorers such as Finland and Shanghai have become
global reference societiesfor policy-making; the processes at work here are far more complicated
than the commonsensical explanation of straightforward lesson-drawing from league-leaders
would suggest. ILSAs are more often than not used to either generate or deect reform pressure
on national educational systems. Strikingly, reform pressure related to ILSAs is being actively gen-
erated by national policy actors themselves. National actors use international tests as a quasi-external
stamp of approval to carry through unpopular reforms, to stave ounwelcome reform pressure or, in
the aftermath of recent reforms, to justify the path that was taken to improve the educational system.
Disclosure statement
No potential conict of interest was reported by the authors.
ORCID
Gita Steiner-Khamsi http://orcid.org/0000-0001-9986-2150
References
Addey, C., S. Sellar, G. Steiner-Khamsi, B. Lingard, and A. Verger. 2017.Forum Discussion: The Rise of International
Large-scale Assessments and Rationales for Participation.Compare 47 (3): 434452. doi:10.1080/03057925.2017.
1301399.
Ball, S. J. 2018.The Tragedy of State Education in England: Reluctance, Compromise and Muddle A System in
Disarray.Journal of the British Academy 6: 207238. doi:10.5871/jba/006.207.
Ball, S. J., and C. Junemann. 2012.Networks, New Governance and Education. Bristol: University of Bristol and Policy
Press.
Benavot, A., and H.-D. Meyer. 2013.Pisa, Power, and Policy. Oxford: Symposium.
Bendix, R. 1978.Kings or People: Power and the Mandate to Rule. Berkeley: University of California Press.
Cummings, W. K. 1989.The American Perception of Japanese Education.Comparative Education 25: 293302.
Dale, R. 2000.Globalization and Education: Demonstrating a Common World Educational Cultureor Locating a
Globally Structured Educational Agenda?.Educational Theory 50 (4): 427448. doi:10.1111/j.1741-5446.2000.
00427.x.
Dale, R. 2005.Globalisation, Knowledge Economy and Comparative Education.Comparative Education 41 (2): 117
149. doi:10.1080/03050060500150906.
Edwards, D. B. 2018.The Trajectory of Global Education Policy. Community-based Management in El Salvador and the
Global Reform Agenda. New York: Palgrave.
Giddens, A. 1995.National State and Violence. Los Angeles: University of California Press.
564 G. STEINER-KHAMSI AND F. WALDOW
Gorur, R. 2014.Towards a Sociology of Measurement in Education Policy.European Educational Research Journal
13 (1): 5872. doi:10.2304/eerj.2014.13.1.58.
Gorur, R. 2016.Seeing Like PISA: A Cautionary Tale About the Performativity of International Assessments.
European Educational Research Journal 15 (5): 598616. doi:10.1177/1474904116658299.
Hamilton, M., B. Maddox, and C. Addey. 2016.Literacy as Numbers: Researching the Politics and Practices of
International Literacy Assessment. Cambridge: Cambridge University Press.
Hogan, A., S. Sellar, and B. Lingard. 2016.Commercialising Comparison: Pearson Puts the TLC in Soft Capitalism.
Journal of Education Policy 31 (3): 243258. doi:10.1080/02680939.2015.1112922.
Jules, T. D. 2017.The Global Educational Policy Environment in the Fourth Industrial Revolution. Bingley: Emerald.
Larsen, M. A., and J. Beech. 2014.Spatial Theorizing in in Comparative and International Education Research.
Comparative Education Review 58 (2): 191214. doi:10.1086/675499.
Lee, Y., and Y.-K. Sung. Forthcoming. Understanding PISAs Attractiveness: Critical Analyses in Comparative Policy
Studies. Edited by F. Waldow, and G. Steiner-Khamsi. London: Bloomsbury.
Liang, X., H. Kidwai, and M. Zhang. 2016.How Shanghai Does It. Insights and Lessons from the Highest-ranking
Education System in the World. Washington, DC: World Bank, Directions in Development.
Martens, K., P. Knodel, and M. Windzio. 2014.Internationalization of Education Policy. A New Constellation of
Statehood in Education? New York: Palgrave.
McAdam, D., S. Tarrow, and C. Tilly. 2001.Dynamics of Contention. Cambridge: Cambridge University Press.
Phillips, D. 2015.The German Example: English Interest in Educational Provision in Germany Since 1800. London:
Bloomsbury.
Resnik, J. 2011.The Construction of a Managerial Education Discourse and the Involvement of Philanthropic
Entrepreneurs: The Case of Israel.Critical Studies in Education 52 (3): 251266. doi:10.1080/17508487.2011.
604075.
Robertson, S. L., and R. Dale. 2008.Researching Education in a Globalizing era: Beyond Methodological Nationalism,
Methodological Statism, Methodological Educationism and Spatial Fetishism.In The Production of Educational
Knowledge in the Global era, edited by J. Resnik, 1932. Rotterdam: Sense.
Robertson, S. L., and R. Dale. 2015.Towards a Critical Cultural Political EconomyAccount of the Globalizing of
Education.Globalisation, Societies and Education 13 (1): 149170. doi:10.1080/14767724.2014.967502.
Robertson, S. L., K. Mundy, A. Verger, and F. Menashy, eds., 2012.Public Private Partnership in Education. New Actors
and Modes of Governance in a Globalizing World. Cheltenham: Edward Elgar.
Schriewer, J., and C. Martinez. 2004.Constructions of Internationality in Education.In The Global Politics of
Educational Borrowing and Lending, edited by G. Steiner-Khamsi, 2952. New York: Teachers College Press.
Steiner-Khamsi, G. 2002.Re-framing Educational Borrowing as a Policy Strategy.In Internationalisierung
Internationalisation, edited by M. Caruso, and H.-E. Tenorth, 5789. Frankfurt/M and New York: Lang.
Steiner-Khamsi, G. 2003.The Politics of League Tables.Journal of Social Science Education 2003 (1). Accessed
January 31, 2018. http://www.jsse.org/index.php/jsse/article/view/470.
Steiner-Khamsi, G. 2004.Blazing a Trail for Policy Theory and Practice.In The Global Politics of Educational
Borrowing and Lending, edited by G. Steiner-Khamsi, 201220. New York: Teachers College Press.
Steiner-Khamsi, G., and F. Waldow, eds. 2012.Policy Borrowing and Lending. World Yearbook of Education 2012.
London: Routledge.
Verger, A., C. Fontdevila, and A. Zancajo. 2016.The Privatization of Education: A Political Economy of Global
Education Reform. New York: Teachers College Press.
Verger, A., and L. Parcerisa. 2017.Accountability and Education in the Post-2015 Scenario: International Trends,
Enactment Dynamics and Socio-educational Eects.Paper Com-missioned for the 2017/8 Global Education
Monitoring Report, Accountability in Education: Meeting Our Commitments. http://unesdoc.unesco.org/
images/0025/002595/259559e.pdf. Paris: UNESCO GEMR.
Waldow, F. 2017.Projecting Images of the Goodand the Bad School: Top Scorers in Educational Large-scale
Assessments as Reference Societies.Compare 47 (5): 647664. doi:10.1080/03057925.2016.1262245.
Whitty, G. 2012.Policy Tourism and Policy Borrowing in Education: A Trans-Atlantic Case Study.In Policy
Borrowing and Lending. World Yearbook of Education 2012, edited by G. Steiner-Khamsi, and F. Waldow, 354
370. London: Routledge.
Wimmer, A., and N. Glick Schiller. 2003.Methodological Nationalism, the Social Sciences, and the Study of
Migration: An Essay in Historical Epistemology.International Migration Review 37 (3): 576610.
Zymek, B. 1975.Das Ausland als Argument in der pädagogischen Reformdiskussion: Schulpolitische Rechtfertigung,
Auslandspropaganda, internationale Verständigung und Ansätze zu einer Vergleichenden Erziehungswissenschaft
in der internationalen Berichterstattung deutscher pädagogischer Zeitschriften, 18711952 [Foreign Countries as
an Argument in Educational Reform Discussions, 18711952]. Ratingen: Henn.
GLOBALISATION, SOCIETIES AND EDUCATION 565
... A macro-dissatisfaction perspective allows for redirecting public attention due to scandalization and a perceived crisis. Therefore, for policymakers, ILSAs offer an opportunity to, on the one side, scandalize the state of education (Steiner-Khamsi and Waldow, 2018), pushing for further education reform (Verger et al., 2019) and on the other side, cherrypick results (Guadalupe, 2024), which can be used to justify specific reforms, regardless of local needs and ILSA results. Other studies (Lockheed and Wagemaker, 2013) point out that ILSAs are being used to motivate countries to comply with global educational standards, improve education systems through naming and shaming, and evaluate the effectiveness of national systems (Niemann and Martens, 2018). ...
Article
Full-text available
Introduction International Large-Scale Assessments (ILSAs) are widely utilized to benchmark to evaluate the quality of education systems globally. Since 2000, the number of participating countries in these assessments has increased dramatically, revealing the dominance of a few education systems while exposing the deficiencies of many others. Especially for the latter group the question, as to why they participate in ILSAs, is puzzling. Existing literature attributes this participation to domestic factors or the influence of International Organizations. However, we argue that the global spread of ILSAs can also be explained by direct country-to-country dependencies through development aid. Methods This study takes an interdependency-inspired approach, focusing on how bilateral development aid networks influence ILSA participation. Using advanced network diffusion and hurdle models, we analyse data from a global set of countries over the period from 1990 to 2012. The models examine the role of development aid distribution in shaping ILSA participation, with particular attention to how participation in ILSAs affects the likelihood of attracting additional donors and aid. Results Our analysis reveals that the distribution of development aid has a significant impact on countries’ decisions to participate in ILSAs. Furthermore, we find that countries already involved in ILSAs are more likely to attract additional donors and aid within established donor-recipient dyads. These results demonstrate a clear connection between development aid distribution and the global spread of ILSAs. Discussion This study highlights the role of monetary incentives, facilitated by the distribution of development aid, in promoting participation in ILSAs. Our findings suggest that the rapid spread of ILSAs is not solely driven by domestic factors or international organizations but also by the interdependent relationships formed through aid distribution networks. These insights contribute to a broader understanding of the factors driving global educational assessments and provide implications for policy-making in education and development aid.
... On the contrary, there is great variation in how national governments, media, and research institutions explain Finland's, Shanghai's, or Singapore's "success" in PISA or TIMSS. In fact, there is a pattern in these varied, sometimes diametrically opposed, explanations, which is best captured by the term "projection" (Steiner-Khamsi & Waldow, 2018;Waldow, 2017). The reception and translation of ILSA results reflect controversial policy issues in a country's own policy context rather than the actual organizational features of the league leaders. ...
... Recent studies underscore the complexity of these challenges. Steiner-Khamsi & Waldow (2018) argues that the global standardization of curricula often leads to a devaluation of local knowledge and pedagogical practices. Imported curricula may neglect indigenous perspectives and cultural nuances, creating learning environments that are disconnected from students' lived experiences. ...
Article
Full-text available
This paper explores an endogenous approach to curriculum development, emphasizing the importance of incorporating both global educational trends and local cultural contexts. It discusses the challenges and pitfalls associated with importing curricula from other nations, examines the sociocultural aspect in mathematics education, highlights the need for evidence-based curriculum development, and underscores the significance of continuous, locally rooted curriculum revisions. This approach aims to promote educational equity, cultural relevance, and sustainable reform.
Chapter
Full-text available
Analisamos como o PISA, avaliação internacional de larga escala realizada pela Organização para a Cooperação e Desenvolvimento Econômico-OCDE é utilizado pelas agendas formuladas pelo Instituto Sagres (Agenda do Partido Militar), Confederação Nacional da Indústria-CNI (Agenda da Indústria) e no documento final da Conferência Nacional de Educação-CONAE 2024 (Agenda da CONAE). O PISA é instrumento de regulação baseada no conhecimento que circula e pode pautar o debate público sobre educação. Os achados de pesquisa evidenciam que a Agenda do Partido Militar e a Agenda da Indústria colocam o PISA como centralidade para a qualidade da educação básica brasileira. Por outro lado, a Agenda da CONAE questiona o PISA e advoga a criação de Sistema Nacional de Avaliação que vá além da avaliação de desempenho dos estudantes. Provavelmente este será um dos pontos de disputa dessas agendas em relação ao próximo Plano Nacional de Educação.
Article
Full-text available
Early childhood educators work in a highly regulated environment in many countries and are constantly asked to produce and improve quality. Our international study of Australian, Canadian, Danish, Georgian and Italian educators’ work examined their notions of quality and how this was impacted by government policies and documents such as frameworks, standards and curricula. Quantitative data were analysed using cross-tabulation and descriptive statistics, while qualitative data were analysed using thematic analysis. The findings reveal that some educators’ notions of quality aligned with their governments’ ideas, but many revealed nuanced concepts. Educators expressed frustration at these differences and the perceived limitations and impact of the imposed policies and documents. Many educators identified how these differences were experienced in the workplace and impacted their teaching, relationships and children’s learning. This study will interest policymakers, educators, and teacher educators.
Chapter
Full-text available
This chapter introduces three temporalities—timing, lifespan, and age—that capture the various trajectories of SAWA adoption and translation at both the national and local levels. The multiple streams framework, theories that explain reform intensity shortly before and after a change in administration, and the externalization thesis are well-known interpretive frameworks that help explain the timing of policy borrowing. In contrast, further research is needed on why some reforms are short-lived while others are sustained and institutionalized. Policy analyses that determine the winners and losers of reform are likely to yield interesting findings on how reform is undermined, reframed, or rejected by disempowered groups, such as teachers unions. Even fewer studies exist on how a reform evolved or, phrased differently, how institutions gradually implement a reform. Arguably, historical antecedents and institutional legacies explain why local and national actors buy into global reform and how they recontextualize it once it has been selectively adopted. Such an intellectual endeavor requires a retrospective analysis of how a borrowed global reform unfolded over time and which features became institutionalized and endured twenty or thirty years later. Noticeably, comparative policy researchers in education rarely have a long time horizon in sight when chronicling reform implementation.
Article
Full-text available
O artigo analisa o programa PISA como uma governança e como modelo de pesquisa baseada em evidências, a fim de construir uma gramática aritmética política europeia das desigualdades e para influenciar novas demandas curriculares. O autor faz uma análise sociológica do caso francês para ilustrar as influências do PISA na educação europeia e em outros contextos locais. O texto reconstrói a trajetória do PISA como programa da OCDE e como tem influenciado a Europa e outros países, por meio de uma revisão de literatura, com uma análise sociológica crítica. O artigo mostra como a racionalidade do programa serve para alimentar a estratégia europeia de aprendizagem ao longo da vida e de reorganização curricular, como uma governança epistêmica que foi construída em torno da pesquisa a partir do conhecimento produzido por uma associação entre especialistas e formuladores de políticas e por meio de uma nova formulação do ideal francês de igualdade de oportunidades na educação.
Book
Full-text available
This book brings a new focus and new insights to the phenomena of global education policies and, relatedly, international policy transfer. While both of these issues have gained popularity in the field of international and comparative education, there remains much that we do not know. In particular, while numerous studies have been produced which examine how global education policies—such as vouchers, charter schools, conditional-cash transfers, standardized testing, child-centered pedagogy, etc.—travel around the world and are implemented, we lack research which illuminates the origins and evolution of such policies. Put differently: scholars have yet to examine how such policies first emerge and then enter the global reform agenda for education. The present book addresses this critical gap in our knowledge by looking at multiple aspects of the trajectory of a particular policy which was born in El Salvador in the early 1990s and subsequently went global. This policy was known as “Education with Community Participation” and was an extreme form of community-based management that transferred (among other things) the responsibility for hiring, firing, and managing teachers from the central Ministry of Education to communities themselves. This book is also valuable in that it explicitly analyses the trajectory of global education policy with reference to the role of international organizations and within the larger international political and economic dynamics that affected the overall country context of El Salvador.
Book
The public sector is going through a period of fundamental change. Service delivery, policy making and policy processes are being carried out by new actors and organisations with new interests, methods and discourses, related to the emergence of new forms of governance. This timely book from bestselling author Stephen Ball and Carolina Junemann uses network analysis and interviews with key actors to address these changes, with a particular focus on education and the increasingly important role of new philanthropy. Critically engaging with the burgeoning literature on new governance, they present a new method for researching governance - network ethnography-which allows identification of the increasing influence of finance capital and education businesses in policy and public service delivery. In a highly original and very topical analysis of the practical workings of the Third Way and the Big Society, the book will be useful to practising social and education policy analysts and theorists and ideal supplementary reading for students and researchers of social and education policy.
Book
In recent decades the study of social movements, revolution, democratization and other non-routine politics has flourished. And yet research on the topic remains highly fragmented, reflecting the influence of at least three traditional divisions. The first of these reflects the view that various forms of contention are distinct and should be studied independent of others. Separate literatures have developed around the study of social movements, revolutions and industrial conflict. A second approach to the study of political contention denies the possibility of general theory in deference to a grounding in the temporal and spatial particulars of any given episode of contention. The study of contentious politics are left to 'area specialists' and/or historians with a thorough knowledge of the time and place in question. Finally, overlaid on these two divisions are stylized theoretical traditions - structuralist, culturalist, and rationalist - that have developed largely in isolation from one another. This book was first published in 2001.
Book
Over the past two hundred years German education policy and practice has attracted interest in England. Policy makers have used the ‘German example’ both to encourage change and development and to warn against certain courses of action. This monograph provides the first major analysis of the rich material from government reports (including work by Matthew Arnold), the press, travel accounts, memoirs, scholarly publications and the archives to uncover the nature of the English fascination with education in Germany, from 1800 to the end of the twentieth century. David Phillips traces this story and uses recent work in theories of educational policy ‘borrowing’ to analyze the reception of the German experience and its impact on the development of English education policy
Article
Researchers interested in the global flow of educational ideas and programmes have long been interested in the role of so-called ‘reference societies’. The article investigates how top scorers in large-scale assessments are framed as positive or negative reference societies in the education policy-making debate in German mass media and which functions they fulfil. Top scores in large-scale assessments do not automatically promote a country to the status of a positive reference society. Whether top scorers are perceived as positive or as negative reference societies depends largely on stereotyped prior perceptions that determine how success in these assessments is framed. Among the functions positive and negative reference societies fulfil are making educational reform agendas more plausible and serving as projection screens for conceptions of the ‘good’ and the ‘bad’ school.
Article
The article focuses on the political usages of OECD- and IEA-type studies on student achievement, and suggests that we examine in more detail how policy makers use results from international comparisons to advance fundamental school reform at national level. The author categorizes three types of policy reactions to league tables: (1) scandalization, (2) glorification, and (3) indifference. Drawing from media reports and policy debates that emerged right after the release of the results from TIMSS, PISA, and the Civic Education Study, the author points at the different policy reactions that these OECD and IEA studies have had in various national contexts. In Japan, for example, the release of TIMSS led to a self-affirmation or glorification of Japanese methods in science and mathematics, whereas the release of PISA in Germany triggered self-criticism or scandalization, and strengthened existing demands for a fundamental reform of the German educational system. Most striking is the political indifference that the release of the IEA Civic Education encountered in Germany. German students held the last rank in the international league table on attitudes towards immigrants (Civic Education Study), whereas they scored below OECD-average in reading literacy (PISA). The author provides a few tentative explanations for the following question: why was there such a political spectacle about the reading literacy scores of German students given that German students did far worse with regard to xenophobia?