ArticlePDF Available

Reading Skills Transfer Best from Home Language to a Second Language: Policy Lessons from Two Field Experiments in South Africa

Authors:
Full Terms & Conditions of access and use can be found at
https://www.tandfonline.com/action/journalInformation?journalCode=uree20
Journal of Research on Educational Effectiveness
ISSN: (Print) (Online) Journal homepage: https://www.tandfonline.com/loi/uree20
Reading Skills Transfer Best from Home Language
to a Second Language: Policy Lessons from Two
Field Experiments in South Africa
Nompumelelo Mohohlwane, Stephen Taylor, Jacobus Cilliers & Brahm
Fleisch
To cite this article: Nompumelelo Mohohlwane, Stephen Taylor, Jacobus Cilliers & Brahm
Fleisch (07 Dec 2023): Reading Skills Transfer Best from Home Language to a Second
Language: Policy Lessons from Two Field Experiments in South Africa, Journal of Research on
Educational Effectiveness, DOI: 10.1080/19345747.2023.2279123
To link to this article: https://doi.org/10.1080/19345747.2023.2279123
View supplementary material
Published online: 07 Dec 2023.
Submit your article to this journal
View related articles
View Crossmark data
This article has been awarded the Centre
for Open Science 'Open Data' badge.
INTERVENTION, EVALUATION, AND POLICY STUDIES
Reading Skills Transfer Best from Home Language to a
Second Language: Policy Lessons from Two Field
Experiments in South Africa
Nompumelelo Mohohlwane
a
, Stephen Taylor
a
, Jacobus Cilliers
b
and
Brahm Fleisch
c
a
Research, Monitoring and Evaluation Directorate, South Africa Department of Basic Education, Pretoria,
South Africa;
b
McCourt School of Public Policy, Georgetown University, Washington, DC, USA;
c
Department of Education, University of Witwatersrand, Johannesburg, South Africa
ABSTRACT
In many countries, children need to become proficient in both their
home language (L1) and an international language, such as English
(L2). Governments face tradeoffs in how to prioritize these two
objectives. We provide empirical evidence on cross-linguistic transfer
between L1 and L2, using the results of two randomized evaluations
of Structured Pedagogy Programs implemented in South Africa. The
programs had the same design, implementing organization, and dur-
ation. The key difference is that one program targeted the teaching
of reading in L1, while the other targeted L2. We find that both
interventions had positive effects on the languages they targeted.
The L1 intervention also had a positive effect on L2 reading profi-
ciency. In contrast, the L2 intervention had a negative effect on L1
outcomes, for the lower-performing students. These results are con-
sistent with the Simple View of Reading and suggest that decoding
skills are best learned in L1. It is thus cost-effective to prioritize learn-
ing to read in L1, as well as supporting teachers in this subject, even
if becoming proficient in L2 is also regarded as an important policy
objective.
ARTICLE HISTORY
Received 27 January 2023
Revised 18 October 2023
Accepted 21 October 2023
KEYWORDS
Language transfer; mother-
tongue; language policy;
teacher professional
development; structured
pedagogy
Introduction
The choice of language of instruction (LOI) is one of the most important policy ques-
tions in education. This is especially true in developing countries that are typically
multilingual with an international languagesuch as English or French chosen as the
lingua franca. Most countries opt for a bilingual language policy, teaching first in
the mother-tongue (L1) and then introducing the foreign/second language (L2), often as
the destination language (Eberhard et al., 2020; Kosonen, 2017; Walter & Benson, 2012).
This is based on education theory recommending that schooling should begin in the
language a child knows best (Ouane & Glanz, 2010; UNESCO, 2003; Walter, 2010;
ß2023 Taylor & Francis Group, LLC
CONTACT Jacobus Cilliers ejc93@georgetow.educ McCourt School of Public Policy, Georgetown University,
Washington, DC, USA.
Supplemental data for this article can be accessed online at https://doi.org/10.1080/19345747.2023.2279123
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS
https://doi.org/10.1080/19345747.2023.2279123
Walter & Benson, 2012). But policymakers wrestle with reconciling this with the strong
demand from parents for their children to be taught in the international language,
1
given the economic returns and associated job opportunities vested in these languages
(Casale & Posel, 2011; Giliomee, 2004; Gordon & Harvey, 2019; Wright, 2002). For
example, some countries, such as Botswana and Tanzania, prioritize one LOI nationally.
Other countries, such as Uganda and Kenya, prioritize one LOI in the urban areas such
as English and Kiswahili, respectively.
2
Rwanda reversed its language policy in 2021,
requiring all primary schools to instruct their students in English after at least three lan-
guage changes between Kinyarwanda, and French.
3
In South Africa, the mother-tongue
is mostly used as the LOI for the first three grades, with English taught as a subject, fol-
lowed by a switch to mostly English as the LOI.
The evidence for theories of language transition has largely been from the global
north with an application for minority language speakers acquiring a majority language.
Very little evidence exists for contexts where the majority of the population are mother-
tongue speakers attempting to acquire a minority second language. For instance,
although seen as an international language,English is often the minority language in
the global south (Eberhard et al., 2020; Kirkpatrick, 2012; Kosonen, 2017; Walter &
Benson, 2012). Moreover, the empirical research has largely focused on linguistically
similar language pairs such as Spanish to English, and English to French or German
(Baker & Stoolmiller, 2011; Goswami et al., 1998; Melby-Lervåg & Lervåg, 2011). Recent
evidence examines more linguistically diverse pairs such as English to Korean and
English to Chinese (Wang et al., 2006,2009). Except for limited studies on English and
local languages in Kenya, Uganda, and Namibia (de Galbert, 2023; Kim & Piper, 2019;
Piper et al., 2018; Veii & Everatt, 2005), there is very little research on the applicability
of these language transfer theories for the African context, where there is typically a
larger language distance between L1 and L2 within a multilingualism context (Eberhard
et al., 2020; Ouane & Glanz, 2010; Prah & Brock-Utne, 2009; UNESCO, 2003).
Do improvements in L1 literacy skills also cause improvements in L2, when the lan-
guage pair is linguistically distinct? Is there a reverse causal relationship flowing from
L2 to L1 literacy skills? And given limited resources, which language, L1 or L2, should
teacher professional development programs target?
Our article examines these questions in the context of South Africa, using longitu-
dinal data from two randomized evaluations of structured pedagogy programs targeting
early grade literacy, called the Early Grade Reading Studies (EGRS). The first was a
mother tongue L1 intervention implemented over three years from 2015 to 2018
(Cilliers et al., 2020,2022a; Fleisch, 2018; Fleisch et al., 2017; Kotze et al., 2019) and the
second was an English L2 intervention also implemented over three years from 2017 to
2019 (Cilliers et al., 2022b). Although these were two separate randomized evaluations
1
Low-cost private schools in India, for example, often use English as the language of instruction. https://www.epw.in/
journal/2021/13/special-articles/learning-and-language.html. Accessed June 6th 2022.
2
Early grade language of instruction (LOI) in Botswana is either Setswana or English, even though 26 languages are
spoken in the country. Kiswahili is the early-grade LOI in Tanzania, and urban centers in Kenya. English is the LOI in
urban Uganda. In rural areas the language of the catchment area is used, which is typically the mother tongue.
3
https://www.worldpoliticsreview.com/in-rwanda-language-change-in-schools-leaves-students-and-teachers-struggling/.
Accessed October 10th 2022. https://www.washingtonpost.com/politics/2020/01/24/third-time-11-years-rwanda-changed-
language-used-primary-schools/. Accessed May 9th 2023.
2 N. MOHOHLWANE ET AL.
rather than two arms within one randomized experiment, there were many factors held
constant. In both studies, learners were assessed in their mother tongue as well as in
English; and we tracked the same group of learners over a period of four years, or
more. Importantly, in both studies, a very similar intervention model was implemented,
namely detailed lesson plans, integrated reading materials, and professional support
through on-site coaching delivered over a 3-year period to children in grades 13
attending non-fee paying schools in rural South African provinces. The key difference
was the language being targeted.
We find that targeting the home language leads to improvements in both home lan-
guage and English literacy skills. In contrast, targeting English causes an improvement
in English literacy, but a deterioration in home language literacy for students in the bot-
tom half of the distribution. These results are consistent with the Simple View of
Reading.
Literature and Theories of Reading Acquisition
The Simple View of Reading
Becoming literate relies on children understanding that spoken language can be repre-
sented by written language, and then learning what symbols represent these sounds.
Thus, literacy development rests on both knowledge of the oral language, and the way it
is represented in print. The Simple View of Reading (SVR) defines comprehension as
the product of two skills: decoding and oral language (Gough & Tunmer, 1986). The
continued relevance of SVR has been demonstrated by a meta-analysis of 155 studies
(Quinn & Wagner, 2018), and empirical validation (Rodriguez-Segura, 2022). Additional
contributors to SVR identified as supplementary predictors to the simple view of read-
ing are background knowledge (Quinn & Wagner, 2018; Spires & Donley, 1998) work-
ing memory (Quinn & Wagner, 2018; Schaefer & Kotz
e, 2019) and reasoning and
inference skills (Ardington et al., 2021; Quinn & Wagner, 2018). Several studies have
applied the SVR to L2 acquisition and found a similar relationship for Dutch, Spanish,
and English bilingual learners. Both oral language comprehension and decoding were
strong predictors of comprehension (Lee et al., 2022).
Although the SVR argues for an underlying similarity in language acquisition and
each language requires specific instruction, learning an L2 is dependent on learning an
L1. According to the developmental interdependence theory (Cummins, 1979), there are
minimum language thresholds that have to be reached in L1 first before successfully
learning an L2; without reaching these thresholds, learners may fail to become literate
in either language rather than becoming biliterate. In other words, successful transfer
only happens under certain conditions. Besides the specific reading skills that transfer
from L1 to L2, learners would not need to learn each language entirely, there are some
literacy skills that transfer from L1 to L2 including linguistic knowledge about how lan-
guage works; process knowledge of using and handling of books; story grammar of nar-
rative, and styles of social interaction; decontextualizing language as well as abstract
thinking (Cummins, 1979; Kim & Piper, 2019; Macdonald, 1990).
The largest body of evidence on skill transfer from L1 to L2 is in phonemic and
phonological awarenessfocusing on letters and word reading with transfer established
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS 3
through correlation studies (Branum-Martin et al., 2006; Koda & Reddy, 2008; Wang
et al., 2006). Both correlation and causal evidence from the global south have been lim-
ited, an early exception of causal evidence was contributed by Wawire and Kim (2018),
based on a randomized control trial in Kenya. They found a positive impact of an 8-
week Kiswahili intervention on phonological awareness and letter-sound knowledge in
both Kiswahili and English. This result leaves open the possibility that a similar English
intervention might also have had a positive spillover to Kiswahili. Our study builds on
this by examining both L1 to L2 and L2 to L1 skill transfers, and by doing so in the
context of more substantial curriculum-wide programs running over three years (grades
13). More recent work measured language transfer in Uganda for two local
languages, Luganda and Runyankole-Rukiga, and English (de Galbert, 202) and in
Namibia measuring language transfer predictors in Herero and English (Veii &
Everatt, 2005).
Deciding on the Language of Instruction (LOI)
There is an ongoing debate on the choice of the LOIL1 or L2particularly in the global
south. The conversation is not only about the educational benefits but alsoabout heri-
tage and preservation of indigenous languages while reconciling the pressure to transi-
tion to a foreign/international language.The colonial history of these languages
contributes to the tension (Alexander, 2005; Giliomee, 2009; Ngcobo, 2009; Wright,
2002). Furthermore, the LOI question is shaped by an understanding of reading acquisi-
tion for both L1 and L2.
Several traditional theories inform bilingual education including the immersion and
submersion theories that are now widely critiqued as subtractivereplacing L1 with L2
(Cohen & Swain, 1976; Padilla et al., 1990; Parkin et al., 1987). More recent approaches
(Ball, 2011; Collier & Thomas, n.d.; Feltes, 2022; Ginkel, 2014) include two-way bilin-
gualism or dual immersion, using two languages as the LOI; multilingualism, using
more than two LOIs in the curriculum; and mother-tongue-based education that culmi-
nates in a transition to an L2. In the latter, the L1 is used as a bridging language to L2,
marked by an early exit (e.g. grade 4) or a late transition to L2 (e.g. grade 7).
Proponents for an early introduction of L2 paired with an early exit from L1 argue
that young children are more efficient at acquiring L2, and there is a critical period for
L2 acquisition (Colombo, 1982; Lenneberg, 1967,1969). This has now been disproven
(Ball, 2011; Ginkel, 2014; Snow & Hoefnagel-H
ohle, 1977). More recent research con-
firms that young learners are not more efficient than older children or adults at acquir-
ing L2. Adults and children differ in how they learn pronunciation, accent, and syntax.
When to introduce L2 and how efficient this will be is more substantially affected by
contextual factors such as whether learners are exposed to the L2 outside the classroom,
the number of hours of L2 teaching, and teacher competency in teaching L2 (Cummins,
1980; Dutcher & Tucker, 1995; Ginkel, 2014; Walter, 2010).
Establishing when learners have enough mastery for a language to be the LOI is a
critical policy question. How long should L1 be maintained before introducing and then
transitioning to the L2 as the LOI? There is often an understated distinction between
learning a language sufficiently and learning a language proficiently enough to learn
4 N. MOHOHLWANE ET AL.
content in it. Cummins (1979,1980) refers to this as the linguistic threshold hypothesis;
it attempts to express the stage at which learners have sufficient skills to successfully
learn content in either L1 or L2 as a LOI. He argues that there is a minimum language
threshold required to successfully become literate and then biliterate.
Empirical research is ongoing to establish which skills and thresholds fit the linguistic
threshold hypothesis. The skills to be measured have moved from grammar to vocabu-
lary, although the exact number of high-frequency words required is still under discus-
sion. This has contributed to the development and use of high frequency words in the
English language as well as other benchmarks such as Oral Reading Fluency (Ginkel,
2014; Hasbrouck & Tindal, 2017). Such thresholds have however been underdeveloped
in multilingual contexts and for agglutinating languages. Nakamura et al. (2019) contrib-
ute to research in multilingual contexts by examining two local South Indian languages,
Kannada or Telugu as L1 and English as L2. They propose nascent thresholds for
decoding skills including syllable level-phonological awareness and phoneme level
phonological awareness in L1 for successful transfer to L2. While tentative, their work
contributes to emerging empirical data on skill-based thresholds by context and lan-
guage. A broader critique of existing work on thresholds (Nakamura et al., 2019;
Takakuwa, 2005) is firstly, whether they are absolute or relative (e.g. a specific number
of words reached by a specific age or grade or if its a range in the number of words
reached at any age). Recognizing, however, that most skills like vocabulary are continu-
ous or unconstrained and thus difficult to measure. Secondly, how choices on which
skills should be considered are made.
While the literature reviewed has been broad, important gaps have been identified.
Firstly, there are limited studies validating the range of theories in the global south.
Secondly, most of the existing literature lacks causal evidence for language transfer and
thirdly, the possibility of language transfer through structured learning programs is lim-
ited. Our article contributes to these areas, respectively.
South African Context
South Africa is a middle-income country with nine provinces and corresponding educa-
tion departments. While the performance of South Africa has improved significantly in
the past decade, overall levels of learning remain low. For example, South Africa scored
on average 320 in the 2016 Progress in International Reading Literacy Study (PIRLS),
whereas the midpoint is 500 points (Gustafsson, 2020a; Howie et al., 2017).
South Africa is similar to many developing countries in its linguistic diversity, with
twelve official languages. English is the dominant language used in post-school education
and spoken in commerce (Le Cordeur, 2013;Madadzhe,2019;Nudelman,2015) although
it is a minority L1 language, spoken by <10% of the population as an L1 (Statistics South
Africa, 2012). Low English contextual exposure is found in broader social communication
as seen through radio and television programs. Out of the top 10 largest radio stations,
only two of these use English predominantly. In a typical week with a listenership of 37
million adults, only 30% are listening to English radio stations. Access to international
television platforms and streaming services is increasing, however, the public television
broadcaster still has a large n average audience of 26 million adults monthly with a legal
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS 5
mandate to spend 50% of their independently produced program budget on local African
language or programs (South African Broadcasting Services, 2020).
Language policy
Notwithstanding the highly constrained English societal context, the language policy bal-
ances the need for children to learn to read and write in a language they understand,
with a decision to develop proficiency in English. Schools are encouraged to use mother-
tongue as the LOI while simultaneously teaching a first additional language, usually
English, from the first grade. Although the language policy allows schools to implement
this model up to the sixth grade, the language of teaching changes for the majority of
learners from the start of the fourth grade. Ninety percent of learners transition to
English as the LOI while 10% transition or continue in Afrikaans from the fourth grade
with the exception of a handful of schools that retain an African Language L1 as LOI.
Approximately 70% of learners learn in their L1 as the LOI for the first three grades, and
there is a high match between the LOI and their actual Home Language according to
population data (Gustafsson, 2020b). Significantly, however, 23% of learners start learn-
ing in English as their LOI, which is almost four times more than the English home lan-
guage population figure which stands at 6% (Gustafsson, 2020b). A detailed discussion on
the rationale and challenges of maintaining L1 for longer or selecting English as L2 is
complex, with a detailed discussion provided by Mohohlwane (2019).
Of note to this study are differences in the South African national curriculum frame-
work between teaching L1 vs. L2 early grade literacy (Curriculum & Assessment Policy
Statement, 2011). According to the curriculum, teaching in L1 assumes that children
have a basic command of the oral vocabulary as they enter grade one, but have not yet
developed decoding skills. The primary object then of the early grade curriculum is to
build and become fluent in decoding skills. In L1, learners are taught to master phono-
logical awareness, letter naming, letter sounds, phoneme/grapheme relationships, and
sounding out syllables and letter blends. Combined, these skills are used to decode
words. These skills and strategies are taught from Grade 1 and continue into Grade 3 in
the L1 with a maximum time allocation of 8 h per week.
In contrast, not only is the teaching of English as a First Additional Language (EFAL)
allocated less time in the week, a maximum of 3 h, but the focus of teaching is different.
In Grade 1, the focus is not on reading, but on oral vocabulary development. In subse-
quent years, the curriculum largely assumes that the decoding skills have been mastered
in the L1 and would be transferred to L2. Even though there are clearly distinct
demands for learners to master different consonant blends in English, the assumption is
that decoding knowledge transfer would take place.
Program Description and Evaluation Design
Program Description
We use data from the first and second Early Grade Reading Studies (EGRS I and EGRS
II) conducted between 2015 and 2020 in South Africa. The two studies were similar
interms of the research team, program design, duration, sample, and service provider.
6 N. MOHOHLWANE ET AL.
First, both studies evaluated a structured learning program, which provided daily lesson
plans to teachers with integrated materials combined with an on-site coach providing
monthly in-classroom support to teachers as well as needs-based workshops. In each
study, the lesson plans were fully integrated with the official government curriculum.
Second, the studies also had the same duration and target grades: teachers were sup-
ported over 1 year with the intervention following the learners for three years: i.e., grade
1 teachers supported in year 1, then grade 2 teachers supported in year 2, and grade 3
teachers supported in year 3. Third, in both studies, the program targeted poor, non-
fee-paying public schools, referred to as quintile 1 to 3 schools.
4
Fourth, the studies
were initiated and supervised by the Department of Basic Education, but in each case,
implementation was outsourced to the same service provider.
5
Fifth, both studies were
designed as randomized control trials, the experimental design details are provided in
the next section.
The key difference between the two studies is that the first Early Grade Reading
Study (EGRS I) targeted teaching of Setswana Home Language (L1) and the second
study (EGRS II) targeted teaching English as a First Additional Language (EFAL) (L2).
6
The programs were also implemented in two different provinces in South Africa and
were two years apart. EGRS I started in 2015 and was implemented in North-West
province, whereas EGRS II started in 2017 and was implemented in Mpumalanga, where
the home language is either Siswati or isiZulu. In both studies, schooling was continuing
as usual in line with the curriculum, and there were no dedicated interventions targeting
other languages or subjects.
7
The provinces are relatively similar in terms of poverty levels and education perform-
ance. In each province, 68.7% of schools were classified as quintile 1 to 3 (South
African School Act & 1996 (Act No 84 of 1996), 1996), 2022). The North West province
was ranked fourth (out of nine provinces) and Mpumalanga ranked sixth based on their
performance in the 2016 PIRLS assessment (van Staden & Bosker, 2014). The provinces
also retained a similar ranking in the national school-leaving examination of 2020, at
fifth and sixth position, respectively (Department of Basic Education, 2021).
The dominant home language is different in these two provinces. In North West
province Setswana is dominant, spoken by 63% of the province. In Mpumalanga
isiZulu, spoken by 24%, and Siswati, spoken by 27% of the population, are the two
dominant languages (Statistics South Africa, 2012). A comparison of the actual home
language of learners and the LOI by province and language in the Foundation Phase
shows a 61% Siswati and 64% isiZulu match for learners in Mpumalanga. While in
North West 100% of Setswana home language speakers are learning in Setswana as the
LOI (Van der Berg et al., 2020).
4
The majority of schools in South Africa are public (93%) (Department of Basic Education, 2021). Public schools in South
Africa are classified by school Socio-Economic Status, referred to as quintiles. These are not perfectly proportional;
quintile 1 to 3 schools are the poorest constituting 83%of schools overall. Furthermore, quintile 1 to 3 schools are
non-fee paying.
5
Class Act educational services and Molteno Institute for Language and Literacy.
6
Neither program had any specific components aimed at transferring literacy skills across languages.
7
Note that since the curriculum stipulates that teachers should dedicate 78 h to teaching home language, compared to
34 h teaching EFAL. The different amount of time allocated to the targeted language of the two interventions may
have contributed both the main outcomes and transfer.
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS 7
These languages were also the L1 in this study. All three African languages have
transparent orthographies: there is a one-to-one mapping in the graphemephoneme
relationship, unlike English which has an opaque orthography and a more complex
mapping. They are however distinct in their morphology i.e., how words relate to each
other. Two of the languages, isiZulu and Siswati, are part of the Nguni language group
distinguished by their conjunctive morphology: one word may represent a sentence
(Khumalo, 1987). In contrast, Setswana has a disjunctive morphology with short word
segments written separately from suffixes and prefixes (Machobane & Mokitimi, 1998).
For example, the sentence there was a stranger who was very hungryis written as
Kunesihambi esasilambile kakhuluin isiZulu using only three words and Go na le
moeng o a neng a tshwere ke tlala thatain Setswana using twelve words.
The morphological differences in the L1s required careful test development within
each study as well as across the two studies. The most comparable L1 items were the
letter-sound naming, Rapid Object Naming, and Oral Reading Fluency. The one-for-one
letter-sound mapping allowed for a simple design aspect across EGRS I and II, with the
same sequence of letters followed for 70% of the assessments. The differences were in
ensuring that high-frequency lettersless than five letters per languageappeared early
in the assessment. The same items were also used for Rapid Object Naming across the
languages and the object names were not particularly different in length or complexity.
The Oral Reading Fluency passages however were distinct. The passages differed by
length, with shorter isiZulu passages, averaging 59 words for isiZulu and 60 words for
Siswati. The average length for Setswana was 159 words. This was informed by the spe-
cific language structure; we expected learners to read faster in Setswana. The passage
length aligns with the newly developed reading benchmarks for African languages,
which specify 35 words correct a minute for Nguni languages by the end of Grade 3
and 60 words correct a minute for Sesotho-Setswana languages (Mohohlwane et al.,
2022). The passages were piloted and revised to ensure appropriateness as part of the
development.
Experimental Design
The studies were evaluated using a clustered randomized control trial. In each study, we
created 10 strata of 13 schools that were similar in terms of socio-economic status and
exam performance. We then performed stratified random assignment, allocating 50
schools (5 per strata) to the intervention and 80 schools to the control.
8
Previous articles
reporting on the results found that both programs were successful at improving literacy
in the targeted language (Cilliers et al., 2020,2022b).
Data Collection
A data collection service provider visited the sample sites multiple times over the period
of the evaluation, each time collecting detailed data on student learning and teaching
8
The studies also included additional treatment arms, to compare the cost-effectiveness of different modalities of
implementation. We restrict this paper to the treatment arms that are comparable across studies, and were also the
most cost-effective.
8 N. MOHOHLWANE ET AL.
practices (see Table 1). In each study, a random sample of 20 grade 1 students was
sampled and assessed at baseline (before the start of the invention) and tracked over a
period of four years or more. The learner assessments consisted of one-on-one adapted
Early Grade Reading Assessments (EGRA) complemented by an exam-type setting
written assessment. These were administered by trained fieldworkers using electronic
tablets for the one-on-one assessments on the Tangerine or SurveyCTO app. The
assessments consisted of tasks assessing letter recognition, listening comprehension,
word recognition, oral reading fluency, and comprehension as well as written
comprehension.
Table 2 below provides a summary of the learner assessments across the data collec-
tions. While EGRS I and II focused on L1 and L2, respectively, learners were assessed in
both L1 and L2 across the studies. The assessment instruments are most similar in the
round of data collection one year after the completion of the intervention (i.e., when
our sample of non-repeating students was in grade 4). The English assessments are
exactly the same.
9
Although the words included in the home language assessment are
different across studies, because the languages assessed were different, they were each
designed to be similar in difficulty. Section A.1 in the Supplementary Appendix provides
more detail on the assessment instruments.
Data Analysis
Empirical Strategy
We estimate the impacts on each sample of pupils (EGRS I or II) and each grade year
separately, using the following equation:
yicsb ¼b0þb1Treatment
ðÞ
sþX0
icsbCþqbþicsb , (1)
where yicsb is the outcome of interest for student iwho was taught by a teacher in class
c, school s, and stratum b; (Treatment)sis a dummy variable equal to one if the student
was assigned to the treatment group; qbrefers to strata fixed effects; Xicsb is a vector
of controls;
10
and icsb is the error term clustered at the school level.
When conducting mediation analysis, we follow the methods proposed by Imai et al.
(2010) and estimate the following in conjunction with Equation (1):
yicsb ¼c0þc1Treatment
ðÞ
sc1MicsbþX0
icsbCþqbþicsb , (2)
The difference,
^
b1
^
c1, can be interpreted as the causal mediation effect: the impact
on yicsb that can be attributed to improvements in the mediating variable, Micsb:We
treat this analysis as suggestive, given the strong underlying assumptions.
11
9
Eight additional words were added in the word recognition test for EGRS II. We drop these items for our analysis. The
same story was used for Oral Reading Comprehension although the time to administer the task changed from 1 to
3 min. We adjust for this and use only 1 min reading across both studies. Any other differences in the test
administration are also addressed for the analysis.
10
The control variables include the different baseline measures of student home language literacy (phonemic awareness,
letter recognition, etc.), student gender and age, and some measures of school socio-economic status.
11
The strongest assumption is that Micsb is independent of yicsb,conditional on treatment and baseline covariates, X0
icsb:
Even though treatment is random, there might be other factors that cause both Mand y.
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS 9
Table 1. Timelines for the intervention and data collection EGRS I and EGRS II.
2015 2016 2017 2018 2019 2020
EGRS I
Intervention Grade 1 teachers Grade 2 teachers Grade 3 teachers No intervention
Data collection Start and end of the year End of the year No data collection End of the year
EGRS II
Intervention Grade 1 teachers Grade 2 teachers Grade 3 teachers No intervention
Data collection Start and end of the year End of the year End of the year End of the year
10 N. MOHOHLWANE ET AL.
Internal Validity Tests: Balance and Attrition
As a starting point for the analysis, we show in Table A2.1 in the Supplementary
Appendix that, for both studies, the samples are balanced across treatment arms, even
after accounting for attrition. Next, Table A2.2 shows that the attrition rates by the end
of year four28% in each studyare balanced across treatment and control. Moreover,
the coefficient on Attrition Treatmentshows that there is no systematic difference
between those who attrited in the Treatment arm and those who attrite in the Control,
with the exception of age in EGRS I: attriters in the treatment arm are younger relative
to attriters in the control. Taken together, we have confidence that our sample is bal-
anced and that attrition does not bias our results.
Next, we also investigate the similarity of the two samples, by comparing the English
reading proficiency levels of the control students in grade 4, when the assessment
instruments are most comparable across studies. Balance between these two samples is
not necessary for the internal validity of the results but does strengthen the argument
that the differences we observe in effect sizes are due to differences in the language tar-
geted in the intervention, rather than due to treatment heterogeneity. Table 3 shows
that students in the two samples performed similarly in English word recognition and
Oral Reading Fluency (ORF), with the EGRS I sample slightly out-performing the EGRS
II sample. Note that the EGRS II grade 4 sample was assessed during the Covid period,
so there might have been some learning loss.
As a further comparison, Figure 1 shows the proportion of students in the control
groups by grade and study who cannot read a single word, either in L1 or L2. Even after
four years of school, over a fifth of learners cannot read a single word in English; and a
slightly smaller fraction (15 and 20% in EGRS I and II, respectively) could not read a
single word in their home language.
Implementation Quality and Earlier Impacts
Next, we show in Table 4 that the quality of implementation was high and remarkably
similar in both programs. For example, 94 and 95% of treated teachers in ERGS I and
II, respectively, reported receiving training at the beginning of the year; over 90% of
treated teachers in each study reported having access to the graded reading booklets dis-
tributed by the program; and 90% of treated teachers in EGRS I report having the les-
son plans, with 85% of treated teachers in ERGS II reporting to use the lesson plans.
Table 2. Common items of the learner assessments across rounds of data collection.
Grade 2 Grade 3 Grade 4
EGRS I EGRS II EGRS II EGRS I EGRS II
Construct HL EFAL HL EFAL HL EFAL HL EFAL HL EFAL
Letter-sound recognition X X X X
Word reading fluency X X X X X X X
ORF X XXXXXXXX
ORF comprehension X X X X X X X X X
Written comprehension X X X X
HL: home language; EFAL: English as a first additional language; ORF: oral reading fluency.
Notes. Light-grey shaded refer to EGRS I assessment instruments. No data was collected at the end of grade 3 for
EGRS I.
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS 11
Moreover, observed teaching practices improved in both programs, along similar dimen-
sions, which indicates that the programs succeeded in causing the desired instructional
change. For example, data from classroom observations revealed that the proportion of
classes where a pupil reads individually to a teacher increased by 40 and 33 percentage
points in EGRS I and II, respectively. This suggests that differences in the impacts of
the program cannot be attributed to differences in the quality of implementation, or dif-
ferences in teaching practices emphasized by the respective programs.
As further evidence of the quality of implementation, we show in Figure 2 that each
program succeeded in improving the intended literacy outcomes in the targeted lan-
guage.
12
In EGRS I, students improved their home language literacy by 0.15 and 0.25
Table 3. Comparison between EGRS I and II samples in grade 4 English literacy.
(1) (2) t-Test
EGRS 1 EGRS II Difference
Variable Mean/SE Mean/SE (1)(2)
Word recognition 29.412 27.535 1.877
[1.161] [1.020]
Oral reading fluency (ORF) 39.131 36.480 2.652
[1.722] [1.475]
ORF comprehension 0.166 0.230 0.065
[0.010] [0.012]
Written compr. 0.184 0.184 0.000
[0.009] [0.010]
Notes. Grade 4 data, with samples restricted to control group students in each study. The value displayed for t-tests are
the differences in the means across the groups. Standard errors are in square brackets and are clustered at the school
level.  indicates significance at the 1, 5, and 10% critical level.
0.39
0.34
0.22
0.15
0.20
0.23
0.22
0
.1
.2
.3
.4
Proportion of students
Grade 2 (L1) Grade 3 (L1) Grade 4 (L1) Grade 4 (Eng.)
EGRS I EGRS II
Figure 1. Proportion of students cannot read a single word, by grade, language, and sample.
12
The outcomes reported in Figure 2 aggregate scores constructed using principal component analysis, and
standardized to have a control mean of one and standard deviation of zero. See Table 2 for the constituent indicators
12 N. MOHOHLWANE ET AL.
standard deviations, by the end of the first and second years, respectively. EGRS II had
the desired positive impact on both English language and literacy skills, by the end of
the third year. The positive effect on English language skills was already present at the
end of the first year of the program, which is consistent with the fact that English
vocabulary is heavily emphasized in the grade 1 L2 curriculum.
Main Results: Language Transfer
Our main results are reported in Table 5. We focus on grade 4 results when the assess-
ment instruments are most comparable. There is a striking asymmetry in language
transfer, depending on which language is targeted. Targeting the home language caused
positive spillovers onto English literacy (Panel A, columns (3) and (4)), but targeting
English caused a reduction in home language literacy (Panel B, columns (1) and (2)).
For example, EGRS I caused a 9% increase in English ORF, but EGRS II caused an 11%
reduction in home language ORF compared to the control group. Moreover, the inter-
vention targeting home language instruction had a larger impact on English literacy
than the intervention targeting English instruction. Notably, all of these outcomes are
observed one year after the respective programs ended, so they suggest persistence in
learning gains/loss.
Quantile Regressions
Figure 3 shows quantile regression for EGRS II at the end of grade 3the final
year of program implementation. Figure 3a shows that targeting L2 actually had a
Table 4. Implementation quality.
(1) (2)
EGRS I EGRS II
(A) Teacher surveys Mean Mean
Received training beginning of the year 0.94 0.95
Access to graded reading booklets 0.9 0.96
Use graded reading booklets 0.93
Access to lesson plans 0.9
Use lesson plans 0.85
Use lesson plans daily 0.79
(B) Impact on teaching practices Coef./(SE) Coef./(SE)
Group-guided reading 0.378 0.293
(0.157) (0.148)
Pupils read individually to teacher 0.397 0.333
(0.202) (0.121)
Notes. Data in (A) come from teacher surveys and document inspection conducted in the respective studies, each case
restricted to teachers in the treatment arm. Graded reading bookletsand lesson plansare resources provided by the
program. See Table 2 in Cilliers et al. (2020) and Figure 1 in Cilliers et al. (2022b) for more details. Data from (B) come
from classroom observations conducted in a random sample of 40 teachers in each study: 20 teachers in the treatment
and control groups, respectively. Statistics reported are the coefficient of a regression of the dependent variable on
treatment, including strata fixed effects. Standard errors are in parentheses. p<0.01. See Table 6 in Cilliers et al.
(2020) and Table 3 in Cilliers et al. (2022b) for more details.
for the literacy scores. There were no floor effects in home language literacy, but there were floor effects in English
reading proficiency.
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS 13
positive significant effect on L1 letter recognition, for students in the top half of
the performance distribution. This is evidence of positive spillovers in basic decod-
ing skills even though there were negative spillovers in higher-level L1 reading
proficiency. But there are stark inequalities in who benefited or suffered from the
EGRS II intervention. Only students in the top half of the distribution improved
their English literacy skills (Panel B), and only students in the bottom half of the
distribution experienced a reduction in L1 ORF (Panel A).
13
This pattern of result
is not present in EGRS I.
Mediation Analysis
As a final step, we perform mediation analysis on the EGRS I sample, to determine how
much of the improvements in English in grade 4 can be attributed to earlier gains in home
language literacy. We apply the methods proposed by Imai et al. (2010), which allows one
to decompose the overall effect size on English literacy between an indirect effect that
.55
.22
.34
0
.2
.4
.6
.8
Standard Deviations
Year 1 Year 2 Year 3
-.068
.042
.13
-.2
-.1
0
.1
.2
Standard Deviations
Year 1 Year 2 Year 3
(a) EGRS II—English Language Skills (b) EGRS II—English Literacy
.15
.25
0
.1
.2
.3
.4
Standard Deviations
Year 1 Year 2
(c) EGRS I—Home Language Literacy
Figure 2. Treatment effects, by study and year. (a) EGRS IIEnglish Language Skills. (b) EGRS II
English Literacy. (c) EGRS IHome Language Literacy. Notes. Coefficient estimates and 90% confi-
dence intervals for
^
b1, estimated using Equation (1). Separate regressions are run for each study, out-
come, and year. The dependent variables are aggregate scores constructed using principal component
analysis, and standardized to have a control mean of one and standard deviation of zero. See Table 2
for the constituent indicators for the literacy scores. The indicators for English Language are (i) pro-
ductive vocabulary and (ii) English comprehension.
13
Note that there is no effect, positive or negative, for the bottom quintile of students because of floor effects: in both
the treatment and control arms, the bottom fifth of students cannot read a single word in their home language.
14 N. MOHOHLWANE ET AL.
operates through a mediating variable (i.e., improvements in English that are due to
improvements in L1), and a direct effect (i.e., improvements in English that cannot be
attributed to improvements in L1). The estimating equations are shown in Section
Empirical Strategy, and full analyses can be found in Section A.2 in the Supplementary
Appendix.
Results are shown in Table 6. Columns (1) and (2) show the direct and indirect
effects, respectively. The mediating variables are different indicators for home lan-
guage literacy, measured at the end of grade 2. For comparison, Column (3) shows
theoveralleffectoftheprogramonGrade4EnglishORF,restrictingthesampleto
the same learners who were assessed in both grades 2 and 4. These results suggest
that all of the observed gains in English are explained by the earlier gains in home
language literacy. In fact, column (1) suggests that there would have been a negative
impact on English literacy, were it not for the improvements in word recognition,
ORF, or comprehension. We cannot state with certainty which of these different
indicators for home language literacy are most important for the development of
English literacy, because they are all highly correlated with each other and funda-
mentally relate to the same underlying construct.
Discussion and Mechanisms
Many studies have shown correlations between literacy measures in L1 and L2, but have
lacked a way to identify causal relationships between L1 skills and L2 skills. In this art-
icle, we have been able to measure the causal impact of L1 skills on L2 reading out-
comes, and the causal impact of L2 skills on L1 reading outcomes. The experimental
design means that we can rely on an externally caused improvement in one language to
Table 5. Impacts on home language and English literacy at the end of grade 4.
(1) (2) (3) (4)
Home language English
ORF Reading compr. ORF Reading compr.
(A) Improving home language (L1) instruction (EGRS I)
Treatment 7.159 0.058 3.5610.024
(1.972) (0.015) (2.026) (0.013)
Control mean 47.357 0.298 39.131 0.166
Observations 1846 1846 1846 1846
R-squared 0.176 0.163 0.157 0.128
(B) Improving English second language (L2) instruction (EGRS II)
Treatment 2.774 0.0331.151 0.030
(1.024) (0.019) (2.025) (0.017)
Control mean 25.093 0.448 36.480 0.230
Observations 1729 1729 1729 1729
R-squared 0.284 0.220 0.253 0.237
EGRS: early grade reading study; ORF: oral reading fluency.
Notes. Each column in each panel is a separate regression, estimated using Equation (1). (A,B) Use data from the ERGS I
and II, respectively. Data collection took place one year after the program ended, four years after the start of the pro-
gram, when non-repeating students in our sample were in grade 4. The dependent variables in the first two columns
relate to home language literacy; the dependent variables in the remaining columns relate to English literacy. Standard
errors are in parentheses and clustered at the school level. All estimations include strata fixed effects and the following
control variables: different baseline measures of student home language literacy (phonemic awareness, letter recogni-
tion, etc.), student gender and age, and some measures of school socio-economic status, p<0.1 and p<0.01.
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS 15
identify the impact of reading skills in that language on reading skills in another lan-
guage. Moreover, we have two reciprocal experiments allowing us to observe the causal
relationships between L1 and L2 skills in both directions. The close similarity in
research and program design between EGRS 1 and EGRS 2 means that we are able to
rule out many possible reasons for different results between the two experiments, other
than the nature of language transfer between L1 and L2.
Figure 3. Quantile regressions for ERGS II on grade 3 literacy outcomes. (A) Home Language (L1). (a)
Letter Recognition. (b) Oral Reading Fluency. (B) English (L2). (c) Word Recognition. (d) Oral Reading
Fluency. Notes. Quantile regressions for each decile of student performance. In (A) the dependent vari-
ables are home language letter recognition and Oral Reading Fluency (ORF); in (B) the dependent var-
iables are English word recognition and ORF.
Table 6. Mediating effects of grade 2 home language literacy on grade 4 English ORF.
Mediator (M)
(1) (2) (3)
Direct effect
^
b1
^
c1Indirect effect ^
c1Overall effect
^
b1
Letter recognition 0.028 3.785 3.813
Word recognition 2.083 5.896 3.813
ORF 2.203 6.016 3.813
Paragraph compr. 1.486 5.299 3.813
ORF: oral reading fluency.
Notes. The overall effect is estimated using Equation (1). The indirect is measured using equation (2). The direct effect is
the difference between the two.
16 N. MOHOHLWANE ET AL.
Ruling Out Competing Mechanisms
We are able to rule that differences in the quality of program implementation, or spill-
overs in teaching practices or teaching time, explain the results. First, we show in sec-
tion Data Analysis above that the quality of implementation was high and remarkably
similar in both studies. Second, the negative effect on home language literacy in EGRS
II is unlikely due to crowding out of teaching time. We asked teachers at the end of
grade 3 how many hours they dedicate to teaching home language literacy. There was a
small, statistically insignificant decrease of 13 min in the amount of time that treated
teachers reported to spend teaching home language in a week (156 s a day), relative to
a control mean of 7 h. This is unlikely to explain the magnitude of the observed negative
effects. We also do not see any reduction in mathematics, providing further evidence
that crowding out of teaching time does not explain the results.
14
Third, although it is theoretically possible that the improvements in English reading
skills in EGRS I were due to a transfer of teaching skills from one subject to another, it
is unlikely to explain the magnitude of the results, for four reasons. First, if general
teaching practices improved one would expect to see improvements in all the subjects
taught by the treated teachers, but in both EGRS I and II there were no positive spill-
overs in mathematics. Second, these are bundled interventions combining coaching with
the provision of resources, such as lesson plans and reading aids. So even if teachers in
EGRS I improved their general pedagogy, they would have been unable to fully apply
them in the English class without the additional learning aids. Third, positive spillover
would require teachers to be familiar with the differing expectations of the curriculum
for L1 and L2 and be able to navigate through these successfully. Fourth, if generic
improvements in teaching practice prompted by an L1 structured learning program
caused improvement in both L1 and L2 in EGRS 1, then one would also expect it to
apply the other way around in EGRS II, which is not the case.
This combination of evidence leads us to conclude that the mechanism operates
through a transfer of skills at a student level, not a teacher level.
Theoretical Explanations
The results of this study are consistent with the simple view of reading (SVR), which
argues that reading comprehension requires both strong decoding skills and oral
vocabulary skills. A weakness in either will lead to a weakness in reading for meaning.
In the case of EGRS I, the gains in English reading fluency and comprehension are
likely to have been influenced by the improved decoding skills in Setswana that were
transferred to the L2. Most learners had sufficiently high levels of oral language profi-
ciency in L1 and thus improved their word decoding skills in their L1 when teachers
were supported by a structured pedagogical program. The mediation analysis confirms
that almost all of the gains seen in English came from learning to decode in L1. The
findings suggest that all of the SVR assumptions and conditions were met for L1
instruction, and the curriculum was based on correct assumptions.
14
In South Africa one teacher teachers all the subjects at early grade. So, the same grade 1 teacher teaches Home
Language, English and Mathematics.
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS 17
In the case of EGRS II, the focus of L2 was mostly on oral vocabulary, and students
improved their vocabulary skills.
15
However, because L2 teaching did not stress the
teaching of decoding skills, and L1 decoding skills were also weak, there were limited
improvements in reading fluency. This is evidenced by the fact that only the high-per-
forming students improved their L2 reading skills. In other words, only those with a
sufficient grasp of decoding skills as acquired through L1 seem to have benefited from
the L2 intervention, which complemented those decoding skills with improved English
vocabulary. The fact that there was no positive spillover from L2 to L1 reading fluency
and comprehension is also consistent with the SVR since there were limited improve-
ments in L2 decoding skills. There were positive spillovers in L1 letter sound recogni-
tion for the top-performing skills, likely because letter sounds are written in the same
way across both L1 and L2.
The negative impact of EGRS II on L2 ORF and reading comprehension for the stu-
dents in the bottom half of the distribution might be due to the fact that teachers do
not have sufficient knowledge of the orthographic rules for both L1 and L2. As dis-
cussed above, there is a large linguistic distance between indigenous South African lan-
guages and English. EGRS II teachers might have applied the same sequencing of
decoding skillsi.e., the same sounding out syllables and letter blendsthat they
received for L2 to their L1 classes. But this is the wrong starting point, given the differ-
ent orthographic rules in the different languages. This could have confused students
who are already struggling with basic decoding skills. We can only speculate on this
interpretation, and more research is required to fully understand the result.
It is possible that the differences in morphology between the various home languages
in the two studies account for some of our results. In particular, the home languages
spoken in the L2 intervention, Siswati and isiZulu, have a conjunctive morphology,
while the home language spoken in the L1 intervention, Setswana, possesses a disjunct-
ive morphology that is more similar to English. Plausibly a positive transfer of ORF is
easier when the orthographies of the two languages are similar. Consequently, we might
have observed positive (or lack of negative transfer) transfer in ORF from L2 to L1 in
EGRS II if the home language were Setswana.
Nevertheless, three pieces of empirical evidence and theoretical considerations suggest
that the differences in morphology between the home languages are not sufficient to
fully explain the results. Firstly, there is evidence of negative transfer from L2 to L1
ORF. Secondly, the English literacy skills of the control groups in both samples are
remarkably similar. Table 3 demonstrates that there is no statistically significant distinc-
tion between the two samples regarding English ORF at grade 4, and, in fact, the EGRS
II sample performed better in the comprehension test. Thus, the evidence does not sup-
port the notion that the transfer of ORF skills between L1 and L2 is easier when the
home language is Setswana. Thirdly, students tend to develop decoding skills at a slower
pace in English due to the cognitive load of learning both a new language and decoding
skills. This is substantiated by the notable discrepancy in the impact on L1 literacy in
EGRS I compared to the impact on English literacy in EGRS II (refer to Figure 2).
15
As discussed above, the L1 curriculum places a large emphasis on mastering decoding in grade 1, the L2 curriculum
emphasises oral vocabulary. The assumption is that students already have a basic command of the oral vocabulary in
their L1, and that the decoding skills they learn in L1 will transfer to L2.
18 N. MOHOHLWANE ET AL.
Considering the lesser impact on L2 decoding skills, one would anticipate a smaller
transfer of L1 decoding skills as well.
Conclusion
Over the past decade evidence on the impact of structured learning programs has included
contributions from developing countries. However, one critical problem relates to the sub-
ject and language sequencing, and the extent to which intervention designed to improve
instructional practices in one school subject and/or language would transfer or spill over
into other subjects and language. This study examines the question of reciprocal language
transference between L1 and L2 in the African context, taking advantage of two large-scale
randomized evaluations of structured pedagogy programs in South Africa. We have a
unique opportunity to understand the nature of language transfer between L1 and L2, in
both directions, since we have two interventions with the same modality, dosage, and ser-
vice provider, but one targeting L1 and one targeting L2.
We find that in both studies the structured learning program was successful at chang-
ing teaching practice and improving literacy in the targeted language. However, it was
only in the case of the L1 intervention that a positive spillover to L2 was observed.
When the program targeted English as the L2, there were gains in English language and
reading skills, but these gains were modest and concentrated amongst the top half of
the performance distribution. Furthermore, despite some initial positive effects on letter
sound recognition in L1, there were no positive spillovers to L1 reading fluency and
comprehension, and ultimately a negative impact on these L1 reading skills for students
in the bottom half of the performance distribution. The results can at least be partly
explained by, and support, the SVR.
Taken together, these results suggest that decoding skills are best taught in the L1
since children already possess sufficient oral language comprehension. Moreover, decod-
ing skills are more easily transferable across languages with similar orthographies,
whereas oral language skills, such as vocabulary, do not transfer in the same way.
Furthermore, teaching of decoding skills in L2 may worsen studentsdecoding skills in
L1, especially if there is a large orthographic distance between languages and students
have not sufficiently mastered L1 decoding skills.
This has important policy implications for multilingual settings where children do
not enter school with sufficient prior exposure to the L2. First, students should be
taught in their home language, especially in the early grades. Second, programs aimed at
improving early grade reading should not prioritize L2 literacy instruction. Our studies
did not include a program targeted at both L1 and L2, so we do not know whether
such an intervention would be more or less cost-effective. But if resource constraints
mean that governments or implementing organizations can only intervene in one lan-
guage, then L1 should be prioritized.
One caveat is that our results are drawn from two experiments in two different popu-
lations, and not one experiment in one population. Even though the interventions them-
selves were almost exactly equivalent, the different populations might have had different
responses to the treatment. We show in the article that the two provinces are very simi-
lar in terms of socio-economic status and education outcomes, and that both studies
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS 19
sampled the same type of schools. But a key difference is the studentshome language.
Theoretically, the extent of language transferences from L2 to L1 might depend on the
degree of similarity between the two languages. These are only conjectures, of course,
and future studies comparing L1 and L2 interventions within the same language or the
same language group would provide further insights.
Disclosure Statement
No potential conflict of interest was reported by the author(s).
Open Research Statements
Study and Analysis Plan Registration
There is no study and analysis plan registration associated with this manuscript.
Data, Code, and Materials Transparency
The data and code underlying the results reported in this manuscript are openly available in
Harvard Dataverse: https://doi.org/10.7910/DVN/RSUADW.
Design and Analysis Reporting Guidelines
This manuscript is not accompanied by a completed JREE Randomized Trial Checklist.
Transparency Declaration
The lead author (the manuscripts guarantor) affirms that the manuscript is an honest, accurate,
and transparent account of the study being reported; that no important aspects of the study have
been omitted; and that any discrepancies from the study as planned (and, if relevant, registered)
have been explained.
Replication Statement
This manuscript reports an original study.
Open Scholarship
This article has earned the Center for Open Science badge for Open Data. The data are openly
accessible at https://doi.org/10.7910/DVN/RSUADW.
References
Alexander, N. (2005). Language, class and power in post-apartheid South Africa. Harold Wolpe
Memorial Trust Open Dialogue Event.
20 N. MOHOHLWANE ET AL.
Ardington, C., Wills, G., Pretorius, E., Mohohlwane, N., & Menendez, A. (2021). Benchmarking
oral reading fluency in the early grades in Nguni languages. International Journal of
Educational Development,84, 102433. https://doi.org/10.1016/j.ijedudev.2021.102433
Baker, D. L., & Stoolmiller, M. (2011). Effect of reading comprehension on passage fluency in
Spanish and English for second-grade English learners. School Psychology Review,40(3),
331351. https://doi.org/10.1080/02796015.2011.12087702
Ball, J. (2011). Enhancing learning of children from diverse language backgrounds:
Mother tongue-based bilingual or multilingual education in the early years. UNESCO,
Education Sector, 87.
Branum-Martin, L., Mehta, P. D., Fletcher, C. D., Carlson, A., Ortiz, M., Carlo, M., & Francis,
D. J. (2006). Bilingual phonological awareness: Multilevel construct validation among Spanish-
speaking kindergarteners in transitional bilingual education classrooms. Journal of Educational
Psychology,98(1), 170181. https://doi.org/10.1037/0022-0663.98.1.170
Casale, D., & Posel, D. (2011). English language proficiency and earnings in a developing country:
The case of South Africa. The Journal of Socio-Economics,40(4), 385393. https://doi.org/10.
1016/j.socec.2011.04.009
Cilliers, J., Fleisch, B., Kotze, J., Mohohlwane, M., & Taylor, S. (2022a). The challenge of sustain-
ing effective teaching: Spillovers, fade-out, and the cost-effectiveness of teacher development
programs. Economics of Education Review,87, 102215. https://doi.org/10.1016/j.econedurev.
2021.102215
Cilliers, J., Fleisch, B., Kotze, J., Mohohlwane, N., Taylor, S., & Thulare, T. (2022b). Can virtual
replace in-person coaching? Experimental evidence on teacher professional development and
student learning in South Africa. Journal of Development Economics,155, 102815. https://doi.
org/10.1016/j.jdeveco.2021.102815
Cilliers, J., Fleisch, B., Prinsloo, C., & Taylor, S. (2020). How to improve teaching practice?: An
experimental comparison of centralized training and in-classroom coaching. Journal of Human
Resources,55(3), 926962. https://doi.org/10.3368/jhr.55.3.0618-9538R1
Cohen, A. D., & Swain, M. (1976). Bilingual education: The immersionmodel in the North
American context. TESOL Quarterly,10(1), 45. https://doi.org/10.2307/3585938
Collier, V. P., & Thomas, W. (n.d.). How Quickly Can Immigrants Become Proficient in School
English? 11.
Colombo, J. (1982). The critical period concept: Research, methodology, and theoretical issues.
Psychological Bulletin,91(2), 260275. https://doi.org/10.1037/0033-2909.91.2.260
Cummins, J. (1979). Linguistic interdependence and the educational development of bilin-
gual children. Review of Educational Research,49(2), 222251. https://doi.org/10.3102/
00346543049002222
Cummins, J. (1980). The cross-lingual dimensions of language proficiency: Implications for bilin-
gual education and the optimal age issue. TESOL Quarterly,14(2), 175. https://doi.org/10.2307/
3586312
Curriculum and Assessment Policy Statement (2011). Curriculum and assessment policy statement
English home language. Intermediate phase Grade 4-6 Grade 4-6. Department of Basic
Education.
de Galbert, P. G. (2023). Language transfer theory and its policy implications: Exploring inter-
dependence between Luganda, Runyankole-Rukiga, and English in Uganda. Journal of
Multilingual and Multicultural Development,44(1), 119. https://doi.org/10.1080/01434632.
2020.1788038
Department of Basic Education (2021). National Senior Certificate 2020 examination report.
Dutcher, N., & Tucker, R. (1995). The use of first and second languages in education. A review of
international experience [Pacific Island Discussion Paper Series]. World Bank. Retrieved from
http://documents1.worldbank.org/curated/en/131161468770987263/pdf/multi-page.pdf
Eberhard, D. M., Simons, G. F., & Fennig, C. D. (Eds.). (2020). Ethnologue: Languages of the
world (23rd ed.). SIL International.
Feltes, J. M. (2022). La doble inmersi
on en dos lenguas nacionales: Una metodolog
ıa pedag
ogica
para el desarrollo de habilidades de biliteracidad cr
ıtica y el di
alogo intercultural para
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS 21
estudiantes de escuelas primarias ind
ıgenas de M
exico. Universidad Iberoamericana AC.
Retrieved from https://www.scielo.org.mx/pdf/sine/n43/n43a5.pdf
Fleisch, B. (2018). The education triple cocktail: System-wide instructional reform in South Africa
(1st ed.). Juta.
Fleisch, B., Taylor, S., Sch
oer, V., & Mabogoane, T. (2017). Failing to catch up in reading in the
middle years: The findings of the impact evaluation of the Reading Catch-Up Program in
South Africa. International Journal of Educational Development,53,3647. https://doi.org/10.
1016/j.ijedudev.2016.11.008
Giliomee, H. (2004). The rise and possible demise of Afrikaans as public language. Nationalism
and Ethnic Politics,10(1), 2558. https://doi.org/10.1080/13537110490450764
Giliomee, H. (2009). A note on Bantu education, 1953 to 1970. South African Journal of
Economics,77(1), 190198. https://doi.org/10.1111/j.1813-6982.2009.01193.x
Ginkel, A. (2014). Additive language learning for multilingual settings. USAID.
Gordon, S. L., & Harvey, J. (2019). Choice of language in education: Do we know what South
Africans want? Language and Education,33(3), 226243. https://doi.org/10.1080/09500782.
2018.1488865
Goswami, U., Gombert, J. E., & Barrera, L. F. (1998). Childrens orthographic representations and
linguistic transparency: Nonsense word reading in English, French, and Spanish. Applied
Psycholinguistics,19(1), 1952. https://doi.org/10.1017/S0142716400010560
Gough, P. B., & Tunmer, W. E. (1986). Decoding, reading, and reading disability. Remedial and
Special Education,7(1), 610. https://doi.org/10.1177/074193258600700104
Gustafsson, M. (2020a). A revised PIRLS 2011 to 2016 trend for South Africa and the importance
of analysing the underlying microdata [Working Paper of the Department of Economics and
the Bureau for Economic Research]. Stellenbosch University.
Gustafsson, M. (2020b). Teacher demand in South Africa in 2019 and beyond (No. 1).
Department of Higher Education and Training. Retrieved from https://resep.sun.ac.za/wp-con-
tent/uploads/2022/03/DHET-Supply-and-Demand-Report-Phase-1-1.pdf
Hasbrouck, J., & Tindal, G. (2017). An update to compiled ORF norms (Technical No. 1701).
Behavioral Research and Teaching University of Oregon. Retrieved from https://intensiveinter-
vention.org/sites/default/files/TechRpt_1702ORFNorms%20FINAL.pdf
Howie, S., Combrinck, C., Roux, K., Tshele, M., Mokoena, G., & Palane, N. M. (2017). Progress
in International Reading Literacy Study 2016 (p. 220). Centre for Evaluation and Assessment,
Faculty of Education, University of Pretoria.
Imai, K., Keele, L., & Tingley, D. (2010). A general approach to causal mediation analysis.
Psychological Methods,15(4), 309334. https://doi.org/10.1037/a0020761
Khumalo, J. S. M. (1987). An autosegmental account of Zulu Phonology, 82.
Kim, Y.-S G., & Piper, B. (2019). Cross-language transfer of reading skills: An empirical investiga-
tion of bidirectionality and the influence of instructional environments. Reading and Writing,
32(4), 839871. https://doi.org/10.1007/s11145-018-9889-7
Kirkpatrick, A. (2012). English in ASEAN: Implications for regional multilingualism. Journal of
Multilingual and Multicultural Development,33(4), 331344. https://doi.org/10.1080/01434632.
2012.661433
Koda, K., & Reddy, P. (2008). Cross-linguistic transfer in second language reading. Language
Teaching,41(4), 497508. https://doi.org/10.1017/S0261444808005211
Kosonen, K. (2017). Language of instruction in Southeast Asia. Background paper prepared for the
2017/8 Global Education Monitoring Report, Accountability in education: Meeting our
commitments.
Kotze, J., Fleisch, B., & Taylor, S. (2019). Alternative forms of early grade instructional coaching:
Emerging evidence from field experiments in South Africa. International Journal of
Educational Development,66, 203213. https://doi.org/10.1016/j.ijedudev.2018.09.004
Le Cordeur, M. (2013). Afrikaans as medium of instruction within a transformed higher educa-
tion system in South Africa with special reference to Stellenbosch University. In C. C.
Wolhuter (Ed.), Conference Proceedings: Educational Research in South Africa: Practices and
Perspectives,2530 January (pp. 5576). Oxford University Press.
22 N. MOHOHLWANE ET AL.
Lee, H., Jung, G., & Lee, J. H. (2022). Simple view of second language reading: A meta-analytic
structural equation modeling approach. Scientific Studies of Reading,26(6), 585603. https://
doi.org/10.1080/10888438.2022.2087526
Lenneberg, E. (1967). Biological foundations of language (Vol. 13). Wiley. https://doi.org/10.1080/
21548331.1967.11707799
Lenneberg, E. (1969). On explaining language. Science,164(3880), 635643. https://doi.org/10.
1126/science.164.3880.635
Macdonald, C. (1990). Crossing the threshold into standard three.pdf [Threshold Project].
Machobane, M., & Mokitimi, M. (1998). Problems in the development of Sesotho orthography.
In K. K. Prah (Ed.), Between distinction and extinction: The harmonisation and standardisation
of African language (pp. 203212). Wits University Press.
Madadzhe, R. N. (2019). Using African languages at universities in South Africa: The struggle
continues. Stellenbosch Papers in Linguistics Plus,58, 205218. https://doi.org/10.5842/58-0-843
Melby-Lervåg, M., & Lervåg, A. (2011). Cross-linguistic transfer of oral language, decoding,
phonological awareness and reading comprehension: A meta-analysis of the correlational evi-
dence. Journal of Research in Reading,34(1), 114135. https://doi.org/10.1111/j.1467-9817.2010.
01477.x
Mohohlwane, N. L. (2019). How language policy and practice sustains inequality in education. In
South African Schooling: The enigma of inequality:A study of the present situation and future
possibilities (pp. 127146).
Mohohlwane, N., Wills, G., & Ardington, C. (2022). A review of recent efforts to benchmark
early reading skills in south African languages. In Early grade reading in South Africa (Vol. 1,
pp. 83108). Oxford University Press.
Nakamura, P. R., De Hoop, T., & Holla, C. U. (2019). Language and the learning crisis: Evidence
of transfer threshold mechanisms in multilingual reading in South India. The Journal of
Development Studies,55(11), 22872305. https://doi.org/10.1080/00220388.2018.1493192
Ngcobo, M. (2009). The politics of compromise and language planning: The case of South Africa.
Language Matters,40(2), 205214. https://doi.org/10.1080/10228190903188575
Nudelman, C. (2015). [Language in South Africas higher education transformation: A study of lan-
guage policies at four universities] [Masters]. University of Cape Town.
Ouane, A., & Glanz, C. (2010). Why and how Africa should invest in African languages and multi-
lingual education: An evidence- and practice-based policy advocacy brief. UNESCO Institute for
Lifelong Learning.
Padilla, A. M., Fairchild, H. H., & Valadez, C. M. (Eds.). (1990). Bilingual education: Issues and
strategies. Sage Publications.
Parkin, M., Morrison, F. C., & Watkin, G. (1987). French immersion research relevant to decisions
in Ontario. Ministry of Education: Publications Sales, Ontario Institute for Studies in
Education.
Piper, B., Zuilkowski, S. S., Kwayumba, D., & Oyanga, A. (2018). Examining the secondary effects
of mother-tongue literacy instruction in Kenya: Impacts on student learning in English,
Kiswahili, and mathematics. International Journal of Educational Development,59, 110127.
https://doi.org/10.1016/j.ijedudev.2017.10.002
Prah, K. K., & Brock-Utne, B. (2009). Multilingualism: An African advantage: A paradigm shift in
African language of instruction policies. Centre for Advanced Studies of African Society.
Quinn, J. M., & Wagner, R. K. (2018). Using meta-analytic structural equation modeling to study
developmental change in relations between language and literacy. Child Development,89(6),
19561969. https://doi.org/10.1111/cdev.13049
Rodriguez-Segura, D. (2022). A closer look at reading comprehension: Experimental evidence
from Guatemala. International Journal of Educational Development,93, 102630. https://doi.org/
10.1016/j.ijedudev.2022.102630
Schaefer, M., & Kotz
e, J. (2019). Early reading skills related to Grade 1 English Second Language
literacy in rural South African schools. South African Journal of Childhood Education,9(1), 1
13. https://doi.org/10.4102/sajce.v9i1.644
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS 23
Snow, C. E., & Hoefnagel-H
ohle, M. (1977). Age differences in the pronunciation of foreign
sounds. Language and Speech,20(4), 357365. https://doi.org/10.1177/002383097702000407
South African Broadcasting Services (2020). South African Broadcasting Services Annual Report
2020 (p. 172).
South African School Act, 1996 (Act No 84 of 1996) (2022). Amended National Norms and
Standards for School Funding, Pub. L. No. 1730, 45878.
Spires, H. A., & Donley, J. (1998). Prior knowledge activation: Inducing engagement with infor-
mational texts. Journal of Educational Psychology,90(2), 249260. https://doi.org/10.1037/0022-
0663.90.2.249
Statistics South Africa (2012). Census 2011: Census in brief.
Takakuwa, M. (2005). Lessons from a paradoxical hypothesis: A methodological critique of the
threshold hypothesis, 12.
UNESCO (2003). Education in a multilingual world: UNESCO education position paper (p. 35).
Van der Berg, S., Gustafsson, M., & Burger, C. (2020). School teacher supply and demand in
South Africa in 2019 and beyond (No. 1). Department of Higher Education and Training.
https://resep.sun.ac.za/wp-content/uploads/2022/03/DHET-Supply-and-Demand-Report-Phase-
1-1.pdf
van Staden, S., & Bosker, R. (2014). Factors that affect South African Reading Literacy
Achievement: Evidence from prePIRLS 2011. South African Journal of Education,34(3), 19.
https://doi.org/10.15700/201409161059
Veii, K., & Everatt, J. (2005). Predictors of reading among HereroEnglish bilingual Namibian
school children. Bilingualism: Language and Cognition,8(3), 239254. https://doi.org/10.1017/
S1366728905002282
Walter, S. (2010). Mother tongue-based education in developing countries: Some emerging
insights, 26.
Walter, S. L., & Benson, C. (2012). Language policy and medium of instruction in formal educa-
tion. In B. Spolsky (Ed.), The Cambridge handbook of language policy (1st ed., pp. 278300).
Cambridge University Press. https://doi.org/10.1017/CBO9780511979026.017
Wang, M., Park, Y., & Lee, K. R. (2006). Korean-English biliteracy acquisition: Cross-language
phonological and orthographic transfer. Journal of Educational Psychology,98(1), 148158.
https://doi.org/10.1037/0022-0663.98.1.148
Wang, M., Yang, C., & Cheng, C. (2009). The contributions of phonology, orthography, and
morphology in ChineseEnglish biliteracy acquisition. Applied Psycholinguistics,30(2), 291314.
https://doi.org/10.1017/S0142716409090122
Wawire, B. A., & Kim, Y.-S G. (2018). Cross-language transfer of phonological awareness and let-
ter knowledge: Causal evidence and nature of transfer. Scientific Studies of Reading,22(6), 443
461. https://doi.org/10.1080/10888438.2018.1474882
Wright, L. (2002). Language as a resourcein South Africa: The economic life of language
in a globalising society. English Academy Review,19(1), 219. https://doi.org/10.1080/
10131750285310031
24 N. MOHOHLWANE ET AL.
... The largest body of evidence on language transfer has noted that language structure knowledge, phonemic awareness, and mastery of decoding in letter and word reading in the first language may spill over to a second language if certain conditions are met (Branum-Martin et al., 2006;Commissaire et al., 2011;Koda & Reddy, 2008). Emerging evidence from South Africa and Kenya on transfer between an indigenous home language and English confirms the same (Mohohlwane et al., 2023;Probert & De Vos, 2016). ...
... Crucially, the evidence demonstrates that the impact disproportionally affects the children who are most at risk of low educational outcomes and economic and cultural marginalisation. For example, Mohohlwane et al (2023) show that learning to read in English, rather than a home language, leads to particularly poor literacy outcomes for the children that are most at risk of low achievement. Similarly, there is evidence that those with better access to English outside of the classroom perform better in English Medium Education, evidence that broadly maps onto wider socio-economic structures such as rates of rurality and poverty (Fleisch, 2008;Benson and Wong, 2017). ...
... Crucially, the evidence demonstrates that the impact disproportionally affects the children who are most at risk of low educational outcomes and economic and cultural marginalisation. For example, Mohohlwane et al (2023) show that learning to read in English, rather than a home language, leads to particularly poor literacy outcomes for the children that are most at risk of low achievement. Similarly, there is evidence that those with better access to English outside of the classroom perform better in English Medium Education, evidence that broadly maps onto wider socio-economic structures such as rates of rurality and poverty (Fleisch, 2008;Benson and Wong, 2017). ...
Article
Full-text available
This paper explores how Ugandan secondary school learners experience schooling in English-medium schools where the use of English only is strictly enforced. We conceptualise the ways that the learners sit at the intersection of direct, systemic and cultural violence that in turn impacts their educational experiences. We particularly focus on instances of direct violence through corporal punishment, and the ways that such violence, and associated fear, are part of many learners’ everyday schooling experiences. We demonstrate this through presentation of findings from thematic analysis of individual and focus group interviews with 64 learners at two public and two private secondary schools in the Amuru and Kitgum districts of Northern Uganda. Our conclusions advocate for greater attention to be paid to the ways that changes to enforced English-only policies could support more positive well-being and educational outcomes.
... Further, studies by Edward and Shukia (2021) and Ndijuye and Beatus (2022) established that learning of reading skills among early grades was affected by pupils' mother tongue. It should be noted that a number of studies suggest that in teaching reading skills to early grades, pupils' cultural and linguistic diversities should be considered to facilitate learning of Kiswahili reading skills (Agbevivi, 2022;Mohohlwane et al., 2023;Serede & Mwoma, 2022). On the absence of PPE among grade one pupils, these findings corroborate those of Mabagala and Shukia (2019); Ndijuye et al., (2020); Ndijuye and Beatus, (2022); Serede and Mwoma, (2022). ...
Article
Research has consistently pointed out the important role played by phonemic awareness and alphabet knowledge in development of reading skills among pupils. Phonemic awareness and alphabet knowledge are good predictors in reading competencies in early grades and higher levels of primary education. This study aims at exploring the constraints facing teaching of Kiswahili phonemic awareness and alphabet knowledge in grade one. The study was qualitative in nature in which phenomenology design was employed. The purposive sampling technique was used to recruit ten grade one teachers and ten head teachers from ten public primary schools in Chemba district. Data were collected through semi-structured interviews. The collected data from teachers and head teachers were thematically analyzed. The research findings indicated that there were variations of the views among teachers and head teachers on the impediments in teaching phonemic awareness and alphabet knowledge in grade one. The prominent mentioned challenges were truancy, mother tongue effect, parents’ limited knowledge. It was recommended that teachers should collaboratively work with parents; revisiting of language policies to incorporate mother tongue in early grades is crucial; and attendance to PPE should be taken into account by the educational stakeholders.
... Studies show that many countries prioritize national or official languages (second language) as the medium of instruction, often not the languages children speak at home (Kosonen, 2017).Nonetheless, a negative impact on learning is demonstrated to exist when home and school languages diverge, according to UNESCO (2016).A study conducted in 2010 by SACMEQ III data found a positive correlation between children's achievement, particularly in reading, and the use of the language of instruction (Trudell, 2016). Moreover, reading skills are best enhanced by using the mother language (Mohohlwane, Taylor, Cilliers & Fleisch, 2023). Within the framework of this research, the simultaneous use of Kiswahili and the mother tongue for learning results in inadequate teacher-child interaction. ...
Article
Full-text available
Letter Name Knowledge is among the most vital emergent literacy skills that predict future reading and writing among pre-primary children, and teachers are central to learning. Much has been researched on the factors influencing letter name acquisition, including the child's characteristics in the home and school environment. Less research has been done on pre-primary teachers' views on the factors they encounter in enhancing letter name skills in children. This study investigated pre-primary teachers' challenges in enhancing letter-name knowledge among pre-primary learners in the Shinyanga District Council, Shinyanga Region. The study identified challenges pre-primary teachers encounter in enhancing letter-name knowledge. The study also assessed the challenges pre-primary teachers face in enhancing the knowledge of letter names for pre-primary children with the guidance of the Whole-Child Approach. A qualitative approach and phenomenological design were utilised for the study.20 (to the point of saturation) pre-primary teachers were involved in the interview for data collection. The obtained data were analyzed thematically. The findings identified the following challenges: pre-primary children's use of mother tongue, inadequate teaching and learning facilities and instructional materials, lack of teachers' professionalism, large class size and instructional burden, children absenteeism and implementation of pre-primary curriculum. In conclusion, the identified challenges influence pre-primary teachers' effectiveness in enhancing letter name knowledge acquisition for public pre-primary children in the Shinyanga region. The study recommends that the Ministry of Science and Technology (MoEST) create a mother tongue policy for pre-primary children for quality, fair and holistic comprehensive curricula provision in rural areas.
Article
This research explores structural relations among the component skills of reading comprehension in Kiswahili. Furthermore, the study examines the relationship between socio‐economic status, home and school language use, and home literacy environment with Kiswahili reading outcomes. The study utilized secondary data from the baseline Tusome Literacy activity implemented in Kenya at scale from 2015 to 2022 by USAID, Research Triangle Institute in collaboration with the Ministry of Education Kenya and other partners. A three‐stage stratified sampling procedure was used to randomly select the schools and students from a sample frame compiled from multiple education databases of public formal and non‐formal schools in Kenya. The final sample comprised 4886 grade 1 and 2 learners who completed a battery of early grade literacy assessment in Kiswahili and a survey of the socio‐economic status (SES), home literacy environment (HLE), and school and home language use. We conducted a regression analysis to examine structural relations among the component skills of reading comprehension and the relationships between the SES, HLE, and early literacy skills. The findings indicate that the component skills are interconnected with the sub‐lexical skills, serving as the building block for the higher‐order skills. Letter sound knowledge, text reading fluency, and listening comprehension predict reading comprehension. Reading stories at home, reading aloud, and silent reading practice at school significantly influences reading outcomes. The mismatch between home and school language and low SES negatively impacts reading outcomes. These findings indicate that systematic and explicit instruction is critical in acquiring literacy skills, particularly for learners from disadvantaged backgrounds.
Preprint
Full-text available
This paper addresses the situation in which treatment effects are reported using educational or psychological outcome measures comprised of multiple questions or ``items.'' A distinction is made between a treatment effect on the construct being measured, which is referred to as impact, and item-specific treatment effects that are not due to impact, which are referred to as differential item functioning (DIF). By definition, impact generalizes to other measures of the same construct (i.e., measures that use different items), while DIF is dependent upon the specific items that make up the outcome measure. To distinguish these two cases, two estimators of impact are compared: an estimator that naively aggregates over items, and a less efficient one that is highly robust to DIF. The null hypothesis that both are consistent estimators of the true treatment impact leads to a Hausman-like specification test of whether the naive estimate is affected by item-level variation that would not be expected to generalize beyond the specific outcome measure used. The performance of the test is illustrated with simulation studies and a re-analysis of 34 item-level datasets from 22 randomized evaluations of educational interventions. In the empirical example, the dependence of reported effect sizes on the type of outcome measure (researcher-developed or independently developed) was substantially reduced after accounting for DIF. Implications for the ongoing debate about the role of researcher-developed assessments in education sciences are discussed.
Article
Full-text available
Reviews the concept of "critical periods" in postnatal behavioral development. Evidence on the criteria and characteristics of critical period phenomena is considered with respect to endogenous and exogenous influences; methodology of critical period research is described and evaluated; and conceptual issues and problems are discussed in light of past attempts at subclassification of the field and recovery of function as a refutation of the critical period hypothesis. It is concluded that the critical period concept is viable if certain limitations are observed. (3½ p ref)
Article
Full-text available
Purpose The present study aimed to systemically summarize the structural relationships among correlated components of second language (L2) reading comprehension to investigate the extent to which the two major components – language comprehension abilities and decoding skills – could account for reading comprehension in L2 contexts in accordance with the model of Simple View of Reading. Method We used a meta-analytic structural equation modeling. This study included 81 samples (from 67 studies) including 10,526 participants, and the collected dataset successfully fitted the proposed model of Simple View of L2 Reading. Results L2 comprehension abilities and L2 decoding skills accounted for over 60% of the variation in L2 reading comprehension, with the former having a larger contribution. Considering age and L2 proficiency as moderator variables, it was revealed that L2 decoding skills played less important roles for more proficient and older learners, whereas L2 comprehension abilities maintained their importance across different ages and L2 proficiency levels. The moderators related to language differences between learners’ first language and L2 did not show significant moderating effects. Conclusion The study presented acceptable model fit indices for its models. Future studies can incorporate more pooled correlation coefficients and variables to investigate an effective instruction for L2 reading.
Article
Full-text available
Virtual communication holds the promise of enabling low-cost professional development at scale, but the benefits of in-person interaction might be difficult to replicate. We report on an experiment in South Africa comparing on-site with virtual coaching of public primary school teachers. After three years, on-site coaching improved students’ English oral language and reading proficiency (0.31 and 0.13 SD, respectively). Virtual coaching had a smaller impact on English oral language proficiency (0.12 SD), no impact on English reading proficiency, and an unintended negative effect on home language literacy. The top-performing students consistently benefited most. Classroom observations show that on-site coaching improved teaching practices, while virtual coaching led to larger crowding-out of home language teaching time. Implementation and survey data suggest technology itself was not a barrier to implementation, but rather that in-person contact enabled more accountability and support.
Article
Full-text available
To prevent children from falling behind in the developmental sequence of reading, a shared vision of what reading success looks like is required. This paper provides the first benchmarks for early grade oral reading fluency that are necessary (albeit not sufficient) to read for meaning in three Nguni languages – isiZulu, isiXhosa and Siswati - belonging to the Southern Bantu family of African languages. In contrast with previous benchmarking methodologies, our approach is informed by a non-parametric analysis of longitudinal early grade reading assessment (EGRA) data, guided by reading development theory. The EGRA-type data used for this analysis is the largest compilation of data on early grade fluency in these languages, with comparative assessments for nearly 14,200 children. Analysing empirical regularities and reading trajectories, we identify a lower fluency threshold of 20 correct words per minute (cwpm) and an upper fluency benchmark of 35 cwpm for the early grades. These benchmarks contribute to guiding curriculum policy, provide specificity to improve tracking of literacy progress and address gaps in the literature on reading in African languages.
Article
Full-text available
Both the advent of democracy in 1994 and the adoption of the Constitution of the Republic of South Africa in 1996 kindled hope that ultimately official African languages, in addition to English and Afrikaans, would soon be utilised as languages of teaching and learning throughout the education sector of South Africa. However, in spite of government efforts and significant measures assumed by both private and public institutions to promote the use of African languages, this article reveals that the use of African languages in higher education still leaves much to be desired. This article presents a variety of causes for this state of affairs such as globalisation, economic factors, negative attitudes towards African languages and a lack of will or confidence by both students and university officials to take the plunge in using African languages in teaching and learning. Furthermore, developments in the country around issues such as #RhodesMustFall, decolonisation and Africanisation of higher education curricula, as well as the imminent introduction of the Revised Language Policy for Higher Education in 2019 make it imperative to make a reappraisal of the possibility of utilising African languages at universities in South Africa. Finally, the article argues that it is high time to walk the talk because debating the relevance of African languages in teaching and learning at universities in South Africa cannot take place indefinitely. Indeed, it has to come to a stop somewhere considering that for the past 50 years, scholars have been debating the aptness of African languages in education in general. The present analysis hinges on two theoretical frameworks, that is, Sociocultural theory and Afrocentricity.
Book
The education triple cocktail brings together rigorous quantitative and qualitative research on a new approach to improving foundational teaching and learning for schoolchildren living in working-class, poor and remote rural communities in resource-constrained systems like South Africa. At the core of this book is the theory and evidence for a powerful, new, interlocking and mutually reinforcing change model. Inspired by the AIDS treatment story, the approach brings together structured daily lesson plans, appropriate and high-quality educational materials, and one-on-one instructional coaching to help teachers transform their instructional practices in early grade classrooms and thereby improve learning outcomes. For education systems defined by low levels of early grade learning and profoundly unequal outcomes, The education triple cocktail offers a theoretically informed, evidence-based way forward.
Article
In spite of the relatively high literacy rates around the world, reading comprehension outcomes remain weak. Reading comprehension is a key foundational skill to progress into higher educational levels, and to later on reap the economic and educational benefits of literacy. However, the current literature in developing countries has focused more on emergent literacy skills than on reading comprehension and the developmental processes through which it improves. This paper provides two key contributions to the literature on reading comprehension in developing countries. First, I provide suggestive experimental evidence that an intervention in public primary schools in Tecpán, Guatemala, which provides teacher training, coaching on the delivery of a new and evidence-based instructional approach, and high-quality reading materials, was effective at improving reading comprehension levels, although the effects were mostly concentrated among first graders. Secondly, I leverage the early literacy theory of the “Simple View of Reading”, to empirically test hypotheses about the developmental processes through which reading comprehension improved in this context. In all, these results have important implications for reading interventions in developing countries, as they highlight that reading comprehension is a multi-layered developmental process that requires special attention to each student’s gaps in the building blocks of literacy.
Article
The cost-effectiveness of human capital investments depends on their sustained impacts on productivity. We test for this in a randomized evaluation of two teacher professional development programs—Coaching and Training—aimed at improving the teaching of early-grade reading in South Africa. One year after participating in the programs, teachers in both programs retained knowledge and continue using the resources provided by the programs. However, only teachers who received Coaching maintained improved teaching techniques. Moreover, the magnitude of the effects on learning for students taught by teachers one year after program participation—0.11 and 0.19 standard deviations for Training and Coaching, respectively are roughly half the size relative to the first cohort. Given conservative assumptions, we estimate that Training and Coaching are 44 and 55 percent more cost-effective, when considering gains to future cohorts. These results demonstrate that current estimates of the cost-effectiveness of teacher professional development programs are likely under-estimated. But they also suggest that more resources should be dedicated to sustaining initial gains.
Article
The aim of the current study is to expand our understanding of cross-linguistic transfer (CLT) to new languages and settings under-represented in the research literature. Empirical evidence of CLT is almost exclusively demonstrated in studies examining European and Asian languages in high-income countries. Literacy data were collected from 3561 second-grade students in one of two languages in Uganda – Luganda and Runyankole-Rukiga – and English. Structural equation modelling was used to test a latent construct of alphabetical knowledge and a path model of bilingual reading comprehension. Findings suggest that second-grade students transfer decoding and reading comprehension skills from their first to second language, and initial evidence that the interdependence varies according to the language used in the classroom. Implications for language-in-education policies are discussed.