James S. Kim

Harvard University | Harvard · Harvard Graduate School of Education

In a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the hand-coded scores as a measured outcome. This process...

The purpose of the study was to explore the extent of first-grade children’s academic vocabulary usage in writing. We additionally investigated the extent to which children who used more academic words tended to write compositions that reflected more phonologically and orthographically unique words and/or words with greater semantic challenge. The...

Analyses that reveal how treatment effects vary allow researchers, practitioners, and policymakers to better understand the efficacy of educational interventions. In practice, however, standard statistical methods for addressing heterogeneous treatment effects (HTE) fail to address the HTE that may exist within outcome measures. In this study, we p...

The current study aimed to explore the COVID-19 impact on reading achievement growth by Grade 3–5 students in a large urban school district in the U.S. and whether the impact differed by students’ demographic characteristics and instructional modality. Specifically, using administrative data from the school district, we investigated to what extent...

To make progress in improving students’ reading comprehension, we need to rethink the very nature of reading comprehension — it’s not a skill and it requires background knowledge. James Kim and Mary Burkhauser explain that, to help students apply what they learn from one reading task to another reading task, educators should consider developing the...

We developed a sustained content literacy intervention that emphasized building domain and topic knowledge from Grade 1 to Grade 2 and evaluated transfer effects on students’ reading comprehension outcomes. The Model of Reading Engagement (MORE) intervention emphasizes thematic lessons that provide an intellectual framework for helping students con...

Parental text messaging interventions are growing in popularity to encourage at-home reading, school-attendance, and other educational behaviors. These interventions, which often combine multiple components, frequently demonstrate varying amounts of effectiveness, and researchers often cannot determine how individual components work alone or in com...

This experimental study aimed to replicate and extend a previous efficacy study of an elementary grade content literacy intervention that demonstrated positive effects on students’ vocabulary knowledge depth, argumentative writing, and reading comprehension. Using a cluster (school) randomized trial design, this replication experiment was conducted...

Thousands of educational apps are available to students, teachers, and parents, yet research on their effectiveness is limited. This meta-analysis synthesized findings from 36 intervention studies and 285 effect sizes evaluating the effectiveness of edu- cational apps for preschool to Grade 3 children and the moderating role of methodological, part...

This study examined teachers’ spontaneous low-level comprehension questions teachers in script- supported informational read alouds, with a secondary analysis on the relationship between low- and high-level comprehension questions. Participants came from a predetermined subsample of 34 teachers and 824 third-grade students. Results revealed notable...

This study investigated the effectiveness of the Model of Reading Engagement (MORE), a content literacy intervention, on first graders’ science domain knowledge, reading engagement, and reading comprehension. The MORE intervention emphasizes the role of domain knowledge and reading engagement in supporting reading comprehension. MORE lessons includ...

Why, when so many educational interventions demonstrate positive impact in tightly controlled efficacy trials, are null results common in follow-up effectiveness trials? Using case studies from literacy, this article suggests that replication failure can surface hidden moderators—contextual differences between an efficacy and an effectiveness trial...

With a sample of 7,752 fourth- to seventh-grade students in 25 schools which were randomized at the school level to condition, this article reports experimental impacts of an enhanced version of Word Generation on student outcomes at the end of Year 1 and of Year 2. Word Generation employs analysis, synthesis, critique, and problem-solving activiti...

This study employs a sequential multiple assignment randomized trial (SMART) design to develop an adaptive intervention with personalized print and digital content for kindergarten to Grade 2 children (n = 273). In Stage 1, we ask whether it is better for children to receive an adaptive intervention based on (a) 10 conceptually coherent texts or (b...

This study assesses whether oral retellings of a narrative and informational text during the summer following third grade predicted performance on reading comprehension in the fall of fourth grade. To assess comprehension of a narrative and an informational text, 52 teachers called 117 third-grade students over the summer and asked them to provide...

The present study examined potential synergistic relationships between reading engagement and reading comprehension among 3,689 third and fourth graders across 59 schools in North Carolina. Using hierarchical regression analyses, we replicated previous findings that reading engagement explains unique variance in reading comprehension. Our results i...

Children’s motivation to read is a strong predictor of their reading comprehension. However, some recent research has suggested that the relationship between reading motivation and reading comprehension may be mediated through the amount that students read. This study attempts a conceptual replication of several existing models that explore the rel...

Book retelling has been frequently used as an indicator of children’s reading proficiency. However, how children’s performance varies across retelling narrative and expository texts and whether that has different implications for reading proficiency remains understudied. The present study examined 85 high-poverty second- and third-graders’ retellin...

Theory and empirical work suggest that teachers’ social capital influences school improvement efforts. Social ties are prerequisite for social capital, yet little causal evidence exists on how malleable factors, such as instructional management approaches, affect teachers’ ties. In this cluster-randomized trial, we apply a decision-making perspecti...

In a common approach for scaling up effective educational practice, schools adopt evidence-based programs to be implemented with fidelity. An alternative approach assumes that programs should be adapted to local contexts. In this randomized trial of a reading intervention, we study a scaffolded sequence of implementation, in which schools first dev...

This qualitative study investigated the ways in which 84 parents from predominantly low-income communities described supporting their third graders’ reading skills, motivation, and habits. Thematic analysis of open-ended parent interviews indicated that parents actively and deliberately scaffolded their children’s progress toward developing indepen...

The authors conducted a cluster-randomized trial to examine the effectiveness of structured teacher adaptations to the implementation of an evidence-based summer literacy program that provided students with (a) books matched to their reading level and interests and (b) teacher scaffolding for summer reading in the form of end-of-year comprehension...

Policymakers and economists have expressed support for the use of incentives in educational settings. In this paper, rather than asking whether incentives work, we focus on a different question: For whom and under what conditions do incentives work? This question is particularly important because incentives’ promise relies on the idea that they mig...

Research has found that peers influence the academic achievement of children. However, the mechanisms through which peers matter remain underexplored. The present study examined the relationship between peers' reading skills and children's own reading skills among 4,215 total second- and third-graders in 294 classrooms across 41 schools. One innova...

This study examined the efficacy of a supplemental, multicomponent adolescent reading intervention for middle school students who scored below proficient on a state literacy assessment. Using a within-school experimental design, the authors randomly assigned 483 students in grades 6–8 to a business-as-usual control condition or to the Strategic Ado...

Prior research suggests that summer learning loss among low-income children contributes to income-based gaps in achievement and educational attainment. We present results from a randomized experiment of a summer mathematics program conducted in a large, high-poverty urban public school district. Children in the third to ninth grade (N = 263) were r...

To improve the reading comprehension outcomes of children in high poverty schools, policymakers need to identify reading interventions that show promise of effectiveness at scale. This study evaluated the effectiveness of a low-cost and large-scale summer reading intervention that provided comprehension lessons at the end of the school year and sti...

This study examines the effects of four types of reading comprehension questions – immediate, non-immediate, summary, and unanswerable questions – that linguistically diverse and predominantly low-income parents asked their fourth graders on children’s text retellings. One-hundred-twenty (N = 120) parent and child dyads participated in a home visit...

There are large gaps in reading skills by family income among school-aged children in the United States. Correlational evidence suggests that reading skills are strongly related to the amount of reading students do outside of school. Experimental evidence testing whether this relationship is causal is lacking. We report the results from a randomize...

A randomized trial involving 19 elementary schools (K–5) was conducted to replicate and extend two previous experimental studies of the effects of a voluntary summer reading program that provided (a) books matched to students’ reading levels and interests and (b) teacher scaffolding in the form of end-of-year comprehension lessons. Matched schools...

This meta-analysis reviewed research on summer reading interventions conducted in the United States and Canada from 1998 to 2011. The synthesis included 41 classroom- and home-based summer reading interventions involving children from kindergarten to Grade 8. Compared to control group children, children who participated in classroom interventions,...

In this study, 72 secondary English teachers from the Santa Ana Unified School District were randomly assigned to participate in the Pathway Project, a cognitive strategies approach to teaching interpretive reading and analytical writing, or to a control condition involving typical district training focusing on teaching content from the textbook. P...

This study reports Year 1 findings from a multisite cluster randomized controlled trial of a cognitive strategies approach to teaching text-based analytical writing for mainstreamed Latino English language learners (ELLs) in 9 middle schools and 6 high schools. There were 103 English teachers stratified by school and grade and then randomly assigne...

The authors describe an independent evaluation of the READ 180 Enterprise intervention designed by Scholastic, Inc. Despite widespread use of the program with upper elementary through high school students, there is limited empirical evidence to support its effectiveness. In this randomized controlled trial involving 312 students enrolled in an afte...

A 2008 experiment suggests that a summer books program, when combined with teacher scaffolding lessons and parent support, can significantly improve the reading achievement of low-income children. However, just giving student books to read did not improve achievement. By having teachers provide end-of-year lessons in reading comprehension and fluen...

The purpose of this study was (1) to examine the causal effects of READ 180, a mixed-methods literacy intervention, on measures of word reading efficiency, reading comprehension and vocabulary, and oral reading fluency and (2) to examine whether print exposure among children in the experimental condition explained variance in posttest reading score...

Randomized field trials were used to examine the impact of the Teacher Study Group (TSG), a professional development model, on first grade teachers’ reading comprehension and vocabulary instruction, their knowledge of these areas, and the comprehension and vocabulary achievement of their students. The multisite study was conducted in three large ur...

The effects of a voluntary summer reading intervention with and without a parent training component were evaluated with a sample of low-income Latino children from language minority families. During the last month of 4th grade, 370 children were pretested on a measure of reading comprehension and vocabulary and were randomly assigned to (a) a treat...

The authors designed and implemented a voluntary reading program that was intended to reduce loss in reading achievement over the summer months, particularly for low‐income and ethnic minority children. The program had two major components: providing eight books that were well matched to each child's reading level and interests end‐of‐year lessons...

The effects of a voluntary summer reading intervention with teacher and parent scaffolding were investigated in an experimental study. A total of 24 teachers and 400 children in Grades 3, 4, and 5 were randomly assigned to one of four experimental conditions: control, books only, books with oral reading scaffolding, and books with oral reading and...

Mr. Kim looks back at the troubled history of the relationship between research and practice in the area of early reading instruction. From it he draws valuable lessons about improving the relationship between educational research and practice in general.

The causal effects of a voluntary summer reading intervention on children's reading activities and reading achievement were assessed in a randomized experiment involving 331 children in Grades 1-5. Children were pretested in the spring on a standardized test of reading achievement (Stanford Achievement Test, 10th ed.), on the Elementary Reading Att...

The federal No Child Left Behind Act of 2001 (NCLB) expanded the federal role in American education, and by doing so altered the distribution of power among the federal government, states, and local districts. When the law was enacted, it was unclear how this change in the distribution of power would play itself out. This study examines the develop...

The federal No Child Left Behind Act of 2001 (NCLB) expanded the federal role in American education, and by doing so altered the distribution of power among the federal government, states, and local districts. When the law was enacted, it was unclear how this change in the distribution of power would play itself out. This study examines the develop...

The effects of a voluntary summer reading intervention were assessed in a randomized field trial involving 552 students in 10 schools. In this study, fourth-grade children received eight books to read during their summer vacation and were encouraged by their teachers to practice oral reading at home with a family member and to use comprehension str...

Under the No Child Left Behind (NCLB) Act, every school is subject to the controversial mandates for annual test score gains contained in the federal law. The law represents a profound change in the relationship between the federal government and state and local education agencies regarding who controls education and has direct implications for wha...

Under the No Child Left Behind Act (NCLB), every school is subject to the controversial mandates for annual test score gains contained in the federal law. The law represents a profound change in the relationship between the federal government and state and local education agencies regarding who controls education and has direct implications for wha...

Social science research suggests that reducing class size has its largest effects on the achievement of minority and inner-city children during the first year of formal schooling. Despite scholarly disagreements about the implications of specific studies on class size, economists generally agree that targeted class-size policies rest on stronger ev...

This report examines the implementation of No Child Left Behind's (NCLB) supplemental educational service provisions in eleven urban districts--Mesa Public Schools and Washington Elementary District Schools, AZ, Fresno Unified School District and Los Angeles Unified School District, CA, Chicago Public Schools, IL, Buffalo Public Schools and New Yor...

The accountability requirements of the No Child Left Behind Act of 2001 place high-poverty schools and racially diverse schools at a disadvantage because they rely on mean proficiency scores and require all subgroups to meet the same goals for accountability. In this article, student achievement data from six states are used to highlight difference...

The No Child Left Behind (NCLB) teacher quality provisions recognize both the importance of teacher quality for improving student achievement and the unequal distribution of teachers across districts and schools. But the question of how to achieve the goal of a high quality teacher in every classroom is complicated because of the challenges of attr...

A number of studies have shown that low-income and minority students undergo larger summer reading losses than their middle-class and White classmates, and that reading is the only activity that is consistently related to summer learning. The purpose of this study was to explore whether reading books during summer vacation improved fall reading pro...

The No Child Left Behind (NCLB) teacher quality provisions recognize both the importance of teacher quality for improving student achievement and the unequal distribution of teachers across districts and schools. But the question of how to achieve the goal of a high quality teacher in every classroom is complicated because of the challenges of attr...

The No Child Left Behind Act of 2001 (NCLB) alters federal-state relations by expanding the federal role further into a primary function of state and local governments and raises questions about how federal, state, and local policies interact--that is, conflict or reinforce each other. Early indications suggest that states are differently positione...

This report examines how state policymakers designed their accountability systems to meet the NCLB Title I requirements and the implications of its provisions for schools with large numbers of low-income and minority students. The authors conducted their study in six states--Arizona, California, Illinois, New York, Virginia, and Georgia--which are...

This paper focuses on the first-year implementation of the choice provisions of the No Child Left Behind (NCLB) Act in Buffalo, New York, DeKalb County, Georgia, and Richmond, Virginia. After an analysis of the assumptions underlying school choice and the relevant research literature, the study addressed four research questions motivated by NCLBs c...

UMI # 3055866. Vita. Thesis (Ed. D.)--Harvard Graduate School of Education, 2002. Includes bibliographical references (leaves 200-217).

Which is more equitable, teacher-assigned grades or high-stakes tests? Nationwide, there is a growing trend toward the adoption of standardized tests as a means to determine promotion and graduation. “High-stakes testing” raises several concerns regarding the equity of such policies. In this article, the authors examine the question of whether high...