ArticlePDF Available

College Performance and Retention: A Meta-Analysis of the Predictive Validities of ACT ® Scores, High School Grades, and SES

Authors:

Abstract and Figures

This meta-analysis examines the strength of the relationships of ACT® Composite scores, high school grades, and socioeconomic status (SES) with academic performance and persistence into the 2nd and 3rd years at 4-year colleges and universities. Based upon a sample of 189,612 students at 50 institutions, ACT Composite scores and high school grade point average (GPA) are highly correlated with 1st-year academic performance. First-year academic performance emerges as the best predictor of 2nd- and 3rd-year retention. SES is a weak predictor of both academic performance and retention. Moderator analyses of admission selectivity indicate that although the estimated mean validity coefficients for ACT Composite scores and high school GPA vary slightly, the credibility intervals indicate they are valid predictors across levels of admission selectivity. This longitudinal study demonstrates the importance of precollege academic preparation and how success in the 1st year of college strongly influences persistence toward completing a degree.
Content may be subject to copyright.
A preview of the PDF is not available
... However, there is surprisingly little empirical research that has directly examined the extent to which KAS affects knowledge acquisition in post-school contexts. Instead, previous studies often used more indirect or artificial approaches, for example, by testing whether school achievement predicts success later in life (e.g., Westrick et al., 2015), by using crystallized intelligence as a proxy for prior knowledge (e.g., Moehring et al., 2018), or by examining the relationship between prior knowledge and learning in very specific content domains, such as baseball (e.g., Recht & Leslie, 1988). ...
... Given the high relevance of this selection process to individuals' careers and life-courses, the success of the study programmes, and the supply of an educated workforce in the long run, selection criteria are expected to be highly valid in predicting which applicants have the greatest chance to succeed in any given programme. Studies have already shown that the final grade on an entrance qualification is a strong predictor for study success (for example, Westrick et al. 2015). Therefore, it is not surprising that it is the foremost applied selection criterion, although there is some variation across fields of study (Haase et al. 2021), which is highly relevant because students do not apply only to one particular higher-education institution, but instead apply to a particular programme or field of study within an institution. ...
Article
Full-text available
This article investigates the relevance of local selectivity in study programmes for the probability of attaining a first academic degree. Empirical selectivity can be the result of both selection procedures of study programmes and self-selection of potential students. From higher-education research, complemented by prominent arguments from school effectiveness research, various competing hypotheses are derived regarding the impact of individual academic ability and the contextual impact of local selectivity. While all hypotheses expect individual ability to be positively related to degree completion, they differ in expectations about local selectivity. The subsequent empirical analysis expands the existing international state of research by covering not only the institutional level but also fields of study. Using data from an undergraduate cohort of the German National Educational Panel Study, results from two-level linear probability models fit best with the composition hypothesis, which predicts a positive correlation between degree completion and local selectivity that purely reflects the composition of the student body. In contrast to results in the mostly U.S. context of whole universities, own ability seems more important than selectivity of the context in the form of study programmes in German higher education, at least in terms of surrounding peers' ability.
... The selection of control variables was based on a combination of the potential role of these variables in reducing bias in the link between first-gen peers and college success (as discussed above); prior research that examined college interpersonal relationships, grades, retention, and graduation as outcomes (see Mayhew et al., 2016;Richardson et al., 2012;Roksa et al., 2022;Sacerdote, 2014;Westrick et al., 2015); previous studies that established the predictive utility of some of these specific variables ; and the availability of relevant variables within institutional data. Although most of this evidence pertained to predictors of traditional success outcomes, the same control variables were also used to predict social networks, since there was no compelling reason to exclude those independent variables from the models. ...
Article
Full-text available
Despite a burgeoning literature on first-generation college student success, little is known about how the presence of first-generation or continuing-generation peers may facilitate desired outcomes among first-generation students. Moreover, two theoretical traditions lead to contrasting predictions about the potential impact of the representation of other first-generation students. The present study explored this issue within a sample of 4154 first-year, first-generation students who lived on 159 floors in 12 residence halls. Across a variety of statistical models that sought to reduce selection bias, students with a first-generation roommate have lower retention and graduation rates than students with a continuing-generation roommate. Students with a first-generation roommate also have more modest social networks within the university dining halls, but no significant relationships are observed for first-semester or first-year GPA. The link between the proportion of first-generation floormates and success outcomes is rarely significant and yields inconsistent results across analyses.
Article
Pocos estudios con Analítica del Aprendizaje han intentado predecir los resultados de conjunto de un año académico. Esta investigación desarrolló un modelo predictivo del riesgo de suspender el primer año en un Grado de Negocios (i.e., obtener menos créditos de los necesarios para aprobar), utilizando Regresión Logística con datos de dos cohortes de estudiantes (n=1046). El modelo utiliza la tasa de asistencia, calificaciones de evaluación continua de tres asignaturas y los clics en la LMS, del primer semestre del año. Se probó con 74 estudiantes de una cohorte diferente, obteniendo una precisión alta, pero una sensibilidad baja. Los resultados sugieren que la asistencia a clases, las habilidades de comunicación y la competencia numérica son transversales al éxito académico. El artículo revela una relación no lineal entre la actividad en la LMS y la media académica y propone un método para tratarlo.
Article
General chemistry is often the first course taken by students interested in careers in STEM and health fields, and therefore, is considered an essential course for the success and retention of students in these fields. Prior studies have shown study habits and skills to be related to student performance in college-level courses, including STEM courses. Previous chemistry studies have focused on deep versus surface approaches to studying, how affective variables ( e.g. , self-efficacy) affect study habits, and how students study week to week. Literature has also shown that students’ management of their general study time can impact their performance, with distraction while studying becoming an increasing challenge for students. This study examined first-semester general-chemistry students' study behaviors (both their explicit learning strategies and study-time management practices) focusing on their exam preparation and that relationship to exam performance when controlling for prior knowledge and class attendance. Key findings include: (1) students, on average, employed two active strategies for exam preparation, dedicated half of their study time to active strategies, and were distracted 26% of the time. (2) While active strategies positively influenced exam performance and passive strategies had a negative impact, not all active strategies were equally effective. (3) The percentage of study time spent on active strategies correlated positively with performance, whereas higher distraction levels during exam preparation negatively affected outcomes. Understanding student exam-study behaviors and their effects on exam performance can help instructors support students more effectively by teaching them study strategies effective for their courses.
Article
Full-text available
The high prevalence of delay and non-completion among academic track students across OECD countries raises questions about academic tracks’ effectiveness in successfully preparing students for higher education. Yet, empirical studies addressing academic track students’ college readiness remain scarce. Therefore, this study investigates the long-term effects of cognitive (i.e., ability) and non-cognitive indicators (i.e., self-efficacy, learning skills, transition knowledge, and cognitive strategies) of college readiness on “on-time” progress throughout higher education. Additionally, this study investigates whether shared teacher expectations (i.e., teachability culture) explain differences in students’ college readiness. Results of multilevel analyses based on data from 671 Flemish students across 16 schools (ISCY: 2013–2019), indicated that teachability culture positively affected college-readiness indicators, namely: self-efficacy and cognitive strategies. In turn, self-efficacy positively affected students’ “on time” progression throughout higher education. Given its malleable nature, self-efficacy is potentially an interesting tool to increase college-readiness, and ultimately “on time” degree completion.
Article
Dans cette étude, nous apparions les données SISE aux données APB/Parcoursup pour les cohortes de bacheliers 2014-2019 afin d’explorer les facteurs susceptibles d’affecter les chances de réussite en première année à l’université en focalisant notre attention sur le genre. Nous comparons les différentiels de réussite fille-garçon observés à ceux estimés lorsque filles et garçons sont rendus comparables du point de vue de leurs caractéristiques individuelles, de celles de leur établissement d’origine et de la formation supérieure suivie. Nos résultats peuvent être résumés comme suit : Les caractéristiques sociodémographiques et des établissements d’origine sont associées aux chances de réussite mais leur rôle semble moins important que celui de la performance scolaire du bachelier et, surtout, la filière suivie dans le supérieur. Le différentiel fille-garçon est bien plus important lorsque leurs caractéristiques sont prises en compte, indiquant que leurs différences de caractéristiques modèrent le différentiel observé. La caractéristique la plus contributive au différentiel fille-garçon est la filière suivie dans le supérieur : si filles et garçons faisaient les même choix, le différentiel observé en faveur des filles serait plus important. Nos résultats ne montrent pas d’effet significatif attribuable au passage de la plateforme APB à Parcoursup ni en matière de taux de réussite, ni en matière de différentiels fille-garçon dans les chances de réussite.
Article
Student academic success plays an important role in higher education institutions, as it is often used as a core measure of university performance. Internationally, there is an extensive literature on the predictors of academic success. In addition to intellectual variables, the effects of psychological factors have received increased attention. However, there is little literature on cross-cultural differences in the predictors of academic success. This study examines three psychological predictors (hope, self-efficacy, and motivation) and investigates differences between the scores of business students at a university in Germany and a university in Finland. The results indicate differences in students’ scores on the predictor hope. In addition, some differences were found in relation to the students’ demographics. Regarding the predictive power of the factors examined, for hope and self-efficacy this was higher in Finland than in Germany.
Article
Objectives: The present study performed a systematic review of the scientific literature that deals with the academic performance of university students with ADHD, collecting the research conducted between 2018 and 2024. Likewise, we aimed to know the factors that influence on academic performance and evaluate the tools used in the collection of ADHD symptoms and educational data. Methods: The electronic databases PubMed, PsycInfo, and Scopus were used to search studies using PRISMA guidelines. Quantitative studies selected had to discuss about academic performance in college students with ADHD. For each study, quality of evidence was examined using the Quality Assessment Tool of the National Heart Lung and Blood Institute. Results: Fifteen studies with good-fair quality were included in the review. These studies demonstrated that an ADHD diagnosis or significant ADHD symptoms are associated with lower academic performance in college students, particularly those with inattention symptoms. Additionally, factors such as executive functions, medication use, and study strategies also influence the academic performance of these students. The most commonly used instruments for the assessment of ADHD were the screening measures ADHD Self-Report Scale and the ADHD Rating Scale-Self Report Version. To assess academic performance half of the studies collected the Grade Point Average directly from university records, while in other studies, students were asked directly for their grades. Conclusion: Overall, ADHD has a relevant impact on the academic performance of university students, but the evaluation methodology used has some differences with respect to child's evaluations procedures. Therefore, studies in this population must include not only self-reported symptomatology, but also assessments from clinicians specialized in adult ADHD.
Chapter
Full-text available
Euphoria mahasiswa, saat pertama kali menjadi bagian dari pendidikan tinggi, tidak akan berlangsung selamanya. Kegembiraan diterima di universitas adalah efek yang muncul dan dirasakan mahasiswa, mengiringi kebanggaan melewati ujian dan atau persyaratan untuk, akhirnya, bisa menyandang gelar mahasiswa. Meskipun demikian, di tengah kegembiraan luar biasa terkait dengan status mahasiswa di universitas, fase transisi sering menggambarkan masa yang ditandai dengan“volatilitas dan ambiguitas”(Dias & Sa, 2014). Segera setelahnya, mahasiswa tahun pertama di perguruan tinggi akan menghadapi masa yang paling menantang, dengan berbagai kesulitan dan rintangan. Rasa takut, tidak nyaman, kekecewaan, merasa tidak menjadi diri sendiri, serta was-was merupakan bentuk vulnerability (kerentanan) yang muncul dan bisa merugikan mahasiswa. Belum lagi, rasa khawatir dan tidak percaya diri yang tidak segera terbangun dengan kuat, akan mengarahkan dan menguatkan kerentanan negatif serta membuat mahasiswa mungkin mengalami berkurangnya rasa kompetensi, serta kesulitan menemukan tempat dan peran mereka dalam lingkungan sosial dan akademik yang baru. Berbagai tantangan yang harus dihadapi mahasiswa tahun pertama, juga seiring muncul beriringan dengan semakin luasnya diversity (keberagaman) yang terpapar padanya. Meskipun keberagaman latar belakang penerimaan mahasiswa semakin dipertimbangkan, keberagaman pengalaman tahun pertama masih kurang mendapat perhatian. Situasi ini menuntut perhatian yang lebih besar terhadap keberagaman siswa dan dampaknya terhadap prestasi akademik. Bagaimana kemudian merangkul keberagaman bisa memberikan peran yang positif pada pengelolaan kerentanan akademik, menjadi kajian menarik yang perlu dikembangkan lebih lanjut.
Article
Full-text available
The ability of high school grades (high school GPA) and SAT® scores to predict cumulative grades in different types of college courses was evaluated in a sample of 26 colleges. Each college contributed data from three cohorts of entering freshmen, and each cohort was followed for at least four years. Colleges were separated into four levels by average SAT scores. Grade point averages for four categories of courses (English; science, math, and engineering [S/M/E]; social science; and education) were computed, and analyses were run separately for gender within race/ethnicity classifications. Correlations of the combined predictors with course grades over four or more years, corrected for range restriction, ranged from .45 for education courses to 0.64 for S/M/E courses. The SAT increment, that is, the increase in the multiple correlations when SAT scores are added to high school grades, ranged from 0.03 in education courses to 0.08 in S/M/E courses. Because these seemingly small numbers are frequently misinterpreted, an additional analysis showed how the percentage of students succeeding at a high level (cumulative GPA of 3.5 or higher) increases as SAT scores increase for students with similar high school grades. For example, for students with a high school GPA of 3.7 or higher in colleges where the mean combined SAT score is below 1200, only 2 percent of the students at the lowest SAT level (800 or lower combined score) were highly successful in social science courses. At the highest SAT level (1410-1600), 77 percent were highly successful.
Article
The criterion most frequently used in studies designed to assess the predictive validity of measures used in college admission has been the freshman-year GPA. It is not self-evident that the first-year GPA provides either a sufficient or a representative sample of a student's academic performance. Questions have been raised regarding the validity of admissions measures for predicting longer-term performance in college. This is the report of a systematic review of research bearing on (a) the validity of admissions measures for predicting GPA that reflects performance beyond the freshman year—i.e., longer-term cumulative or independently computed post-freshman-year GPA, such as senior-year GPA; (b) the comparative relevance and utility of freshman-year, cumulative, and independently computed post-freshman-year GPA as criteria for the validation of admissions measures. Among other things, the research reviewed lends support to the traditional practice of employing the freshman-year GPA in admissions-related predictive validity studies.
Article
RANGEJ is a Pascal program to compute the Lawley multivariate correction for range restriction. The correction is useful for the estimation of correlation coefficients when a sample has been subject to range restriction due to prior selection.