Sergio Araneda

Caveon Test Security

As the task force seeks to find consensus around the foundational competencies in our field, it is appropriate to take some time and critically examine the process by which the task force created this document and the views that it represents. Overall, our reaction is that the professional who was trained according to this consensus document will n...

En el presente articulo examinamos críticamente la transición de la PSU a la PAES en el contexto de las admisiones universitarias en Chile. Investigamos si este cambio representa un paso hacia un sistema más equitativo de admisión. Analizamos cómo la PAES intenta superar las desigualdades inherentes a la PSU, centrándose en habilidades y conocimien...

In October 2021, the Graduate Student Issues Committee at NCME called their graduate students to create a study group about the current edition of The Standards for Educational and Psychological Testing (Standards). During this study group, we studied eachchapter of the Standards and consulted with different Experts about its content and potential...

In this Dissertation, I will present the theoretical basis and two proof-of-concept studies of something I will call an “Experiential” approach to Test Design and Validation. This approach finds its origins in Game design, where the effort goes around the experience elicited by a device (a game). The idea of the experiential approach is to apply th...

https://youtu.be/JD3EywvkcsU Slides and video for my Dissertation Defense.

In this presentation, I will explain the idea for my Dissertation at UMass Amherst, in something I call "An Experiential Approach" to test design and validation.

In this paper, I will do a short review of different authors in the literature of feminist epistemologies and critically connect those ideas with the current validation practices in educational assessment. I start by considering the ideas of Standpoint Theory and Strong objectivity proposed by Harding (1992), including the ideas of Collins of th...

I will present a game in which players are asked to reorder two symmetrical deck of slides that present the results of two tests: one with low reliability and one with high reliability. Players need to use their advanced knowledges about reliability to solve this fun puzzle. Summary of the demonstration The game "reliability challenge!" was designe...

Students exhibit many behaviors when responding to items on a computer-based test, but only some of these behaviors are relevant to estimating their proficiencies. In this study, we analyzed data from computer-based math achievement tests administered to elementary school students in grades 3 (ages 8–9) and 4 (ages 9–10). We investigated students’...

In this study, we analyzed students’ process data (e.g., total time, first response latency) in a computer-based mathematics achievement test that included different item formats. The results indicated differences in response behaviors across item formats. Implications for test construction and future analyses in this area are discussed.

We propose an approach to test design and validation based on the study of the experiences of the examinees. We present a conceptual framework to understand the experiences and discuss how this approach will work in practice, for both test design and validation. https://ncme2021.us2.pathable.com/meetings/virtual/QHqfzuwmvm2qeXPRQ min 32 Presentati...

Chile has a centralized application system for admission to its most prestigious public and private universities. Prior to 2011, selection was based solely on the students' high school GPA and their scores in the national admission test (PSU).In 2012 an additional admission criterion was introduced-the student's class rank standing relative to prev...

Early draft of an study about the score "ranking de notas" used in the admission system to universities in Chile. Ranking de notas is a score based on high-school gpa and the relative position of the students compared with previous cohorts, in a class-rank style.