Figure 6 - uploaded by Francisco Olivos
Content may be subject to copyright.
Source publication
This study explores the use of artificial intelligence (AI) as a complementary tool for grading essay-type questions in higher education, focusing on its consistency with human grading and potential to reduce biases. Using 70 handwritten exams from an introductory sociology course, we evaluated generative pre-trained transformers (GPT) models' perf...
Contexts in source publication
Context 1
... assess whether the human and GPT scoring are consistent across settings, we estimated the correlation between the human scoring and the average of the 100 tasks for each combination of model and temperature. These correlations are displayed in Figure 6. ...
Context 2
... Figure 6 about here] Figure 6 suggests a positive correlation between the human scoring for the different settings. It indicates that in general, GPT can meaningfully utilize its own knowledge to assess students' answers. ...
Similar publications
Two-phase sampling is a useful technique for sample surveys, particularly when prior auxiliary data is not accessible. The ranks of the auxiliary variable often coincide with those of the research variable when two variables are correlated. By considering this relationship, we can significantly increase estimator accuracy. In this paper, we use the...
