ArticlePDF Available

Abstract and Figures

When students answer an in-class conceptual question individually using clickers, discuss it with their neighbors, and then revote on the same question, the percentage of correct answers typically increases. This outcome could result from gains in understanding during discussion, or simply from peer influence of knowledgeable students on their neighbors. To distinguish between these alternatives in an undergraduate genetics course, we followed the above exercise with a second, similar (isomorphic) question on the same concept that students answered individually. Our results indicate that peer discussion enhances understanding, even when none of the students in a discussion group originally knows the correct answer.
Content may be subject to copyright.
DOI: 10.1126/science.1165919
, 122 (2009); 323Science et al.M. K. Smith,
Performance on In-Class Concept Questions
Why Peer Discussion Improves Student
This copy is for your personal, non-commercial use only.
. clicking herecolleagues, clients, or customers by , you can order high-quality copies for yourIf you wish to distribute this article to others
. herefollowing the guidelines can be obtained byPermission to republish or repurpose articles or portions of articles
(this information is current as of February 19, 2010 ):
The following resources related to this article are available online at www.sciencemag.org
http://www.sciencemag.org/cgi/content/full/323/5910/122
version of this article at: including high-resolution figures, can be found in the onlineUpdated information and services,
http://www.sciencemag.org/cgi/content/full/323/5910/122/DC1
can be found at: Supporting Online Material
found at: can berelated to this articleA list of selected additional articles on the Science Web sites
http://www.sciencemag.org/cgi/content/full/323/5910/122#related-content
http://www.sciencemag.org/cgi/content/full/323/5910/122#otherarticles
, 2 of which can be accessed for free: cites 11 articlesThis article
http://www.sciencemag.org/cgi/content/full/323/5910/122#otherarticles
5 articles hosted by HighWire Press; see: cited byThis article has been
http://www.sciencemag.org/cgi/collection/education
Education : subject collectionsThis article appears in the following
registered trademark of AAAS. is aScience2009 by the American Association for the Advancement of Science; all rights reserved. The title CopyrightAmerican Association for the Advancement of Science, 1200 New York Avenue NW, Washington, DC 20005.
(print ISSN 0036-8075; online ISSN 1095-9203) is published weekly, except the last week in December, by theScience
on February 19, 2010 www.sciencemag.orgDownloaded from
plored by combining models and further em-
pirical data, but geology offers a stronger constraint
because circumstances under which sulfate can
be preserved in terrestrial sedimentary records
are uncommon.
Although various aspects of Neoproterozoic
glaciations are intensely disputed (25), our results
confirm a profound difference from Phanerozoic
ice ages. A near-global distribution of glaciated
continents during the Marinoan phase ending
~ 635 million years ago is supported by evidence
of low palaeomagnetic latitudes (26). The snow-
ball Earth model (27) predicts a progressive accu-
mulation of volcanic volatiles in the atmosphere
that are not removed by weathering until the rapid
demise of the ice age as the ice-albedo feedback
reverses. If sulfate with large negative
17
O signals
derived from oxidative weathering could only be
generated in a large quantity after melting of the
snowballand exposure of continents, then the
diamictites above W2 had to be deposited during
final glacial retreat, a hypothesis that should prompt
a re-examination of their sedimentology. The al-
ternative slushballmodel, in which parts of the
ocean area are ice-free (28), would also permit ac-
cumulation of sulfate from prolonged oxidative
weathering in certain continental oaseswhere
arid but cold conditions prevailed. This study pro-
vides an effective way to study the dynamics of
sedimentation and atmospheric-hydrosphere-
biosphere interactions during a global glaciation
and highlights the need for further stratigraph-
ically constrained
17
O
SO4
data on continental
carbonate precipitates to ground-truth flux-balance
models.
References and Notes
1. H. Bao, D. Rumble, D. R. Lowe, Geochim. Cosmochim.
Acta 71, 4868 (2007).
2. d
18
Oord
17
OR
xsample
/R
xstandard
1(whereR
x
=
18
O/
16
O
or
17
O/
16
O); the same dnotation applies to d
13
Cord
34
S
in this paper.
3. Reference units for stable isotope compositions: VSMOW
for sulfate d
18
O, d
17
O, and
17
O; VPDB for carbonate
d
13
C and d
18
O; and Vienna Canyon Diablo Troilite for
sulfate d
34
S.
4. G. E. Claypool, W. T. Holser, I. R. Kaplan, H. Sakai, I. Zak,
Chem. Geol. 28, 199 (1980).
5. R. A. Socki, R. P. Harvey, D. L. Bish, E. Tonui, H. Bao, in
Lunar and Planetary Science Conference, vol. XXXIX
(NASA, Houston, TX, 2008), p. 1964.
6. H. Bao, Chem. Geol. 214, 127 (2005).
7. H. Bao, M. H. Thiemens, D. B. Loope, X.-L. Yuan,
Geophys. Res. Lett. 30, 1843 (2003).
8. H. Bao, J. R. Lyons, C. M. Zhou, Nature 453, 504
(2008).
9. G. P. Halverson, A. C. Maloof, P. F. Hoffman, Basin Res.
16, 297 (2004).
10. G. P. Halverson, in Neoproterozoic Geobiology and
Paleobiology, S. Xiao, A. J. Kaufman, Eds. (Springer,
New York, 2006), pp. 231271.
11. I. J. Fairchild, M. J. Hambrey, Precambrian Res. 73, 217
(1995).
12. I. J. Fairchild, M. J. Hambrey, B. Spiro, T. H. Jefferson,
Geol. Mag. 126, 469 (1989).
13. Materials and methods are available as supporting
material on Science Online.
14. G. W. Luther III, Geochim. Cosmochim. Acta 51,3193
(1987).
15. C. O. Moses, J. S. Herman, Geochim. Cosmochim. Acta
55, 471 (1991).
16. N. Balci, W. C. Shanks, B. Mayer, K. W. Mandernack,
Geochim. Cosmochim. Acta 71, 3796 (2007).
17. M. R. Talbot, Chem. Geol. Isol. Geol. Sect. 80, 261
(1990).
18. J. Farquhar, D. E. Canfield, A. Masterson, H. Bao,
D. Johnston, Geochim. Cosmochim. Acta 72,2805
(2008).
19. N. F. Moreira, L. M. Walter, C. Vasconcelos, J. A.
McKenzie, P. J. McCall, Geology 32, 701 (2004).
20. I. J. Fairchild, M. J. Hambrey, Precambrian Res. 26, 111
(1984).
21. B. J. Reedy, J. K. Beattie, R. T. Lowson, Appl. Spectrosc.
48, 691 (1994).
22. A. Angert, S. Rachmilevitch, E. Barkan, B. Luz, Global
Biogeochem. Cycles 17, article 1030 (2003).
23. B. Luz, E. Barkan, Geochim. Cosmochim. Acta 69, 1099
(2005).
24. R. T. Pierrehumbert, J. Geophys. Res. Atmos. 110, article
D01111 (2005).
25. I. J. Fairchild, M. J. Kennedy, J. Geol. Soc. London 164,
895 (2007).
26. D. A. D. Evans, Am. J. Sci. 300, 347 (2000).
27. P. F. Hoffman, D. P. Schrag, Terra Nova 14, 129
(2002).
28. T. J. Crowley, W. T. Hyde, W. R. Peltier, Geophys. Res.
Lett. 28, 283 (2001).
29. H.B. and I.J.F. designed research and led the writing of
the manuscript; H.B. performed CAS extraction and triple
oxygen isotope measurements; I.J.F secured samples
from field expeditions and conducted sedimentological,
petrographic, mineralogical and elemental studies;
P.M.W. conducted preliminary CAS extraction and
performed d
34
S
CAS
analysis; and C.S. carried out d
13
C and
d
18
O analysis of host carbonates. We thank G. Halverson
for discussion and Y. Peng for analytical assistance.
Financial and facility supports were provided by Louisiana
State University, NSF, and Chinese Academy of Science
(H.B.), Natural Environment Research Council (NERC)
standard grant (GR3/C511805/1) and NERC inductively
coupled plasma mass spectrometry facilities (I.J.F.), and
Austrian Science Funds (C.S.). The authors declare no
competing financial interests.
Supporting Online Material
www.sciencemag.org/cgi/content/full/323/5910/119/DC1
Materials and Methods
SOM Text
Figs. S1 and S2
Tables S1 and S2
References
3 September 2008; accepted 25 November 2008
10.1126/science.1165373
Why Peer Discussion Improves
Student Performance on In-Class
Concept Questions
M. K. Smith,
1
*W. B. Wood,
1
W. K. Adams,
2
C. Wieman,
2,3
J. K. Knight,
1
N. Guild,
1
T. T. Su
1
When students answer an in-class conceptual question individually using clickers, discuss
it with their neighbors, and then revote on the same question, the percentage of correct answers
typically increases. This outcome could result from gains in understanding during discussion, or
simply from peer influence of knowledgeable students on their neighbors. To distinguish between
these alternatives in an undergraduate genetics course, we followed the above exercise with a
second, similar (isomorphic) question on the same concept that students answered individually.
Our results indicate that peer discussion enhances understanding, even when none of the students
in a discussion group originally knows the correct answer.
In undergraduate science courses, conceptual
questions that students answer using personal
response systems or clickersare promoted
as a means to increase student learning [e.g. (1,2)],
often through peer instruction (PI) (3). Instructors
using this approach break up their lectures with
multiple-choice questions to test understanding
of the concepts being presented. When PI is used,
students are first asked to answer a question in-
dividually, and then a histogram of their re-
sponses may be displayed to the class. If there is
substantial disagreement among responses, stu-
dents are invited to discuss questions briefly with
their neighbors and then revote before the correct
answer is revealed. The instructor then displays
the new histogram and explains the reasoning
behind the correct answer. Most instructors report
that the percentage of correct answers, as well as
studentsconfidence in their answers, almost
always increases after peer discussion (24).
It is generally assumed that active engage-
ment of students during discussion with peers,
some of whom know the correct answer, leads to
increased conceptual understanding, resulting in
improved performance after PI. However, there is
an alternative explanation: that students do not in
fact learn from the discussion, but simply choose
the answer most strongly supported by neighbors
they perceive to be knowledgeable. We sought to
distinguish between these alternatives, using an
additional, similar clicker question that students
answered individually to test for gains in under-
standing. Our results indicate that peer discussion
enhances understanding, even when none of the
students in a discussion group originally knows
the correct answer.
In an undergraduate introductory genetics
course for biology majors at the University of
ColoradoBoulder (additional demographic in-
1
Department of Molecular, Cellular, and Developmental
Biology, University of Colorado, Boulder, CO 80309, USA.
2
Department of Physics, University of Colorado, Boulder,
CO 80309, USA.
3
Department of Physics, University of
British Columbia, Vancouver, BC V6T 1Z3, Canada.
*To whom correspondence should be addressed. E-mail:
michelle.k.smith@colorado.edu
2 JANUARY 2009 VOL 323 SCIENCE www.sciencemag.org122
REPORTS
on February 19, 2010 www.sciencemag.orgDownloaded from
formation in table S1), we asked an average of
five clicker questions per 50-min class through-
out the semester and encouraged students to
discuss questions with their neighbors. Students
were given participation points for answering
clicker questions, regardless of whether their an-
swers were correct. Exam questions were similar
to the clicker questions, so that students had an
incentive to take clicker questions seriously.
Sixteen times during the semester we assessed
how much students learned from peer discus-
sion by using a paired set of similar (isomorphic)
clicker questions. Isomorphic questions have dif-
ferent cover stories,but require application of
the same principles or concepts for solution (5,6).
Sample isomorphic question pairs are shown in
fig. S1. In class, students were first asked to an-
swer one question of the pair individually (Q1).
Then they were invited to discuss the question
with their neighbors and revote on the same ques-
tion (Q1
ad
for Q1 after discussion). Finally, stu-
dents were asked to answer the second isomorphic
question, again individually (Q2). Neither the an-
swers to the two questions (Q1/Q1
ad
and Q2) nor
the histograms of student answers were revealed
until after the voting on Q2, so that there was
minimal instructor or whole-course peer influence
on the Q2 responses. The isomorphic questions
were randomly assigned as Q1/Q1
ad
or Q2 after
both questions were written. Data analysis was
limited to students who answered all three questions
of an isomorphic pair with a total of 350 students
participating in the study (7) (see supporting
online text).
Two results indicate that most students
learned from the discussion of Q1. First, using
data pooled from individual mean scores on Q1,
Q1
ad
, and Q2 for all 16 question pairs, the av-
erage percentage correct for Q2 was significantly
higher than for Q1 and Q1
ad
(Fig. 1A and Table
1). Second, of the students who answered Q1
incorrectly and Q1
ad
correctly, 77% answered Q2
correctly (Fig. 2). This result suggests that most
students who initially did not understand a con-
cept were able to apply information they learned
during the group discussion and correctly answer
an isomorphic question. In contrast, almost all
students who answered Q1 correctly, presumably
because they understood the concept initially, did
not change their votes on Q1
ad
andwentonto
answer Q2 correctly (Fig. 2).
In addition, students who answered both Q1
and Q1
ad
incorrectly still appeared to learn from
discussions with peers and answering a second
question on the same topic. Of these students,
44% answered Q2 correctly, significantly better
than expected from random guessing (Fig. 2; on
average, the questions in our 16 isomorphic pairs
had four answer choices each). This result was
unexpected because when students answered
Q2, they had not been told the correct answer to
Q1/Q1
ad
, had not seen histograms of student re-
sponses, and had not discussed Q2 with their
peers. We speculate that when this group of stu-
dents discussed Q1, they were making sense of
the information, but were unable to apply their
new knowledge until presented with a fresh ques-
tion on the same concept (Q2). There may also
be a learning benefit to considering successive
clicker questions on the same topic (8).
Although the difficulty of the question pairs
varied, as judged by the percentage of correct
answers on Q1 (see supporting online text), stu-
dents performed significantly better on Q1
ad
and
Q2 compared to Q1 for each difficulty level (Fig.
1B and Table 1). On the most difficult questions
there was another significant increase between
Q1
ad
and Q2, suggesting that there was an addi-
tional delayed benefit to the group discussions.
Fig. 1. The percentage of students
who can correctly answer a ques-
tion as individuals increases after
peer discussion of a similar (iso-
morphic) question. Q1: One ques-
tion of an isomorphic pair was
voted on individually; Q1
ad
:the
same question was voted on again
afterpeerdiscussion;Q2:the
second isomorphic question was
voted on individually. (A)Results
for all 16 question pairs were
averaged for each individual (n=
350 students), and the class aver-
ages of these scores are shown. (B)
The 16 paired questions were
grouped according to difficulty based
on the percentage of correct answers
for Q1 (five easy questions, seven
medium questions, and four difficult
questions), and performance results
were again averaged for each indi-
vidual (n= 343 students for easy,
344 for medium, and 337 for dif-
ficult) before computing the averages
shown. Error bars show the SEM.
Table 1. Mean differences between Q1, Q1
ad
, and Q2. The SEM is in parentheses.
Question category Q1
ad
Q1* (%) Q2 Q1* (%) Q2 Q1
ad
* (%)
All questions 16(1) 21(1) 5(1)
Easy questions 16(1) 12(2) 4(1)
Medium questions 15(1) 16(2) 1(1)
Difficult questions 16(2) 38(2) 22(2)
*Mean values are the averages of the differences between Q1
ad
-Q1, Q2-Q1, and Q2-Q1
ad
for each student.
No significant
improvement between these questions.
Fig. 2. Breakdown of student responses for the pool of 16 Q1, Q1
ad
, and Q2 questions. Percentages of
the category are connected by arrows from the preceding line. Underlined entries represent students who
initially did not answer Q1 correctly but did so after group discussion; entries with an asterisk represent
students who did not answer either Q1 or Q1
ad
correctly, but nevertheless were able to correctly answer
the isomorphic question Q2. Of the 32 questions in our 16 question pairs, 7 had 5 answer choices, 5 had 4
choices, 3 had 3 choices, and 1 had 2 choices.
www.sciencemag.org SCIENCE VOL 323 2 JANUARY 2009 123
REPORTS
on February 19, 2010 www.sciencemag.orgDownloaded from
Our results suggest that peer discussion can
be effective for understanding difficult concepts
even when no one in the group initially knows
the correct answer. In a postsemester survey (n=
98 responding), students reported an average
of three participants in their peer discussion
groups. If students who knew the answer to Q1
were randomly distributed throughout the class-
room, then on the difficult questions (Fig. 1B),
more than half of the 84 groups would have in-
cluded no one who knew the correct answer to Q1
(naïve groups). Statistical analysis (see supporting
online text) shows that some students who an-
swered Q2 correctly must have come from naïve
groups.
Student opinion supported the view that having
someone in the group who knows the correct
answer is unnecessary. On an end-of-year survey
(n= 328 responding), 47% of students disagreed
with the statement: When I discuss clicker
questions with my neighbors, having someone
in the group who knows the correct answer is
necessary in order to make the discussion pro-
ductive.Representative comments from these
students included the following: Often when
talking through the questions, the group can fig-
ure out the questions without originally knowing
the answer, and the answer almost sticks better
that way because we talked through it instead of
just hearing the answer.”“Discussion is produc-
tive when people do not know the answers be-
cause you explore all the options and eliminate
the ones you know cant be correct.
This study supports the substantial value of
student peer discussion as an effective means of
active learning in a lecture class. Our findings are
consistent with earlier demonstrations of social
learning, including the value of discussion with
peers (913). The significant increases in per-
formance between Q1 and Q1
ad
confirm results
from earlier classroom studies (24). In addition,
we have presented new evidence showing that
these increases result primarily from student
gains in conceptual understanding rather than
simply from peer influence.
Previous explanations for the value of PI have
maintained the transmissionistview (14)that
during discussion, students who know the right
answer are explaining the correct reasoning to
their less knowledgeable peers, who consequently
improve their performance on the revote (3,4).
Our finding that even students in naïve groups
improve their performance after discussion sug-
gests a more constructivist explanation: that these
students are arriving at conceptual understanding
on their own, through the process of group dis-
cussion and debate.
Some instructors who use clicker questions
skip peer discussion entirely, believing that in-
structor explanation of the correct reasoning will
be more clear and accurate than an explanation
by peers, and will therefore lead to more student
learning. Although our current work does not
directly compare the benefits of instructor versus
peer explanation, research in physics has shown
that instructor explanations often fail to produce
gains in conceptual understanding (15). We have
shown that peer discussion can effectively pro-
mote such understanding. Furthermore, justifying
an explanation to a fellow student and skeptically
examining the explanation of a peer provide val-
uable opportunities for students to develop the
communicative and metacognitive skills that are
crucial components of disciplinary expertise.
References and Notes
1. D. Duncan, Clickers in the Astronomy Classroom (Pearson
Education, San Francisco, 2006).
2. J. K. Knight, W. B. Wood, Cell Biol. Educ. 4, 298 (2005).
3. E. Mazur, Peer Instruction: A User's Manual (Prentice
Hall, Saddle River, NJ, 1997).
4. C. H. Crouch, E. Mazur, Am. J. Phys. 69, 970 (2001).
5. K. Kotovsky, J. Hayes, H. Simon, Cognit. Psychol. 17, 248
(1985).
6. H. Simon, J. Hayes, Cognit. Psychol. 8, 165 (1976).
7. Internal Review Board, University of Colorado, Boulder,
Approval to evaluate clicker responses (exempt status,
Protocol No. 0108.9).
8. N. W. Reay, P. F. Li, L. Bao, Am. J. Phys. 76, 171
(2008).
9. P. Cohen, J. Kulik, C.-L. Kulik, Am. Educ. Res. J. 19, 237
(1982).
10. M. T. H. Chi, N. De Leeuw, M. H. Chiu, C. LaVancher,
Cogn. Sci. 18, 439 (1994).
11. N. Webb, L. Cullian, Am. Educ. Res. J. 20, 411 (1983).
12. A. S. Palinscar, A. L. Brown, Cogn. Instr. 1, 117 (1984).
13. E. B. Coleman, I. D. Rivkin, A. L. Brown, J. Learn. Sci. 6,
347 (1997).
14. We use this term to describe the view that learning
during instruction occurs by transmission of information
from a teacher to a learner.
15. D. Hestenes, Phys. Teach. 30, 141 (1992).
16. M.K.S., W.K.A. and J.K.K. were supported by the
University of Colorado Science Education Initiative.
Supporting Online Material
www.sciencemag.org/cgi/content/full/323/5910/122/DC1
SOM Text
Fig. S1
Tables S1 to S3
15 September 2008; accepted 10 November 2008
10.1126/science.1165919
Regulation of Neuronal
Survival Factor MEF2D by
Chaperone-Mediated Autophagy
Qian Yang,
1
Hua She,
1
Marla Gearing,
2
Emanuela Colla,
3
Michael Lee,
3
John J. Shacka,
4
Zixu Mao
1,2
*
Chaperone-mediated autophagy controls the degradation of selective cytosolic proteins
and may protect neurons against degeneration. In a neuronal cell line, we found that
chaperone-mediated autophagy regulated the activity of myocyte enhancer factor 2D (MEF2D),
a transcription factor required for neuronal survival. MEF2D was observed to continuously shuttle
to the cytoplasm, interact with the chaperone Hsc70, and undergo degradation. Inhibition of
chaperone-mediated autophagy caused accumulation of inactive MEF2D in the cytoplasm.
MEF2D levels were increased in the brains of a-synuclein transgenic mice and patients with
Parkinsons disease. Wild-type a-synuclein and a Parkinsons diseaseassociated mutant disrupted
the MEF2D-Hsc70 binding and led to neuronal death. Thus, chaperone-mediated autophagy
modulates the neuronal survival machinery, and dysregulation of this pathway is associated with
Parkinsons disease.
In neurodegenerative diseases, certain popula-
tions of adult neurons are gradually lost because
of toxic stress. The four myocyte enhancer fac-
tor 2 (MEF2) transcription factors, MEF2A to
MEF2D, have been shown to play an important
role in the survival of several types of neurons, and
a genetic polymorphism of the MEF2A gene has
been linked to the risk of late onset of Alzheimers
disease (13). In cellular models, inhibition of
MEF2s contributes to neuronal death. Enhancing
MEF2 activity protects neurons from death in
vitro and in the substantia nigra pars compacta in a
mouse model of Parkinsons disease (PD) (4). Neu-
rotoxic insults cause MEF2 degradation in part by a
caspase-dependent mechanism (5), but how MEF2
is regulated under basal conditions without overt
toxicity is unknown. Autophagy refers to the deg-
radation of intracellular components by lysosomes.
Relative to macro- and microautophagy, chaperone-
mediated autophagy (CMA) selectively degrades
cytosolic proteins (6). This process involves bind-
ingofheatshockproteinHsc70tosubstratepro-
teins via a KFERQ-like motif and their subsequent
targeting to lysosomes via the lysosomal membrane
receptor Lamp2a. Dysregulation of autophagy
plays a role in neurodegeneration (79). However,
the direct mechanism by which CMA modulates
neuronal survival or death is unclear.
1
Department of Pharmacology, Emory University School of
Medicine, Atlanta, GA 30322, USA.
2
Department of Neurology,
Emory University School of Medicine, Atlanta, GA 30322, USA.
3
Department of Pathology, Johns Hopkins University School of
Medicine, Baltimore, MD 21205, USA.
4
Department of
Pathology, Division of Neuropathology, University of Alabama
at Birmingham, Birmingham, AL 35294, USA.
*To whom correspondence should be addressed. E-mail:
zmao@pharm.emory.edu
2 JANUARY 2009 VOL 323 SCIENCE www.sciencemag.org124
REPORTS
on February 19, 2010 www.sciencemag.orgDownloaded from
... One effective way to foster these capabilities is by facilitating dialogue during class (Bennett et al., 2010;Lim et al., 2024;Murphy et al., 2016;Smith et al., 2009). While the derivative of the term encompasses all verbal communication (Howe & Abedin, 2013), in the context of reading a text the definition of dialogue can be narrowed down to "asking and answering (comprehension) questions with a partner (Chi & Wylie, 2014, p. 221)". ...
... Experimental research can be useful in validating these mechanisms behind the effectiveness of dialogue in learning (Reznitskaya & Gregory, 2013;Smith et al., 2009). Through a series of procedures, Smith et al. (2009) substantiated that students genuinely learn from peers during the conversation rather than simply copying the correct answers. ...
... Experimental research can be useful in validating these mechanisms behind the effectiveness of dialogue in learning (Reznitskaya & Gregory, 2013;Smith et al., 2009). Through a series of procedures, Smith et al. (2009) substantiated that students genuinely learn from peers during the conversation rather than simply copying the correct answers. In their experiment, the researchers instructed students to solve Question 1 individually. ...
Article
The ways students learn through dialogue are diversifying, in terms of whom they engage with and how. With the recent advancement of AI chatbots like ChatGPT, learners can leverage aspects of dialogue, such as asking and answering questions, without a peer or instructor being present. Given the lack of experimental studies validating their effect, this study compares three dialogue conditions involving Peer, ChatGPT, and Intelligent Tutoring System. A chat interface was developed where students could exchange questions with a Peer, ask questions to a GPT agent, or answer questions displayed by an ITS agent. After reading a biology passage, 114 university students from Republic of Korea solved two practice items and then engaged in dialogue with their respective counterparts about what they had studied. Finally, they were instructed to re-answer the practice items and solve two new isomorphic test problems. The Peer and GPT groups, where students could ask questions, demonstrated significantly higher post-dialogue performance in both absolute score and conditional correct rate compared to the ITS group, which only answered questions. The number of questions asked and the level of trust in the dialogue were positively correlated with individual differences in performance. Our findings highlight the importance of asking questions over asking many when learning through dialogue, laying the groundwork for designing more effective interactive learning systems.
... In general, collaborative learning and group work have been shown to be effective tools for a more inclusive environment (Smith et al, 2009). Student performance and learning in group work, however, depend on student level of engagement during collaborative activities. ...
Article
This paper discusses the need to develop higher education students as global citizens and presents examples of how this need is met at SJSU through institutional goal setting, as well as course and curriculum design that ensure students’ development of global understanding and intercultural competencies. Inclusive and culturally sensitive pedagogies are also discussed as key elements of this course and curriculum design. The paper also presents a host of extracurricular activities and programs, with highlights among them the Global Technology Initiative for STEM majors and the Ed.D. Leadership Program Global Field Experience, two of the most successful programs at SJSU, in hopes that the ideas presented are adaptable to other fields of study at institutions around the world. Keywords: internationalization, globalization, course and curriculum design, teaching and learning in a global context, extracurricular activities, pedagogy
... Nevertheless, closed-ended practice tests have been included as part of classroom learning activities where they have been shown to facilitate learning. However, in applied settings, these activities are often confounded with other instructional interventions, such as providing feedback (Pyburn et al., 2014) or having students discuss questions with each other (Smith et al., 2009). They often test for memory for information from the learning materials and may also fail to include a true no-testing control group (Bjork et al., 2014). ...
Article
Full-text available
While work on improving comprehension has primarily focused on open-ended generative activities, closed-ended practice tests using inference-type questions may also benefit understanding from text. Four experiments were designed to investigate how practice tests, specifically in multiple-choice and true—false formats, may support comprehension. Experiments 1 and 2 compared the two practice test formats to rereading. Both formats improved performance on a final essay test in Experiment 1, but in Experiment 2, only multiple-choice practice enhanced performance on a short-answer (SA) test. Experiment 3 introduced feedback on practice tests, but found no added benefit on the final SA test, which remained consistently better for those who completed the multiple-choice as compared with the true—false version of the practice test. Finally, manipulating text availability during practice tests in Experiment 4 improved performance on the final SA test. However, multiple-choice practice consistently led to better SA performance than true—false, regardless of text availability. The present work illustrates that the benefits from a closed-ended practice test with multiple-choice questions can persist over a delay and transfer to a set of new comprehension questions. At the same time, the results also highlight important constraints in that subtle nuances in question design can impact the observed benefits of practice testing on learning outcomes.
... Additionally, the quality of explanations can vary significantly, as not all students possess the ability to clearly articulate complex concepts (Bichler et al., 2022). Without proper guidance and oversight from the instructor, peer-led discussions may sometimes fail to address critical gaps in understanding, potentially hindering overall learning outcomes (Smith et al., 2009). Furthermore, students who are more confident or knowledgeable may dominate the discussion, limiting the contributions of others and reducing the collaborative benefits intended by peer explanation (Mills et al., 2020). ...
Preprint
Full-text available
This scoping review examines the use of student explanation strategies in postsecondary mathematics and statistics education. We analyzed 46 peer-reviewed articles published between 2014 and 2024, categorizing student explanations into three main types: self-explanation, peer explanation and explanation to fictitious others. The review synthesizes the theoretical underpinnings of these strategies, drawing on the retrieval practice hypothesis, generative learning hypothesis, and social presence hypothesis. Our findings indicate that while self-explanation and explaining to fictitious others foster individual cognitive processes enhancing generative thinking, peer explanation have the potential to combine these benefits with collaborative learning. However, explanation to fictitious others have the potential to mitigate some of the negative impacts that may occur in peer explanation, such as more knowledgeable students dominating peer discussions. The efficacy of the methods varies based on implementation, duration, and context. This scoping review contributes to the growing body of literature on generative learning strategies in postsecondary education and provides insights for optimizing the integration of student explanation techniques in mathematics and statistics.
Article
Two-stage exams, which pair a traditional individual exam with a subsequent collaborative exam, are widely popular with both students and faculty for fostering deep engagement, collaboration, and immediate feedback. Over the last decade, this assessment model has gained substantial traction in STEM college courses; however, holding both stages during class sessions often limits the full potential of two-stage exams, deterring many instructors from adopting them. To accommodate these constraints, instructors must either reduce the exam’s content depth and coverage, or hold evening, in-person exam sessions at fixed times, which can often be impractical for students and faculty with external commitments. In this paper, we introduce an alternative asynchronous approach that allows the collaborative portion to be completed unsupervised and outside of regular class hours, within 48 hr of the individual exam. This method not only eases logistical constraints but also allows more time for collaboration, potentially enhancing feedback quality. Our findings show that students equate their engagement, collaboration, and feedback quality during the asynchronous collaborative exam with that of standard in-class exams and show signs of retention of learning. This cost-effective approach requires no extra time or resources and could promote widespread adoption of this effective assessment method, especially in online-only and general STEM courses.
Chapter
This chapter explores the potential of active learning techniques as transformative pedagogical interventions to address learning challenges and enhance educational outcomes. The chapter begins by contextualizing the challenges of large classrooms that often hinder meaningful interaction and personalized feedback. It then examines the theoretical underpinnings of active learning, drawing from constructivist theory. Through an analysis of various active learning techniques, the chapter demonstrates how these methods can be adapted to large classroom environments. The chapter also addresses the role of technology in scaling active learning in large classes. However, the research also uncovers notable challenges in implementing these interventions. Despite these challenges, the chapter argues that integrating active learning in large classrooms is both feasible and beneficial with appropriate institutional support. The study employs a mixed-methods approach, combining classroom observations, surveys, and interviews with both students and lecturers in state universities in Zimbabwe. Data is analyzed thematically.
Article
Full-text available
Controversial topics are important parts of academic discussions, and due to the nature of these topics, students may be reluctant to speak freely about them in college classrooms. This study aims to explore factors that influence students’ reluctance to speak at a small midwest college, and the effect this may have on academic performance. We surveyed 233 undergraduates to evaluate the connection between campus expression and academic performance through the hypothesis that there is an inverse relationship between reluctance to speak and grade-point-average. A t-test was used to examine whether the number of topics students are reluctant to speak about is related to GPA, and found that the average GPA of students who are reluctant about a moderate number of topics is higher than those reluctant about an extreme number. We also explored the hypothesis that students who are reluctant to speak about controversial topics in the classroom are more concerned that peers will criticize their views as offensive than they are about criticism from professors or on social media. A McNemar’s Chi-Square test was used to analyze the results to determine which factor students were more concerned about. Students were more concerned about their peers than about their professors or being posted on social media. These results may highlight targets in classroom structure for attempting to decrease reluctance to speak.
Article
Two-stage exams, in which students first complete an exam individually and then again as a group, have been used successfully in many disciplines to promote collaboration, learning, and retention of learning. However, it is unknown what the impacts of two-stage exams would be with chemical engineering students. In this study, two-stage exams were implemented in a material and energy balances course, and student performance on and perceptions of the individual and group components are compared.
Article
Full-text available
A new question methodology has been developed and used with voting machines in large physics lecture classrooms. The methodology was tested by comparing student performance in voting machine and non-voting machine lecture sections during three consecutive electricity and magnetism quarters of introductory calculus-based physics. Data from The Conceptual Survey of Electricity and Magnetism and common examination questions indicates that students using voting machines achieved a significant gain in conceptual learning, and that voting machines reduced the gap between male and female student performances on tests. Surveys indicated that students were positive about the use of voting machines and believed that they helped them learn. The surveys also suggested that grading voting machines responses and/or overusing voting machines may lower student enthusiasm. © 2008 American Association of Physics Teachers.
Article
Full-text available
Scitation is the online home of leading journals and conference proceedings from AIP Publishing and AIP Member Societies
Article
Full-text available
Two instructional studies directed at the comprehension-fostering and comprehension-monitoring activities of seventh grade poor comprehenders are reported. The four study activities were summarizing (self-review), questioning, clarifying, and predicting. The training method was that of reciprocal teaching, where the tutor and students took turns leading a dialogue centered on pertinent features of the text. In Study 1, a comparison between the reciprocal teaching method and a second intervention modeled on typical classroom practice resulted in greater gains and maintenance over time for the reciprocal procedure. Reciprocal teaching, with an adult model guiding the student to interact with the text in more sophisticated ways, led to a significant improvement in the quality of the summaries and questions. It also led to sizable gains on criterion tests of comprehension, reliable maintenance over time, generalization to classroom comprehension tests, transfer to novel tasks that tapped the trained skills of summarizing, questioning, and clarifying, and improvement in standardized comprehension scores. Many of these results were replicated in Study 2. In contrast to Study 1, which was conducted by an experimenter, Study 2 examined group interventions conducted by volunteer teachers with their existing reading groups.
Article
Full-text available
We carried out an experiment to determine whether student learning gains in a large, traditionally taught, upper-division lecture course in developmental biology could be increased by partially changing to a more interactive classroom format. In two successive semesters, we presented the same course syllabus using different teaching styles: in fall 2003, the traditional lecture format; and in spring 2004, decreased lecturing and addition of student participation and cooperative problem solving during class time, including frequent in-class assessment of understanding. We used performance on pretests and posttests, and on homework problems to estimate and compare student learning gains between the two semesters. Our results indicated significantly higher learning gains and better conceptual understanding in the more interactive course. To assess reproducibility of these effects, we repeated the interactive course in spring 2005 with similar results. Our findings parallel results of similar teaching-style comparisons made in other disciplines. On the basis of this evidence, we propose a general model for teaching large biology courses that incorporates interactive engagement and cooperative work in place of some lecturing, while retaining course content by demanding greater student responsibility for learning outside of class.
Article
This study investigated (a) the relationships among student and group characteristics, group interaction, and achievement in small groups in junior high school mathematics classrooms, and (b) the stability of these relationships over time. One hundred and five students in four classrooms participated in two studies. All students first learned a unit on consumer mathematics. Three months later, half the students learned a unit on area and perimeter, and the other half learned a 1-week unit on probability. Interaction in the group was a potent predictor of achievement in all studies; asking a question and receiving no answer, the best predictor, was detrimental to achievement. The best predictor of interaction in the group was group composition: The frequency of asking questions and receiving no answer was higher in uniform-ability groups than in mixed-ability groups. Group interaction tended to be stable over time, both in average frequency and in individual students’ relative levels of participation.
Article
I. OVERVIEW. 1. Introduction. 2. Peer Instruction. 3. Motivating the Students. 4. A Step-by-Step Guide to Preparing for a Peer Instruction Lecture. 5. Sample Lecture. 6. Epilogue. II. RESOURCES. 7. Mechanics Baseline Test. 8. Force Concept Inventory. 9. Questionnaire Results. 10. Reading Quizzes. 11. Concept Tests. 12. Conceptual Exam Questions. Appendix: Disk Instructions. Index.
Article
This study explored the influence of offering different instructions to undergraduate students prior to their learning an expository text on evolutionary biology. Participants were asked to either explain, summarize, or listen to another's explanation or summary of Darwin's theory of evolution through natural selection. Three conditions were compared: In Condition 1, students were told to study the text because they were going to teach the contents of the text to their partner by either explaining or summarizing (these are referred to as the teach through explanation or summary conditions). In Condition 2, 2 different groups of participants were told to study the identical material on evolution and either explain or summarize the contents of the text aloud to the experimenter following the study period. However, they were only told to do so after they were finished studying for themselves. These are referred to as the explain or summarize to self conditions. In Condition 3, 2 different groups did not read the text for themselves. They were told that their partner was preparing to teach them a text on evolution and that they should listen carefully to their partner's explanation or summary because they would be asked some questions afterwards. These 2 groups are referred to as the hearers (50% listened to an explanation and 50% listened to a summarization). Overall, explainers outperformed summarizers on a far transfer task dealing with evolution. Moreover, the teach through explaination condition had the strongest effect on students' learning from text as measured by their performance on (a) an explanation-summary task, and on (b) evolutionary near and far transfer problems.
Article
Investigated the causes for large differences in difficulty of various isomorphic versions of the Tower of Hanoi problem in 6 experiments with 191 undergraduates. Since isomorphism rules out size of task domain as a determinant of relative difficulty, the present experiments identified causes for the differences in problem representation. Results show that (1) the solution process depended on Ss' expertise in utilizing problem rules to make moves, (2) the automation of the rule-using behavior was a necessary precursor to planning behavior, and (3) a small amount of planning capability enabled a rapid solution. (38 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
Reports and analyzes evidence concerning assumptions incorporated in a previously designed computer program, UNDERSTAND, which incorporates a theory about human understanding of written instructions. 20 graduate students and college faculty members were presented with puzzle isomorphs, identical in formal structure but differing in "cover stories." Ss' methods of solving the puzzles were observed and analyzed in terms of their bearing on the UNDERSTAND theory. It is concluded that how Ss name the objects in a puzzle and how they structure the internal problem representation are determined by the language in which the instructions are written. As predicted by UNDERSTAND, Ss followed the naming and representation in the instructions; however, when naming or representation is awkward and places too heavy a load on short-term memory, the inconvenient naming may be discarded in favor of a more convenient form. The program assumption that the understanding process will precede attempts at solution is partly borne out by the findings, but other assumptions are not supported. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
We report data from ten years of teaching with Peer Instruction (PI) in the calculus- and algebra-based introductory physics courses for nonmajors; our results indicate increased student mastery of both conceptual reasoning and quantitative problem solving upon implementing PI. We also discuss ways we have improved our implementation of PI since introducing it in 1991. Most notably, we have replaced in-class reading quizzes with pre-class written responses to the reading, introduced a research-based mechanics textbook for portions of the course, and incorporated cooperative learning into the discussion sections as well as the lectures. These improvements are intended to help students learn more from pre-class reading and to increase student engagement in the discussion sections, and are accompanied by further increases in student understanding.