Content uploaded by Daniela Castellanos-Reyes
Author content
All content in this area was uploaded by Daniela Castellanos-Reyes on Feb 02, 2023
Content may be subject to copyright.
© 2021 IAP
All rights reserved
Social Media, pages 231–263
Copyright © 2021 by Information Age Publishing
All rights of reproduction in any form reserved. 231
CHAPTER 8
THE RELATIONSHIP BETWEEN
SOCIAL NETWORK SITES
AND PERCEIVED LEARNING
AND SATISFACTION FOR
EDUCATIONAL PURPOSES
A Systematic Review and Meta-Analysis
Daniela Castellanos-Reyes
Purdue University
Yukiko Maeda
Purdue University
Jennifer C. Richardson
Purdue University
ABSTRACT
This chapter presents a systematic review of 31 studies that focused on the ef-
fect of using social network sites (SNSs) for educational purposes on students’
AU: To indicate corrections to these proofs, please use latest Adobe Acrobat Use the
Commenting tool, which can be accessed on the current version by right clicking on
the PDF and selecting Add Sticky Note. Position the Sticky Note where you want the
correction made and insert revision text inside the Sticky Note. Text you wish to revise
can also be highlighted by selecting the text, right clicking, and selecting Highlight
Text. The Strikethrough Text option can be used indicated text to delete. Please DO
NOT directly edit or copy and paste corrections to the PDF. Doing so will adversely
aect formatting and mangle the text. Failure to comply to these requirements will
result in corrected proofs not being accepted and returned to the author.
DO NOT EDIT ON DROPBOX. You must supply standalone files for each chapter
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
232 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
perceived learning and satisfaction. It was found that SNSs support these out-
comes when guidance and rules are clearly specified to learners. A subset of
the studies was also used for a meta-analysis. Small positive relations between
SNSs and student satisfaction (r = .17) and SNSs and perceived learning
(r = .23) were found. 𝐼² statistics (95% for satisfaction and 84% for perceived
learning) indicated that eect sizes across studies were heterogeneous. Face-
book was found to be a cost-eective alternative to learning management sys-
tems. Research with additional constructs like motivation is recommended.
Social network sites (SNSs) are Internet-based communication platforms
that Ellison and boyd (2013) characterized with three main features: (a)
uniquely identifiable profiles for platform members that display data con-
tributed by users and the system, (b) semi-public connections that can
be visited and accessed by others, and (c) user-generated content made
by members of their network. Gramlich (2019) reported that seven in 10
adults use Facebook in the United States, making it the most widely used
SNS across all ages, and three-quarters of American Facebook users log in
daily to their accounts (Pew Research Center, 2019). The Pew Research
Center (2019) reported that 90% of Americans between the ages of 18–29
use at least one SNS. Snapchat and Instagram are significantly popular
among young adults, which are used by 75% and 73% of 18–24 year-olds,
respectively (Perrin & Anderson, 2019). These values are similar to those
reported by Gramlich in teenage populations who reported using YouTube
(85%) and Instagram (72%) more than Facebook (51%).
Much research has focused on common uses of SNSs with fewer stud-
ies focused on the relationship between these sites and outcome variables
such as student learning in K–12 contexts (Greenhow & Askari, 2017).
However, Lim and Richardson (2016) found that college learners use SNSs
to gather and share information/resources and concluded that SNSs are
practical tools for educational purposes. They reported that SNSs are pre-
dominant components of learners’ lives based on the frequency of use;
of 89 online students in their study, 87.9% used SNSs for the past four
years, and 64% reported daily use. Lim and Richardson concluded that
students are already familiar with the interface and functionalities of SNSs
for social connections. Therefore, learners could escalate their SNS use to
include educational contexts without diculty (Lim & Richardson, 2016).
Xue and Churchill (2019) echoed Lim and Richardson’s findings with an
empirical review of the educational aordances of the SNS WeChat, which
is highly popular in Asia. Xue and Churchill found that SNSs have four
components that assist learning: (a) resources (access and sharing), (b)
activity (authentic learning, motivating environment), (c) support (col-
laboration and community building), and (d) evaluation (feedback and
administration of learning).
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 233
Although some researchers acknowledge the educational aordances
that social media brings to collaboration and teamwork (Klamma et al.,
2007; Qi, 2019; Xue & Churchill, 2019), others have conflicting (Keles,
2018; Manca & Ranieri, 2016a) or negative (Kirschner & Karpinski, 2010;
Liu et al., 2017) opinions about SNS use in formal education. Some re-
searchers (e.g., Huang, 2018; Liu et al., 2017; Marker et al., 2018) have
investigated the relationship between academic achievement and SNSs in
empirical studies. For example, Marker et al. (2018) examined the eect
of SNS use in academic achievement in a meta-analysis that grouped 50
studies based on three types of use: general use, multitasking, and use to
support learning. They found small negative or little eects in relation to
academic achievement when examining SNS use in general (r = −.07) and
multitasking (r = −.10). They also reported almost no eect (r = .07) when
learners used SNSs to support learning.
However, shedding light upon student outcomes other than achieve-
ment is also vital to obtain a complete picture of the role of SNSs in student
learning. Educational researchers often use multiple indices for evaluating
learning experiences (e.g., satisfaction, reaction, retention) beyond grades
(Bacon, 2016; Elbeck & Bacon, 2015; Sitzmann et al., 2010). For example,
Strelan et al. (2020) evaluated the eectiveness of flipped classrooms from
the students’ perspective by examining their satisfaction levels towards the
course and the instructor. Massive open online courses are often evaluated
based on student retention (Padilla Rodriguez et al., 2020). Therefore, al-
ternative measures are necessary to evaluate SNSs. Given this, we believe
that it would be beneficial to extend the investigation of alternative mea-
sures to evaluate SNSs and that by not doing so we would continue to con-
clude that SNS use is detrimental for learning, thereby potentially missing a
rich opportunity. Moreover, we need to investigate the role of SNSs in learn-
ers’ aective outcomes considering that SNSs are an outlet for expressing
emotions and creating a sense of community (Manca & Ranieri, 2016b; Na-
zir & Brouwer, 2019; Song & Xu, 2019; Tess, 2013; Xue & Churchill, 2019).
Therefore, our systematic review focused on aective learning outcomes to
provide further information on how and when SNSs can be beneficial to
student learning.
SOCIAL LEARNING AND SNS
Bandura (1971) explained learning as the process in which an individual
acquires new knowledge by observing others and modeling their behaviors.
The process is called social learning, as observation and modeling occur
in social contexts after learners imitate consciously or unconsciously the
example from others. Pahl-Wostl and Hare (2004) explained that “[social
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
234 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
learning] assumes an iterative feedback between the learner and their
environment, the learner changing the environment, and these changes
aecting the learner” (p. 194). Therefore, social learning implies a per-
manent multi-actor negotiation process between learners and the context
that involves them to, ultimately, co-create knowledge (Deaton, 2015; Sol
et al., 2013). However, such modeling is not limited to physical behavior or
mimicry. Abstract modeling is observational learning from thinking skills.
Bandura (2001) explained in his social cognitive theory that “observational
learning of thinking skills” (p. 275) occurs when learners verbalize thoughts
while problem-solving, which allows for internalization of societal rules.
Taking the potential of SNSs to provide learners with many opportuni-
ties to model behavior, we frame this study under the social cognitive theory
to examine the relationship between SNS use for academic purposes and
perceived learning and student satisfaction. Yilmaz et al. (2019) argued that
social media oers vicarious experiences in which learners benefit from
seeing others fail and succeed. SNSs allow users to interact fully and col-
laborate through multiple forms of user-created content (e.g., videos, im-
ages, audio, text posts). As such, users can model behaviors from videos or
pictures generated or shared by other users in their network (Peng et al.,
2019). As users become learners, they can discover underlying cultural rules
from text posts (Deaton, 2015) that enunciate other users’ problem-solving.
SNS AND STUDENT OUTCOMES
Researchers and educators use SNSs for academic purposes (Huang, 2018;
Liu et al., 2017; Manca & Ranieri, 2016b; Marker et al., 2018; Tess, 2013)
in multiple disciplines, including architecture (Awidi et al., 2019), history
(McKenzie, 2014), second language learning (Miller et al., 2018), education
(Abella-García et al., 2019; Cedar & Singhara, 2017), and business (Wan-
kel, 2009). Traditionally, researchers determine the eectiveness of SNS
use by examining its relationship with academic achievement (i.e., grades).
Rosen et al. (2013) argued that SNS use has adverse eects on academic
achievement due to multitasking and distraction. They observed learners
and tallied the number of times participants accessed Facebook while study-
ing. Rosen et al. concluded that learners who used Facebook one or more
times while studying had a lower GPA. A previous meta-analysis on the re-
lationship between SNS general use and achievement reported no eect
on grades when learners used Facebook (r = –.02) and only a small but
negative eect when learners use other types of SNSs (r = –.12) (Huang,
2018). Liu et al. (2017) also reported a small negative correlation (r = –.08)
between SNS use and GPA. However, they found almost no correlation be-
tween SNS use and language tests (r = .05). Similarly, Marker et al. (2018)
AU: please add to
references
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 235
reported almost no relationship when learners intentionally use SNSs for
academic purposes (r = .07). The negative small or no eect results con-
tradict the assumption that people learn by modeling abstract behaviors
observed through SNSs. Given the interactive and highly emotional nature
of SNSs, they can be related to aective learning outcomes like perceived
learning and satisfaction.
STUDENT PERCEIVED LEARNING AND SATISFACTION
Perceived learning refers to students’ self-reported level of knowledge gain
(Bacon, 2016). Contrary to actual learning, perceived learning is not mea-
sured using direct methods like tests or oral examinations (Elbeck & Bacon,
2015). Perceived learning is an indirect measure of knowledge gain based
on students’ introspection and reflection (Elbeck & Bacon, 2015; Joosten et
al., 2019; Mutambuki et al., 2019). Although researchers have determined
perceived learning gain to be a weak cognitive measure (Sitzmann et al.,
2010), this construct is important because self-perception of learning re-
quires learners to critically evaluate their learning as they build lifelong
learning habits (Sullivan et al., 1999). Perceived learning gain is indeed
positively correlated with aective measures like reaction (r = .51) (i.e., sat-
isfaction) and motivation (r = .59) (Sitzmann et al., 2010). Perceived
learning serves as a measure of course design eectiveness, intervention
implementation (Richardson et al., 2010), and curriculum development
(Mutambuki et al., 2019).
Student satisfaction is the extent to which students or learners are satis-
fied and positively assess their learning experience (Arquero et al., 2017;
Joosten et al., 2019; Li et al., 2017). Orawiwatnakul and Wichadee (2016)
described student satisfaction as students’ impression of the level of ef-
fectiveness of the learning process and the extent to which the process is
advantageous. For example, student satisfaction in online learning is a
promising estimate of how likely learners are to continue enrolling in on-
line courses (Arbaugh, 2000) as student satisfaction is associated with per-
sistence, motivation, and retention (Alqurashi, 2017; Strelan et al., 2020).
Allen et al. (2015) invited researchers to shift the focus when investigat-
ing student satisfaction from the broad examination of online learning to
specific technological applications. Furthermore, instructors are not con-
strained to use learning management systems (i.e., Blackboard, Moodle)
to host online learning experiences (Allen et al., 2015) because they can
use other online platforms like SNSs. Allen et al. (2015) also argued that
research synthesis, in particular, a meta-analysis, is necessary to determine
the impact of various online environments, including the use of SNSs, on
student satisfaction, and its variation in learning conditions.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
236 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
CURRENT STUDY
To determine the impact of SNSs in education, we aimed to systematically
synthesize study findings focused on educational SNS use and students’ af-
fective learning measures. More specifically, with this systematic review, we
first aimed to identify how researchers, educators, and students are using
SNSs for learning purposes. For example, Manca and Ranieri’s (2016b)
critical review examined Facebook use and its aordances for learning.
Although their analysis was comprehensive, they did not consider other
popular SNSs used for learning purposes (e.g., Twitter). Likewise, previ-
ous meta-analyses that examined multiple SNSs did not focus on the rela-
tionship with aective learning outcomes but with dierent measures like
actual learning (Huang, 2018; Liu et al., 2017; Marker et al., 2018). Liu
et al. (2017) called for future synthesis on the relationship between spe-
cific SNS uses (e.g., educational purposes) and gratification and academic
performance. Using academic achievement as the sole reference point can
provide a reductionist conclusion to the eect of SNS use on the learning
process. Also, these reviews (Huang, 2018; Liu et al., 2017; Marker et al.,
2018) were limited to studies with enough quantitative data to calculate ef-
fect size or have a specific research design (i.e., comparing experimental to
control group), so the implication of their findings may be limited.
Studies with qualitative designs often provide more in-depth insights
and high-quality interpretative research evidence (Yore & Lerman, 2008).
Therefore, a systematic process that reviews empirical findings regardless of
the research design will provide a more comprehensive account of the tar-
get phenomenon, that is, how researchers and practitioners are using SNSs
for academic purposes and how SNSs are related to student aective learn-
ing outcomes. As a part of the systematic review, we also conducted a meta-
analysis to investigate the strength of the relationship between SNS use and
students’ perceived learning and satisfaction with a small subset of studies
with quantitative evidence. This meta-analysis addresses this knowledge gap
by investigating the eect of academic SNS use on perceived learning and
satisfaction. Given this, our research questions were as follows:
1. How are SNSs incorporated to support aective outcomes (i.e., per-
ceived learning and satisfaction)?
2. What is the context of academic SNS use (i.e., type of SNS, learn-
ing management system [LMS] integration, optional use, academic
domain, and type of course)?
3. To what extent does the use of SNSs for educational purposes re-
late to an increase in students’ perceived learning and satisfaction?
Is there a significant variability in these relationships across studies?
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 237
METHOD
A systematic review attempts to make a comprehensive synthesis of studies
on a topic by systematically identifying previous research that meets explicit
predefined criteria (Uman, 2011). As part of this systematic review, we also
conducted a meta-analysis with a subset of quantitative studies to estimate
the strength of the relationship between SNS use and aective learning
outcomes. Borenstein et al. (2009) explained that a meta-analysis is a piv-
otal part of the systematic review as “it is the statistical synthesis of the data”
gathered during the review (p. xxiii).
The systematic review process has multiple steps (e.g., Higgins & Green,
2009; Newman & Gough, 2020). First, we formulated the research ques-
tions to focus on the educational use of SNSs and the desired learning
outcomes (satisfaction and perceived learning). Second, we defined our
inclusion and exclusion criteria to identify the studies to include. Third, we
developed a search strategy by defining search terms and databases. Fourth,
after selecting a comprehensive list of primary studies, we extracted the
data using the final coding scheme. Fifth, we synthesized empirical findings
from primary studies in the systematic review. Then, results from studies
that provided enough quantitative information were included in the meta-
analysis. Finally, we evaluated our findings for validity. The details of the
process are described below.
Study Inclusion and Exclusion Criteria
Empirical primary studies reported between 1997, when SNSs first
launched to the public, and January 2020 were eligible for the systematic
review, regardless of their reporting format. Any literature that only reports
theoretical discussions, essays, reviews, or non-empirical findings was ex-
cluded. Studies were included using the following criteria:
1. Authors examined the relationship between the use of SNSs for
educational purposes and students’ perceived learning or satisfac-
tion in their study.
2. The study used SNSs for formal or informal educational purposes.
3. The study was reported in either English or Spanish for the re-
searchers to be able to read them.
We included other educational settings, including government and mili-
tary educational settings, as undergraduate populations and higher educa-
tion settings dominated previous meta-analyses (Huang, 2018; Liu et al.,
2017; Marker et al., 2018). Studies that reported attitudes towards SNSs or
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
238 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
student motivation to use SNSs were excluded (e.g., Bardwell, 2017; Kan-
thawongs et al., 2016; Zainuddin et al., 2017). Likewise, research focused
on games embedded within SNSs were also excluded (e.g., Krom, 2012; La-
bus et al., 2015). Research focused on actual learning using direct measures
(e.g., exams, GPA) was not included (e.g., Slim & Hafedh, 2019). Similarly,
studies that measured students’ satisfaction with an advisor (e.g., Junco et
al., 2016) or factors external to the course (e.g., Wang, 2013) were exclud-
ed. Finally, our systematic review excluded studies reporting on the social
network aordances of LMSs because such environments are specifically
developed for learning (e.g., Ellahi, 2018).
Study Search Process
Figure 8.1 is a PRISMA chart (preferred reporting items for systematic
reviews and meta-analyses) that summarizes the sampling process (Moher
et al., 2009). The search process had four phases: identification, screening,
eligibility, and inclusion. In the identification phase, we used specific key
terms listed below to find potential research studies to include in the sys-
tematic review. In this first phase, we identified studies from the following
sources: electronic databases, conference proceedings, references of rele-
vant articles, and referrals from experts. The first author identified relevant
studies in October 2019 using the following databases: ERIC from EBSCO,
PsycINFO, Communication & Mass Media Complete, Education Full Text, Edu-
cation Source, APA PsycArticles, and APA PsycInfo. Search terms used were a
combination of terms related to SNSs, perceived learning, and satisfaction.
The following are three groups of key terms associated with each variable:
1. “Social network sites” [SNS, social media, social networks, Face-
book, Twitter, Pinterest, LinkedIn, Instagram, MySpace, Weibo,
Renren, StudiVZ, Google+]
2. “Perceived learning” [learning]
3. “Satisfaction” [learner satisfaction, student satisfaction]
We manually searched unpublished conference papers presented at two
prominent academic conferences: the American Educational Research As-
sociation (records available between 2010 and 2019) and the Association
for Educational Communications and Technology (records available be-
tween 1998 and 2018). Also, we manually searched the reference lists of
previous research syntheses (Huang, 2018; Liu et al., 2017; Manca & Ran-
ieri, 2016b; Marker et al., 2018). We reviewed relevant literature about per-
ceived learning and satisfaction as indicators of student outcomes (Allen et
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 239
al., 2012; Alqurashi, 2017; Elbeck & Bacon, 2015; Joosten et al., 2019; Li et
al., 2017; Richardson et al., 2010; Sitzmann et al., 2010).
The identification phase produced 574 citations of research studies from
database searching. Of those, 514 were excluded because these sources did
not have the key terms associated with the study (i.e., SNS, perceived learn-
ing, or satisfaction), but the databases associated them as synonyms. The
database search yielded several studies from the field of medicine that were
excluded because the keyword “perceived” was related to perceived anxiety
and the keyword “satisfaction” to satisfaction with life.
In the screening phase, the identified studies were evaluated based on
their abstracts. We retained papers when at least one of the associated
terms related to the target phenomenon (i.e., the use of SNSs for educa-
tion purposes) and at least one of the terms related to the target outcomes
PL k = 7
Included Eligibility Screening Identification
SS k = 8
Records identified
through database
searching
(n = 433)
Records identified
through references
of relevant articles
(n = 12)
Records identified
through conference
proceedings
(n = 120)
Records identified
through other
sources
(n = 9)
Records screened
(n = 574)
Records excluded
(n = 514)
Full-text articles excluded,
with reasons
(n = 29)
• Duplicates (n = 4)
• Articles did not
examine students’
perceived learning
or satisfaction
(n = 25)
Full-text articles assessed for eligibility
(n = 60)
Studies included in systemic
narrative review
(n = 31)
Unique studies included in quantitative
summary (meta-analysis)
(k = 12)
Figure 8.1 PRISMA flow diagram for study selection. Note: Studies included in
the quantitative summaries are also part of the systematic review of SNSs used for
learning purposes and learning outcomes. PL k: Studies from which a perceived
learning eect size was extracted. SS k: Studies from which a student satisfaction
eect size was extracted.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
240 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
(i.e., students’ perceived learning or satisfaction) were present in the ab-
stract of each of the research papers. The screening phase resulted in 60
research studies to be further assessed for eligibility. Forty-one of those 60
articles came from our database search, four from conference proceedings,
six from reference lists, and nine from external identification (e.g., authors
recommended, suggested by the database during search).
Full-text articles of these 60 studies were accessed during the eligibility
phase. The first author retrieved each document and assured that it met
all the inclusion criteria. Twenty-five of these studies did not explore the
relationship between educational SNS use and perceived learning or sat-
isfaction, and four additional articles were duplicates of studies already in-
cluded. The inclusion phase resulted in a final sample of 31 studies for the
systematic review.
Data Extraction and Coding Reliability
for Systematic Review
While selecting studies, we also developed and piloted a coding scheme
to extract data from the primary studies. The first author developed an
initial coding scheme. The second and third authors reviewed the coding
scheme, and adjustments were made accordingly. The first author and a
graduate researcher piloted the revised coding scheme. Inter-rater reli-
ability for the revised coding scheme was calculated with the “irr” package
(Gamer et al., 2019) in R software (R Core Team, 2019). The two coders
achieved 91% agreement, Kappa = .90, z = 33.6, p < .01. Coders met to dis-
cuss disagreement and coding scheme areas for improvement. With the fur-
ther revisions on the coding scheme and piloting, the two coders achieved
93.8% agreement, Kappa = .93, z = 33.9, p < .01.
Meta-Analysis of Quantitative Studies
Eect Size Calculation
We used Pearson’s correlation coecient (r) as the eect size for the
meta-analysis. Borenstein et al. (2009) explained that measurement scales
change between studies when researchers use dierent psychometric or
educational instruments to assess an outcome. A correlation coecient is a
standardized eect size measure that “take[s] account of dierent metrics
in the original scales” (Borenstein et al., 2009, p. 41). The interpretation
of Pearson’s correlation is intuitive, ranging from –1 to +1, with zero repre-
senting no relationship (Durlak, 2009). The estimates of eect sizes were
either directly obtained from primary studies or computed from available
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 241
quantitative data provided in the primary studies. Pearson’s correlations
were converted to Fisher’s z scale for normalizing its sampling distribution
and then converted back to the original r metric for reporting purposes
(Borenstein et al., 2009).
Handling Dependence of Eect Sizes
A total of 28 eect sizes were originally extracted from the 12 prima-
ry studies included in the meta-analysis portion of the systematic review.
Five studies (Frisby et al., 2016; Kucuk & Sahin, 2013; Nalbone et al., 2016;
Pishock, 2018; Thoms & Eryilmaz, 2015) reported multiple independent ef-
fect sizes. However, the eect sizes extracted from Kucuk and Sahin (2013)
and Pishock (2018) were considered statistically dependent because they
were obtained from the same samples. While variant methods are avail-
able for handling dependent eect sizes (e.g., Card, 2012; Cooper, 2010;
Hedges et al., 2010; Olkin & Gleser, 2009; Sutton et al., 2000; Van den
Noortgate et al., 2013, 2015), we decided to calculate an average of the
eect size weighted by its precision within each study (e.g., Borenstein et
al., 2009; Cooper, 2010). The decision was made because (a) the method
has been most widely used in meta-analysis (Hedges et al., 2010), and (b)
alternative methods, like a multivariate method, require additional data
knowledge (e.g., covariances among dependent eect sizes, Olkin & Gle-
ser, 2009), which is often not reported in primary studies, or requires strict
data assumptions for unbiased estimations (e.g., the application of the use
of multilevel modeling, Van den Noortgate et al., 2013, 2015) and thereby
it was not feasible to apply to the current meta-analysis. It also helped us
to avoid losing information by simply selecting one eect size per study.
To aggregate the dependent eect sizes, we used the MAd R package (Del
Re et al., 2011) aggregation function that implements the Borenstein et al.
(2009) procedure. A total of 19 eect sizes was extracted for synthesis after
aggregating dependent eect sizes. Of those, 10 eect sizes accounted for
student satisfaction, and nine accounted for perceived learning.
Data Analysis
We adapted the random-eects model as our methodological frame-
work because the fixed-eect model omits potential meaningful variation
between studies (Hunter & Schmidt, 2000). Hunter and Schmidt (2000)
recommended that researchers use a random-eects model when conduct-
ing meta-analytic computations as it allows researchers to make generaliz-
able conclusions that allow for future replication. Three statistics were used
to investigate the variation of eect sizes across studies. First, we quantified
heterogeneity using an τ2 statistic to show the percentage of variance among
studies due to reasons other than chance. Second, we tested for homoge-
neity using a Q test (Hedges & Olkin, 1985). Finally, the between-groups
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
242 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
variance statistic τ2 was calculated (Higgins et al., 2003). The average cor-
relation was computed by weighting each eect size for its precision (Bo-
renstein et al., 2009). We used the “meta” (Schwarzer, 2019) and “metafor”
(Viechtbauer, 2010) statistical packages to perform the meta-analysis in R
(R Core Team, 2019).
Sensitivity Analysis
The file drawer problem, also known as publication bias (Sutton, 2009),
means that studies that do not result in statistically significant results are less
likely to be published than studies that show statistical significance (Rosen-
thal, 1979). This may lead the present meta-analysis to have publication bias
assuming that the majority of published studies show statistically significant
results. We attempted to make a comprehensive gathering of studies that
resulted in nine published journal articles and three unpublished disserta-
tions. To examine possibilities of publication bias, we plotted the eect sizes
as a function of their standard errors in a funnel plot for visual inspection
(Egger et al., 1997). The trim and fill analysis was also used to estimate the
number of studies missing in the funnel plot to make it more symmetric
and explore publication bias.
RESULTS
Characteristics of Included Studies
in the Systematic Review
The studies included in the systematic review were conducted in the
United States (n = 14), Israel (n = 3), Spain (n = 3), Turkey (n = 3), Thai-
land (n = 2), Australia (n = 1), Cyprus (n = 1), Iraq (n = 1), Saudi Arabia
(n = 1), Taiwan (n = 1), and United Kingdom (n = 1). The combined to-
tal sample size was 4,552 participants. Table 8.1 summarizes the studies
included in the systematic review. The mean age of participants was 23.4
years. Gender was fairly even across the sample of studies. Twenty-one stud-
ies reported participants’ gender, and the mean percentage of female par-
ticipants across studies was 57.3%. Only five studies included data on par-
ticipants’ race. The mean percentage of White participants was 62.43%.
Twelve studies out of 31 studies reported student satisfaction as the aective
outcome. Likewise, 12 studies investigated perceived learning as the aec-
tive outcome. A subset of seven studies studied both student satisfaction
and perceived learning as aective outcomes.
Facebook was the most reported SNS used for academic purposes
(n = 21), followed by Twitter (n = 13). Studies included in the systematic re-
view could examine the relationship between SNSs and aective outcomes
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 243
TABLE 8.1 Summary of Studies on the Relation Between Social Network Sites Use for Academic Purposes
and Affective Outcomes
Author(s) and Year Type NSNS(s)
Optional/
Mandatory
Academic
Domain
Type of
Course r SS r PL
Affective
Outcome
Abella-García et al. (2019) J 202 T M ED F2F — — PL
Al-Azawei (2019) J 143 F O IT F2F — — SS
Arquero et al. (2017) J 202 F, T O B F2F — — SS
Awidi et al. (2019) J 60 F M A B — — PL
Cedar & Singhara (2017) J 30 F M SLL B — — SS, PL
*Clarke & Nelson (2012) J 81 T O B F2F .28 .19 SS, PL
Davidovitch & Belichenko (2018) J 150 F O M F2F — — SS, PL
*Eastman (2015) D 40 T M B F2F — .20 PL
*Frisby et al. (2016) #1 J 10 F M LA F2F .31 –.16 SS, PL
*Frisby et al. (2016) #2 J 15 T M LA F2F .18 .34 SS, PL
Homan (2009) CP 51 N M ED O — — SS
Hurt et al. (2012) J 107 F M LA F2F — — PL
Ioannou et al. (2016) J 60 F M M F2F — — SS, PL
*Kucuk & Sahin (2013) J 109 F M ED B .24 — SS
Kurtz (2014) J 134 F O ED B — — PL
Lowe & Laey (2011) J 123 T O B F2F — — SS
Lowenthal & Dunlap (2010) CP 17 T O ED O — — SS, PL
Meishar-Tal et al. (2012) J 50 F O ED F2F — — PL
Miller et al. (2019) J 35 F, T M SLL F2F — — PL
(continued)
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
244 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
TABLE 8.1 Summary of Studies on the Relation Between Social Network Sites Use for Academic Purposes
and Affective Outcomes (continued)
Author(s) and Year Type NSNS(s)
Optional/
Mandatory
Academic
Domain
Type of
Course r SS r PL
Affective
Outcome
*Nalbone et al. (2016) #1 J 568 F O M F2F –.01 — SS
*Nalbone et al. (2016) #2 J 465 F O M F2F .17 — SS
Orawiwatnakul & Wichadee (2016) J 82 F M SLL F2F — — SS
Ozan (2013) J 48 F, T O ED F2F — — PL
*Pishock (2018) D 300 F M MS F2F .65 — SS
Porath (2018) J 26 T, G+ O ED O — — PL
*Powless (2011) D 799 F O M F2F .05 — SS
*Rinaldo et al. (2011) J 113 T M B F2F — .22 PL
*Rueda et al. (2017) J 94 F, T, P, L, G+ O B F2F –.28 –.23 SS, PL
Salameh (2017) J 145 F O SLL F2F — — SS
Shih (2013) J 111 F M SLL B — — SS
*Strahler (2014) D 39 T O ED O — .81 PL
*Thoms & Eryilmaz (2015) #1 J 23 T M CS O — .26 PL
*Thoms & Eryilmaz (2015) #2 J 24 T M CS F2F — .15 PL
*Uzun et al. (2014) J 96 F M ED F2F .01 — SS
Note: The 12 unique studies included in the meta-analytic review are indicated with an asterisk. Number after publication year indicates that multiple
independent eect sizes were extracted from the same study. J = Journal Article; D = Dissertation; CP = Conference Proceeding; F = Facebook;
T = Twitter; G+ = Google+; P = Pinterest; L = LinkedIn; N = Ning; ED = Education; IT = Information Technology; B = Business; A = Architecture;
SLL = Second Language Learning; M = Mixed Academic Domains; LA = Liberal Arts; MS = Military Science; F2F = Face-to-face; OL = Online
Learning; B = Blended Learning; PL = Perceived Learning; SS = Student Satisfaction. Dash indicates that an eect size was not obtained from the
research study.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 245
with more than one SNS platform. For example, four studies investigated
both Facebook and Twitter (Arquero et al., 2017; Frisby et al., 2016; Miller
et al., 2018; Ozan, 2013). For that reason, the aforementioned numbers
add up to more than the 31 studies included. Homan (2009) focused on
Ning while Porath (2018) focused on Google+ in addition to Twitter. One
study reported that learners used multiple SNSs simultaneously (Facebook,
Twitter, Pinterest, LinkedIn, Google+; Rueda et al., 2017). Most studies did
not integrate an LMS with the educational use of SNSs (n = 22).
While disciplinary variation was observed among conducted studies, the
available research was mainly limited to undergraduate students and face-
to-face learning environments. More specifically, 22 of 31 studies were con-
ducted with an undergraduate population in various disciplines: education
(n = 5, Abella-García et al., 2019; Homan, 2009; Kucuk & Sahin, 2013;
Ozan, 2013; Uzun et al., 2014), business (n = 5, Arquero et al., 2017; Clarke
& Nelson, 2012; Eastman, 2015; Rinaldo et al., 2011; Rueda et al., 2017),
second language learning (n = 3, Miller et al., 2018; Orawiwatnakul &
Wichadee, 2016; Salameh, 2017), liberal arts (n = 2, Frisby et al., 2016; Hurt
et al., 2012), architecture (n = 1, Awidi et al., 2019), information technol-
ogy (n = 1, Al-Azawei, 2019), computer science (n = 1, Thoms & Eryilmaz,
2015), military science (n = 1, Pishock, 2018), and mixed disciplines (n = 3,
Davidovitch & Belichenko, 2018; Nalbone et al., 2016; Powless, 2011). In
contrast, limited studies are available with graduate student populations
(n = 6; Ioannou et al., 2016; Kurtz, 2014; Lowe & Laey, 2011; Lowenthal
& Dunlap, 2010; Meishar-Tal et al., 2012; Shih, 2013) and with the govern-
ment sta (n = 1, Cedar & Singhara, 2017). Studies in an informal learning
setting were also limited (n = 2, Porath, 2018; Strahler, 2014).
Five of the studies were based in a blended learning environment (Awi-
di et al., 2019; Cedar & Singhara, 2017; Kucuk & Sahin, 2013; Kurtz, 2014;
Shih, 2013) and another five were based in online learning environments
(Homan, 2009; Lowenthal & Dunlap, 2010; Porath, 2018; Strahler, 2014;
Thoms & Eryilmaz, 2015); the remaining 21 studies were focused on face-to-
face learning environments. Mandatory or optional use of SNSs was relatively
equal across studies. Participants were required to use SNSs in 16 studies,
whereas 15 studies gave students a choice to use or not use SNSs for the class.
Relationship Between SNS Use and Student Satisfaction
Facebook (n = 14) was the most used SNS, followed by Twitter (n = 6), to
examine its relationship with student satisfaction. The SNS Ning was used
in one study (Homan, 2009) to support learning. Given the predomi-
nance of Facebook and Twitter, the results are divided on the type of af-
fective learning outcome and use of Facebook and Twitter for educational
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
246 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
purposes. Furthermore, we believe it will be more practical for practitio-
ners and researchers alike to find the results by SNS when looking for
recommendations.
Facebook to Support Student Satisfaction
Overall, researchers reported that using Facebook for learning purposes
increased student satisfaction (n = 11). Not all researchers reported the
standard deviation of quantitative findings. Consequently, we are report-
ing the number of items of the scale used to measure satisfaction when
the standard deviation was not available. Nalbone et al. (2016) observed
improvement on student satisfaction in an experimental study in which
Facebook was used to create a learning community among first-year un-
dergraduate students (M = 2.28, SD = .52) when comparing to a control
group (M = 2.11, SD = .45). In this case, Facebook was used to help first-
year students transition to college life. Similarly, Cedar and Singhara (2017;
M = 4.58, scale 1–5), Davidovitch and Belichenko (2018) (M = 2.72, scale
1–4), and Salameh (2017; M = 4.66, scale 1–5) also reported positive re-
sults regarding student satisfaction. Orawiwatnakul and Wichandee (2016;
M = 3.76, scale 1–5) explained that the positive results could be due to the
high level of familiarity with Facebook and its widespread use. Facebook
helped create bonding among students by allowing them to disclose infor-
mation (e.g., hobbies, interests) that otherwise would not be shared with
peers (Frisby et al., 2016). Having opportunities to discuss topics dierent
from the content area (Arquero et al., 2017) allowed participants to build
interpersonal ties with their peers (Frisby et al., 2016) and increased enthu-
siasm towards the learning experience (Kucuk & Sahin, 2013).
Even though 11 studies showed how Facebook supported student satisfac-
tion, four studies did not find positive or statistically significant results. For
example, Uzun et al. (2014) reported that there was no statistically significant
dierence between experimental (Facebook) and control groups regarding
student satisfaction, t(96) = 0.08, p = .94. Al-Azawei (2019) found a positive
relationship (r = .80) between experience using Facebook and student sat-
isfaction. Al-Azawei suggested that further training on using SNS for edu-
cational purposes would increase satisfaction. Consequently, learners who
are unfamiliar with SNSs should receive guidelines on how to use them to
improve student satisfaction. Rueda et al. (2017) showed a weak negative cor-
relation (r = –.28) between SNS use and student satisfaction. However, this
study allowed learners to use multiple SNSs in addition to Facebook and did
not provide details on how they were used in the classroom.
Twitter to Support Student Satisfaction
All but one (Rueda et al., 2017) study that used Twitter to support student
satisfaction (n = 6) yielded positive results. Two of those studies achieved
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 247
statistical significance (Clarke & Nelson, 2012; Lowe & Laey, 2011), and
three showed a mean increase in satisfaction (Arquero et al., 2017; Frisby
et al., 2016; Lowenthal & Dunlap, 2010). Twitter use for learning purposes
promotes positive attitudes towards the overall learning experience and
promotes a sense of classroom community (Clarke & Nelson, 2012). The
positive relationship between Twitter use for learning purposes and student
satisfaction is related to the use of clear course guidelines. For example,
Clarke and Nelson (2012) established a course hashtag to follow course
tweets, provided specific criteria to follow course tweets, and asked partici-
pants to tweet at least three times about topics relevant to the course.
Still, not all studies provided learners with guidelines on how to use Twit-
ter, yielding mixed or negative results. For example, Lowenthal and Dunlap
(2010) used Twitter as an optional just-in-time tool for course interaction.
Lowenthal and Dunlap reported that learners were very satisfied (M = 3.63,
0–4 scale) with the learning experience when using Twitter, given that it
provided a “more intimate [communication] than mandatory weekly dis-
cussions” (p. 6). As seen with Facebook, learners also reported establishing
closer connections with peers by sharing personal information (Lowenthal
& Dunlap, 2010). However, the follow-up interviews also revealed students’
discomfort with receiving continuous updates from classmates and the in-
structor. As one student put it: “I was not interested in knowing what my
instructor was doing each minute of the day. I don’t want to know intimate
details about my instructors and peers” (Lowenthal & Dunlap, 2010, p. 13).
Only Rueda et al. (2017) reported a negative correlation between SNS use
and student satisfaction. However, guidelines on how Twitter was used in
the course are not explicit. Therefore, we presume that the use of multiple
SNSs and lack of guidance may have led to a negative relationship.
Meta-Analytic Results on the Relationship Between SNS Use and
Student Satisfaction
Studies investigating SNS use for academic purposes and student satis-
faction showed correlations ranging from r = –.28 (Rueda et al., 2017) to
r = .65 (Pishock, 2018). The 10 studies represented a total of 3,595 students.
Figure 8.2 is a forest plot that shows the correlation coecients, their
weights, and 95% confidence intervals. The vertical line at zero indicates no
eect or no relationship. The forest plot shows that most eect sizes were
positive and had large variation. The exceptions were Nalbone et al. (2016)
#1 (first iteration) on using Facebook to support college transition and
Rueda et al. (2017) who used multiple unguided SNSs to support learning.
The weighted average correlation was r = .17, which is a small but posi-
tive correlation, according to Cohen’s (1992) guideline. The I
2 = 95% (with
the CI of [92%, 96%]) indicated that the relationship between academic
use of SNSs and student satisfaction is heterogeneous due to reasons other
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
248 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
than sampling error variation. The statistically significant result from the
heterogeneity test, Q(9) = 168.88 (p < .01), 𝜏² = 0.07 also supports the het-
erogeneity of the relationship. However, further analysis with the modera-
tors was not possible due to the small number of eect sizes. The results of
the meta-analysis are consistent with the findings of studies only included in
the systematic review. The eect of SNS use on student satisfaction is posi-
tive when it is used for learning purposes.
Relationship between SNSs and Perceived Learning
Researchers used Twitter and Facebook almost exclusively to research
the relationship between academic SNS use and perceived learning. Only
Rueda et al. (2017) included other SNS options (Pinterest, Linkedin,
Google+). However, they also researched Twitter and Facebook in their
study. Results are presented by SNS type, like in the case of student satisfac-
tion above.
Facebook to Support Perceived Learning
Similar to student satisfaction, most studies (n = 7) reported a positive
relationship between Facebook use for learning purposes and perceived
learning. Facebook created a dynamic online place for intensive and col-
laborative learning experiences (Ioannou et al., 2016; Meishar-Tal et al.,
2012). Researchers created these collaborative online spaces using Face-
book as an alternative to the institutional LMS or course website (Hurt et
al., 2012; Kurtz, 2014; Meishar-Tal et al., 2012; Ozan, 2013). Meishar-Tal et
al. (2012) created a private Facebook group specifically to serve as a LMS
Figure 8.2 Forest plot of relationship between SNS use for academic purposes
and student satisfaction.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 249
in the course, and in another study, Facebook served as a course reposi-
tory to share course materials (e.g., presentation, documents) (Awidi et al.,
2019). It was also the communication channel among students when do-
ing group work (Frisby et al., 2016). Similarly, instructors used Facebook
to communicate with students individually (Hurt et al., 2012). Facebook
was also heavily used for peer-assessment and online discussions (Meishar-
Tal et al., 2012) and learners reacting to others’ comments in active (re-
plying) and passive (liking) ways (Meishar-Tal et al., 2012). Unlike a LMS,
Facebook cannot guarantee participants’ privacy. Therefore, when using
Facebook for educational purposes, researchers protected learners’ privacy
by creating closed groups in which only course members could have access
(Miller et al., 2018). Contrary to Twitter, in which tweets are publicly avail-
able and can be found using the course hashtag, participants could restrict
their Facebook posts.
Participants reported high perceived learning in second language learn-
ing when using Facebook (Cedar & Singhara, 2017; Miller et al., 2018). Face-
book improved perceived learning in reading and writing skills (Miller et al.,
2018). Participants also stated that using Facebook to support oral communi-
cation skills improved their English pronunciation (e.g., “I could speak more
correctly and more clearly” (Cedar & Singhara, 2017, p. 131). Researchers
explained that the positive relationship of Facebook with perceived learning
is due in part to instructors’ good discussion facilitation (Awidi et al., 2019).
Unlike the previous studies, Hurt et al. (2012) did not yield statistically sig-
nificant results on the use of Facebook and perceived learning when compar-
ing an experimental and control group. However, Hurt et al. clarified that
they intervened as little as possible in Facebook interactions. Therefore, we
conclude that participants of the Facebook group had little support in the
learning experience resulting in sparse perceived learning.
Twitter to Support Perceived Learning
Nine studies out of 12 found Twitter to increase perceived learning.
Twitter was ideal for participants to share experiences and have discussions
(Abella-García et al., 2019), especially for informal learning settings. For
example, Strahler (2014) reported a high correlation between perceived
learning and Twitter use for learning purposes (r = .81). Participants of the
Twitter conversation #edtechchat discussed educational technology topics
in this study. The hashtag was used to follow asynchronous conversations
and provide answers to questions posted by moderators. Porath (2018) in-
vestigated the use of the hashtag #CyberPD by a community of educators
who were members of a book club. Participants of the informal commu-
nity followed book authors and even had synchronous conversations with
them. Porath clarified that the books’ content became a secondary topic
because most of the learning was reported from interactions with peers.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
250 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
As the learning community was established, participants stated that they
implemented strategies learned from the book club and discussions in their
teaching practices.
Twitter also increased perceived learning in formal educational settings.
For example, Rinaldo et al. (2011) reported a statistically significant in-
crease (t = 3.41, p < .001) over time in a business course that used Twitter.
Rinaldo et al. conceptualized Twitter as an experiential learning tool in
which business learners could see the principles of marketing being ap-
plied by companies’ accounts that they followed on Twitter. Thoms and
Eryilmaz (2015) also found an increase in perceived learning when using
Twitter to illustrate ethical concepts to computer science and business stu-
dents. Yet Clarke and Nelson (2012) suggested that instructors needed to
emphasize how Twitter bridges theory and practice to avoid seeing Twitter
as a merely social activity.
A positive relationship was also discovered regarding perceived learn-
ing when using Twitter for second language learning. Miller et al. (2018)
found Twitter to be positive for perceived learning in writing, grammar,
and vocabulary. However, Frisby et al. (2016) argued that Twitter hinders
the transmission of academic ideas due to the character limit. Miller et al.
explained that limiting characters forced learners to write short sentences
in the target language, making it easier for them to communicate simple
ideas correctly. Lowenthal and Dunlap (2010) found that Twitter’s charac-
ter limit fosters more natural communication among learners who could
share personal details about their family and school life.
Meta-Analytic Results on the Relationship Between SNS Use and
Perceived Learning
A total of nine correlations from 464 individuals represented the re-
lationship between academic use of SNSs and perceived learning with a
range from r = –.23 (Rueda et al., 2017) to r = .81 (Strahler, 2014). A forest
plot with the nine independent eect sizes (see Figure 8.3) indicates that
the majority of the eect sizes show a positive relationship between SNS use
and perceived learning, except for Frisby et al. (2016) #1 and Rueda et al.
(2017). A small but positive average correlation (r = .23) was found. The
I
2 = 84% statistic was high, with a 95% confidence interval of 72% and 91%,
indicating that the studies investigating the relationship between academic
use of SNSs and perceived learning are heterogeneous. The result of a het-
erogeneity test Q(8) = 50.84 (p < .01), 𝜏² = .12 showed that there was a statis-
tically significant variation among studies under the random-eects model.
However, further analysis with the moderators was not possible due to the
small number of eect sizes. Like student satisfaction, SNSs also had a posi-
tive eect on perceived learning when purposefully used for education.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 251
Sensitivity Analysis for Meta-Analysis
Figure 8.4 shows the funnel plots referenced to explore publication bias
in academic SNS use and aective learning outcomes. Duval and Tweedie’s
trim and fill procedure (Duval, 2005) was conducted to estimate the ef-
fect size assuming that potential missing studies were published for both
student satisfaction and perceived learning. The trim and fill test in the
student satisfaction data shows that after adding three studies with small to
moderately large negative eect sizes (r = –.15, r = –.19, r = –.56), the sum-
mary eect decreases from r = .16 to r = .05. In the perceived learning data,
the average correlation would decrease from r = .23 to r = .08 after adding
two studies with negative eect sizes with the size of r = –.18 and r = –.74.
Because the sample sizes for both meta-analyses are small, adding small
numbers of the studies with a negative correlation would nullify the overall
Figure 8.3 Forest plot of the relationship between SNSs use for academic pur-
poses and perceived learning.
Figure 8.4 Funnel plot for correlations of academic SNS use and students’ satis-
faction and perceived learning.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
252 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
summary of the relationships. However, based on our findings from the
systematic review, it is unlikely to find studies with such large negative cor-
relations. While we acknowledge the potential threat to publication bias
and the need for replication of meta-analysis with a larger sample size, we
consider the results of the current meta-analytic findings to have scholarly
merit for interpretation.
DISCUSSION AND CONCLUSIONS
Leary and Walker (2018) stated that the systematic report of previous re-
search in the field of instructional design and technology is urgent to deep-
en the understanding of prior research and improve theory. Failure to find
scholarly agreement results in the use of ineective strategies and unneces-
sary replication of work. The ambivalent opinions of researchers and the
lack of systematic attempts to condense results indicate a need for another
method that brings agreement, at least to some extent, among scholars. Re-
searchers explored student satisfaction and perceived learning in empiri-
cal studies comparing face-to-face environments to online environments
(Allen et al., 2015). To respond to the accelerated speed of technology,
researchers should examine multiple forms of learning in online environ-
ments (Allen et al., 2015). To date, no systematic eorts have synthesized
the findings of empirical studies examining the relationship between SNS
and perceived learning and satisfaction. Researchers use meta-analytic
methods to review and synthesize past literature in a systematic way (Hattie
et al., 2014). Field (2005) explained that a meta-analysis is “used to discover
how big an eect actually is and what factors moderate that eect” (p. 1).
Therefore, the present meta-analysis addressed the eect of using SNSs for
academic purposes on aective learning outcomes.
We found that rules on how to use SNSs are necessary to avoid adverse
eects on learning outcomes. The few studies that reported negative re-
sults did not provide enough support and guidance to participants on how
to use SNSs for learning purposes. For example, Rueda et al. (2017) al-
lowed learners to use multiple SNSs. However, they do not report providing
explicit instruction to learners on best practice uses. We infer that satura-
tion of media (various SNSs) and lack of guidance resulted in a negative
eect for both perceived learning r = –.23 and satisfaction r = –.28. Hurt
et al. (2012) also reported a negative eect of SNS use on the aective
measure perceived learning. In this case, researchers purposefully avoided
interacting within the SNS (Facebook). Therefore, it is the intentional and
structured use of SNSs for learning that benefits participants’ perceived
learning and satisfaction. Researchers and practitioners should set clear
guidelines for SNS use to support the learning experience. As a reference,
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 253
Lowe and Laey (2011) provided a set of recommendations on how to use
Twitter in business courses that can be applied in other disciplines. Recom-
mendations include providing a short debriefing on the SNS as a learning
tool, assigning a course hashtag, and exemplifying course content through
tweets (Lowe & Laey, 2011). Oering an introductory session on how to
use SNSs is a useful instructional method to communicate guidelines to
participants.
We found positive results when learners used SNSs to support language
learning when learners received enough guidance. Facebook supported
oral communication skills (Cedar & Singhara, 2017) and reading and writ-
ing skills (Miller et al., 2018). The benefits of Twitter for language learning
focused on writing, grammar, and vocabulary (Miller et al., 2018) despite
the character limit that hindered complex language production (Frisby et
al., 2016). It could be argued that Facebook oers a broader array of af-
fordances than Twitter, like in the case of Cedar and Singhara (2017) who
required learners to share audio files via a private group wall on Facebook.
Still, users can upload videos, images, and gifs to Twitter via public tweets
or private messages. Despite Liu et al. (2017) studying actual achievement,
our positive findings agree with their results that established SNS use was
positively associated with academic performance in language tests. Liu et al.
discussed that SNSs prompted students who did not produce or consume
written material to read and write actively. However, the quality of such
processes is yet to be seen. Therefore, providing guidelines and rubrics that
explicitly communicate standards to learners is a persistent need.
Another crucial finding of this systematic review and meta-analysis was
the use of SNSs as an alternative to universities’ LMSs. Facebook was the
predominant option to substitute for an LMS because it served as an infor-
mation repository and had a space for online discussions (i.e., Facebook
wall). Although it brings privacy concerns to participants (Pishock, 2018),
Facebook can be a cost-eective option to host and facilitate learning expe-
riences, particularly in countries and institutions with limited technologi-
cal infrastructure and resources. Meishar et al. (2012) first studied the use
of Facebook groups as an LMS in a case study finding that learners per-
ceived Facebook to promote collaborative work better than a traditional
LMS. Unlike an LMS, Facebook allowed active (i.e., comments) and pas-
sive (i.e., likes) participation (Meishar et al., 2012). Despite Facebook not
oering an advanced file sharing organization like traditional LMSs that
restricts the timing of assignment submissions (Kalelioğlu, 2017), learners
and instructors can still take advantage of comments and chat timestamps.
We believe that multiple LMS aordances can be emulated on Facebook if
clear procedures are stated beforehand. Like with any LMS, external plat-
forms like Google Drive can complement Facebook’s capabilities. Future
work could focus on how developing countries are using Facebook as LMSs.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
254 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
Hattie et al. (2014) argued that finding a study that supports any method
or defending any claim is an easy task. The challenge is to find to what ex-
tent such a claim is valid for a larger population and similar studies. They
also argued that conducting empirical studies in education with “zero” ef-
fect as a baseline is misleading because it makes all studies set to have posi-
tive outcomes (Hattie et al., 2014). Therefore, they concluded that an aver-
age eect size of d = 0.4 “should be used as the benchmark to judge eects
in education” (p. 202). Following the guidelines of Hattie et al., the eect
size of academic SNS use on student satisfaction (r = .17) does not meet
the required guidelines. However, given that previous meta-analyses on the
relationship between SNS general use and student outcomes yielded eect
sizes close to zero (Huang, 2018; Marker et al., 2018), we can say that there
is a noticeable eect on the relationship between academic SNS use and
student satisfaction. We infer that it is the intentionality of using SNSs for
academic purposes that increased the eect in this particular set of studies.
Thus, we can conclude that the eect of purposeful academic SNS use is
small to moderate on students’ satisfaction. In a similar fashion to student
satisfaction, the eect size of academic SNS use on perceived learning was
positive r = .23 and larger than meta-analyses that used actual achievement
as student outcomes (Huang, 2018; Marker et al., 2018). We conclude that
the eect of academic SNS use on student satisfaction and perceived learn-
ing is positive and should be further considered.
The meta-analysis section of this systematic review included a small
sample of studies. The trim and fill procedure conducted during sensitivity
analysis shows that more studies could have reduced the eect of academic
SNS use on student satisfaction. However, this was not the case for per-
ceived learning, which showed that no additional studies were needed. In
any case, the limited number of primary studies showed that more empiri-
cal research should be done on the relationship between academic SNS use
and student satisfaction and perceived learning under various academic
settings and contexts. A major limitation to including more studies in this
meta-analysis was that researchers failed to report quantitative data neces-
sary to compute eect sizes. For example, 19 studies failed to report suf-
ficient data to make calculations. Regarding the systematic review, some
researchers also failed to provide details on how SNSs were used for learn-
ing purposes. Davidovitch and Belichenko (2018) and Rueda et al. (2017)
did not elaborate on how SNSs were incorporated into the learning ex-
perience. Richardson et al. (2017) concluded that lack of attention when
“reporting design elements may imply the limited application of the rel-
evant theory to practice” (p. 414). As a result, it was not possible to obtain a
complete picture of how SNSs were or were not useful to support aective
measures in their case.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 255
Researchers could also explore other subjective variables highly corre-
lated to the aective domain like motivation (Sitzmann et al., 2010). Future
work could also examine learning that occurs in SNS use, using distance
learning theory like the community of inquiry framework, as in Du Bois
et al. (2019). These researchers studied comments in a Facebook group
where learners of massive open online courses discussed course related top-
ics. Specifically, Du Bois et al. examined the role of social presence when us-
ing SNSs for learning purposes. Furthermore, the three subcomponents of
social presence (i.e., aective communication, open communication, and
cohesive responses; Garrison, 2017) would better inform researchers of the
use of SNSs to promote students’ aective learning outcomes. This meta-
analysis only included studies that used SNS platforms designed for purpos-
es other than learning. In future studies, researchers can explore the eect
of educational SNSs purposefully created for learning, such as EDMODO,
on student satisfaction or perceived learning (Ellahi, 2018; Yildiz, 2019).
Moreover, this systematic review’s findings could relate to better course
design by informing instructional designers on how SNS integration is most
advantageous for learners. To date, no meta-analysis has summarized the
results of empirical studies that investigated the relationships between SNS
use for academic purposes and perceived learning and satisfaction. This
meta-analysis provides a comprehensive summary to researchers, instruc-
tors, and instructional designers on the relationship with subjective student
outcomes when SNSs are intentionally used for academic purposes. Prac-
titioners can use this review to make decisions relevant to course design
concerning SNSs and their net benefits in student outcomes. They can also
use this study to make informed decisions on the potential educational af-
fordances that SNSs oer based on the course design. Finally, researchers
can use this review to eectively gauge relevant research on the topic and
potential gaps in the literature for future work. It is pivotal for educational
researchers and practitioners to investigate the educational aordances of
alternative platforms like SNSs. We may find them as allies in the quest to
provide high-quality engaging education rather than seeing them as merely
distractions for learners.
REFERENCES
Abella-García, V., Delgado-Benito, V., Ausín-Villaverde, V., & Hortigüela-Alcalá, D.
(2019). To tweet or not to tweet: Student perceptions of the use of Twitter on
an undergraduate degree course. Innovations in Education and Teaching Inter-
national, 56(4), 402–411. https://doi.org/10.1080/14703297.2018.1444503
Al-Azawei, A. (2019). What drives successful social media in education and e-learn-
ing? A comparative study of Facebook and Moodle. Journal of Information Tech-
nology Education: Research, 18, 253–274. https://doi.org/10.28945/4360
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
256 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
Allen, M., Omori, K., Burrell, N., Mabry, E., & Timmerman, E. (2012). Satisfaction
with distance education. In M. G. Moore (Ed.), Handbook of distance education
(pp. 143–154). Routledge. https://doi.org/10.4324/9780203803738.ch9
Alqurashi, E. (2017). Self-ecacy and the interaction model as predictors of student satis-
faction and perceived learning in online learning environments [Doctoral disserta-
tion, Duquesne University]. Duquesne Scholarship Collection. https://dsc
.duq.edu/etd/194/
Arbaugh, J. B. (2000). Virtual classroom characteristics and student satisfaction with
internet-based MBA courses. Journal of Management Education, 24(1), 32–54.
https://doi.org/10.1177/105256290002400104
Arquero, J. L., Del Barrio-García, S., & Romero-Frías, E. (2017). What drives stu-
dents’ loyalty-formation in social media learning within a personal learning
environment approach? The moderating role of need for cognition. Jour-
nal of Educational Computing Research, 55(4), 495–525. https://doi.org/10
.1177/0735633116672056
Awidi, I. T., Paynter, M., & Vujosevic, T. (2019). Facebook group in the learning
design of a higher education course: An analysis of factors influencing posi-
tive learning experience for students. Computers and Education, 129(2019),
106–121. https://doi.org/10.1016/j.compedu.2018.10.018
Bacon, D. R. (2016). Reporting actual and perceived student learning in educa-
tion research. Journal of Marketing Education, 38(1), 3–6. https://doi.org/10
.1177/0273475316636732
Bandura, A. (1971). Social learning theory. General Learning Corporation.
Bandura, A. (2001). Social cognitive theory of mass communication. Media Psychol-
ogy, 3(3), 265–299. https://doi.org/10.1207/S1532785XMEP0303_03
Bardwell, N. B. (2017). The perceptions and usage of social media in higher education
(Publication No. 10640108) [Doctoral Dissertation, Mississippi State Univer-
sity]. ProQuest LLC.
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Intro-
duction to meta-analysis. John Wiley & Sons, Ltd. https://doi.org/10.1002/
9780470743386
Card, N. A. (2012). Applied meta-analysis for social science research. Guilford Publications.
Cedar, P., & Singhara, I. M. (2017). The benefits of the proprioceptive method used
in learning English via Facebook by Thai government ocials. English Lan-
guage Teaching, 10(8), 123–134. https://doi.org/10.5539/elt.v10n8p123
Clarke, T. B., & Nelson, C. L. (2012). Classroom community, pedagogical eective-
ness, and learning outcomes associated with Twitter use in undergraduate mar-
keting courses. Journal for Advancement of Marketing Education, 20(2), 29–38.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://
doi.org/10.1037/0033-2909.112.1.155
Cooper, H. (2010). Research synthesis and meta-analysis: A step-by-step approach (4th
ed.). SAGE Publications.
Davidovitch, N., & Belichenko, M. (2018). Using Facebook in higher education:
Exploring eects on social climate, achievements, and satisfaction. Interna-
tional Journal of Higher Education, 7(1), 51–58. https://doi.org/10.5430/ijhe
.v7n1p51
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 257
Deaton, S. (2015). Social learning theory in the age of social media: Implications for
educational practitioners. i-Manager’s Journal of Educational Technology, 12(1),
1–6. https://doi.org/10.26634/jet.12.1.3430
Del Re, A. C., & Hoyt, W.T. (2014). MAd: Meta-analysis with mean dierences (Version
0.8-2) [Computer software]. The R Foundation. https://cran.r-project.org/
package=MAd
Du Bois, B., Krasny, M. E., & Russ, A. (2019). Online professional development for
environmental educators: Strategies to foster critical thinking and social in-
teractions. Environmental Education Research, 25(10), 1479–1494. https://doi
.org/10.1080/13504622.2018.1564247
Durlak, J. A. (2009). How to select, calculate, and interpret eect sizes. Journal of
Pediatric Psychology, 34(9), 917–928. https://doi.org/10.1093/jpepsy/jsp004
Duval, S. (2005). The trim and fill method. In A. Rothstein, A. Sutton, & M. Boren-
stein (Eds.), Publication bias in meta-analysis: Prevention, assessment, and adjust-
ments (pp. 127–144). John Wiley & Sons Ltd.
Eastman, M. (2015). Does Twitter fly or fail in marketing classroom? The eect of Twitter on
student learning outcomes, attitudes and instructor eectiveness ratings (Publication
No. 10187858) [Doctoral Dissertation, University of South Dakota]. ProQuest
LLC.
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis
detected by a simple, graphical test. British Medical Journal Publishing Group,
315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629
Elbeck, M., & Bacon, D. (2015). Toward universal definitions for direct and indirect
assessment. Journal of Education for Business, 90(5), 278–283. https://doi.org/
10.1080/08832323.2015.1034064
Ellahi, A. (2018). Social networking sites as formal learning environments in busi-
ness education. Educational Technology and Society, 21(4), 64–75.
Ellison, N. B., & boyd, d. m. (2013). Sociality through social network sites. In W. H.
Dutton (Ed.), The Oxford handbook of internet studies (pp. 1–27). Oxford Uni-
versity Press. https://doi.org/10.1093/oxfordhb/9780199589074.013.0008
Field, A. (2005). A bluer’s guide to meta-analysis. http://www.discoveringstatistics
.com/docs/meta.pdf
Frisby, B. N., Kaufmann, R., & Beck, A. C. (2016). Mediated group development and
dynamics: An examination of video chatting, Twitter, and Facebook in group
assignments. Communication Teacher, 30(4), 215–227. https://doi.org/10.1080/
17404622.2016.1219038
Gamer, M., Lemon, J., Fellows, I., & Singh, P. (2019). irr: Various coecients of in-
terrater reliability and agreement (Version 0.84.1) [Computer software]. The R
Foundation. https://CRAN.R-project.org/package=irr
Garrison, D. R. (2017). E-learning in the 21st century: A community of inquiry framework
for research and practice (3rd ed.). Routledge/Taylor & Francis.
Gramlich, J. (2019, August 2). 10 facts about Americans and Facebook. Pew Research
Center Fact Tank. https://www.pewresearch.org/fact-tank/2019/08/02/10
-facts-about-americans-and-twitter/
Greenhow, C., & Askari, E. (2017). Learning and teaching with social network sites:
A decade of research in K–12 related education. Education and Information
Technologies, 22(2), 623–645. https://doi.org/10.1007/s10639-015-9446-9
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
258 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
Hattie, J., Rogers, H. J., & Swaminathan, H. (2014). The role of meta-analysis in
educational research. In A. D. Reid, E. Hart, & M. Peters (Eds.), A compan-
ion to research in education (pp. 197–207). Springer. https://doi.org/10
.1007/978-94-007-6809-3_26
Hedges, L. V., & Olkin, I. (1985). Statistical model of meta-analysis. Academic Press,
Inc.
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010). Robust variance estimation in
meta-regression with dependent eect size estimates. Research synthesis meth-
ods, 1(1), 39–65. https://doi.org/10.1002/jrsm.5
Higgins, J., & Green, S. (2009). Cochrane handbook for systematic reviews of interventions
version 5.0.2. The Cochrane Collaboration. https://training.cochrane.org/
handbook/archive/v5.0.2/
Higgins, J., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring incon-
sistency in meta-analysis. British Medical Journal, 327(7417), 557–560. https://
doi.org/10.1136/bmj.327.7414.557
Homan, E. S. (2009, October). Designing for aect: The potential of social networking
for teacher education [Paper presentation]. Association for Educational Com-
munications and Technology (AECT) 32nd Annual Convention, Louisville,
KY, United States.
Huang, C. (2018). Social network site use and academic achievement: A meta-
analysis. Computers and Education, 119, 76–83. https://doi.org/10.1016/j
.compedu.2017.12.010
Hunter, J. E., & Schmidt, F. L. (2000). Fixed eects vs. random eects meta-
analysis models: Implications for cumulative research knowledge. Interna-
tional Journal of Selection and Assessment, 8(4), 275–292. https://doi.org/10
.1111/1468-2389.00156
Hurt, N. E., Moss, G., Bradley, C., Larson, L., Lovelace, M., Prevost, L., Riley, N.,
Domizi, D., & Camus, M. (2012). The “Facebook’’ eect: College students’
perceptions of online discussions in the age of social networking. International
Journal for the Scholarship of Teaching and Learning, 6(2), Article 10. https://
doi.org/10.20429/ijsotl.2012.060210
Ioannou, A., Vasiliou, C., & Zaphiris, P. (2016). Problem-based learning in mul-
timodal learning environments. Journal of Educational Computing Research,
54(7), 1022–1040. https://doi.org/10.1177/0735633116636755
Joosten, T., Cusatis, R., & Harness, L. (2019). A cross-institutional study of instruc-
tional characteristics and student outcomes: Are quality indicators of online
courses able to predict student success? Online Learning, 23(4), 354–378.
https://doi.org/10.24059/olj.v23i4.1432
Junco, R., Mastrodicasa, J. M., Aguiar, A. V., Longnecker, E. M., & Rokkum, J. N.
(2016). Impact of technology-mediated communication on student evalua-
tions of advising. NACADA Journal, 36(2), 54–66. https://doi.org/10.12930/
nacada-16-014
Kalelioğlu, F. (2017). Using Facebook as a learning management system: Experi-
ences of pre-service teachers. Informatics in Education, 16(1), 83–101. https://
doi.org/10.15388/infedu.2017.05
Kanthawongs, P., Kanthawongs, P., & Chitcharoen, C. (2016, October). Factors aect-
ing perceived satisfaction with Facebook in education [Paper presentation]. 13th
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 259
International Conference on Cognition and Exploratory Learning in Digital
Age (CELDA 2016), Mannheim, Germany. https://files.eric.ed.gov/fulltext/
ED571427.pdf
Keles, E. (2018). Use of Facebook for the Community Services Practices course:
Community of inquiry as a theoretical framework. Computers and Education,
116, 203–224. https://doi.org/10.1016/j.compedu.2017.09.003
Kirschner, P. A., & Karpinski, A. C. (2010). Facebook® and academic performance.
Computers in Human Behavior, 26(6), 1237–1245. https://doi.org/10.1016/j
.chb.2010.03.024
Klamma, R., Chatti, M. A., Duval, E., Hummel, H., Hvannberg, E. T., Kravcik, M.,
Law, E., Naeve, A., & Scott, P. (2007). Social software for life-long learning.
Educational Technology and Society, 10(3), 72–83.
Krom, C. L. (2012). Using FarmVille in an introductory managerial accounting
course to engage students, enhance comprehension, and develop social net-
working skills. Journal of Management Education, 36(6), 848–865. https://doi
.org/10.1177/1052562912459029
Kucuk, S., & Sahin, I. (2013). From the perspective of community of inquiry frame-
work: An examination of Facebook uses by pre-service teachers as a learning
environment. Turkish Online Journal of Educational Technology, 12(2), 142–156.
Kurtz, G. (2014). Integrating a Facebook group and a course website: The eect on
participation and perceptions on learning. The American Journal of Distance
Education, 28(4), 253–263. https://doi.org/10.1080/08923647.2014.957952
Labus, A., Despotović-Zrakić, M., Radenković, B., Bogdanović, Z., & Radenković, M.
(2015). Enhancing formal e-learning with edutainment on social networks.
Journal of Computer Assisted Learning, 31(6), 592–605. https://doi.org/10
.1111/jcal.12108
Leary, H., & Walker, A. (2018). Meta-analysis and meta-synthesis methodologies:
Rigorously piecing together research. TechTrends, 62(5), 525–534. https://
doi.org/10.1007/s11528-018-0312-7
Li, N., Marsh, V., Rienties, B., & Whitelock, D. (2017). Online learning experiences
of new versus continuing learners: A large-scale replication study. Assessment
and Evaluation in Higher Education, 42(4), 657–672. https://doi.org/10.1080/
02602938.2016.1176989
Lim, J., & Richardson, J. C. (2016). Exploring the eects of students’ social net-
working experience on social presence and perceptions of using SNSs for
educational purposes. Internet and Higher Education, 29, 31–39. https://doi
.org/10.1016/j.iheduc.2015.12.001
Liu, D., Kirschner, P. A., & Karpinski, A. C. (2017). A meta-analysis of the relation-
ship of academic performance and social network site use among adolescents
and young adults. Computers in Human Behavior, 77, 148–157. https://doi
.org/10.1016/j.chb.2017.08.039
Lowe, B., & Laey, D. (2011). Is Twitter for the birds? Using Twitter to enhance
student learning in a marketing course. Journal of Marketing Education, 33(2),
183–192. https://doi.org/10.1177/0273475311410851
Lowenthal, P. R., & Dunlap, J. C. (2010, April–May). Investigating Twitter’s ability to
enhance social presence [Paper presentation]. American Educational Research
Association Annual Meeting. Denver, CO, United States.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
260 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
Manca, S., & Ranieri, M. (2016a). Facebook and the others. Potentials and obstacles
of social media for teaching in higher education. Computers and Education, 95,
216–230. https://doi.org/10.1016/j.compedu.2016.01.012
Manca, S., & Ranieri, M. (2016b). Is Facebook still a suitable technology-enhanced
learning environment? An updated critical review of the literature from 2012
to 2015. Journal of Computer Assisted Learning, 32(6), 503–528. https://doi
.org/10.1111/jcal.12154
Marker, C., Gnambs, T., & Appel, M. (2018). Active on Facebook and failing at
school? Meta-analytic findings on the relationship between online social net-
working activities and academic achievement. Educational Psychology Review,
30(3), 651–677. https://doi.org/10.1007/s10648-017-9430-6
McKenzie, B. A. (2014). Teaching Twitter: Re-enacting the Paris commune and the
Battle of Stalingrad. Society for History Education, 47(3), 355–372.
Meishar-Tal, H., Kurtz, G., & Pieterse, E. (2012). Facebook groups as LMS: A case
study. International Review of Research in Open and Distance Learning, 13(4), 33–48.
Miller, A. M., Morgan, W. J., & Koronkiewicz, B. (2019). Like or tweet: Analysis of
the use of Facebook and Twitter in the language classroom. TechTrends, 63,
550–558. https://doi.org/10.1007/s11528-018-0341-2
Moher, D., Liberati, A., Tetzla, J., Altman, D. G., & The PRISMA Group. (2009).
Preferred reporting items for systematic reviews and meta-analyses: The PRIS-
MA statement. PLoS Med, 6(7), Article e1000097. https://doi.org/10.1371/
journal.pmed.1000097
Mutambuki, J. M., Fynewever, H., Douglass, K., Cobern, W. W., & Obare, S. O. (2019).
Integrating authentic research experiences into the Quantitative Analysis
Chemistry Laboratory course: STEM majors’ self-reported perceptions and
experiences. Journal of Chemical Education, 96(8), 1591–1599. https://doi
.org/10.1021/acs.jchemed.8b00902
Nalbone, D. P., Kovach, R. J., Fish, J. N., McCoy, K. M., Jones, K. E., & Wright, H. R.
(2016). Social networking web sites as a tool for student transitions: Purposive
use of social networking web sites for the first-year experience. Journal of Col-
lege Student Retention: Research, Theory and Practice, 17(4), 489–512. https://
doi.org/10.1177/1521025115579253
Nazir, M., & Brouwer, N. (2019). Community of inquiry on Facebook in a formal
learning setting in higher education. Education Sciences, 9(1), 1–23. https://
doi.org/10.3390/educsci9010010
Newman, M., & Gough, D. (2020). Systematic reviews in educational research:
Methodology, perspectives and application. In O. Zawacki-Richter, M. Kerres,
S. Bedenlier, M. Bond, & K. Buntins (Eds.), Systematic reviews in educational
research (pp. 3–22). Springer. https://doi.org/10.1007/978-3-658-27602-7
Olkin, I., & Gleser, L. (2009). Stochastically dependent eect sizes. In H. Cooper,
L.V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and
meta-analysis (2nd ed.; pp. 357–376). The Russell Sage Foundation.
Orawiwatnakul, W., & Wichadee, S. (2016). Achieving better learning performance
through the discussion activity in Facebook. Turkish Online Journal of Educa-
tional Technology, 15(3), 1–8.
Ozan, O. (2013). Scaolding in connectivist mobile learning environment. Turkish
Online Journal of Distance Education, 14(2), 44–55.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 261
Padilla Rodriguez, B. C., Armellini, A., & Rodriguez Nieto, M. C. (2020). Learner
engagement, retention and success: Why size matters in massive open online
courses (MOOCs). Open Learning, 35(1), 46–62. https://doi.org/10.1080/02
680513.2019.1665503
Pahl-Wostl, C., & Hare, M. (2004). Processes of social learning in integrated re-
sources management. Journal of Community & Applied Social Psychology, 14(3),
193–206. https://doi.org/10.1002/Casp.774
Peng, C. T., Wu, T. Y., Chen, Y., & Atkin, D. J. (2019). Comparing and modeling via
social media: The social influences of fitspiration on male Instagram users’
work out intention. Computers in Human Behavior, 99, 156–167. https://doi
.org/10.1016/j.chb.2019.05.011
Perrin, A., & Anderson, M. (2019, April 10). Share of U.S. adults using social media, in-
cluding Facebook, is mostly unchanged since 2018. Pew Research Center Fact Tank.
https://www.pewresearch.org/fact-tank/2019/04/10/share-of-u-s-adults
-using-social-media-including-facebook-is-mostly-unchanged-since-2018/
Pew Research Center. (2019). Social media fact sheet. http://www.pewinternet.org/
fact-sheet/social-media
Pishock, J. (2018). Comparing Blackboard and Facebook as a learning management system
in military science and leadership (Publication No. 10867605) [Doctoral disser-
tation, St John’s University]. ProQuest LCC.
Porath, S. L. (2018). A powerful influence: An online book club for educators. Jour-
nal of Digital Learning in Teacher Education, 34(2), 115–128. https://doi.org/10
.1080/21532974.2017.1416711
Powless, S. (2011). College student satisfaction: The impact of Facebook and other factors
(Publication No. 3458021) [Doctoral dissertation, University of Toledo]. Pro-
Quest LCC.
Qi, C. (2019). Social media usage of students, role of tie strength, and perceived
task performance. Journal of Educational Computing Research, 57(2), 385–416.
https://doi.org/10.1177/0735633117751604
R Core Team. (2019). R: A language and environment for statistical computing (Version
3.6.1) [Computer software]. The R Foundation. https://www.R-project.org/
Richardson, J. C., Maeda, Y., Lv, J., & Caskurlu, S. (2017). Social presence in relation
to students’ satisfaction and learning in the online environment: A meta-anal-
ysis. Computers in Human Behavior, 71, 402–417. https://doi.org/10.1016/j
.chb.2017.02.001
Richardson, J. C., Maeda, Y., & Swan, K. (2010). Adding a web-based perspective
to the self-assessment of knowledge: Compelling reasons to utilize aective
measures of learning. Academy of Management Learning and Education, 9(2),
329–334. https://doi.org/10.5465/AMLE.2010.51428555
Rinaldo, S. B., Tapp, S., & Laverie, D. A. (2011). Learning by tweeting: Using Twitter
as a pedagogical tool. Journal of Marketing Education, 33(2), 193–203. https://
doi.org/10.1177/0273475311410852
Rosen, L. D., Mark, C. L., & Cheever, N. A. (2013). Facebook and texting made me
do it: Media-induced task-switching while studying. Computers in Human Be-
havior, 29(3), 948–958. https://doi.org/10.1016/j.chb.2012.12.001
Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psy-
chological Bulletin, 86(3), 838–641.
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
262 D. CASTELLANOS-REYES, Y. MAEDA, and J. C. RICHARDSON
Rueda, L., Benitez, J., & Braojos, J. (2017). From traditional education technolo-
gies to student satisfaction in management education: A theory of the role
of social media applications. Information and Management, 54(8), 1059–1071.
https://doi.org/10.1016/j.im.2017.06.002
Salameh, Z. (2017). Attitudes towards Facebook and the use of knowledge and skills
among students in the English department at the University of Hail. Journal of
Education and Practice, 8(8), 1–6.
Schwarzer, G. (2019). General package for meta-analysis (Version 4.9-7) [Computer
software]. The R Foundation. http://meta-analysis-with-r.org
Shih, R. C. (2013). Eect of using Facebook to assist English for business commu-
nication course instruction. Turkish Online Journal of Educational Technology,
12(1), 52–59.
Sitzmann, T., Ely, K., Brown, K. G., & Bauer, K. N. (2010). Self-assessment of knowl-
edge: A cognitive learning or aective measure? Academy of Management
Learning and Education, 9(2), 169–191. https://doi.org/10.5465/AMLE.2010
.51428542
Slim, H., & Hafedh, M. (2019). Social media impact on language learning for spe-
cific purposes: A study in English for business administration. Teaching English
with Technology, 19(1), 56–71.
Sol, J., Beers, P., & Wals, A. (2013). Social learning in regional innovation net-
works: Trust, commitment and reframing as emergent properties of inter-
action. Journal of Cleaner Production, 49, 35–43. https://doi.org/10.1016/j
.jclepro.2012.07.041
Song, Y., & Xu, R. (2019). Aective ties that bind: Investigating the aordances of so-
cial networking sites for commemoration of traumatic events. Social Science Com-
puter Review, 37(3), 333–354. https://doi.org/10.1177/0894439318770960
Strahler, D. (2014). Educators’ perceptions of Twitter for educational technology profes-
sional development: A uses and gratifications expectancy model (Publication No.
3646860) [Doctoral dissertation, Duquesne University]. ProQuest LLC.
Strelan, P., Osborn, A., & Palmer, E. (2020). Student satisfaction with courses and
instructors in a flipped classroom: A meta-analysis. Journal of Computer Assisted
Learning, 36(3), 295–314. https://doi.org/10.1111/jcal.12421
Sullivan, M. E., Hitchcock, M. A., & Dunnington, G. L. (1999). Peer and self as-
sessment during problem-based tutorials. American Journal of Surgery, 177(3),
266–269. https://doi.org/10.1016/S0002-9610(99)00006-9
Sutton, A. J. (2009). Publication bias. In H. Cooper, L. V. Hedges, & J. C. Valentine
(Eds.), The handbook of research synthesis and meta-analysis (pp. 435–452). Rus-
sell Sage Foundation.
Sutton, A. J., Abrams, K. R., Jones, D. R., Sheldon, T. A., & Song, F. (2000). Methods
for meta-analysis in medical research. Wiley & Sons.
Tess, P. A. (2013). The role of social media in higher education classes (real and
virtual)–A literature review. Computers in Human Behavior, 29(5), A60–A68.
https://doi.org/10.1016/j.chb.2012.12.032
Thoms, B., & Eryilmaz, E. (2015). Introducing a Twitter discussion board to support
learning in online and blended learning environments. Education and Informa-
tion Technologies, 20(2), 265–283. https://doi.org/10.1007/s10639-013-9279-3
© 2021 IAP
All rights reserved
© 2021 IAP
All rights reserved
SNS for Educational Purposes and Affective Outcomes 263
Uman, L. (2011). Systematic reviews and meta-analyses. Journal of the Cana-
dian Academy of Child and Adolescent Psychiatry, 20(1), 57–59. https://doi
.org/10.1007/978-1-59745-230-4_18
Uzun, A., Ünal, E., & Karataş, S. (2014). Using Facebook as a supplementary tool
in education: Its eectiveness in comparison to traditional instruction. World
Journal on Educational Technology, 6(1), 99–106.
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J.
(2013). Three-level meta-analysis of dependent eect sizes. Behavior Research
Methods, 45(2), 576–594. https://doi.org/10.3758/s13428-012-0261-6 .
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Me-
ca, J. (2015). Meta-analysis of multiple outcomes: A multilevel approach.
Behavior Research Methods, 47(4), 1274–1294. https://doi.org/10.3758/
s13428-014-0527-2.
Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package.
Journal of Statistical Software, 36(3), 1–48. https://doi.org/10.18637/jss.v036.i03
Wang, J. (2013). What higher educational professionals need to know about today’s
students: Online social networks. Turkish Online Journal of Educational Technol-
ogy, 12(3), 180–193.
Xue, S., & Churchill, D. (2019). A review of empirical studies of aordances and de-
velopment of a framework for educational adoption of mobile social media.
Educational Technology Research and Development, 67(5), 1231–1257. https://
doi.org/10.1007/s11423-019-09679-y
Yildiz, H. (2019). Examining the acceptance and use of online social networks by
preservice teachers within the context of unified theory of acceptance and
use of technology model. Journal of Computing in Higher Education, 31(1), 173–
209. https://doi.org/10.1007/s12528-018-9200-6
Yılmaz, M., Yılmaz, U., & Demir-Yılmaz, E. N. (2019). The relation between social
learning and visual culture. International Electronic Journal of Elementary Educa-
tion, 11(4), 421–427. https://doi.org/10.26822/iejee.2019450837
Yore, L. D., & Lerman, S. (2008). Metasyntheses of qualitative research studies in
mathematics and science education. International Journal of Science and Mathe-
matics Education, 6(2), 217–223. https://doi.org/10.1007/s10763-008-9128-9.
Zainuddin, Z., Zhang, X., Zhang, Y., Li, X., Tse, S., Yau, K., & Chu, S. K. W. (2017,
April–May). Exploring the impact of social media Facebook and Schoology on stu-
dents’ internship programs [Roundtable presentation]. American Educational
Research Association Annual Meeting, New York, NY, United States. https://
doi.org/10.302/1307153