ArticlePDF Available

Rapid transition of traditionally hands-on labs to online instruction in engineering courses

Authors:

Abstract and Figures

The COVID-19 pandemic forced universities to suspend face-to-face instruction, prompting a rapid transition to online education. As many lab courses transitioned online, this provided a rare window of opportunity to learn about the challenges and affordances that the online lab experiences created for students and instructors. We present results from exploratory educational research that investigated student motivation and self-regulated learning in the online lab environment. We consider two student factors: motivation and self-regulation. The instrument is administered to students (n = 121) at the beginning of the semester and statistically analysed for comparisons between different demographic groups. The results indicated students' major was the only distinguishing factor for their motivation and self-regulation. Students' unfamiliarity with online labs or uncertainty about what to expect in the course contributed to the lower levels of self-regulation. The lack of significant differences between various subgroups was not surprising, as we posit many students entered the virtual lab environment with the same level of online lab experience. We conducted interviews among these respondents to explore the factors in greater detail. Using latent Dirichlet allocation, three main topics that emerged: (1) Learning Compatibility, (2) Questions and Inquiry, and (3) Planning and Coordination.
Content may be subject to copyright.
Full Terms & Conditions of access and use can be found at
https://www.tandfonline.com/action/journalInformation?journalCode=ceee20
European Journal of Engineering Education
ISSN: (Print) (Online) Journal homepage: https://www.tandfonline.com/loi/ceee20
Rapid transition of traditionally hands-on labs to
online instruction in engineering courses
Dominik May, Beshoy Morkos, Andrew Jackson, Nathaniel J. Hunsu, Amy
Ingalls & Fred Beyette
To cite this article: Dominik May, Beshoy Morkos, Andrew Jackson, Nathaniel J. Hunsu,
Amy Ingalls & Fred Beyette (2022): Rapid transition of traditionally hands-on labs to online
instruction in engineering courses, European Journal of Engineering Education, DOI:
10.1080/03043797.2022.2046707
To link to this article: https://doi.org/10.1080/03043797.2022.2046707
© 2022 The Author(s). Published by Informa
UK Limited, trading as Taylor & Francis
Group
Published online: 05 Mar 2022.
Submit your article to this journal
Article views: 882
View related articles
View Crossmark data
RESEARCH ARTICLE
Rapid transition of traditionally hands-on labs to online
instruction in engineering courses
Dominik May
a
, Beshoy Morkos
a
, Andrew Jackson
b
, Nathaniel J. Hunsu
a
, Amy Ingalls
c
and
Fred Beyette
a
a
College of Engineering, University of Georgia, Athens, GA, USA;
b
College of Education, University of Georgia,
Athens, GA, USA;
c
Online Learning, University of Georgia, Athens, GA, USA
ABSTRACT
The COVID-19 pandemic forced universities to suspend face-to-face
instruction, prompting a rapid transition to online education. As many
lab courses transitioned online, this provided a rare window of
opportunity to learn about the challenges and aordances that the
online lab experiences created for students and instructors. We present
results from exploratory educational research that investigated student
motivation and self-regulated learning in the online lab environment.
We consider two student factors: motivation and self-regulation. The
instrument is administered to students (n = 121) at the beginning of
the semester and statistically analysed for comparisons between
dierent demographic groups. The results indicated studentsmajor
was the only distinguishing factor for their motivation and self-
regulation. Studentsunfamiliarity with online labs or uncertainty about
what to expect in the course contributed to the lower levels of self-
regulation. The lack of signicant dierences between various
subgroups was not surprising, as we posit many students entered the
virtual lab environment with the same level of online lab experience.
We conducted interviews among these respondents to explore the
factors in greater detail. Using latent Dirichlet allocation, three main
topics that emerged: (1) Learning Compatibility, (2) Questions and
Inquiry, and (3) Planning and Coordination.
ARTICLE HISTORY
Received 30 October 2020
Accepted 22 February 2022
KEYWORDS
Online education; virtual
laboratory; hands-on
courses; motivation; self-
regulation
1. Introduction
Online labs (i.e. remote or fully virtual labs) have long been considered a promising option for
facilitating alternate lab experiences in STEM elds. However, to ensure students receive a worth-
while educational experience, it is important to ensure that the pedagogical and curricular value
of online labs are comparable to their face-to-face counterpart. The COVID-19 pandemic forced
universities to suspend face-to-face instruction, prompting instructors to rapidly transition to
online instruction. This transition was challenging for many instructors in traditional STEM pro-
grammes, especially for engineering instructors who were also required to deliver labs as an inte-
gral part of their curriculum. For example, hands-on lab components are integral to the curricular
experience for about 70% of Electrical Engineering (EE) and Computer Systems Engineering (CSE)
required courses at the [university]. Similar to many other universities, the sudden shift from face-
© 2022 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group
This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License (http://
creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the
original work is properly cited, and is not altered, transformed, or built upon in any way.
CONTACT Beshoy Morkos bmorkos@uga.edu
EUROPEAN JOURNAL OF ENGINEERING EDUCATION
https://doi.org/10.1080/03043797.2022.2046707
to-face to online instruction created uniquely challenging situations for the instructors of those
courses.
Prior to the COVID-19 global pandemic, the college only oered two fully online undergraduate
engineering courses (Engineering Statics and Fluid Mechanics). The courses were only oered during
summer semesters, and neither of the two courses had lab components. However, our College had
designed instruction with online experimentation technology through using both purchased online
lab tools and self-developed online laboratory equipment in selected engineering courses.
Nevertheless, the onset of COVID-19 compelled an extensive, wholesale shift to all online instruc-
tion. As part of the transition, it was necessary to transform the semester-long, hands-on, experiential
learning components of EE and CSE courses to fully online lab experiences. Beginning in April 2020,
the college transitioned all instructions online, and by implication, laboratory instruction was also
moved to various online formats to facilitate hands-on lab experiences. Although online lab experi-
ences were not widely used before, we were able to leverage our earlier experiences with setting up
small-scale online laboratories and our colleges prior intellectual and nancial investment in online
labs pre-COVID, to facilitate an extensive migration of course laboratory components to online
formats.
Inevitably, the pandemic forced all instruction online with little or no time to contemplate the
implications of the transitions on the ecacy of learning and pedagogy. The situation did not
allow for students to choose whether they wanted their instructions in in-person or online
modes. On the one hand, the sudden transition to online instructions presented uncharted chal-
lenges for instructors and students alike especially because learning ecacy, self-directed learning,
and studentsbeliefs about online learning inuence student outcomes (Bernard et al. 2004). Con-
versely, the COVID response also provided a rare window of opportunity to learn about the chal-
lenges and aordances that the online lab experiences created for students and instructors at
college. As much as the broad pivot to online learning instigated unexpected educational chal-
lenges, it also aorded an unprecedented opportunity to investigate the roadblocks, challenges,
and successes experienced by students who might not typically have participated in an online learn-
ing environment.
In this article, we draw on existing literature and share our experience with transitioning from tra-
ditional in-person labs our labs to online modes in order to manage instructional disruptions due to
COVID. In addition, we present observations from exploratory educational research that investigated
student motivation and self-regulated learning in the online lab environment as it was deployed.
With the work presented in this paper, we do not simply discuss our reaction to COVID but also
share insights into the transition process from hands-on lab instruction to online experimentation,
broadly, and build fundamental understanding about student perceptions. We envisage that such
investigation could provide insight for developing positive instructional online laboratory experi-
ences for students and to better understand the challenges and opportunities associated with shift-
ing face-to-face labs to the virtual space.
2. Background
2.1. Online laboratories in higher education
Laboratory and hands-on learning experiences in online STEM education have benetted from
recent technological innovations and developments that support alternative modalities for
oering lab experiences. Online labs are currently facilitated through remote labs (where physically
existing real equipment is controlled remotely), augmented reality (real existing labs are augmented
by Virtual Reality add-ons), and virtual labs (via software-based fully virtual lab that are possible by
simulation). These labs are referred to as online labs,remote labs,orcross-reality labsin the lit-
erature (Brinson 2015; Faulconer and Gruss 2018; May 2020). Over the last decades, online labora-
tories (we use this term to include all non-traditional lab solutions that rely on the internet for
2D. MAY ET AL.
labuser interaction) have gained prominence because they can overcome some of the limitations of
classical labs (Corter et al. 2007; Potkonjak et al. 2016). A number of educational research studies,
including individual research eorts and broader literature analysis, have provided evidence to
demonstrate the potential benets of these online labs (Heradio et al. 2016; Hernández-de-Menén-
dez, Vallejo Guevara, and Morales-Menendez 2019; Estriegana, Medina-Merodio, and Barchino 2019).
Some studies show that online laboratories can be ecient tools for engaging STEM students in
authentic learning experiences, fostering conceptual understanding, stimulating self-paced learning,
oering practical problem-solving experience, and for overcoming the geographic and temporal
limitations of scheduling labs in higher education institutions (Kollöel and de Jong 2013; Ma and
Nickerson 2006).
Researchers are at polar ends of arguments for and against the ecacy of online labs. In a review
of hands-on versus simulated and remote laboratories in engineering education, Ma and Nickerson
(2006) observed that online laboratories were especially well suited for teaching conceptual knowl-
edge rather than design skills. They also found that studentsbelief about the technology and
whether they have options between participating in hands-on and online labs aects their lab cur-
ricular experiences. However, they also concluded that much of online lab research confound
dierent factors in their studies, which makes it challenging to reach denite conclusions about stu-
dentslearning experiences in hands-on versus simulated and remote laboratories. About 10 years
later, Brinson (2015) published an extensive review of more than 50 empirical studies that examined
dierent learning outcomes in virtual and remote labs versus traditional hands-on labs. Both reviews
concluded that online labs had comparable eects on learning outcomes (e.g. understanding,
inquiry skills, practical skills, perception, analytical skills, and social and scientic communication)
as traditional hands-on labs under certain conditions (Brinson 2015; Ma and Nickerson 2006).
However, there is yet no consensus in extant research about how eectively online labs facilitate
positive learning experiences and outcomes. As such, there are calls for further studies to better
delineate how online labs impact learning outcomes and experiential learning experience across
instructional contexts (Brinson 2015; Brinson 2017).
Although there are several calls for more studies to examine the eects and the instructional per-
spective of online labs, a bibliometric analysis of more than 4000 published papers on virtual and
remote labs conducted by Heradio et al. (2016) showed that the themes of most research inquiries
of online labs in the literature so far had coalesced around technical considerations for developing,
managing, and sharing virtual labs; collaborative learning in virtual labs; and assessing the edu-
cational eectiveness of virtual labs. The authors argued that more fundamental educational
research is needed to explore how dierent pedagogical modalities can be embedded within
online labs to improve their ecacy for learning in non-traditional labs contexts. Although some evi-
dence suggests that non-traditional labs can be as eective as traditional labs, most of the studies
that have evaluated the strengths and weaknesses of online labs conclude that online lab research is
quite diverse, and that there is not yet consensus around how to categorise the eectiveness of the
various modes of implementing online labs to ensure eective lab-based learning.
2.2. Pre-COVID online lab initiative in the college
Prior to COVID, instructors in our college were exploring using online labs either to scale their lab
oering or to provide pre-lab or post-lab engagement to students through an initiative led by the
rst author. Instructors who took part in the initiative developed and piloted remote lab modules
in electrical, mechanical, and bio-engineering courses. For the electric engineering labs, in particular,
Virtual Instrument Systems In Reality (VISIR) (Gustavsson et al. 2009; Garcia-Zubia et al. 2017) was
adapted for use in an existing electric circuit course over one (May, Trudgen, and Spain 2019).
This prior trial with online labs served as a proof-of-concept for introducing and eectively using a
ready-to-use remote lab like VISIR more extensively in existing circuits courses. In addition to demon-
strating readiness for implementation, these initial eorts also pointed the team to educational
EUROPEAN JOURNAL OF ENGINEERING EDUCATION 3
research opportunities and directions that should be explored for a deeper understanding of how
online labs platforms like VISIR facilitate learning in electrical engineering courses. Moreover,
these initial experiences with VISIR served as a starting point for the development, acquisition,
and assessment of further online laboratories (such as the EMONA system) in other scientic
elds in the college (Al Weshah, Alamad, and May 2021; Pokoo-Aikins, Hunsu, and May 2019;
Devine and May 2021; Li, Morelock, and May 2020). In retrospect, these initial experiences with
online labs provided critical support to a seamless transition when the rapid shift to online occurred.
Initial feedback from an assessments of this pilot eort was generally positive: many students
appreciated the exibility that online labs aorded, and instructors who took advantage of the
eort found online labs to be a useful component of their course instruction (May 2020; May,
Trudgen, and Spain 2019). Although studentsfeedback was supportive, they pointed out several
areas for improvement to increase the instructional viability of the online labs. In our view of the
pilot experiences, we also recognise the need to master how to integrate the lab into the local learn-
ing management system, which can add additional burden to instructional preparation for
instructors.
Further, because students would have to learn at a distance, online labs need to motivate and
stimulate student self-regulated learning to remain on task and schedule with lab work. Much of
existing online lab research studies have focused on their technical development, their eects on
student learning outcomes, and student satisfaction with online lab experiences. Nevertheless,
there is a shortage of research on how online labs promote student motivation and self-regulated
learning. Such studies could be critical to understanding how to design an online lab curriculum
to facilitate meaningful learning engagement. These aspects of learning support are needed in
general and especially in urgent situations, like the one caused by the COVID-19 pandemic in the
2020 and 2021. Consequently, this prior work with online laboratories positioned us to both eec-
tively respond to the challenges induced by the pandemic and build educational research around
the online experimentation eorts.
3. Implementing and studying online laboratories in electrical and computer
engineering courses
Although a few instructors in our college were involved in exploring online labs, setting them
up rapidly in response to the instructional disruptions that COVID caused was still quite challen-
ging.However,weidentied this challenging situation to be an ideal set-up for educational
research work in the context of transitioning to online experimentation. This resulting research
work is part of a project funded by the National Science Foundation to study the implications of
instructional migrations due to COVID on learning experiences in engineering contexts. Our
broader project integrates three perspectives in studying the online labs: instructor resistance
to adoption, user experience and success, and student motivation and self-regulation. These
perspectives respond to the necessary, widespread transition to online labs, including the per-
spectives of instructors and students who might not otherwise have participated in these
environments.
This paper specically responds to the need to explore studentsmotivation and self-regulation in
online labs. In the following sections, we describe the curriculum context and dierent types of
online labs options implemented to support our EE and CSE courses during the COVID-19 instruc-
tional transitions, which build on the aforementioned pilot work. Then, we discuss our empirical
investigation of online laboratories in electrical and computer engineering courses through two
complementary approaches. First, we used a quantitative survey to explore studentsperceptions
toward the online labs at the beginning of the semester. This quantitative approach was already
framed by educational theory on student motivation and self-regulation, which operationalise the
broader concept of emotional and cognitive student engagement. In a second step, we conducted
interviews among these respondents to explore factors of motivation and self-regulation in greater
4D. MAY ET AL.
detail. Data collected from human subjects in the form of surveys and interviews were approved by
the university Institutional Review Board to ensure compliance.
3.1. Curricular context
The main context for the work presented here is the implementation of two similar, combined
lecture and lab courses: ECSE 2170 Fundamentals of Circuit Analysis, which is targeted toward
EE and CSE students, and ENGR 2170 Applied Circuit Analysis, which provides entry-level circuit
analysis content for non-ECE majors. While ENGR 2170 serves as a breadth course for other engin-
eering majors, in the EE and CSE curricula, ECSE 2170 is a critical prerequisite that opens up
access to the core courses in the plan of study and, in turn, nearly all technical electives and capstone
courses for EE and CSE students. ECSE 2170 serves approximately 100 students annually (about 15 in
the summer term). ENGR 2170 serves approximately 250 students annually (about 50 in the summer
term).
Though the depth and focus of these courses vary slightly for major and non-major versions,
the courses have signicant overlap in the learning outcomes and share common lab modules.
Both courses provide exposure to analytical skills (i.e. skills required for the design and evalu-
ation of circuits) and hands-on skills (i.e. skills required for building, testing, and debugging cir-
cuits). Under normal face-to-face instruction, these courses covered basic circuit analysis
concepts in lecture and then reinforced those conceptsthroughaseriesoflabactivitiesrequir-
ing the use of circuit simulation software (e.g. PSPICE, MultiSim) before building the circuits
using discrete components on a breadboard and then testing using standard electronic test
equipment.
3.2. Online laboratories included in the study
To pivot to online instruction and in our research study, we implemented VISIR and the netCIRCUI-
Tlabs from Emona Instruments remote labs for electric circuit courses oered to students across the
college. Both remote lab technologies oer online circuit building and testing environments that are
suitable for lab activities in electric circuits.
The VISIR virtual workbench was designed to emulate the tactile learning experience that stu-
dents receive when they build, power, and test a circuit in reality. The VISIR platform replicates
the appearance and operational functionality of physical electronics lab bench equipment (i.e.
moving components and rotating instrument knobs as you would on at physical lab bench).
However, each studentsvirtual lab bench can be accessed from any internet connection. Student
users access the VISIR workbench (see Figure 1) remote lab environment through a web interface
that enables them to use virtual versions of familiar benchtop instruments. In the VISIR workbench,
students can access a virtual breadboard for building circuits with virtual wires and a set of basic dis-
crete electronic components (e.g. resistors, capacitors, wires) to move onto their breadboard. A
virtual power supply or a virtual function generator is used to power the circuits. Once properly
wired, students can use additional instruments like a virtual multimetre or a virtual oscilloscope to
take measurements and test the performance circuit. The developed virtual circuits are replicated
using the VISIR technical back-end, which responds with real measurement data based on physically
existing experimentation equipment.
Like the VISIR lab, the Emona TIMS netCIRCUITlabs system also oers online, remote access for
multiple students to simultaneously control and measure real electronics circuits. The system is
accessible via a web browser and covers a range of experiments such as AC ampliers, feedback cir-
cuits, and dierential ampliers. To implement the remote lab modules presented in this study,
student users used a web interface to access the circuit simulation software (see Figure 2). The
further remote lab equipment comprises a technical back-end control unit and several switchable
boards for dierent experiments.
EUROPEAN JOURNAL OF ENGINEERING EDUCATION 5
The VISIR and netCIRCUITlabs systems have several similarities but important dierences. It is
worth emphasising that these virtual lab systems are not simulation environments but remote lab-
oratories using physically existing equipment for experimentation and data measurement. Circuits
are physically built on the experiment boards, though they are accessed and controlled through a
virtual interface. In both remote lab platforms, web interfaces enable connections to physical com-
ponents that are connected through a recongurable switch matrix. Programmable voltage sources
enable the implementation of power supplies and function generators and a build-in data acqui-
sition card makes it possible to change voltage levels at nodes within a circuit. The web interface
provides for both remote access to real physical hardware and is programmed to allow a test
environment that replicates the appearance and functionality of equipment on a typical electronics
test bench. Compared to VISIR, the netCIRCUITlabs system is more sophisticated with regard to the
circuits building possibilities and experimentation procedures. Because of the switchable boards, it is
also more exible to be used in dierent lab courses such as introduction courses early in a curricu-
lum or sensors later on in the study programme. But, based on our experiences, it is also promising to
use both remote labs in combination in one course to start with more basic circuits building using
VISIR and switch to more sophisticated experimentation once the studentsabilities are more
advanced.
Online labs in our course sessions were optimised as much as possible to create an experi-
ence close to those that students would have had in a traditional lab session. The web inter-
face of these online lab platforms, in combination with video conferencing, made it possible to
model nearly similar studentinstructor and studentstudent interactions in the virtual labs as
would have occurred in a regular face-to-face lab. In our regular labs, the instructor or a lab
assistant would demonstrate the appropriate steps to build and test a circuit with the lab
apparatus. Remote labs sessions were implemented via Zoomto facilitate this demonstration
and collaborative engagement between students. By using the screen-sharing feature, it was
possible for instructors to model the process in much the same way that had occurred in a
Figure 1. Structural overview of VISIR remote lab with web interface and technical back-end.
6D. MAY ET AL.
face-to-face lab setting. Students who had challenges or questions could also use the shared
screen feature to receive assistance from the lab instructor during real-time online lab-sessions.
Although the remote lab options do not fully provide the tactile experience of pushing com-
ponents into a breadboard or attaching a measurement probe to a component lead as students
would receive in a physical lab, the conceptual challenges that students encounter when they
convert a circuit diagram to a breadboard layout remain. The systems also emulate how measure-
ments probes are appropriately connected and referenced in circuit analysis. In fact, some instructors
have observed that students make as many errors when making circuit connections and taking
measurements in remote labs as they did when using physical labs. Moreover, unlike with traditional
labs, the remote labs were not limited by geographic and time scheduling constrained. Because the
remotes are always available online, students could work individually or in groups via Zoom on lab
assignments outside of regular lab schedules. In such cases, technical diculties or questions could
be posted or emailed to their lab facilitators who addressed them asynchronously.
In the following sections, we will describe the education research study components, in which we
build the empirical database. We will explain the quantitative study section rst, followed by an in-
depth description of the qualitative study section.
3.3. Quantitative study
Our rst aim in exploring student motivation and self-regulation in online lab contexts is to charac-
terise the perceptions of students taking the courses. In such learning environments, student cogni-
tive and emotional engagement are instrumental (Devine and May 2021). We operationalise these as
student self-regulation and motivation perspectives. We administered a portion of the Motivated
Strategies for Learning Questionnaire (MSLQ) (Li, Morelock, and May 2020), aligned with these con-
cepts, and conducted statistical analysis to make comparisons among demographic groups enrolled
in the courses. The MSLQ is an instrument the investigators have used previously in educational
research settings and are familiar with its applications (Kames et al. 2019).
Figure 2. Structural overview of netCIRCUITlabs remote lab with user interface and technical back-end.
EUROPEAN JOURNAL OF ENGINEERING EDUCATION 7
3.1.1. Sampling and participants
Participants in the study were limited to students enrolled in undergraduate engineering courses
that include online lab experiences (ECSE 2170 and ENGR 2170) during Summer 2020, the rst com-
plete semester with online labs following the outbreak of the COVID-19 pandemic, and Spring 2021,
approximately one year from the shift to online instruction. During the academic year, instruction at
[University] included hybrid learning, therefore, access to labs remained limited and the engineering
courses included in the study continued to use online experimentation.
In total, responses were collected from 121 students between the semesters. Students respond-
ing to the research survey included both men and women, many racial identities, and students
across majors and years of study in the college (see Table 1). The subjects provided a wide spread
of majors, though Mechanical Engineering students were a majority of students enrolled in the
course. Additionally, the course did not possess a signicant number of prerequisites and students
could enrol in the course at nearly any point in their curriculum, resulting in students from freshman
to seniors enrolled in the course.
3.1.2. Procedures and measurement
Students were invited to complete an electronic survey during the beginning of their enrolment in
the courses. This quantitative approach is appropriate for capturing student perspectives broadly. In
concentrating on how the transition to online lab instruction would impact student motivation and
self-regulation, we selected four subscales of the MSLQ to consider the two student factors. The
MSLQ is widely used in educational research to study motivation and self-regulation across learning
contexts including engineering. Responses to the MSLQ are measured through a seven-point Likert
scale scored from 1 (not at all true of me) to 7 (very true of me). Language in the subscales was
slightly modied to relate to online labs. For instance, a question for motivation asked students
to rate their agreement that I think I will be able to use what I learn in these online labs in other
coursesand one question about self-regulation rated agreement that When I complete online
labs for this class, I set goals for myself in order to direct my activities in each study period.
3.1.3. Data analysis and preliminary results
Studentsself-reported motivation for approaching the online labs ranged between 2.17 and 7 (x=
5.31, σ= 0.92) and their perceived self-regulation was slightly lower on average, ranging from 2.00 to
6.58 (x= 4.81, σ= 0.81). Both the motivation items and self-regulation items from the MSLQ were
Table 1. Participant demographic data.
Factor Group n(%)
Gender Male 96 (79.34%)
Female 24 (19.83%)
Race White 85 (70.25%)
Asian 21 (17.63%)
Black or African American 6 (4.96%)
More than one race 4 (3.31%)
Other 5 (4.13%)
Major Mechanical Engineering 63 (52.07%)
Electrical and Electronics Engineering 19 (15.70%)
Biological Engineering 18 (14.88%)
Computer Systems Engineering 16 (13.22%)
Agricultural, Environmental, or Biochemical Engineering 5 (4.13%)
Standing Freshman 8 (6.61%)
Sophomore 16 (13.22%)
Junior 52 (42.98%)
Senior 30 (24.79%)
Fifth-year student 14 (11.57%)
Semester enrolled Summer 2020 68 (56.20%)
Spring 2021 53 (43.80%)
8D. MAY ET AL.
reliable (α= .88 and .81, respectively). The rst step of the analysis was to compare motivation and
self-regulation between semesters and conclude whether data could be integrated. Across seme-
sters of enrolment students reported similar levels of motivation and self-regulation, supporting
our simultaneous use of these data to understand how students approach online lab experiences
in general.
To understand studentsinitial perspectives when enrolling in the course with online labs, we
compared motivation and self-regulation scores based on several demographic factors: gender,
under-represented race status within engineering (i.e. non-White or Asian), major, and year of
study. For demographic characteristics with two groups, a t-test was used; when more responses
were possible, analysis of variance (ANOVA) tests were used.
There was no signicant dierence on motivation or self-regulation responses by gender or min-
ority status (both t-tests). A one-way ANOVA test showed dierences for motivation among the
engineering majors, F(4, 116) 3.067, p= .019. Post-hoc comparison using a Tukey test showed that
EE students had a signicantly higher motivation in advance of the course when compared to Agri-
cultural, Environmental, or Biochemical Engineering students (p= .024). CSE studentsmotivation
also trended higher than that of Agricultural, Environmental, or Biochemical Engineering students,
but the dierence was not signicant (p= .087). Notably, there was no signicant dierence in
self-regulation by major; across majors, students reported the same level of preparedness to
manage the online lab materials. Neither was there a dierence in motivation or self-regulation
by studentsyear of study rst-year and sophomore students had marginally higher motivation
than upper-class students, but not at a signicant level (p> .05).
3.2. Qualitative study
During studentsparticipation in the course, we extended invitations for in-depth interviews
about their perceptions and experiences with online labs. The interview protocol mirrored the
conceptual basis of the MSLQ, with questions about motivation and self-regulation, allowing stu-
dents to elaborate on the factors inuencing their engagement in theonlinelabs.Thecompleted
interviews were then transcribed and analysed using latent Dirichlet allocation (LDA) (Blei, Ng,
and Jordan 2003) to extract the topics spoken about by students. LDA is a topic modelling
approach used to study text corpus datasets (Chen, Mullis, and Morkos 2021). The topics extracted
using LDA are used to assist researchersfocus in student interviews. For example, they describe
the frequency of occurrence and sets of words used together and help gather greater insight in
the qualitative analysis. By identifying salient topics across student interviews, and seeking to
understand their meaning in the context of the interview, we can better understand the range
of studentsexperiences with the course.
3.2.1. Sampling and participants
Following completion of the quantitative survey, invitations to participate in an interview about the
online labs were delivered to students. Interviews were conducted after students had participated in
some online labs, either halfway through or at the end of the semester, to ascertain how student
perspectives had developed throughout the semester. Two interviews were conducted with volun-
teers each semester. The interviews comprised four male students (three white and one Asian). Inter-
views ranged from 30 to 75 min as interviewees were free to elaborate as needed on each question.
3.2.2. Interview protocol
A formal interview protocol was developed using the interview protocol renement (IPR) process
(Yeong et al. 2018). This framework was selected to ensure interview questions were created sys-
tematically, in-line with the proposed research direction, while considering elements beyond the
specic questions (Castillo-Montoya 2016; Rubin and Rubin 2005). Further, our prior experience
(Clark et al. 2019;Shahetal.2019) with IPR resulted in the successful collection of qualitative
EUROPEAN JOURNAL OF ENGINEERING EDUCATION 9
data that was used to reinforce quantitative ndings. The IPR is composed of four steps, as shown
in Figure 3. These steps involve aligning interview questions with research questions or relevant
themes in the study and formulating an inquiry-based conversation throughout the interview.
The IPR supported developing questions to explore student motivation and self-regulation in
greater depth.
3.2.3. Latent Dirichlet allocation (LDA)
Interviews were completed by a member of the research team and transcribed by an external service.
The results were examined by several members of the research team for accuracy before proceeding.
A model representing the LDA process is shown in Figure 4. LDA treats a given corpus compiled of all
student interview transcriptions as a collection of words w=(w1,w2,...,wN), where each docu-
ment (M) consists of Nwords. Assuming each corpus contains a mix of interpretable topics, LDA con-
stitutes a hierarchical model to approximate the topics-word and document-topic distributions
(Yeong et al. 2018).
The important function that must be solved is the posterior given by Equation (1)
p(
u
,z|w,
a
,
b
)=p(
u
,z,w|
a
,
b
)
p(w|
a
,
b
)(1)
where αis the Dirichlet prior for the distribution of topics, βis a topicword matrix representing the
probability of a word for each topic, θfollows a multinomial distribution of topics representing the
probability of a topic in a document.
Figure 3. Interview protocol renement process (Yeong et al. 2018).
10 D. MAY ET AL.
To solve for p(w|
a
,
b
), we can identify a marginal distribution for the document as shown in
Equation (2)
p(w|
a
,
b
)=p(
u
|
a
)
N
n=1
zn
p(zn|
u
)p(wn|zn,
b
)

d
u
(2)
Model parameters αand βare designed to be estimated (which can be accomplished through various
estimation methods). Collapsed Gibbs sampling, a common-use algorithm, was performed to approxi-
mate posterior distribution for LDA.
Once approximated, a list of Ntopics (z) is determined alongside the distribution θ. To evaluate
the generalisation of each assigned topic, we consider perplexity, a statistical measure of how well
the model can predict topics. Equation (3) denotes perplexity, where a lower score represents a
better generalisation for a given corpus and model convergence. A tolerance number was set to
0.01, which will stop the calculation once perplexity improves by less than 1%. With a continuously
increasing number of topics, the perplexity value will decrease and each associated word will
become dicult to interpret. This threshold is used as a strategy to avoid model overtting. With
limited interviews available, an LDA training process was conducted to study the composition of
underlying topics, and the testing process was validated by human judgment.
P(Dtest)=exp
M
d=1
log p(wd)
M
d=1
Nd
(3)
Once topics were selected, the most frequent terms for each topic were analysed for their saliency
(Chuang, Manning, and Heer 2012; Chuang et al. 2012) and relevance (Sievert and Shirley 2014). As
shown in Equation (4), saliency measures the likelihood of P(T|w) that a given word will convey
information on topics (Chuang, Manning, and Heer 2012; Chuang et al. 2012).
saliency(w)=P(w)
T
P(T|w)log P(T|w)
P(T)(4)
Relevance measures the placement of a word to a specic topic given a weighted parameter (
l
) from
0
l
1, balancing the probability that a word appears in a topic P(w|T) relative to the likelihood
of its appearing over the entire corpus (Sievert and Shirley 2014).
Relevance(w|T)=
l
P(w|T)+(1
l
)P(w|T)
P(w|M)(5)
3.2.4. Data analysis and preliminary results
The LDA was used to determine the topics generated from the corpus of interviews. Modelling
began with data preprocessing, to remove noise from the text data (e.g. pluralities, suxes). After
Figure 4. Graphical representation of LDA model (Blei, Ng, and Jordan 2003).
EUROPEAN JOURNAL OF ENGINEERING EDUCATION 11
stop-words ltering, the compiled document contained 721 unique words, which were lowercased,
tokenised, and lemmatised for LDA analysis. We determined the optimal number of topics to be 11
by plotting the perplexity (Equation (3)) against the number of topics (Figure 5). While lower perplex-
ities are available at a higher number of topics, the results became saturated and dicult to inter-
pret; instead, we selected a topic number that balances a succinct number of topics and a low
perplexity. The words selected for each topic distribution are shown in Table 2.
The 11 topics are plotted against the two principal components in Figure 6, the intertopic dis-
tance map. The geometric size of each topic on the plot represents the marginal topic distribution
allocation the relative importanceof the topic or the probability of the topic in the corpus with
topic numbering in order of marginal topic distribution size (where Topic 1 has the greatest
distribution).
Taking this information collectively the words of each topic, the contextual use of these in the
corpus, and the underlying structure of these topics we labelled the main topics and discuss them.
The results indicated there were minimal dierences between students when compared quantitat-
ively. However, the qualitative ndings provided insight on the challenges students experienced and
their approach to completing the lab.
4. Study discussion
Among demographic and enrolment characteristics, studentsmajor was the only distinguishing
factor for their motivation and self-regulation approaching the online labs. Given the course
content and expectation that the labs would relate to electronics, it is justiable that students with
certain engineering emphases (EE and CSE) might have greater intrinsic motivation for the experience.
Furthermore, this was a prerequisite course in the plan of study, creating utility value for the material.
On the other hand, the imposed shift to online instruction and labs may have dampened any motiv-
ation dierences among students compared to if they had an option for course format.
There were also no signicant group dierences for self-regulation; while student motivation and
self-regulation were moderately correlated (r= .60, p< .001), their unfamiliarity with online labs or
Figure 5. LDA perplexity versus topic count.
12 D. MAY ET AL.
uncertainty about what to expect in the course may have contributed to the lower levels of self-regu-
lation overall. The lack of signicant dierences between various subgroups was not surprising as we
posit many students entered the virtual lab environment with the same level of previous experience
(none, as this course was the rst of its kind) and concerns. Nonetheless, studentsthinking around
Figure 6. Topics plotted against principal components (PC1 and PC2).
Table 2. Word selections for each topic.
Topic Words
1 Day go easy week early long time ahead every set ne spend check know look expectation minute speak top lot feel end
whole stay always night tempt comfortable eat
2 Pretty hand guess depend much like still component good really work way aect connect engineering something
subject touch virtual lab experience online actual either code equipment laptop important major basic
3 Big stusometimes bit little thing able remote gure many real learn seem afraid pace situation program world rush
time yeah mean log bare station minimum single sit amount teach
4 Professor two three hey student come lecture condence oh drop happen likely run understand post ask another
struggle plan gather leave member straightforward zoom wish could maybe online think problem
5 Take semester class decision environment next part pandemic send factor say couple sense option beforehand example
advice biology prereq graduate physics spring would probably summer like online inaudible matter portion
6 One everything see document last let dicult work read lab step recent thankfully communicate rough instead half
make else little break hard version partner may go correctly material overlay hop
7 Start question answer approach instruction give wrong report email talk dierent ask okay get point confused forward
become someone toward face rst hard complex end would comp excited fundamental prepare
8 Expect help nd use new need music suppose together program specic tool upcoming love listen list click vague hope
toolbox detailed knowledge structure software since complete far great put typical
9 Condent home campus prefer want sorry person session engagement less yes due small instance previous prep ability
extra talk mostly would space instead awesome successful setting benecial stressed six snippet
10 Issue yes technology access idea kind use simulation mixed circuit operate entirely fast nice computer problem call quick
sure grab process school template believe classmate receiver citrix remotely video design
11 Hmm course mm inuence level yeah convenient armative goal change inaudible order throughout consider create
currently side debate stressful delay dierently element interest trouble bite eye simplistic communication gpa speed
EUROPEAN JOURNAL OF ENGINEERING EDUCATION 13
motivation and self-regulation emerged as important topics in the subsequent qualitative
interviews.
When attempting to understand the axis of the principal component graph in Figure 6, two major
themes seemed to underlie student interview responses: execution (horizontal) and scheduling (ver-
tical). The words go,start, and completeare seen in topic 1, topic 7, and topic 8, respectively,
which span the horizontal axis of the intertopic map (see also Table 2). Vertically, topic 3 represents
shorter-term self-regulation during the labs as a theme in the interviews; this aligns with quantitative
results which show the equivalence of self-regulation among students. Additionally, topic 5
describes long-term planning toward graduation and studentsdecisions to take the course. This
demonstrates another dimension of planning involved in the labs. A deeper exploration of these
topics and verication with additional qualitative approaches and data collection might reinforce
the importance of these factors for the student experience in online labs.
Examining important topics of the interviews reveal nuance related to student motivation and
self-regulation in their lab experiences. As students described the experience in online labs, their per-
spectives were often benchmarked against traditional in-person labs. Yet, students noticed impor-
tant attributes of both lab formats. We labelled the three main topics #1: Learning Compatibility,
#2: Questions and Inquiry, and #3: Planning and Coordination and see ways that these correspond
to the main aspects of motivation and self-regulation. The most frequent words in each topic are
displayed in Figure 7 and we use quotes from the participants to further uncover their meaning.
4.1. Learning compatibility
The rst topic related to learning in the lab experience and was a focus for many students during
their interviews. Despite being compelled to complete the labs online, students spoke about the
benets and challenges of labs in all formats in-person and online and reected that compat-
ibility was among the most important factors in the lab experience. Student responses high-
lighted several dimensions for considering this compatibility: with personal preferences or
needs and with learning content. Among these benets of in-person labs were participating in
the campus experience, feeling more hands-on, getting greater practice with the equipment,
and being immersed in the lab environment. On the other hand, students commented that the
online labs allowed them to have less time commuting, go at their own pace, prepare for
future digital work environments, or do work from the comfort of home. In light of the pandemic,
they commented that working from home also allowed personal health safety. These personal
dimensions carried over into student perceptions of learning compatibility. For instance, one
student said, I like going in-person because I get to use hands. I get to see how you actually
make the connections [] because theory and application in this class are two dierent
things(Student D).
Moreover, students felt that certain learning topics might be more compatible with in-person or
virtual lab experiences, it depends on what the purpose of the lab is. One student commented that
the experience might change from day to day and be ne:
Figure 7. Topic 1, 2, and 3 word maps.
14 D. MAY ET AL.
It depends, because like, my major is electrical engineering, so my major is not hands-on. In some components,
like, we connect wires, connect transistors, resistors, and voltages [] I feel like being hands-on would be more
helpful. But in some other components, like if we have like a virtual lab one day, itsne. (Student A)
Indeed, in some cases, the use of online labs exceeded studentsexpectations for the ways in which it
was compatible with their circumstances and their growth in learning.
4.2. Questions and inquiry
Topic 2 related to questions and inquiry. Students expressed concern regarding how to communi-
cate with their professors or lab mates when they were confused, considering the ease at which this
was possible in traditional, in-person formats. As seen by the interview excerpts below, students dis-
cussed their approaches for addressing questions or course inquiry, including dialogue between lab
partners.
If a friend or someone didnt understand this question, then I would email the professor, set up a Zoom session
with the professor, ask him a question on what to do, how do I take someone forward and answer this question.
(Student A)
Sometimes my question that I was asking or my problem would get skewed a little bit in translation to the pro-
fessor, and then as Id email back, Id get half the answer I needed. (Student B)
This language shows the general order that students applied for help-seeking during the labs, begin-
ning rst with a peer or team member, then asking the professor. However, it also reveals major
impediments for communication in the virtual settings communication was delayed and some-
times unclear.
While this might seem to portray a problem for clear communication in online labs, it is also the
case that clear channels for communication are required in in-person settings. Students commented
that when the materials were clear, progress was not an issue:
If I understand the material for this week, then I really dont have a problem with the lab at all, online or in-
person, it doesnt matter. But if I dont understand it, or if Im struggling to understand it, then it makes it
very dicult for me to complete the lab, especially online. (Student D)
And when students had a clear means to get help, whether through Zoom calls or structured time to
ask questions, they were more likely to take advantage. In other words, clear communication and
verbal instruction, which might happen naturally in the face-to-face lab courses during the course
meeting, need to be planned in a more deliberate way when transitioning to online instruction.
4.3. Planning and coordination
Topic 3 related to planning and coordination, how students executed the lab successfully. This
includes ensuring equipment worked so labs can be properly complete or allocating timing for
task/activity completion. As seen by the interview excerpts below, students reported varying
items for how the timing of the labs and found it was imperative to stay organised.
Its really easy, it being online, to feel tempted that you can just do something else during the lab time and then
come back and do it over the weekend or some other day. I would just advise people to keep to the schedule.
Stay on top of it. (Student C)
Always plan ahead. I know in the past, where Ill have forgotten to look at the schedule for this week, and I think,
Oh Im online, this should be easy.But its taken me two or three hours more than Ive set aside for and Ive had
some really late nights trying to nish it. So long as you stay on top of things and as long as you make time for it,
then youll be ne. (Student D)
Students also found patterns for eective regulation of the experiences as they learned from their
mistakes from lab to lab, and found ways to check their work to ensure they were executing the
lab correctly.
EUROPEAN JOURNAL OF ENGINEERING EDUCATION 15
4.4. Study Limitations
There are limitations the investigators are aware of that must be addressed in future research eorts,
particularly as it relates to data collection. In future data collection, we will collect data before,
during, and at the end of the semester to determine the change in motivation and self-regulation
throughout the semester. Further, the number of interviews performed must also increase to
allow for a larger data set and a more diverse set of interviewees.
For small datasets, LDA is less eective for producing meaningful topics (Tang et al. 2014). To over-
come this problem, more textual data could improve the model performance. Besides the basic LDA
model, future work should explore dierent LDA model structures. In particular, education prac-
titioners could explore dierent strategies of nding the optimal number of topics, modelling sen-
tence structure with alternative assumptions, and developing non-overlapping word distributions.
5. Conclusion and future work
Future work includes further testing with additional course cohorts, where data are collected pre-
and post-course, to determine if their motivation and learning strategies changed. Further, a
formal coding scheme will be developed to realise codes and themes within the interview
responses. Similar to the ndings of LDA, we anticipate that these codes and themes will relate
to the main inuences of student motivation and self-regulation and opportunities to shape
student thinking about online lab experiences. Beyond student motivation and regulation,
research on how students prepared for online courses, given their novelty, is necessary. For
instance, an important research direction pertains to how students use prior lab experience to
frame their preparation for online lab courses. Further, there are questions pertaining to how stu-
dents approach an online lab and the eects of this approach. For instance, do they operate at
their own pace and how does the experience challenge their conceptual understanding of the
content?
The presented work discussed the introduction of online laboratories to EE and CSE courses in the
context of a rapid switch from face-to-face to online experimentation from the studentsperspective.
However, this perspective only focusses on one party in the classroom. Apart from considering the
studentsperspective, it is also important to include the instructor and their perception of online
experimentation practice in the account. In parallel to the student perspective-related research
activities, our broader project includes the instructor perspective in a separate research thrust.
This project section examines how instructors experienced a topdown mandated, time-constrained,
and rapid transition to exclusively online-based laboratory modules in engineering courses along a
continuum of resistance towards, or embracing of these educational technologies. In a manner
similar to the student perspective reported here, the instructor perspective under study also rep-
resents a major gap in the literature, since many of the online laboratory studies in the literature
are performed by the same instructor which implemented and sometimes developed the respective
labs. This observation clearly raises the question of technology adoption and diusion of innovation
(Rogers 2010; Froyd et al. 2017). With a growing demand for online laboratory solutions in higher
education, it will become normal that instructors, instead of developing their own labs, will need
to use or adapt labs that are developed by other institutions. Though the general process of
diusion of educational innovations is extensively discussed in the literature, an in-depth consider-
ation in the context of online laboratories is important, yet does not presently exist. A preliminary
comparison between the instructor and the student perspective results reveals that both view com-
patibility to existing instruction practices and communication channels as the area of interest. Both
topics seem to have a big impact on how the parties perceive online experimentation as a whole.
Complementary to this research, further investigation into the student user experience (UX) with
the online lab experiments will inform researchers of specic roadblocks and challenges students
encounter, as well as identify areas of strength in the implementation of online labs. Course
16 D. MAY ET AL.
redesigns incorporating the UX research information will improve the overall experience and facili-
tate studentsfocus on learning content by removing technical barriers and improving usability.
As we better understand the student, instructors, and UX framing of online lab experiences, we
will be able to close the feedback loop of the personal experiences when transitioning lab activities
online by making strategic improvements to online lab experiences and the surrounding instruc-
tional materials.
Acknowledgement
This material is based upon work supported by the National Science Foundation under grant number 2032802.
Disclosure statement
No potential conict of interest was reported by the author(s).
Funding
This work was supported by National Science Foundation [grant number 2032802].
Notes on contributors
Dr. Dominik May is an Assistant Professor in the Engineering Education Transformations Institute. He researches online
and intercultural engineering education. His primary research focus lies on the development, introduction, practical use,
and educational value of online laboratories (remote, virtual, and cross-reality) and online experimentation in engineer-
ing instruction. In his work, he focuses on developing broader educational strategies for the design and use of online
engineering equipment, putting these into practice and provide the evidence base for further development eorts.
Moreover, Dr. May is developing instructional concepts to bring students into international study contexts so that
they can experience intercultural collaboration and develop respective competences.
Beshoy Morkos is an associate professor in the College of Engineering at the University of Georgia. His research group
currently explores the areas of system design, manufacturing, and their respective education. His system design
research focuses on developing computational representation and reasoning support for managing complex system
design through the use of Model Based approaches. The goal of Dr. Morkosmanufacturing research is to fundamentally
reframe our understanding and utilization of product and process representations and computational reasoning capa-
bilities to support the development of models which help engineers and project planners intelligently make informed
decisions. On the engineering education front, Dr. Morkosresearch explores means to improve persistence and diver-
sity in engineering education by leveraging studentsdesign experiences.
Dr. Andrew Jackson is an Assistant Professor of Workforce Education, with expertise in technology, engineering, and
design education. His research involves cognitive and non-cognitive aspects of learning. In particular, he is interested
in design-based learning experiences, how beginning students navigate the design process, and how studentsmotiv-
ation and condence plays a role in learning. Dr. Jacksons past work has bridged cutting-edge soft robotics research to
develop and evaluate novel design experiences in K-12 education, followed studentsself-regulation and trajectories
while designing, and produced new instruments for assessing design decision-making.
Nathaniel J. Hunsu is an assistant professor of Engineering Education. He is aliated with the Engineering Education
Transformational Institute and the School of Electrical and Computer Engineering in the University of Georgias College
of Engineering. His interest is at the nexus of the research of epistemologies, learning mechanics and assessment of
learning in engineering education. His research focuses on learning for conceptual understanding, and the roles of
learning strategies, epistemic cognition and student engagements in fostering conceptual understanding. His research
also focuses on understanding how students interact with learning tasks and their learning environment. His expertise
also includes systematic reviews and meta-analysis, quantitative research designs, measurement inventories develop-
ment and validation.
Amy Ingalls is a passionate educator who believes in accessibility and equal access to education for all. A part of the
original UGA Online Learning team, Amy has extensive experience in developing, designing, and supporting impactful
online courses at the undergraduate and graduate levels. Outside of her work at UGA, Amy has experience as a library
media specialist and technology instructor in K12 classrooms. As an instructor, a course developer, and a human, Amy
EUROPEAN JOURNAL OF ENGINEERING EDUCATION 17
believes that online-delivered courses remove barriers to education and the pursuit of education is a part of our mission
at UGA.
Fred Beyette is the founding chair of the School of Electrical and Computer Engineering in the University of Georgia
College of Engineering. Over the past decade, Beyettes research has focused on developing point-of-care devices
for medical and health monitoring applications - including devices that guide the diagnosis and treatment of acute
neurologic emergencies such and stroke and traumatic brain injury. His work has resulted in 12 patent applications.
References
Al Weshah, A., R. Alamad, and D. May. 2021.Work-in-Progress: Using Augmented Reality Mobile App to Improve
Students Skills in Using Breadboard in an Introduction to Electrical Engineering Course.In Cross Reality and
Data Science in Engineering, edited by M. Auer and D. May, 313319. Switzerland, Cham: Springer.
Bernard, R. M., A. Brauer, P. C. Abrami, and M. Surkes. 2004.The Development of a Questionnaire for Predicting Online
Learning Achievement.Distance Education. 25 (1): 3147.
Blei, D. M., A. Y. Ng, and M. I. Jordan. 2003.Latent Dirichlet Allocation.Journal of Machine Learning Research 3: 993
1022.
Brinson, J. R. 2015.Learning Outcome Achievement in Non-traditional (Virtual and Remote) Versus Traditional (Hands-
on) Laboratories: A Review of the Empirical Research.Computers & Education 87: 218237.
Brinson, J. R. 2017.A Further Characterization of Empirical Research Related to Learning Outcome Achievement in
Remote and Virtual Science Labs.Journal of Science Education and Technology 26 (5): 546560.
Castillo-Montoya, M. 2016.Preparing for Interview Research : The Interview Protocol Renement Framework.
Qualitative Report (online) 21 (5): 811831.
Chen, C., J. Mullis, and B. Morkos. 2021.A Topic Modeling Approach to Study Design Requirements.In ASME 2021
International Design Engineering Technical Conferences and Computers and Information in Engineering Conference,
August 17.
Chuang, J., C. D. Manning, and J. Heer. 2012.Termite: Visualization Techniques for Assessing Textual Topic Models.In
Advanced Visual Interfaces.
Chuang, J., D. Ramage, C. D. Manning, and J. Heer. 2012.Interpretation and Trust: Designing Model-Driven
Visualizations for Text Analysis.In ACM Human Factors in Computing Systems (CHI).
Clark, M., D. Shah, E. Kames, and B. Morkos. 2019.Developing an Interview Protocol for an Engineering Capstone
Design Course.In Proceedings of the ASME Design Engineering Technical Conference, Vol. 3.
Corter, J. E., J. V. Nickerson, S. K. Esche, C. Chassapis, S. Im, and J. Ma. 2007.Constructing Reality: A Study of Remote,
Hands-on, and Simulated Laboratories.ACM Transactions on Computer-Human Interaction 14 (2): 7.
Devine, R., and D. May. 2021.Work in Progress: Pilot Study for the Eect of a Simulated Laboratories on the Motivation
of Biological Engineering Students.In edited by M. Auer and D. May, 429436. Switzerland, Cham: Springer.
Estriegana, R., J.-A. Medina-Merodio, and R. Barchino. 2019.Student Acceptance of Virtual Laboratory and Practical
Work: An Extension of the Technology Acceptance Model.Computers & Education 135: 114.
Faulconer, E. K., and A. B. Gruss. 2018.A Review to Weigh the Pros and Cons of Online, Remote, and Distance Science
Laboratory Experiences.The International Review of Research in Open and Distributed Learning 19 (2): 156168.
Froyd, J. E., C. Henderson, R. S. Cole, D. Friedrichsen, R. Khatri, and C. Stanford. 2017.From Dissemination to
Propagation: A New Paradigm for Education Developers.Change: The Magazine of Higher Learning 49 (4): 3542.
Garcia-Zubia, J., J. Cuadros, S. Romero, U. Hernandez-Jayo, P. Orduna, M. Guenaga, L. Gonzalez-Sabate, I. Gustavsson.
2017.Empirical Analysis of the Use of the VISIR Remote Lab in Teaching Analog Electronics.IEEE Transactions on
Education 60 (2): 149156.
Gustavsson, I., K. Nilsson, J. Zackrisson, J. Garcia-Zubia, U. Hernandez, A. Nafalski, Z. Nedic, et al. 2009.On Objectives of
Instructional Laboratories, Individual Assessment, and Use of Collaborative Remote Laboratories.IEEE Transactions
on Learning Technologies 2 (4): 263274.
Heradio, R., L. de la Torre, D. Galan, F. J. Cabrerizo, E. Herrera-Viedma, and S. Dormido. 2016.Virtual and Remote Labs in
Education: A Bibliometric Analysis.Computers & Education 98: 1438.
Hernández-de-Menéndez, M., A. Vallejo Guevara, and R. Morales-Menendez. 2019.Virtual Reality Laboratories: A
Review of Experiences.International Journal on Interactive Design and Manufacturing 13 (3): 947966.
Kames, E., D. Shah, M. Clark, and B. Morkos. 2019.A Mixed Methods Analysis of Motivation Factors in Senior Capstone
Design Courses.American Society of Engineering Education Annual Conference & Exposition: 156168.
Kollöel, B., and T. de Jong. 2013.Conceptual Understanding of Electrical Circuits in Secondary Vocational Engineering
Education: Combining Traditional Instruction with Inquiry Learning in a Virtual Lab.Journal of Engineering Education
102 (3): 375393.
Li, R., J. R. Morelock, and D. May. 2020.A Comparative Study of an Online Lab Using Labsland and Zoom During COVID-
19.Advances in Engineering Education 8 (4): 110.
Ma, J., and J. Nickerson. 2006.Hands-on, Simulated, and Remote Laboratories: A Comparative Literature Review.ACM
Computing Surveys 38: 7.
18 D. MAY ET AL.
May, D. 2020.Cross Reality Spaces in Engineering Education Online Laboratories for Supporting International Student
Collaboration in Merging Realities.International Journal of Online Engineering 16 (3): 426.
May, D., M. Trudgen, and A. V. Spain. 2019.Introducing Remote Laboratory Equipment to Circuits Concepts,
Possibilities, and First Experiences.ASEE Annual Conference & Exposition.
Pokoo-Aikins, G. A., N. Hunsu, and D. May. 2019.Development of a Remote Laboratory Diusion Experiment Module for
an Enhanced Laboratory Experience.In 2019 IEEE Frontiers in Education Conference (FIE),15.
Potkonjak, V., M. Gardner, V. Callaghan, P. Mattila, C. Gütl, V. M. Petrović, and K. Jovanović.2016.Virtual Laboratories for
Education in Science, Technology, and Engineering: A Review.Computers & Education 95: 309327.
Rogers, E. M. 2010.Diusion of Innovations. 4th ed. New York, NY: Simon and Schuster.
Rubin, H. J., and I. S. Rubin. 2005.Qualitative Interviewing The Art of Hearing Data, 113117. 2nd ed. Thousand Oaks, CA:
Sage Publications.
Shah, D., M. Clark, E. Kames, and B. Morkos. 2019.Development of a Coding Scheme for Qualitative Analysis of Student
Motivation in Senior Capstone Design.In ASME International Design Engineering Technical Conference, Anaheim.
Sievert, C., and K. Shirley. 2014.LDAvis: A Method for Visualizing and Interpreting Topics.In Proceedings of the
Workshop on Interactive Language Learning, Visualization, and Interfaces,6370.
Tang, J., Z. Meng, X. Nguyen, Q. Mei, and M. Zhang. 2014.Understanding the Limiting Factors of Topic Modeling Via
Posterior Contraction Analysis.In Proceedings of the 31st International Conference on International Conference on
Machine Learning,Vol. 32, I-190I-198.
Yeong, M. L., R. Ismail, M. H. Ismail, and M. I. Hamzah. 2018.Interview Protocol Renement: Fine-Tuning Qualitative
Research Interview Questions for Multi-Racial Populations in Malaysia.Qualitative Report (Online) 23 (11): 27002713.
EUROPEAN JOURNAL OF ENGINEERING EDUCATION 19
... Covid-19 has sparked the largest remote work experiment in history [1]- [5]. explored the introduction of online laboratories to Electrical Engineering and Computer Systems Engineering courses as part of a quick transition from face-to-face to online experiment from the students' viewpoint [6]. presented methods for integrating a flexible blended instructional format. ...
Full-text available
Article
A remote lab is a technology that allows participants to efficiently conduct experimental teaching where users can connect to lab equipment from anywhere without being in a specific physical location. The COVID-19 pandemic affects all areas of human activity. As a result, students did not receive face-to-face instruction, and access to the laboratory was limited or practically impossible, and access to laboratory facilities has been limited or nearly impossible. Especially in engineering education, students’ practical abilities cannot be developed comprehensively. In this paper, this paper built an online remote robotics experiment system using digital twin (DT) technology and IoT technology and adopted ADDIE (Analysis, Design, Development, Implementation, and Evaluation) teaching method. With these measures, students can design and debug robot programs at home, just like in the laboratory. This study sent questionnaires to 64 students, and 58 were returned. The results show that more than 80% of students believe that the remote labs for industrial robotics courses have improved the efficiency and quality of students' skills training as opposed to virtual simulation and watching videos on the computer.
... Not being able to have in-person interactions led to weaknesses for many faculty, including increased workloads, unfamiliarity with new technology, and a steep learning curve regarding how to best engage students in their learning process-all of which were found to be challenging as many faculty faced the "black screen" phenomenon during instructions [114,[118][119][120]. Many universities have various types of learning labs, and it was considered difficult to replicate these labs online as there was no hands-on experience in this regard [121][122][123][124][125][126]. To move in-person labs online in the future, one would need to experiment and reflect in detail to ensure that students receive an optimal learning experience. ...
Full-text available
Article
The COVID-19 pandemic has led to problems and upheaval throughout the highereducation sector, with university campuses ceasing face-to-face instruction and with assessments shifting to an online model for a few years. As a result, the pandemic prompted educators to teach online, utilizing online lectures, narrated power points, audio snippets, podcasts, instant messaging, and interactive videos, whereas traditional universities had primarily relied on in-person courses. Evaluations, which included assignments and multiple-choice questions, were conducted online, forcing lecturers to reconsider how deliverables were set up to prevent students from having easy access to the answers in a textbook or online. Learning from college students’ experiences throughout this time period will assist higher-education stakeholders (administration, faculty, and students) in adapting future online course delivery selections for higher education. In this study, we investigated the experiences of students learning from a distance, as well as aspects of their learning. We provide recommendations for higher education. The COVID-19 pandemic has clearly resulted in the largest distance-learning experiment in history.
Full-text available
Article
COVID-19 made a sudden transition from physical labs to online labs and changed the landscape of lab learning. In this work, we used the VISIR circuits module of remote laboratory platform LabsLand ® together with the video conferencing platform Zoom, to simulate the real electrical circuits lab environment for a class of 38 students in the 2020 spring semester. In this paper, we studied the students’ perception and academic performance in the online lab settings in comparison with previous physical labs.
Full-text available
Chapter
The enhancement of first-year electrical engineering students’ skills in building circuits using the breadboard is essential. To overcome difficulties in dealing with internal breadboard connections, Augmented Reality (AR) technology used to build a 3D application. AR could improve students’ ability with respect to efficient design and build the electrical circuits in the breadboard due to the support for viewing the internal breadboard connections and learning step by step how to build circuits. This paper will explore the integration of AR into the Introduction to Electrical Engineering course in order to provide an interactive learning experience, in which abstract thinking is supported, and concept visualization, exploration, and evaluation are facilitated during the various stages of the circuits building steps. Such an AR app will permit the students to visualize virtual representations of the circuit on the breadboard in real-world settings by mixing the 3D circuit element models with a camera view of the students’ smartphone and 3D animations for circuit-building procedures.
Conference Paper
Risk management is vital to a product’s lifecycle. The current practice of reducing risks relies on domain experts or management tools to identify unexpected engineering changes, where such approaches are prone to human errors and laborious operations. However, this study presents a framework to contribute to requirements management by implementing a generative probabilistic model, the supervised latent Dirichlet allocation (LDA) with collapsed Gibbs sampling (CGS), to study the topic composition within three unlabeled and unstructured industrial requirements documents. As finding the preferred number of topics remains an open-ended question, a case study estimates an appropriate number of topics to represent each requirements document based on both perplexity and coherence values. Using human evaluations and interpretable visualizations, the result demonstrates the different level of design details by varying the number of topics. Further, a relevance measurement provides the flexibility to improve the quality of topics. Designers can increase design efficiency by understanding, organizing, and analyzing high-volume requirements documents in confirmation management based on topics across different domains. With domain knowledge and purposeful interpretation of topics, designers can make informed decisions on product evolution and mitigate the risks of unexpected engineering changes.
Chapter
The main challenge for biological engineering educators is that BE is a relatively new and broad discipline that integrates a diverse array of knowledge from the basic sciences and engineering sciences towards application in the biological and medicinal fields. Due to variety of possible career outcomes and limited department resources (money, laboratory space, etc.), it is not possible to create a single undergraduate curriculum that will cover all of the technical skills spanning the entire biological engineering field in a hands-on setting. As laboratory sections have been shown to provide a variety of educational benefits, it is imperative that university engineering departments seek alternative methods to deliver real-life application of classroom concepts.
Article
span>This paper discusses online laboratories as cross reality spaces in education. Cross Reality (also XR) as a term is borrowed from the field of gaming and broadly describes the integration of immersive, augmented, mixed, and virtual reality technology within physical reality. Online laboratories form an ideal example, as different realities (the real hands-on world in real labs, the virtual world in simulated labs or even a mixture of both in context with remote labs) are merged. The connection between different realities in laboratory education and their relation to engineering education contexts are discussed by describing a three-dimensional matrix for categorizing (online) laboratories in teaching and displaying current research results in this area. On basis of this, a scholarly research study is discussed, which is making use of a remote lab in mechanical engineering education for an international student body. In this study, the lab and its application are evaluated from the learner, the system, and the course perspective. These three perspectives offer a holistic view of the lab and the students’ learning. The study proofs a positive effect on the students learning experiences. The results also show which current needs and future potentials lie on the intersection of engineering education, internationalization, and digitalization in terms of collaborating and learning in Cross Reality Spaces.</span