ArticlePublisher preview available
To read the full-text of this research, you can request a copy directly from the authors.

Abstract and Figures

Despite an increasing focus on integrating engineering design in K-12 settings, relatively few studies have investigated how to support students to engage in systematic processes to optimize the designs of their solutions. Emerging learning technologies such as computational models and simulations enable rapid feedback to learners about their design performance, as well as the ability to research how students may or may not be using systematic approaches to the optimization of their designs. This study explored how middle school, high school, and pre-service students optimized the design of a home for energy efficiency, size, and cost using facets of fluency, flexibility, closeness, and quality. Results demonstrated that students with successful designs tended to explore the solution space with designs that met the criteria, with relatively lower numbers of ideas and fewer tightly controlled tests. Optimization facets did not vary across different student levels, suggesting the need for more emphasis on supporting quantitative analysis and optimization facets for learners in engineering settings.
This content is subject to copyright. Terms and conditions apply.
Vol.:(0123456789)
1 3
Journal of Science Education and Technology (2024) 33:143–155
https://doi.org/10.1007/s10956-023-10080-x
Comparing Optimization Practices Across Engineering Learning
Contexts Using Process Data
JenniferL.Chiu1 · JamesP.Bywater2· TugbaKarabiyik3· AlejandraMagana3· CoreySchimpf4· YingYingSeah5
Accepted: 12 October 2023 / Published online: 31 October 2023
© The Author(s), under exclusive licence to Springer Nature B.V. 2023
Abstract
Despite an increasing focus on integrating engineering design in K-12 settings, relatively few studies have investigated how
to support students to engage in systematic processes to optimize the designs of their solutions. Emerging learning technolo-
gies such as computational models and simulations enable rapid feedback to learners about their design performance, as well
as the ability to research how students may or may not be using systematic approaches to the optimization of their designs.
This study explored how middle school, high school, and pre-service students optimized the design of a home for energy
efficiency, size, and cost using facets of fluency, flexibility, closeness, and quality. Results demonstrated that students with
successful designs tended to explore the solution space with designs that met the criteria, with relatively lower numbers of
ideas and fewer tightly controlled tests. Optimization facets did not vary across different student levels, suggesting the need
for more emphasis on supporting quantitative analysis and optimization facets for learners in engineering settings.
Keywords Optimization· Engineering design· Secondary education· Pre-service teachers· CAD simulation
Engineering in pre-college settings is gaining traction, with
many states adopting the Next Generation Science Stand-
ards (NGSS, 2013) as well as offering standalone engi-
neering curricula (e.g., Project Lead the Way, n.d.). Inte-
grating engineering into pre-college settings enables more
students to participate in the discipline, offering broader
access to those who may not know about engineering as
a field or career (e.g., Cunningham & Lachapelle, 2014;
Moore etal., 2014a).
Many efforts have characterized what should be included in
K-12 engineering. For example, the Framework for P-12 Engi-
neering Learning (Advancing Excellence in P12 Engineering
Education & American Society for Engineering Education
[ASEE], 2020) provides a three-dimensional taxonomy of
engineering habits of mind, engineering knowledge, and
engineering practice. Engineering habits of mind include
traits such as optimism, creativity, persistence, and collabo-
ration. Engineering knowledge consists of the mathematics,
science, and technical expertise required to design solutions
and complete engineering tasks. Engineering practice involves
engineering design, material processing, professionalism, and
quantitative analysis. As such, engineering design has been
promoted as a context for science and math learning (English,
2016), as well as integrated STEM learning (Moore etal.,
2014b; Purzer & Quintana-Cifuentes, 2019), in part because
these projects can help students develop skills that transcend
engineering design problems and have applicability across a
wide set of problem-solving scenarios. Although a fair amount
of research has focused on the engineering design in K-12 set-
tings (e.g., Lammi etal., 2018; Purzer etal., 2014), relatively
little has focused on the practice of quantitative analysis in
pre-college engineering settings (e.g., Chao etal., 2017). In
particular, few research studies investigate how pre-college
students use systematic processes to optimize the designs
James P. Bywater, Tugba Karabiyik, Alejandra Magana, Corey
Schimpf, and Ying Ying Seah contributed equally to this manuscript
* Jennifer L. Chiu
jlchiu@virginia.edu
1 Curriculum, Instruction, andSpecial Education, School
ofEducation andHuman Development, University
ofVirginia, 313 Bavaro, Charlottesville, VA22903, USA
2 Learning, Technology, & Leadership Education, James
Madison University, Harrisonburg, USA
3 Computer andInformation Technology, Purdue University,
WestLafayette, USA
4 Department ofEngineering Education, University atBuffalo,
Buffalo, USA
5 School ofBusiness, Oakland City University, Oakland, USA
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
... A specific type of simulation tool used in engineering design to support simulationbased learning provides affordances for computer-aided design (CAD) and computeraided engineering (CAE). These tools enable rapid testing of designs, immediate feedback, and encourage evidence-based decision making for revisions [25]. Evidence-based decision making has been recognized as an essential strategy for improving the design process and problem solving [26]. ...
... While practitioner tools may have significant learning curves, Aladdin was designed for novice learners, thus providing an intuitive graphical user interface. Accordingly, previous educational implementations have been conducted at the middle school, high school, and undergraduate levels (e.g., [11,25]). ...
Article
Full-text available
Analyzing the integration of scientific knowledge to guide decision-making processes supporting design challenges in engineering education is critical. However, effectively engaging in informed design decision-making processes is challenging, particularly in the context of online education. Simulation-based learning can bring authentic design practices to online education, but effective guidance and scaffolding must be provided to learners. Therefore, this research investigates the implications of integrating simulation-based learning with an argumentation framework to guide students in incorporating scientific knowledge into their design decisions, particularly in designing energy-efficient housing. This study took place during online learning due to the COVID-19 pandemic and was implemented within a first-year engineering technology undergraduate course. It aimed to analyze students’ decision-making processes when designing a zero-energy home for a Midwestern city using Aladdin, an integrated CAD/CAE platform that can be used to design a structure and simulate its function within a single system. This study investigates how students informed their decision-making processes in design for energy-efficient homes and the recurring trends in students’ designs related to economic decision making and energy science. The overall results show how cost constraints significantly influenced students’ observation and argumentation processes during their design challenge, highlighting the pivotal role of economic considerations in shaping their decision making. Moreover, the findings underscore the importance of holistic approaches in providing insights into teaching strategies for online learning, particularly in navigating the intersection of scientific and economic factors in design challenges.
... On the other hand, examining a simulation tool in engineering design, focusing on Computer-Aided Design (CAD) and Computer-Aided Engineering (CAE) capabilities, highlights the critical need for research on technology implementation, data collection, and analysis. This emphasis aims to enhance evidence-based decision-making in design and argumentation processes, contributing to improved outcomes in engineering education [7], [8], [1]. ...
Conference Paper
In the context of engineering design of energy-efficient homes, effective decision-making involves integrating energy science and economic considerations. When faced with the complexity of ill-defined problems, engineering students often rely on trial and error rather than leveraging scientific knowledge. This study examines the educational impact of an Argumentation Framework, guiding students to apply scientific knowledge in design decisions critically. The evidence-based practice manuscript introduces a lesson design in engineering education to analyze and improve educational strategies, reflective practices, and instructional materials. This study outlines a lesson design utilizing the Argumentation Framework to support first-year engineering students in overcoming conceptual challenges while developing engineering projects. This approach was implemented in an Engineering Technology undergraduate course at a Midwestern university, whose curriculum covered foundational topics in Energy Science. The task involved designing a zero-energy home using Aladdin software, as an integrated CAD/CAE platform for design and simulation. Students documented their analysis, inferences, and decisions in a design journal with columns for factor, claim, evidence, and reasoning. Hence, this study explored how students integrate science knowledge and economic considerations in decision-making during an engineering project development, part of the lesson design. Engineering students enrich from applying theoretical knowledge in practical design. This study introduces the Argumentation Framework involved in a lesson design approach, for first-year engineering undergraduate students, fostering critical thinking and practical application of theoretical knowledge in practical design. Emphasizing evidence-backed claims enables students to articulate compelling arguments, enhancing effectiveness in real-world applications. Sankey and Radar charts support these claims, facilitating reflection on how science knowledge guides energy-efficient home design and analyzing emerging trends in economic decision-making and energy science within students' designs.
Article
Full-text available
New national science standards have elevated attention to student performance with a core set of science and engineering practices, yet guidance about how to assess these practices is only just emerging in the literature. This is particularly true for the set of engineering design–focused concepts and practices articulated in the Next Generation Science Standards’ (NGSS) Engineering, Technology, and Application of Science (ETS) standards. In this work, we present a model of student cognition for assessing student facility with the engineering design practice of optimization. We operationalize this model of cognition within a set of engineering-focused units for middle school, framed as Virtual Engineering Internships (VEIs). To operationalize the engineering design practice of optimization within our VEIs, we first broke optimization down into two more specific sub-behaviors: exploration and systematicity. We then designed metrics that provide evidence of those behaviors and would be observable given student clickstream data from a digital design tool. We normalized these metrics based on the obtained distributions from a research trial. We discuss the existing correlations between these behaviors and metrics.
Article
Full-text available
Synergistic learning combining computational thinking (CT) and STEM has proven to be an effective method for advancing learning and understanding in a number of STEM domains and simultaneously helping students develop important CT concepts and practices. We adopt a design-based approach to develop, evaluate, and refine our Collaborative, Computational STEM (C2STEM) learning environment. The system adopts a novel paradigm that combines visual model building with a domain-specific modeling language (DSML) to scaffold learning of high school physics using a computational modeling approach. In this paper, we discuss the design principles that guided the development of our open-ended learning environment (OELE) using a learning-by-modeling and evidence-centered approach for curriculum and assessment design. Students learn by building models that describe the motion of objects, and their learning is supported by scaffolded tasks and embedded formative assessments that introduce them to physics and CT concepts. We have also developed preparation for future learning (PFL) assessments to study students’ abilities to generalize and apply CT and science concepts and practices across problem solving tasks and domains. We use mixed quantitative and qualitative analysis methods to analyze student learning during a semester-long study run in a high school physics classroom. We document some of the lessons learned from this study and discuss directions for future work.
Article
Full-text available
This position paper is motivated by recent educational reform efforts that urge the integration of engineering in science education. We argue that it is plausible and beneficial to integrate engineering into formal K-12 science education. We illustrate how current literature, though often implicitly, discusses this integration from a pedagogical, epistemological, or methodological argumentative stance. From a pedagogical perspective, a historically dominant argument emphasizes how engineering helps make abstract science concepts more concrete. The epistemological argument is centered on how engineering is inherently interdisciplinary and hence its integrative role in support of scientific literacy and more broadly STEM literacy is natural. From a methodological perspective, arguments focus on the engineering design process, which is compatible with scientific inquiry and adaptable to answering different types of engineering questions. We call for the necessity of spelling out these arguments and call for common language as science and engineering educators form a research-base on the integration of science and engineering. We specifically provide and discuss specific terminology associated with four different models, each effectively used to integrate engineering into school science. We caution educators against a possible direction towards a convergence approach for a specific type of integrating engineering and science. Diversity in teaching models, more accurately represents the nature of engineering but also allows adaptations based on available school resources. Future synthesis can then examine student learning outcomes associated with different teaching models.
Article
Economic decisions are a crucial part of the engineering design process as designers aim to minimize the cost and maximize the system’s benefits. This study focuses on first-year undergraduate students’ economic decision-making process when they trade off costs and benefits during a design challenge. In addition, we characterized students’ patterns of outcomes derived from economic decisions using the cost-benefit analysis (CBA) method during the design process. Our results suggest that students took different approaches, such as being conservative, moderately conservative, moderate, and aggressive when they tradeoff their design goals. Implications of this study relate to (a) the characterization of different approaches for trading-off design goals and (b) the use of the cost-benefit analysis method as a tool to assess students’ final designs to decide which alternative design is better. In addition, students can use the CBA method to make informed decisions while designing to optimize their design solutions.
Article
This multiple case study focused on the implementation of a computer-aided design (CAD) simulation to help students engage in engineering design to learn science concepts. Our findings describe three case studies that adopted the same learning design and adapted it to three different populations, settings, and classroom contexts: at the middle-school, high-school, and pre-service teaching levels. Although the classroom orchestration of the particular learning design was customised for specific audiences and contexts, findings from this study suggest that the core components of the learning design, such as content, assessment, and pedagogy, and their alignment among them, resulted in students’ learning. Specifically, results from a pre-post science assessment suggest that the three student groups arrived at similar understanding post-intervention levels, along with a significant aggregate growth in their scientific understanding. Regarding design performance, students in different groups demonstrated different levels of success in meeting design constraints. The findings also suggest that students’ success rate in meeting the design constraints directly influenced their final design performance, where middle-school students had better performance than students in the other groups. That is, across the board, students increased their conceptual understanding of heat transfer, Earth, and solar science and were able to produce feasible designs. Implications of the study include how learning experiences with engineering and science simulations should be designed so that teachers can adopt and adapt materials for their specific audiences, contexts, and settings.
Chapter
Computational Thinking (CT) can play a central role in fostering students’ integrated learning of science and engineering. We adopt this framework to design and develop the Water Runoff Challenge (WRC) curriculum for lower middle school students in the USA. This paper presents (1) the WRC curriculum implemented in an integrated computational modeling and engineering design environment and (2) formative and summative assessments used to evaluate learner’s science, engineering, and CT skills as they progress through the curriculum. We derived a series of performance measures associated with student learning from system log data and the assessments. By applying Path Analysis we found significant relations between measures of science, engineering, and CT learning, indicating that they are mutually supportive of learning across these disciplines.
Article
Design thinking is often hidden and implicit, so empirical approach based on experiments and data-driven methods has been the primary way of doing such research. In support of empirical studies, design behavioral data which reflects design thinking becomes crucial, especially with the recent advances in data mining and machine learning techniques. In this paper, a research platform that supports data-driven design thinking studies is introduced based on a computer-aided design (cad) software for solar energy systems, energy3d, developed by the team. We demonstrate several key features of energy3d including a fine-grained design process logger, embedded design experiment and tutorials, and interactive cad interfaces and dashboard. These features make energy3d a capable testbed for a variety of research related to engineering design thinking and design theory, such as search strategies, design decision-making, artificial intelligent (AI) in design, and design cognition. Using a case study on an energy-plus home design challenge, we demonstrate how such a platform enables a complete research cycle of studying designers” sequential decision-making behaviors based on fine-grained design action data and unsupervised clustering methods. The results validate the utility of energy3d as a research platform and testbed in supporting future design thinking studies and provide domain-specific insights into new ways of integrating clustering methods and design process models (e.g., the function–behavior–structure model) for automatically clustering sequential design behaviors.