Conference PaperPDF Available

ENHACING ABDUCTIVE REASONING IN DESIGN AND ENGINEERING EDUCATION VIA PROBABILISTIC KNOWLEDGE; A CASE STUDY IN AI

Authors:
EPDE2021/1211
INTERNATIONAL CONFERENCE ON ENGINEERING AND PRODUCT DESIGN EDUCATION
9-10 SEPTEMBER 2021, VIA DESIGN, VIA UNIVERSITY COLLEGE, HERNING, DENMARK
ENHANCING ABDUCTIVE REASONING IN DESIGN
AND ENGINEERING EDUCATION VIA
PROBABILISTIC KNOWLEDGE; A CASE STUDY IN AI
Fernando GALDON, Ashley HALL and Laura FERRARELO
Royal College of Art
ABSTRACT
As we are moving into a knowledge-based economy, frameworks addressing the translational processes
around value and impact permeate the development of educational curriculums in the design and
engineering educational spectrum. In response to this approach, this paper presents an operational
framework that explores how abductive reasoning, and its embodied probabilistic knowledge can bridge
the gap between the challenges of accelerating technological development and current design and
engineering educational practice. This is to enable students to locate, evaluate and work creatively with
knowledge to generate new and improved solutions that can tackle uncertain and future real-world
challenges, while delivering impact and value for society. In the process, we introduce probabilistic
knowledge as the most adequate model to translate potentialities into impact and value. This
repositioning enables practitioners to move beyond proving reality to a generative space aiming to
transform it. In this context we present abductive reasoning as a fundamental approach to deal with
directional and transformational potentialities to tackle uncertainties.
Keywords: Abductive reasoning, prospective, probabilistic knowledge, innovation research
1 INTRODUCTION
As we are transitioning into a knowledge-based economy, frameworks addressing the
translational processes around value and impact permeate the development of educational curriculums
in the design and engineering educational spectrum. In response to this approach, this paper presents an
operational framework that explores how abductive reasoning, and its embodied probabilistic
knowledge can bridge the gap between the challenges of accelerating technological development and
current design and engineering educational practice.
In the 1970s, John Chris Jones postulated that design was different from the arts, sciences, and
mathematics.
"The main point of difference is that of timing. Both artists and scientists operate on the physical
world as it exists in the present (whether it is real or symbolic), while mathematicians operate
on abstract relationships that are independent of historical time. Designers, on the other hand,
are forever bound to treat as real that which exists only in an imagined future and have to specify
ways in which the foreseen thing can be made to exist." [1]
As stated in the quote, he understood design as a future-led form of prospective thinking activity in the
context of abductive reasoning in which the designer is making decisions without having all the
information. Similarly, Dorst [2] and more recently Cramer-Petersen et al. [3] have concluded that
design combines deductive and abductive reasoning.
This intrinsic prospective approach of design, based on abductive reasoning, planning, solution-based
problem solving, problem shaping, synthesis, preparedness, readiness, and appropriateness in the built
environment, determines a different model of knowing (Fig. 1). In this scenario, the designer is dealing
with wicked problems by accessing areas yet-to-be or not-fully-formed [5]. Consequently, its output is
based on potentialities, not certainties. We trade some degree of accuracy for access to areas that are
yet-to-be or not-fully-formed. Therefore, our output is probabilistic, and research is always preliminary
in its nature. Moreover, in exchange we provide guiding knowledge for prospective technological
developments as Glanville proposed, ’knowledge for’ future action and possibilities rather than
‘knowledge of' past actions and events [4]. Design practise is directional and transformational at its core.
EPDE2021/1211
In this context, we are more concerned with how things "ought to be’"[5:111-167] instead of how things
actually are. These elements position design research as crucial for addressing the impact of the
accelerating technological developments, based on technology complexity, black-box technologies, and
wicked problems.
Figure 1. Prospective design research model. Fernando Galdon, 2019. [6]
2 ABDUCTION
An abduction process builds from an observation that aims for explaining an anomaly that is not possible
to be addressed by an established theory. The abductive approach process moves, from rule to result to
case[7:137]. It differs from deductive processes which move from rule to case to result. Or inductive
logic which moves from case to result to rule. This approach is particularly helpful in the first stages of
the research process, which is concerned with the formulation and selection process of
hypotheses/propositions. In this context, abductive research helps to derive them in a way that can be
tested in a final deductive phase of research. [7]
The fundamental focus of abductive reasoning is to search for a suitable theory to address a
deviant/unexpected observation. This process is acknowledged by Dubois and Gadde [8] as “theory
matching”, or “systematic combining”. In this process a learning loop is established by collecting
simultaneously data and building the theory. It implies an interactive ‘back and forth’ directionality
between theory and observation [7]. This process is similar to action research and can also be found in
case study research. (Fig. 2)
Figure 2. Abductive research framework. Galdon Building from Kovács & Spens (2005). [7]
PRELIMINARY STEP1 STEP2 STEP3 STEP4
PRIORTHEORETICALKNW.
THEORETICALPROCESS
THEORETICALPROCESS
EMPIRICALPROCESS
EMPIRICALPROCESS
THEORYMATCHING THEORYSUGGESTION
DEVIATINGOBSERVATION APPLICATION
0 31 42
MATCHING+ COMBINING FINALCONCLUSIONS:H/P
ANOMALY OFCONCLUSIONS
ANDEVALUATION
EPDE2021/1211
3 PROBABILISTIC KNOWLEDGE
However, this future-led proposition presents a problem for the ontology of knowledge as currently
configured. Current established practices are limited by the present, and the designer is the witness,
either through measurement or observation. In this area, if we analyse what happens in economic
research, we may find a suitable framework to solve this conundrum.
Economic forecasting is the process of making predictions about the economy. Economists use a
statistical analysis of historical data to determine a forecast. Formal forecasts are produced yearly.
However, quarterly updates or corrections are implemented to fine-tune the projection. The fundamental
function of the economist is to anticipate future risks (i.e., events or conditions that can cause the result
to vary from their initial estimates). These forecasts are continuously updated as the conditions of the
environment evolve. These evolutions determine whether the adjustments will get tighter or looser, and
how interest rates will vary, affecting a wide range of factors from loan repayments to employment
levels.
This type of knowledge can be characterised as probabilistic knowledge of the future. Based on these
economic forecasts, international institutions and governments infer value propositions. From this
perspective, economic research enables design to access the future by legitimising probabilistic
knowledge as a valid type of knowledge. This element provides a bridge to reconcile the probabilistic
and abductive nature of design with established frameworks of practise that have so far been understood
as factual [8]. This type of knowledge may facilitate how design and engineering students may address
future challenges without fully knowing what they are.
The fundamental difference between economics and policy-making and design research is the
directionality of the action. In design research we use this preliminary knowledge to co-shape the future.
Design allows us to be proactive and move towards more imminent future transformations. The role of
the designer is this process is to direct technological developments and reduce future risks to improve
people’s lives. (e.g., AI)
4 DISCUSSION
We tested this process through a case study investigating the changing and impactful nature of AI from
a Machine Learning (ML), Deep Learning (DL), and Reinforcement Learning (RL) developments
perspective via a Quasi-Experimental Non-equivalent Control Group Post-Test-Only Design. This
experiment was conducted with postgraduate students from the RCA. Their diversity in terms of
background, programme of study, culture and nationality, and their diverse, critical, and enabling
capabilities, plus the unifying element of being designers, provided an ideal group of participants to
develop the task at hand. Then, we implemented a cross-disciplinary and progressive evaluation process
via peer-review academic conferences to infer transversality and robustness.
The process of abductive reasoning started when an observation in the early stages of the process did
not match existing theories [9]. In the case study we conducted, this process started when we realised
that the nature of AI was changing due to ML/DL/RL new development and implementations, therefore
we needed a new theory to design its main elements uncertainty and trust. Then, a creative iterative
process of “theory matching” or “systematic combining” started in an attempt to find a new matching
framework. The aim of this process was to understand the new phenomenon to suggest a new theory in
the form of new hypotheses or propositions. This process led to figuring out a range of methods to
address the nature of these emerging systems. This process constructed a theory of Prospective Design
(PrD), which then was applied via a case study on Virtual Assistants (VA). The development and
implementation process consisted of a combination of archival research, surveys, co-design activities,
and workshops. These processes inserted consequential analyses to enable ethical directionalities in its
development. (See [6] for detailed results)
In order to evaluate the output, we implemented an adaptation of the Quasi-Experimental multiple group
post-test-only design, also known as Non-equivalent Control Group Post-Test-Only Design. In this type
of design, the control group is non-equivalent, meaning that “participants are not assigned to either the
experimental or the control group in a random manner” [10]. The pre-test was unnecessary to establish
equivalence between groups, as all participants were design students from the same department and
institution, and the workshops were both about the future technological development of VAs. In this
context, the first workshop introduced a simplified version of the methodology (fig. 3), (control group)
whereas the second workshop introduced an expanded version of model (Fig. 4).
EPDE2021/1211
Figure 3. Consequential analysis toolkit. [6]
The workshops aimed to understand whether prospective insights could be transformed into applied
ethical interventions and grounded in the real world by applying a systematic analysis between the
insight and the design activity to design trusted systems (Fig. 4). The simplified model generated
reactive responses, whereas the full model created proactive responses.
In the second workshop, participants were asked to conduct the consequences quadrant used in
Workshop 1, then each group mapped the anticipated desired and undesired, and by confronting both
groups, the unanticipated emerged for each group (See [6] for detailed results and qualitative analysis).
This element presented participants with their own limitations and enhanced self-criticality. They then
mapped the prospective outcomes in terms of the impact on contexts and the impact of actions. This
analytical step allowed them to understand the impact of contexts and actions on users. Finally,
participants were asked to complete a design activity consisting of developing preventive strategies for
the potentially harmful and power-asymmetric interactions they had mapped. They were requested to
use counter-fictional principles to transform the dystopic into real-world strategies that could be applied.
The results were successful, and presented strategies aiming to ground prospective insights in potential
real-case interventions that aimed to reverse asymmetries to build trust. The author(s) initial research
method focussed on qualitative research [6], however this research explores additional possibilities
identified through a quantitative approach in order to frame future directions.
4.1 Future directions
As design and engineering education is transitioning from practise (output) to research (impact)
questions of evaluation in the context of abductive reasoning emerged. How could we evaluate
innovation when implementing abducting reasoning in the context of impact? In this context we present
a potential framework to address this emerging reality based on work conducted as part of a PhD
implementing abductivity and probabilism. In order to address the abductive process and its emerging
theory and practice, a cross-disciplinary and progressive evaluation process was implemented via peer-
review academic conferences (Fig. 5).
EPDE2021/1211
Figure 5. This table represents the progressive and cross-disciplinary publishing strategy
implemented to generate robustness in the enquiry
The cross-disciplinary publishing strategy aimed to integrate diversity, transversality, impact, relevance,
and responsibility in the process. As a result, we published ten papers in five different fields, ranging
from Industry 4.0, human factors and design research to design futures, or applied engineering. This
approach to practice aimed to support the design interventions and theoretical framework and enhance
the impact of the research in terms of outputs and scrutiny by diverse audiences to maximise its
transversality and therefore, its robustness. This model aims to facilitate a potential transition to impact-
led practise, as well as affect and inspire educational models in design and engineering in breaking its
silos and inserting more transdisciplinary in the development of their processes, curriculums, cohort
formation, and/or faculty.
5 CONCLUSIONS
In this paper we introduced abductive reasoning and probabilistic knowledge as means to address
notions of prospectivity and innovation via a case study on AI.
In the insights presented, the students implementing the full methodology understood, deployed, and
tested both abductive thinking and the concept of prospective design and gained a process to deal with
uncertainty and the ethical impact of technological developments. Consequently, we suggest the need
to include prospective ethical frameworks in design to involve students in ethical issues: to go beyond
what already exists, as well as beyond the positive impact of technology and design strategies to address
and/or mitigate unintended consequences, as they are fundamental for the optimum development of
society; to propose that things can be otherwise. In this context, probabilistic knowledge provides a
bridge to reconcile the future-led and abductive nature of design. In the process, this work challenges
and develops current notions in design education based on technological progress to a model based on
ethical responsibility, which places equal value on the process of design and the impact of the system
on society. In this context, abductive thinking becomes the primary design mindset in driving the
transition from current to potential states, leading to the mediation of anticipated and non-anticipated
consequences. Finally, the implementation of a Quasi-Experimental evaluation test inserted flexibility
into the process, however, it also inserted preliminary. This element was addressed with a cross-
disciplinary and progressive evaluation process via peer-reviewed academic conferences.
This work has been implemented in the context of sessions. Future work will be dedicated to adapting
this framework to modular structures as a testbed to articulate a full academic curriculum.
REFERENCES
[1] Jones J. C. (1992). Design methods. New York: Van Nostrand Reinhold.
[2] Dorst K. (2010). The nature of design thinking. In: DTRS8 Interpreting Design Thinking: Design
Thinking Research Symposium Proceedings, 2010, pp. 131 139.
EPDE2021/1211
[3] Cramer-Petersen C. L., Christensen B. T., and Ahmed-Kristensen S. (2019). Empirically
analysing design reasoning patterns: abductive-deductive reasoning patterns dominate design
idea generation. Design Studies, 60, 39-70. DOI: 10.1016/j.destud.2018.10.001.
[4] Glanville R. (2005). Design propositions. In: M. Belderbos and J. Verbeke, eds. The unthinkable
doctorate: Brussels: Sint Lucas.
[5] Simon H. (1996). The sciences of the artificial. Cambridge, MA: MIT Press.
[6] Galdon F., Hall A., and Wang S. J. (2019). Prospective design: A future-led mixed-methodology
to mitigate unintended consequences. In: Proceedings of the IASDR2019, The University of
Manchester, UK.
[7] Kovács G. and Spens K. M. (2005), "Abductive reasoning in logistics research", International
Journal of Physical Distribution & Logistics Management, Vol. 35 No. 2, pp. 132-144.
[8] Galdon F. and Hall A. (2019). The ontological nature of design; prospecting new futures through
probabilistic knowledge. Design Research for Change Symposium. Design Museum, London.
[9] Dubois A. and Gadde L.-E. (2002), “Systematic combining: an abductive approach to case
research”, Journal of Business Research, Vol. 55, pp. 553-60.
[10] Jackson S. L. (2009). Research methods and statistics’: a critical thinking approach. Third
edition. Wadsworth: Cengage Learning.
... Chen et al. (2020) [32] Sheds light on the transformative influence of AI in engineering design education, enabling the realization of previously unattainable solutions and concepts. Galdon et al. (2021) [33] Presents an operational framework that harnesses abductive reasoning and probabilistic knowledge to enrich design and engineering education. The study showcases the framework's potential in fostering creative engagement with knowledge and generating impactful solutions, emphasizing the necessity of reframing probabilistic knowledge and embracing transformative approaches to address real-world uncertainties and challenges. ...
... Chen et al. (2020) [32] Sheds light on the transformative influence of AI in engineering design education, enabling the realization of previously unattainable solutions and concepts. Galdon et al. (2021) [33] Presents an operational framework that harnesses abductive reasoning and probabilistic knowledge to enrich design and engineering education. The study showcases the framework's potential in fostering creative engagement with knowledge and generating impactful solutions, emphasizing the necessity of reframing probabilistic knowledge and embracing transformative approaches to address real-world uncertainties and challenges. ...
Article
Full-text available
In the ever-evolving era of technological advancements, generative artificial intelligence (GAI) emerges as a transformative force, revolutionizing education. This review paper, guided by the PRISMA framework, presents a comprehensive analysis of GAI in education, synthesizing key insights from a selection of 207 research papers to identify research gaps and future directions in the field. This study begins with a content analysis that explores GAI’s transformative impact in specific educational domains, including medical education and engineering education. The versatile applications of GAI encompass assessment, personalized learning support, and intelligent tutoring systems. Ethical considerations, interdisciplinary collaboration, and responsible technology use are highlighted, emphasizing the need for transparent GAI models and addressing biases. Subsequently, a bibliometric analysis of GAI in education is conducted, examining prominent AI tools, research focus, geographic distribution, and interdisciplinary collaboration. ChatGPT emerges as a dominant GAI tool, and the analysis reveals significant and exponential growth in GAI research in 2023. Moreover, this paper identifies promising future research directions, such as GAI-enhanced curriculum design and longitudinal studies tracking its long-term impact on learning outcomes. These findings provide a comprehensive understanding of GAI’s potential in reshaping education and offer valuable insights to researchers, educators, and policymakers interested in the intersection of GAI and education.
... In this context, we are transitioning towards a consequential model of design in which, the nature, intentionality and implications of the system of interaction demands a different kind of design and time intervention. In this scenario, design research and practise must address complex systems and unintended consequences via prospectivity and emancipation, while dealing with uncertainty, and not-fully-knowing : Galdon, F., Hall, A. & Wang, S. J. (2019: Galdon, F., Hall, A, Ferrarello, L. (2021): ). Furthermore, we need to acknowledge, and remediate, the catastrophic implications of the human-centred approach and hegemonic the world-for-us position in the state of the environment. ...
Chapter
In Metamodernism: The Future of Theory, Jason Ānanda Josephson Storm (2021) structures a new timeframe to understand better the 20th century; the pre-modern, the modern, and the post-modern, which gives way to the metamodern. Metamodernism is a way of viewing the world that emphasises a kind of integrated pluralism. Given the latest development in design during the late 19th century and 20th century, this framework may assist to understand the evolution of its practice. Following this framework, the evolution of design practice may be structured in four fundamental periods; pre-modern embodied by the craftsman, modern embodied by the industrial designer (Papanek's “Like It Is”), post-modern embodied by the innovator (Papanek's “How It Could Be”; Papanek, 1972) and an emerging metamodern paradigm embodied by what I will describe in this chapter as the Polygenetic designer (Figure 5.1). In what follows, I will review the evolution of design practice from a historical perspective to understand the current intersection between design and biology. This position will lead a case for the Polygenetic designer and a potential operational framework.
... In this context, we are transitioning towards a consequential model of design in which, the nature, intentionality and implications of the system of interaction demands a different kind of design and time intervention. In this scenario, design research and practise must address complex systems and unintended consequences via prospectivity and emancipation, while dealing with uncertainty, and not-fully-knowing : Galdon, F., Hall, A. & Wang, S. J. (2019: Galdon, F., Hall, A, Ferrarello, L. (2021): ). Furthermore, we need to acknowledge, and remediate, the catastrophic implications of the human-centred approach and hegemonic the world-for-us position in the state of the environment. ...
Chapter
Full-text available
Chapter
Assessment practices in education are undergoing a significant transformation with the integration of artificial intelligence (AI) technologies. This chapter explores the evolving role of AI in revolutionizing assessment methods across educational contexts. By automating various aspects of assessment, AI offers educators and learners unprecedented opportunities for efficiency, personalization, and scalability. AI-powered assessment tools enable the automation of grading, providing educators with more time to focus on providing personalized feedback and guiding student learning. Additionally, AI can analyze vast amounts of data to identify patterns in student performance, allowing for targeted interventions and adaptive learning experiences tailored to individual needs. Furthermore, AI facilitates the development of innovative assessment formats, such as simulations and interactive scenarios, which can better assess higher-order thinking skills and real-world application of knowledge.
Article
Full-text available
Vernacular architecture represents the traditional architecture that developed over time within a particular culture or region that embodied indigenous knowledge. These buildings provide an invaluable cultural heritage, and learning from them is an important way to preserve indigenous culture. However, the negative view commonly held about indigenous knowledge in architectural theory and historical research that developed during the colonial era has not begun to change; the indigenous knowledge embedded in vernacular architecture has been ignored. This article discusses a proposed framework in which we can learn from vernacular architecture to preserve indigenous culture, including studying traditional building techniques, incorporating traditional materials and designs, adapting traditional designs to contemporary needs, involving local communities, and encouraging sustainable building practices. This proposed framework is applied to learning from Native Hawaiian architecture as a way to demonstrate its practicality and necessity. By studying the designs, materials, and techniques used in vernacular buildings, we can gain a deeper understanding of the cultural, environmental, and social contexts in which they were created.
Conference Paper
Full-text available
As design thinking evolves we are beginning to develop a clearer idea of its relationship to other domains of thinking and in particular its specific ontological nature. Here we consider design’s special relationship to the future and how concepts of anticipation, probabilism and prospectivity underpin a new understanding of design’s relationship to cross-domain collaboration potential. In effect we discuss how design cares for the future of transformation in an era where rapidly advancing technologies via exponential technological developments are challenging human-machine interactions. Probabilistic knowledge emerges as an ontological reality for addressing the intrinsically abductive nature of future design research. Ultimately this approach implies a different form of knowing and aims to position design research as the discipline better prepared for addressing the future.
Conference Paper
Full-text available
In this paper, the authors propose prospective design as a future-led mixed-methodology to address unintended consequences. It combines systems analysis with extrapolations and constructivist perspectives to reconcile confronted models of design future(s). In the results presented, the authors suggest a need to include ethical frameworks in design to involve students in ethical issues to address the main task of design in the digital and exponential technological age within which we are living including; preparedness, readiness, and appropriateness.
Article
Reasoning is a fundamental process in design activity, and it provides a way to understand design behaviour. Theories and models of design propose reasoning that follows abductive-deductive patterns. At the micro-level, these patterns are untested. This study analyses verbal reasoning patterns at the micro-level for group idea generation using protocol analyses of concurrent verbalisations from five design teams with industry participants. The results show that reasoning in design activity across 218 ideas follows general patterns of abductive-deductive reasoning. At the individual idea level, the reasoning patterns are disorderly and enter into micro-patterns of inference. The study concludes that understanding reasoning at early-stage idea generation processes is indicative of the mental models and abductive-deductive reasoning that are prevalent in design activity.
Article
Purpose To construct a framework for exploring and discussing the use of different research approaches – deductive, inductive and abductive – in logistics. Design/methodology/approach A review of research articles in three major logistics journals ( International Journal of Logistics Management , International Journal of Physical Distribution & Logistics Management and Journal of Business Logistics ) from 1998 to 2002. Findings Recognizes the dominance of deductive research in logistics, and the need for more inductive and, in particular, abductive research for theory development. Discusses the use of the abductive research approach in logistics. Research limitations/implications Keywords searches led to a small sample size; more thorough content analysis is needed to apply the findings from the constructed framework. Practical implications Useful source of information on the three different research approaches, their possibilities and implications for research. Originality/value The abductive research approach has not yet been discussed in logistics.
Article
Case studies are frequently used in industrial network research. In this article, we discuss the difficulties and opportunities characterizing the case study approach. In particular, we deal with single case research aiming at theory development. For this purpose, we suggest an approach based on ‘systematic combining’ grounded in an ‘abductive’ logic.
Article
Continuing his exploration of the organization of complexity and the science of design, this new edition of Herbert Simon's classic work on artificial intelligence adds a chapter that sorts out the current themes and tools -- chaos, adaptive systems, genetic algorithms -- for analyzing complexity and complex systems. There are updates throughout the book as well. These take into account important advances in cognitive psychology and the science of design while confirming and extending the book's basic thesis: that a physical symbol system has the necessary and sufficient means for intelligent action. The chapter "Economic Reality" has also been revised to reflect a change in emphasis in Simon's thinking about the respective roles of organizations and markets in economic systems.
The nature of design thinking
  • K Dorst
Dorst K. (2010). The nature of design thinking. In: DTRS8 Interpreting Design Thinking: Design Thinking Research Symposium Proceedings, 2010, pp. 131 -139.
Research methods and statistics': a critical thinking approach
  • S L Jackson
Jackson S. L. (2009). Research methods and statistics': a critical thinking approach. Third edition. Wadsworth: Cengage Learning.