Conference PaperPDF Available
363
Proceedings of CAD’19, Singapore, June 24-26, 2019, 363-366
© 2019 CAD Solutions, LLC, http://www.cadconferences.com
Title:
Application of VR and AR Tools for Technical Drawing Education
Authors:
Omar Huerta, o.huertacardoso@hud.ac.uk, University of Huddersfield, UK
Ertu Unver, e.unver@hud.ac.uk, University of Huddersfield, UK
Ridvan Aslan, ridvan@uludag.edu.tr, Uludag University, Turkey
Abdil Kus, abdilkus@uludag.edu.tr, Uludag University, Turkey
Dimo Chotrov, dchotrov@tu-sofia.bg, Sofia Technical University, Bulgaria
Keywords:
Virtual Reality, Augmented Reality, Technical Drawings, Teaching and Learning.
DOI: 10.14733/cadconfP.2019.363-366
Introduction:
There are concerns from Higher Education (HE) institutions and industry about the decline in
standards of Technical Drawings (TD) due to the lack of understanding of basic principles and
conventions that underpin the best practices. There is growing evidence that simulations/animations
along with augmented and virtual reality (AR/VR) technologies can improve learners’ engagement,
competence, and skills; especially when compared to traditional didactic methods. The purpose of this
work is to develop and examine the overall effect as well as the impact of virtual and augmented
reality -based methods and tools on the teaching and learning experience of technical drawing
principles in the context of higher education settings. The development of tools and methods is based
on the findings of a previous international study in three different categories covering the perception
of TD education, assessing of TD knowledge and ability, and expectations of TD education.
TD has a been always an essential component in the formation of new product designers and
engineers. They play an important role in communicating the technical product specifications (TPS)
(i.e. material, size, shape, tolerances, etc.) for manufacturing during the new product development
process. The decline in standards due to the lack of understanding of basic principles and the
conventions of drafting skills that underpin these practices represent a challenge for HE institutions
and the traditional teaching strategies. Despite engineering and product design students are known to
prefer visual, sensing, inductive, and active learning styles; most engineering education and in
particular the teaching of technical drawing skills has relied on auditory, abstract, deductive, passive,
and sequential teaching styles [1].
The introduction and broadening of 3D tools as a key teaching component in the design process
has significantly change the teaching of TD related subjects as a result. However, HE institutions are
still left with the challenge of developing new T&L tools and methods to make sure students acquire
the knowledge and skills on TD required to meet the demands of both academia and industry [3-4].
AR/VR technologies have already found potential applications in areas of education where
students are facing some learning challenges. These applications have incorporated for example
desktop-based virtual reality technologies to stimulate learning, to teach abstract concepts, to teach
scientific inquiry and engineering subjects [2]. AR/VR offers to HE institutions an efficient way to
present complex and difficult theories/concepts to design and engineering students. Students can
comprehend complex theories and concepts with the contextually enriched interaction offered by AR
technology. For example, animations have shown to provide more enthusiasm for the learning activity,
364
Proceedings of CAD’19, Singapore, June 24-26, 2019, 363-366
© 2019 CAD Solutions, LLC, http://www.cadconferences.com
better performance in understanding the appearances and features of objects and improve the spatial
visualization capabilities [5].
In this paper, the authors present development of 3D interactive AR/VR teaching system from a
design-based method to help engineering and product design students improve on critical and
complex topics related to TD skills according to an international survey and as part of a broader
European funded research project. This work shows that human-centered approaches can improve the
understanding of students needs and facilitate the development of AR/VR technology applications for
T&L within an international and multidisciplinary team.
Development of AR/VR Tools and Animations:
This paper addresses the use of low-cost mobile based AR/VR tools developed with the support of
animation and simulation tools alongside text-based teaching methods. Having several approaches to
teaching would give students a variety of options when learning technical contents. Individual
students may require different support as the concentration and abilities of the students may change
due to personal circumstances, environment, age, among other factors. In the initial stage of this
study, a comprehensive research to identify the area of TDs that require support from AR/VR
technologies in order to overcome T&L issues is carried out. 320 people from UK, Bulgaria and Turkey,
with different educational background (engineering/design, student, instructor/lecturer,
manufacturing sector employee, vocational college/ high school / university student, and
teacher/trainer), participated in a survey. This is used to identify their TD perception, knowledge and
skill levels and expectation of TD education. The research show that current teaching methods can be
further supported by AR/VR and animation technologies to improve engagement and T&L of relatively
complex subject. The program identified six aspects of technical drawings which were separated into
modules to improve the learning experience. From the analysis, the following module areas were
selected for developing AR/VR content and animations:
Dimensioning and Tolerances
Sectioning, Projections and Perspective Drawings
Dimensional Tolerances, Edge Tolerances, Shaft and Hole Tolerances
Geometric Tolerance/Form-Position Tolerances
Surface Treatment Markings/Surface Roughness
Production and Assembly Drawings
The team decided to use a Formula Student Race Car as the centerpiece of the project (Figure 1).
This car is developed by the engineering students at the Technical University of Sofia which has been
designed (i.e. CAD) and physically manufactured. This car model gave a wide range of different
components to be used within AR/VR and animation. Context/environment for each part was assigned
in AR/VR and animations to help the student understand the component and to give a more real-world
experience.
Several software packages were used to achieve the required output including the Adobe suite
(Photoshop, Illustrator, and InDesign) to create the storyboards, and graphics. For 3D content
generation, SolidWorks was used to model the car, which was then imported into 3D Studio Max to
start the animation process. The model was converted to polygonal data (low for AR/VR and high for
animation). Appropriate textures were then applied to the model, and various animation methods were
utilized to create the content, including camera and object movement.
Unity was used to create interactive AR/VR applications with ARCore for building the AR
experience. In this phase, multi-disciplinary knowledge and skills help to effectively create the content
that would be visually rich to be used by students and industry to engage in the modules. Interactivity
is key when creating an engaging experience. Not only should the user be able to look around the
environment, but they should also be able to interact with components and complete objectives. A
multi-disciplinary approach allows the effective and appropriate use of individual skills within
software, programming and design.
365
Proceedings of CAD’19, Singapore, June 24-26, 2019, 363-366
© 2019 CAD Solutions, LLC, http://www.cadconferences.com
Fig. 1: 3D Modelling of Formula Student Race Car and TD for stearin wheel assembly.
The development of AR/VR and animation requires hardware considerations before the development
phase. The requirements for the student/teacher for this project would be:
VR headset
Competency of modelling SolidWorks or equivalent
Design for manufacture experience, experience in TD details
Some experience using AR and VR
Mobile Phone (Android 7.0+)
Powerful computer
AR/VR Technical Drawing Case Study:
Several AR applications have been developed for improving student understanding of tolerances.
Tolerancing is defined as an extension of dimensioning of TDs. It specifies a range of accuracy for the
shape, size, and position of components so that when they are manufactured all parts can fit and
function properly when assembled. Currently, tolerances covering form (straightness, flatness,
circularity and cylindricity), orientation (angularity, perpendicularity and parallelism), location
(position and concentricity) and runout (symmetry, circular runout and total runout) have been
completed. Figure 2 shows cylindricity tolerances in AR with surface parameters. Also shown is an AR
game where the car can be driven using the onscreen controls on a floor defined in AR environment on
Android.
Fig. 2: Mobile AR Applications and sample AR training simulation.
VR development includes the creation of 3d content and the programming of interaction. Depending
on the desired level of both realism and interactivity, either high-level programming languages may be
366
Proceedings of CAD’19, Singapore, June 24-26, 2019, 363-366
© 2019 CAD Solutions, LLC, http://www.cadconferences.com
used; but these required extensive knowledge of programming or game engines such as Unity, Unreal
or similar.
The vehicle has been rendered with panoramic and stereoscopic cameras to be viewed in a
Samsung Gear VR. This VR device enables a decent field of view and good head tracking due to the
sensors. The controller can be used to navigate and interact with the scene. The disadvantage of this
device is that it only works with the latest Samsung phones and has a relatively low level of immersion
which would be good enough for this type of T&L activity.
Discussion and Conclusions:
The use of AR/VR in education is promising and useful in T&L. A multi-disciplinary approach is
crucial. This approach brings a different perspective to T&L methods and content development which
results in a better experience for students. Individuals from different backgrounds (engineering and
design) can offer their expertise in the content development and application of software. Running
international projects require the use of methods and tools to facilitate the communication of content.
The process of creating the AR/VR content is time-consuming if not developed using effective
design and visualisation methods. Students are more accustomed to using 3D games with a high level
of visual detail where a substantial amount of investment may have been available for commercial
projects. Therefore, a careful consideration of end-user requirements and expectations is needed to
engage students. Interactivity is essential when creating AR/VR content. While animations may not
have any interactivity, it would provide a visually pleasing platform to communicate the information.
However, large file sizes may limit its use as it would require high internet speeds to download the
animation content which could be hosted on a website, however, many educational institutions have
fast and free internet available.
Development of AR/VR traditionally requires low-polygon modelling techniques but on
multidisciplinary projects, teams normally use their daily-use software to generate 3D content which
may limit the level of interactivity as optimisation between software would reduce performance and
increase file size of any developed media. Several headsets and mobile phones (Android 7.0+) would
also be required to give each student the experience. For this reason, several platforms have been
developed to ensure that all students would have an experience with each T&L method. Projecting the
view of the VR user onto a screen may also be a solution to this problem.
Positive feedback was received from the initial pilot study where selected students used the
developed AR/VR and animation content. Further work includes the development of an AR/VR
application to other operating systems to reach a wider market. Students would be able to choose a
method tailored to their needs. These didactic resources should be easy to use and must be developed
with a good level of educational usefulness
References:
[1] Felder, R. M.; Silverman, L. K.: Learning and teaching styles in engineering education, Engineering
education, 78(7), 1988, 674-681.
[2] Merchant, Z.: The Impact of Virtual Reality-based Learning Environment Design Features on
Students' Academic Achievements (Doctoral dissertation), 2012.
[3] Meyers, F. D.: First year engineering graphics curricula in major engineering colleges, Engineering
Design Graphics Journal, 64(2), 2009, 23-28.
[4] Unver, E.: Strategies for the transition to CAD based 3D design education, Computer-Aided
Design and Applications, 3(1-4), 2006, 323-330. https://doi.org/10.1080/16864360.2006.10738470
[5] Wu, C. F.; Chiang, M. C.: Effectiveness of applying 2D static depictions and 3D animations to
orthographic views learning in graphical course, Computers & Education, 63, 2013, 28-42.
https://doi.org/10.1016/j.compedu.2012.11.012
... While some teaching approaches may work, some may not, and this sometimes depends on the learners' preference. For instance, it has been noted that learners are known to prefer visual, sensing, inductive, and active learning styles -most engineering education, and in particular, the teaching of technical drawing skills, has relied on auditory, ABSTRACT, deductive, passive, and sequential teaching styles (Cardoso, Unver, Aslan, Kus, & Chotrov, 2019;Felder & Silverman, 1988). investigated current perspectives on innovative methods used in teaching technical drawing. ...
... Evidence that AR can improve learners' engagement, competence, and skills; especially when compared to traditional didactic methods is provided in Cardoso, Unver, Aslan, Kus, & Chotrov (2019). The learning of technical subjects like Technology becomes easy for learners because even at a lower level of interaction with the environment, learners from nontechnical schools are significantly aided to understand the projected views on technical drawing. ...
Chapter
The Fourth Industrial Revolution has impacted the educational sector, thus providing an array of digital technologies, which have become effective, efficient, and innovative media for transmitting knowledge and skills in contemporary times. The purpose of this study was to explore the experience of technology teachers on the use of augmented reality when teaching graphic communication and graphic techniques. This study used a qualitative research approach using semi-structured and observation as data sources. It purposively sampled five teachers who were interested in the use of augmented reality to teach, as such, TPACK was used as its framework. The findings revealed that technology teachers, to a great extent, cannot integrate augmented reality tools during the teaching and learning of graphical communication and graphic techniques. This chapter recommends that the Department of Education should create more opportunities that will expose teachers to these technological advances that are substantive to graphical communication and graphic techniques of learning.
... However, we still see occasional use in everyday life, except for entertainment applications, such as social media and television. Even if MR is now one of the emerging topics [1,2] and both pilot studies [3,4] and prototypes [5,6] were also proposed in the educational field, there are still few real applications in schools and universities. One of the reasons is teachers' resistance to introducing new practices in their consolidated processes, as pointed out in [7,8]. ...
... This technology allows the association between a virtual 3D representation of laboratory equipment and its 2D real representation on a printed drawing, usually in the form of the augmented book, as experienced in [6,15]. Drawings can also be enriched with every additional information (text, videos, pictures) useful for self-learning, as made by [5,23]. This information can also include results of numeric simulations, such as finite element analyses as made by [24,25]. ...
Article
Full-text available
In this work, we propose a Mixed Reality (MR) application to support laboratory lectures in STEM distance education. It was designed following a methodology extendable to diverse STEM laboratory lectures. We formulated this methodology considering the main issues found in the literature that limit MR’s use in education. Thus, the main design features of the resulting MR application are students’ and teachers’ involvement, use of not distracting graphics, integration of traditional didactic material, and easy scalability to new learning activities. In this work, we present how we applied the design methodology and used the framework for the case study of an engineering course to support students in understanding drawings of complex machines without being physically in the laboratory. We finally evaluated the usability and cognitive load of the implemented MR application through two user studies, involving, respectively, 48 and 36 students. The results reveal that the usability of our application is “excellent” (mean SUS score 84.7), and it is not influenced by familiarity with Mixed Reality and distance education tools. Furthermore, the cognitive load is medium (mean NASA TLX score below 29) for all four learning tasks that students can accomplish through the MR application.
... In the olden days, Augmented Reality and Virtual Reality technologies were used in playing games on the computer, but now a day's, it used in various institutions, universities and colleges (Cardoso et al., 2019). VR trains and teaches athletes new skills, and other technical skills can also be learned through this technology, like: "driving a car and different cutting styles of fish and meat. ...
Chapter
Full-text available
In higher education, computers have been utilized for many years. In the last few years, education has become digitalized, where faculty/lab technicians use advanced technology to teach students and provide deep knowledge. In higher education, new pedagogy techniques were brought into the possibility of effectively conducting online/offline classes. In this chapter, the authors have analyzed the impact of digitalization in higher education and intelligent learning techniques. The authors will discuss how new digitalization techniques and development anticipate student performance. Advanced machine learning and deep learning techniques could extract and provide more knowledge to the students. Virtual simulation is becoming increasingly popular in the education and training sector. It involves using software programs and virtual environments to create simulated experiences which allow learners to practice and learn new skills in a safe and controlled environment.
... n beinhaltet und somit einen multimedialen Zugang zu geometrischen Toleranzen ermöglicht, wurde von Humienny und Berta (2013) entwickelt. Ein weiterer Lernansatz, der Augmented und Virtual Reality (AR/VR) mit Animationen bzw. Simulationen kombiniert, um Verständnis im Bereich GPS zu schaffen, ist das Ergebnis eines europäischen Förderprojekts (vgl.Huerta et al. 2019).Garland et al. (2017) präsentieren ein für die Hochschulbildung entwickeltes, mehrwöchiges Programm, in dem auf Grundlage einer 3D-gedruckten Baugruppe funktionsorientiert GPS-Inhalte vermittelt werden.Nicht nur in der Hochschulbildung, sondern auch in der Berufsausbildung und in der Weiterbildung können Inhalte im Themenbereich GPS ver ...
... Higher Education (HE) institutions and industry are concerned about the reduction in Technical Drawings (T.D.) standards as a result of a lack of awareness of essential principles and norms that underpin best practices (Huerta Cardoso, Unver, Aslan, Kus and Chotrov, 2019). Compared to traditional didactic techniques, there is rising evidence that simulations, animations, augmented and virtual reality (AR/VR) technology can improve learners ' engagement, competence, and skills (Huerta Cardoso, Unver, Aslan, Kus and Chotrov, 2019). ...
Article
Full-text available
This study investigated the effect of using the technical visual arts lessons’ material on visualization skills and attitudes. For this purpose, an augmented reality application called BTRS was designed. The application was created using Unity3D, 3Ds Max, and Vuforia programs. The study was conducted for eight weeks, with a total of 33 students (26 boys and seven girls) attending a vocational and technical high school. The study was designed based on Creswell’s sequential explanatory design. While a semi-experimental method with a pretest-posttest control group was conducted for the quantitative part of the study, semi-structured interviews were used for the qualitative component. “Lappan Spatial Visualization Skill Scale," “Purdue Spatial Skill Scale," “AR Attitude Scale,” and semi-structured interview form were used at the beginning and the end of the application. The Mann-Whitney U, paired-samples t-test, and the Wilcoxon signed-rank test were used for quantitative data. Qualitative data were analyzed by the descriptive analysis method. The study results indicated that the Augmented Reality Application did not significantly affect the achievement of the students and their spatial visualization skills. However, it has been observed that students’ excitement and curiosity increased. The students reported that the material was enjoyable, fun, attractive, remarkable, helpful, easy to use, understandable, and persistent. Rotating, zooming, and moving interactive digital models and buttons in the real world have attracted the students. The experimental group described abstract concepts and required spatial thinking skills to be more explicit and more practical.
Conference Paper
Virtual Reality (VR) research has shown promising benefits in several educational areas, particularly those necessitating interaction with spatial information - a key element in teaching engineering skills such as technical drawing. This paper presents a broad process for designing and developing VR-based instructional activities, ultimately producing a VR application that employs immersive visualization and interaction. An evaluation of the application’s effectiveness revealed that engineering students using the VR application performed comparably to those using conventional methods, such as analog drawing, on course exercises. The study also explored cognitive load, comparing the VR group with a control group and a glass box animation group. While the glass box group showed an advantage over the VR group in cognitive load, no significant difference in aggregate scores between the VR and control groups was found. This is notable, given the increased interaction required by the VR exercise. These results provide initial evidence that traditional learning activities can be effectively translated into an immersive VR context and strengthen the case for VR as a viable medium for remote learning. However, it also points to the need for further research which improves the VR exercise and identifies the factors contributing to the management of cognitive load.
Chapter
Virtual Reality (VR) technology has the potential to revolutionize engineering education by providing students with real-world simulation scenarios. This paper presents a user study to measure the effectiveness of VR applications in teaching technical representation and machine elements to first-year mechanical, energy, and aerospace engineering students. The VR application was designed to immerse the students in a virtual mechanical workshop where they could interact with a 3D model of a gearbox and access task instructions and technical drawings through an interactive whiteboard. A total of 448 students voluntarily participated in the one-hour lecture and were divided into groups of two to use the available 15 headsets. The study was assessed by analyzing the log files and their answers to a satisfaction and usability questionnaire. The results indicated that the VR application was an effective supplement to traditional instruction, as the students reported that it helped them better understand technical representation concepts and made the learning experience more enjoyable.
Article
Метою даної статті є аналіз інноваційних методів та мультимедійної форми навчання у викладанні пластичної анатомії в Національній академії образотворчого мистецтва і архітектури. Методи дослідження. В основу дослідження покладено методики експерименту і спостереження, які дали змогу створити систему завдань і отримати робочі результати. Методики аналізу та систематизації уможливили зібрання та систематизацію практичного матеріалу. Методи типологізації були залучені до структурування різноманітних видів та форм завдань. Методи узагальнення та контекстуального аналізу дали змогу виявити можливості нових систем викладання та перспективи їхнього розвитку. Результати. Розглянуто та проаналізовано проблеми, які виникають у процесі викладання спеціальних дисциплін під час дистанційного та змішаного навчання. В процесі викладання пластичної анатомії в НАОМА було запропоновано та використано такі методи мультимедійного навчання, як метод пошарового рисунка та онлайн-метод «прорисовування» анатомічного рисунка по поверхні живописного або графічного твору. Обидва методи можуть використовуватися як аудиторно, так і онлайн. Встановлено, що переваги дистанційного використання таких методів − швидка та якісна поетапна демонстрація, яка дає змогу студентові опанувати великі обсяги візуальної інформації і працювати в ній у динаміці. Окремо розглянуті певні світоглядні аспекти дисципліни та принцип парадоксального порівняння, які пропонується використовувати для більшої інтеграції пластичної анатомії в систему творчого навчання. Висновки. У практиці викладання пластичної анатомії в НАОМА було запропоновано комплексний підхід до викладання цієї дисципліни, в якому поєднуються філософсько-світоглядні компоненти, вивчення досвіду «старих майстрів» та мультимедійні методи навчання, такі як онлайн-метод пошарового рисунка, онлайн-метод «прорисовування» анатомічного рисунка по поверхні живописного або графічного твору, метод парадоксального порівняння та аналіз помилок у роботі, який також може реалізовуватися за допомогою мультимедійних технологій. За результатами трирічного пошуку, використання та вдосконалення мультимедійних форм викладання можемо стверджувати, що такі методики мають широкі перспективи для підвищення ефективності навчання і зміцнення базової підготовки студентів.
Chapter
In the construction-related course, there is a lot of knowledge that is tough to verbalize or teach, especially understanding building details through imagination without experiencing or seeing the construction elements in reality. Visual reality (VR) enables users to visualize the complexity of buildings. The research method used in this research is qualitative method in which interviews were conducted in this research. The interviewees were invited to try the VR technology and data was collected. Throughout the whole research, the workflow of converting a 3D model to a VR model is developed, the constraints of adopting VR are identified and strategies are recommended. The results in the findings showed that all the interviewees need guidance when using the VR technology and some of them suffer from motion sickness. The findings of this research serve as a reference for universities that are interested in adopting VR technology in education to enhance knowledge of VR technology and provide better understanding in the classes.
Article
Full-text available
In the proposed paper, our experience in managing the transition from traditional design education to CAD based design as a case study for comparison is documented. Use of CAD technologies on both undergraduate and Master level is also discussed. This document outlines the necessary details to prepare a paper for the journal Computer-Aided Design and Applications. Authors are requested to follow all formatting instructions encoded into this MS Word file. To simplify the task of paper preparation, simply type in your paper into this document.
Article
This study provides experiment results as an educational reference for instructors to help student obtain a better way to learn orthographic views in graphical course. A visual experiment was held to explore the comprehensive differences between 2D static and 3D animation object features; the goal was to reduce the possible misunderstanding factors in the learning process. This empirical study provided one hundred and twenty Taiwanese freshmen four types of visualization, which includes two 2D static depictions (2DT, 2DR), and two 3D animations (3DT, 3DR), to meet five surface styles on orthographic views. The responses to views ability test and interviews illustrated that applying 3D animations shows better performance in understanding the appearances and features of objects constructed by oblique and double-curved surfaces. The application of 3D animations results also demonstrates a better visual comprehension for students, especially when objects are constructed by the complicated features.
The Impact of Virtual Reality-based Learning Environment Design Features on Students' Academic Achievements (Doctoral dissertation)
  • Z Merchant
Merchant, Z.: The Impact of Virtual Reality-based Learning Environment Design Features on Students' Academic Achievements (Doctoral dissertation), 2012.
First year engineering graphics curricula in major engineering colleges
  • F D Meyers
Meyers, F. D.: First year engineering graphics curricula in major engineering colleges, Engineering Design Graphics Journal, 64(2), 2009, 23-28.