About
344
Publications
53,649
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
4,442
Citations
Introduction
virtual environment, HCI, games
Publications
Publications (344)
To optimize learning experience and improve learning performance, current virtual experimental systems usually assist students with stepwise guidance before operations and feedback after them. However, stepwise and excessive guidance can lead to student overreliance, while late feedback cannot avoid potential errors during experimental learning. Me...
As the cornerstone of spatial geometry and engineering drawings, three‐view drawing lays the necessary foundation for students to learn geography, graphics, industrial design, geographic information science, and so forth. However, teaching three‐view drawing can be challenging due to its abstraction. Currently, desktop and handheld augmented realit...
Using VR in reclining & lying positions is getting common for users, but upward views caused by posture have to be redirected to be parallel to the ground as when users are standing. This affects users’ locomotion performances in VR due to potential physical restrictions, and the visual-vestibular-proprioceptive conflict. This paper is among the fi...
Experimental learning is crucial in secondary school. During experimental learning, students generally use laboratory manuals. However, it is inconvenient and unintuitive to read. Current experiment aids require users to interact by their hands to acquire guidance, affecting hands-on experiments. In order to facilitate students exploring experiment...
When users use Virtual Reality (VR) in nontraditional postures, such as while reclining or lying in relaxed positions, their views lean upwards and need to be corrected, to make sure they see upright contents and perceive the interactions as if they were standing. Such upright redirection is excepted to cause visual-vestibular-proprioceptive confli...
How to intuitively illustrate phenomena while retaining good operation experiences is a key issue in experimental learning. Virtual experiments with desktop environments, handheld devices, or headsets can show invisible phenomena for students. However, they are either visuo‐tactile inconsistent in space or with heavy physical burdens, causing bad e...
We present a simulation microscope device called GiantScope, which combines virtual microscope, cloud computing, and embedded technologies. Users can complete most of the microscope‐based experiments in biology courses by operating our device, while learning the operating skills of microscopes at the same time. Our device supports most of the opera...
Unlike the traditional environment, VR and MR environments provide novel, natural, lifelike 3D user interfaces, which can stimulate the imagination of users. Whether VR and MR environments can influence the creativity and its impact factors (flow, attention, and relaxation) of future teachers' scene expansion in instruction design are the focus of...
Virtual experiments are a new way of doing experiments. A visible difference between virtual and real experiments is the interaction mode. Such a difference causes unfamiliarity and induces unnecessary cognitive load and inefficiency during learning. The objective of the research is to reduce the interactive operation difference between virtual and...
Real chemical experiments may be dangerous or pollute the environment; meanwhile, the preparation of drugs and reagents is time-consuming. Due to the above-mentioned reasons, few experiments can be actually operated by students, which is not conducive to the chemistry learning and the phenomena principle understanding. Recently, due to the impact o...
Metaverse is the next generation gaming Internet, and virtual humans play an important role in Metaverse. The simultaneous representation of motions and emotions of virtual humans attracts more attention in academics and industry, which significantly improves user experience with the vivid continuous simulation of virtual humans. Different from exi...
Spatial augmented reality (SAR), which typically uses projectors to augment physical spaces with virtual contents, is one of the three main forms of augmented reality. In SAR systems, users can interact with virtual contents in physical spaces, therefore they have good environmental, spatial and collaborative perceptions. SAR systems can also reduc...
As an important method for humans to perceive their environment, touch has not been fully integrated into virtual reality technology. Existing tactile feedback devices have the problem of being large and expensive, and most studies have not explored the ability of the affected area to distinguish an external stimulus, thus it is difficult to perfor...
Background
With the aim of addressing the difficulty in identifying temperatures in virtual chemistry experiments, we propose a temperature-sensing simulation method of virtual chemistry experiments.
Methods
We construct a virtual chemistry experiment temperature simulation platform, based on which a wearable temperature generation device is devel...
In this paper, we proposed a method of real-time human motion detection and skeleton control based on the depth image. For the human body part, we use Kinect to detect the original three-dimensional coordinates of the human joint; then smooth the joint movement; calculate the amount of rotation based on the smoothed data. Finally, the FBX file is u...
At present, the display of marching roadmap in the revolutionary history memorial hall are mostly in the form of flat KT board. There are also a few ways of using animation or video, but the way KT board is not conducive to the understanding of the visitors, A certain cognitive burden, animation or video is also not conducive to the latter part of...
This journal subline serves as a forum for stimulating and disseminating innovative research ideas, theories, emerging technologies, empirical investigations, state-of-the-art methods, and tools in all different genres of edutainment, such as game-based learning and serious games, interactive storytelling, virtual learning environments, VR-based ed...
A serious trouble of virtual bicycle ride has to be faced currently, that is the visual information of scene motion perceived by riders doesn’t synchronize with the proprioceptive information of actual ride. This phenomenon makes riders deeply depressing in immersion and interaction. This paper proposes three different interpolation algorithms of C...
Public security is a major problem facing our country at present. Frequent public security accidents have become a great hidden danger affecting social stability. The public security consciousness of our people is generally scarce. When facing such disasters as earthquake and fire, we often do not know how to avoid danger and save ourselves. With t...
Color is one of the most familiar physical phenomena and common sense in daily life. However, to understand color is a very complicated learning processing, which takes a long period of time with great effort in professional color application and design practice to mastering the basic laws of color application. Therefore, how to develop a visual te...
The driver fatigue detection method based on human eye feature information has the advantages, such as non-invasion, low cost, natural interaction and so on, which has been widely favored. However, in the actual detection process, the driver’s face will be shaken due to various factors, and there will be motion blur, which will cause misjudgment an...
This journal subline serves as a forum for stimulating and disseminating innovative research ideas, theories, emerging technologies, empirical investigations, state-of-the-art methods, and tools in all different genres of edutainment, such as game-based learning and serious games, interactive storytelling, virtual learning environments, VR-based ed...
Computational design provides a scientific and quantitative way for designers to conduct clothing functional design. In this study, the authors describe the application of 2D/3D visualization in the clothing thermal computational design process. The computational 2D visualization is employed to compare the key parameters between target cases and se...
This paper describes a usability study of CAD for teaching and learning clothing thermal computational design (CTCD) for university students of fashion and textiles. The CAD helps students to learn the clothing thermal computational design through computational design simulations (CD-Sims). The pedagogical strategies of employing CAD, and learning...
This article discusses what would be needed to realize visual avatars that could dress us well and potentially impact our health by suggesting clothes appropriate for our activities.
This journal subline serves as a forum for stimulating and disseminating innovative research ideas, theories, emerging technologies, empirical investigations, state-of-the-art methods, and tools in all different genres of edutainment, such as game-based learning and serious games, interactive storytelling, virtual learning environments, VR-based ed...
Aimed at the present situation that dynamic hand gestures recognition rate is low and the effect is not ideal, this paper uses Sobel operator to detect the edges in gesture image sequences, enhancing the edge features in dynamic gesture image. In order to prevent the information loss of gesture image after edge detection, the paper will fuse the HO...
By introducing a collaborative aesthetic-driven virtual fitness game, we give a possible solution to guide and encourage people who have sedentary lifestyle to do regular physical activity with enough intensity, duration and frequency. This method bridges physical interaction with a stationary bicycle and visual changes in a virtual environment, an...
This paper proposes a CPI (conceptual-procedural-integrative) learning method for textiles and clothing university students to learn the computational design for clothing thermal functions and performance on knowledge, skills and application levels. First, the CPI learning method is discussed. Second, three proposed learning approaches (virtual tri...
This journal subline serves as a forum for stimulating and disseminating innovative research ideas, theories, emerging technologies, empirical investigations, state-of-the-art methods, and tools in all different genres of edutainment, such as game-based learning and serious games, interactive storytelling, virtual learning environments, VR-based ed...
A successful high-performance sportswear design that considers human factors should result in a significant increase in thermal comfort and reduce energy loss. The authors describe a body-mapping approach that facilitates the effective ergonomic design of sportswear. Their general framework can be customized based on the functional requirements of...
Color perception always depends on subjective factors. When it comes to a color design project, different designers will persist in different opinions. Although, color designing tools are handy to access nowadays, it takes long-term accumulation of color knowledge and abundant experiences of color designing for designers to master color principles...
It is difficult for existing methods to measure the angular, bowing, and rotational knee alignments altogether in 2D radiograph images. We propose an automatic measurement method to quantify these knee alignments in three-dimensional (3D) bone models. Eight important anatomical landmarks of lower limb bones are used to establish lower extremity coo...
Developments in computer capabilities, networks, mobile devices, and social media have enabled researchers and educators to increasingly employ blended strategies when developing new learning technologies. In addition, there is a growing need to develop discipline-specific learning technologies as result of expanding research in various domains. Th...
Harmony and preference are two important factors in constructing color combination for the purpose of color design. We presented a method for generating harmonious color scheme in a previous project. As an extension to the project, we propose here a method for generating color schemes that are based on user's preference. We considered color combina...
Color images are usually observed as integrated objects, or called color gestalt. That is why color effect of image is not only affected by the color components themselves, but also determined remarkably by the image constructive frame, which holds the colors. Although, previous researchers have already explored this issue, the conclusions are usua...
We propose a new approach: aesthetic-driven interactions (ADI), as a pleasurable persuasive technology for encouraging health behavior change, especially for those who feel regular physical exercise is somehow painful.
Hong Kong Polytechnic University educators used the Second Life virtual world to help students learn the relationships between key concepts in designing clothing for functional comfort.
In this paper we present a hybrid collision detection technique in crowd simulation by constructing a field of vision for each agent. The field of vision is represented as a bounding volume that is dependent to the agent’s locomotion variation that results in a variation of its length and angle. The variation will hence create more dynamic executio...
The paper presents a method to estimate real body shape of dressed human. In the method we build a function to describe the fat extent of every vertex on the body. The fat extent is relative to the slim body template and the fat body template. Using the fat function and two templates a synthesizing model is created. The 3D scans of dressed human ob...
This paper provides an online virtual 7home decoration system, which integrates web interaction technique into virtual home decoration. The main functions of this system include house design, house decoration, and data management. For the house design, an automatic joint method of the walls is proposed, in order to design various house. For the hou...
We present an interactive visualization tool for generating color schemes that can be used by both professional artists and novice designers to improve their design efficiency. The method is developed on two color harmony principles of familial factors and rhythmic spans from conventional color theories. The interactive tool makes use of these prin...
Research on real-time 3D animation is attracting a lot of attention in recent years due to the popularity of emerging applications such as distributed virtual environments and computer games. One of the important issues in real-time animation is that the existing motion retrieval techniques generally have a high matching time because they are typic...
This paper proposes a new approach for 3D face reconstruction with RGBD images from an inexpensive commodity sensor. The challenges we face are: 1) substantial random noise and corruption are present in low-resolution depth maps; and 2) there is high degree of variability in pose and face expression. We develop a novel two-stage algorithm that effe...
Emergency exercises are an efficient approach for preventing serious damage and harm, including loss of life and property and a wide range of adverse social effects, during various public emergencies. Among various factors affecting the value of emergency exercises, including their design, development, conduct, evaluation, and improvement planning,...
This paper presents a novel approach for creating self-moving objects using hollow-face illusion. Given a clip of character animation, our approach generates a static object. Looking at the object at different views, a similar deformation can be observed. To accomplish this challenging mission, we give qualitative and quantitative analysis of hollo...
Motion capture data in an uncompressed form can be expensive to store, and slow to load and transmit. Current compression methods for motion capture data are primarily lossy and cause distortions in the motion data. In this paper, we present a lossless compression algorithm for motion capture data. First, we propose a novel Alpha Parallelogram Pred...
Lien sur le site éditeur : http://ieeexplore.ieee.org/xpl/tocresult.jsp?isnumber=6479163&punumber=2945
]Using computer-aided design system to design an elegant 3D garment for a virtual human is often tedious and labor-intensive. Moreover, the garment is usually designed for a reference human model and generally not fitted to other individuals, which largely reduces the reusability of existing 3D garments. In this paper, we introduce proxy mesh to fi...
In this article, we propose a graph-model based technique, identified as demonstration graph, to construct and coordinate both behavioral and cognitive models automatically for IHCs to accomplish complex tasks in a simple, universal way. Our technique is inspired by the insight from psychology, neuroscience, and human ethology that humans' decision...
This paper introduces a home design system with its great functions and framework design, including the scene management based on the Cell&Portal system, improved variance shadow mapping and the recently popular real-time rendering framework called deferred lighting. In the implementation details, we put in some useful improvements, such as compres...
This journal subline serves as a forum for stimulating and disseminating innovative research ideas, theories, emerging technologies, empirical investigations, state-of-the-art methods, and tools in all different genres of edutainment, such as game-based learning and serious games, interactive storytelling, virtual learning environments, VR-based ed...
This journal subline serves as a forum for stimulating and disseminating innovative research ideas, theories, emerging technologies, empirical investigations, state-of-the-art methods, and tools in all different genres of edutainment, such as game-based learning and serious games, interactive storytelling, virtual learning environments, VR-based ed...
In this paper, we introduced a novel method to simulate moving spectator crowd behaviours. Different from the common methods, we taken the emotional affections between spectators into consideration and calculated these affections by heat conduction model. The generation loops can be divided into three steps. We firstly exploited PAD space to build...
In this paper, a global optimum stereo matching algorithm based on improved belief propagation is presented which is demonstrated to generate high quality results while maintaining real-time performance. These results are achieved using a foundation based on the hierarchical belief propagation architecture combined with a novel asymmetric occlusion...
Constructing virtual 3D historical scenes from literature and records is a very challenging problem due to the difficulty in incorporating different types of domain knowledge into the modeling system. The domain knowledge comes from different experts, including: architects, historians, rendering artists, user interface designers and computer engine...
This paper presents the texture mapping algorithm for incomplete and irregular regions in virtual scene. For mapping texture to the incomplete region, the whole region is divided into several discrete subsections and the segmentation textures are kept continuous according to the textures' difference of phases. When mapping texture to the irregular...
Depth camera such as Microsoft Kinect, is much cheaper than conventional 3D scanning devices, and thus it can be acquired for everyday users easily. However, the depth data captured by Kinect over a certain distance is of extreme low quality. In this paper, we present a novel scanning system for capturing 3D full human body models by using multiple...
Taken it into consideration that human has a great deal of experiences and knowledge of hand postures, if these operating skills of postures are applied to HCI, the simple and convenient human-computer interface can be expected. In fact, tracking, recognition and interaction based on 3D freehand are a part of the cores in our virtual assembly syste...
Computer graphics and digital technologies have opened up a myriad of ways for both preservation and transfer of cultural heritage information. The digital storage systems, digital lab notebooks and virtual museums are all examples. VR technology development has made it possible to construct large, immersive and interactive virtual environment for...
This journal subline serves as a forum for stimulating and disseminating innovative research ideas, theories, emerging technologies, empirical investigations, state-of-the-art methods, and tools in all different genres of edutainment, such as game-based learning and serious games, interactive storytelling, virtual learning environments, VR-based ed...
HumMod [Hester et al. 2011] models interactions between the cardiovascular, respiratory, renal, neural, endocrine, skeletal muscle, and metabolic physiologies. One of the difficulties which must be overcome with HumMod is the fact that the number of parameters is prohibitive in developing a clear and comprehensive view of the interactions between p...
Our long-term collaborations with bat flight biologists have revealed that several workflow issues continue to be persistent barriers in scientists' data analysis tasks. Only limited attention has been given to user interfaces that bridge programming and visualization in environments involving multiple information resources, feature extraction by p...
Automatic approach for motion synthesis is challenging and interesting in character animations. However, previous works indicate that smoothness of transitions and connectivity of behaviours are difficult to achieve simultaneously. We propose a novel framework as the motion thread network (MTN) to address this challenge. An MTN is constructed by ta...
Distributed virtual worlds, as online interactive 3D virtual environments and communities through which users can interact with one another, have been integrated widely in research in the social, medical, commercial, educational and entertainment areas. In this study, the authors present a recent instructional practice using Second Life as a platfo...
We present a vision-based gesture interaction technique that is capable of tracking both hands in real-time. By only recovering features calculated from images, large amount of computation for 3D reconstructing and features tracking in 3D voxel grid is avoided. Thus, our system becomes an ideal tool for bimanual 3D gesture interaction, which needs...
Due to the popularity of motion capture data in many applications, such as games, movies and virtual environments, huge collections of motion capture data are now available. It is becoming important to store these data in compressed form while being able to retrieve them without much overhead. However, there is little work that addresses both issue...
Digital Mine has become the inevitable development trend of the future mines. Blasting is a essential process during the exploration and development of practical mining engineering. The blasting always plays a direct influence on the efficiency of each follow-up production process and if it were not handled correctly, it will even threaten the safe...
Time-of-flight range camera (referred to as TOF camera) has many advantages: compact, easy to use and can obtain three-dimensional depth data of any scene in real-time, which makes it increasingly widely used in various applications. However, TOF camera produces very noisy depth map and often performs poorly on the rich-textured scenes, such as tex...
In this paper, we introduce a novel method to display a famous Chinese ancient painting for the purpose of cultural heritage preservation. In order to animate the painting, some objects are extracted from the repainted painting and redrawn with three dimensional figures. Consequently the computer animation and Image-based rendering techniques are u...
Semantic image classification, which is the process of categorizing images using pattern recognition technology, is very useful for image annotation, organization and retrieval. While the literature has focused on the classification of natural scene photographs or images, here we focus on the stylized textile images and this is totally a new area w...
Time-of-flight range sensors have error characteristics, which are complementary to passive stereo. They provide real-time depth estimates in conditions where passive stereo does not work well, such as on white walls. In contrast, these sensors are noisy and often perform poorly on the textured scenes where stereo excels. We explore their complemen...
To generate human motions with various specific attributes is a difficult task because of high dimensionality and complexity of human motions. This paper presents a novel human motion model for generating and editing motions with multiple factors. A set of motions performed by several actors with various styles was captured for constructing a well-...
This paper presents a Biomechanics-based Lifelike Reaching Controller (BLRC) to generate lifelike reaching motion. The BLRC
employs various reaching strategies borrowed from biomechanics to guarantee the naturalness of reaching motion and expands
the reachable space to enrich the flexibility of human behavior. We exploit the arm-reachable workspace...
This paper presents a method for simulating daylight illuminance of indoor scenes with astronomical calculation and computer graphics rendering. The rendered phenomena look like real sunlight streaming into an interior through an outside window. At first, users interactively input date, location of the observed room, and turbidity of atmosphere. Wi...
we present a novel discriminative appearance model for monocular multi-target tracking and segmentation in a comparatively crowded scene. Based on th