Ruidong Bai’s research while affiliated with Southeast University and other places

Multisize geographic information system (GIS) has widely used in social life, and the introduction of natural interactive methods such as gesture interaction further broadens the applications of GIS. Gestures, as a natural means of expression, bring a convenient experience to the use of GIS. The user-elicitation method can determine the user’s original operational intention and take advantage of the natural and convenient gesture interaction. However, current research on elicitation methods mainly focuses on defining the function factors of operation commands and rarely considers the influence of environmental factors such as spatial sizes. This paper takes GIS as the object, which is closely related to multisize space. This paper reports a research project on user-defined gestures for interacting with two-dimensional maps in a virtual reality environment, including three types of GIS operation commands and six sizes of maps. The results showed that the user-defined gestures for the same GIS operation commands varied across map sizes. The increase in map size increased the amount of gestural movement. Drawing on our research, we developed a set of gestures for multisize GIS interface interaction. We hope that this research can provide a guiding foundation for mid-air gesture design for all multisize interfaces.

Based on the multidimensional visual perception of materials, the Kansei engineering method was employed to investigate the multidimensional perceptual strategy and the basis of aesthetic perception of materials. Solid wood and metal, common materials in interior environments that are closely related to health care, were used as material samples. The study was conducted on an online, self-developed collection, selecting more than 300 participants among designers and consumers with a mixed ratio of males to females to participate in the experiments. The first study screened out eight dimensions of material perception by visual semantic differences, selecting 80 metal materials and 14 solid wood materials for multidimensional perception tests. According to the test results, 12 metal materials and six solid wood materials were assigned systematically to 72 dual-material products to calculate the perceptual distance of each dimension among these materials. The results demonstrate that people have similar perception clue strategies in most perception dimensions between different materials. Regarding products with multiple materials, the perception of the materials on the main display surface has a more powerful influence on the overall product perception. The harmonious combination of materials will enhance health care in daily life. This article provides a possible cognitive clue on materials. The experimental results provide reference for medical product design.

Continuous movements of the hand contain discrete expressions of meaning, forming a variety of semantic gestures. For example, it is generally considered that the bending of the finger includes three semantic states of bending, half bending, and straightening. However, there is still no research on the number of semantic states that can be conveyed by each movement primitive of the hand, especially the interval of each semantic state and the representative movement angle. To clarify these issues, we conducted experiments of perception and expression. Experiments 1 and 2 focused on perceivable semantic levels and boundaries of different motion primitive units from the perspective of visual semantic perception. Experiment 3 verified and optimized the segmentation results obtained above and further determined the typical motion values of each semantic state. Furthermore, in Experiment 4, the empirical application of the above semantic state segmentation was illustrated by using Leap Motion as an example. We ended up with the discrete gesture semantic expression space both in the real world and Leap Motion Digital World, containing the clearly defined number of semantic states of each hand motion primitive unit and boundaries and typical motion angle values of each state. Construction of this quantitative semantic expression will play a role in guiding and advancing research in the fields of gesture coding, gesture recognition, and gesture design.