No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
Investigating Multimodal Warnings for Distracted Smartphone Users on the Move in Potentially Dangerous Situations
Abstract
The use of smart devices has become an integrated part of our everyday life. Communication is now possible any place and any time. The distraction caused by these devices, however, can lead to potentially dangerous situations. To mitigate these situations, various researchers have proposed and developed solutions to analyze the environment and to alert the user if a situation is evaluated dangerous. While seeking technical solutions, the concerns of the users are usually not addressed. With our studies we put the needs of the user into focus and investigated the acceptance, potential dangers, events to be warned about, type of warning, reaction time and legal regulations.
... The visual feedbacks are potentially better for understanding real-time circumstances. The feedback containing visual content with information are termed as multimodal feedback which are important for perceiving the content in real-time (Braun et al., 2018). In our system, each feedback has a time interval, feedback content, and feedback modality. ...
... The audio alert has gained popularity in different fields, such as hospital (Meredith & Edworthy, 1995), atomic power plants (Marshall & Baker, 1995), aviation (Boucek et al., 1977), and vehicle drivers (Marshall et al., 2007) applications. The visual colors, shapes, and text alerts improve the user experience using smartphones and wearables (Braun et al., 2018). ...
The application of machine learning (ML) has grown and is now used to enhance learning outcomes. In blended classroom settings, ML, emerging smartphones and wearable technologies are commonly used to improve teaching and learning. The combination of these advanced technologies and ML plays a crucial role in enhancing real-time feedback quality. However, there are abundant scopes of improvement and strong need for further careful investigations in this area. We propose an ML-based intelligent real-time feedback system to address current research challenges for blended classrooms. The proposed system provides real-time feedback to students and teachers. We build an Android application for our intelligent feedback interfaces. The user interfaces use students’ academic performance prediction models with real-time states and dynamic feedback timings based on historic feedback statistics. In addition, the feedback scheduling algorithms, choices of peripheral devices for real-time feedback, and feedback modalities to optimize fatigue make our system interfaces intelligent and novel. The end users well-received the intelligent features and technology of the proposed system. Our empirical findings indicate that unique design elements, such as dynamic timing, choice of peripheral devices, and modalities of real-time feedback, are crucial in integrating the system with blended classes. The intelligent characteristics of the proposed system have been appreciated by a large proportion of the end-users (90.90% of teachers and 84.21% of students) for use in real-time blended classroom environments. The higher comparative system usability scale (SUS) scores with benchmarks show real promise of the system design.
The new coronavirus, which produces a highly contagious sickness, enters the picture. Globally, the coronavirus disease (COVID-19) has boosted the use of Internet commerce. It has resulted in an increase in the number of FTUs, or first-time e-commerce users, in India, who were previously unable to purchase online. Customers are depending on Amazon more than ever before in their social isolation and self-quarantine attempts, according to Amazon, one of the country’s and the world’s major e-commerce businesses (https://retail.economictimes.indiatimes.com/re-tales/impact-of-covid-19-on-onlineshopping-in-india/4115). The goal of this study is to determine the elements that influence customers’ online purchases of mobile phones, as well as how that practice has altered since the global COVID-19 outbreak. An online survey was done, and data were gathered from primary sources to interpret the objectives. The goal of the study is to figure out how successful online advertising is at raising awareness and what the link is between Internet advertising and purchasing decisions.KeywordsCovid-19E-commerceMarketingConsumer choiceInternet advertising
Designing peripheral warnings and notifications to support teaching-learning is progressively increasing. However, existing work usually fails to effectively integrate real-time alerts and tackle poor students in a blended classroom. We present an in-class multimodal alert method for teachers and students to address the challenges. The system utilizes performance prediction and classification of students for real-time alert. The classification of students based on course performance helped in optimizing the number of alerts. The peripheral device selection aided in preventing the disruption in the lecture follow. Moreover, alert content delivery timing (start, during, and end of the class session) is used to reduce alert fatigue. We reported the design and the initial study results. The results show that 25 teachers and students reacted positively to the system design, technology, and features.KeywordsPeripheral alertReal-time feedbackE-learning toolBlended class
The use of smart devices has become an integrated part of our everyday life. Communication is now possible everywhere at any time. The distraction caused by these devices, however, can lead to potentially dangerous situations. To mitigate these situations various researchers have proposed and developed solutions to analyze the environment and to alert the user if a situation is determined dangerous. While seeking technical solutions the concerns of the users are usually not addressed. With our study we put the belongings of the user into focus and investigated the acceptance and other issues of such type of applications. We found that environment awareness for users receiving warnings over those who do not can be significantly improvement. We found that 56% of the participants who tested a safety application and received warnings would use it while only 46% would use it a-priori without experiencing it. We can also confirm that females are more willing to use a safety application in comparison to men.
The emergence of smart phones has had a positive impact on society as the range of features and automation has allowed people to become more productive while they are on the move. On the contrary, the use of these devices has also become a distraction and hindrance, especially for pedestrians who use their phones whilst walking on the streets. This is reinforced by the fact that pedestrian injuries due to the use of mobile phones has now exceeded mobile phone related driver injuries. This paper describes an approach that measures the different levels of distraction encountered by pedestrians whilst they are walking. To distinguish between the distractions within the brain the proposed work analyses data collected from mobile sensors (accelerometers for movement, mobile EEG for electroencephalogram signals from the brain). The long-term motivation of the proposed work is to provide pedestrians with notifications as they approach potential hazards while they walk on the street conducting multiple tasks such as using a smart phone.
Effects of “smart-phoning” (using a smart phone) while walking were investigated in a laboratory experiment. While walking with an iPhone 5s, 24 undergraduate students texted a message, watched a video, played a game, and just held the phone in one hand in addition to performing visual and auditory detection tasks at the same time. The detection tasks were to respond to designated target signals as quickly as possible by clicking the wireless mouse held in the hand that did not hold the phone. The visual stimuli were presented on 4 video displays placed outside of the walking route. The target was a sudden change in screen color from blue to red. The auditory signals were presented through a loudspeaker once each second for a duration of 500 ms, and the target was to respond to a higher pitch within the tones. Participants performed these multiple tasks while walking clockwise along the perimeter of a 3 m by 3 m square marked on the floor. Results showed that the number of right footsteps that missed the line marking the walking route was greater under cell phone-use conditions than under the control condition, with results for the game condition worst among the cell phone-use conditions. Mean reaction times for both visual and auditory targets were significantly longer under cell phone-use conditions than under the control condition. Again, the game condition was the worst among cell phone-use conditions. Number of missed visual targets was significantly higher with the game condition than the control and video watching conditions. In summary, the results suggest a higher risk of accidents among pedestrians who are using cell phones, especially for those who are playing games with a smart phone.
Walking while staring at the mobile phone is dangerous, and the danger mainly arises from distraction. While watching the mobile phone, one could fall into a deep well without noticing the manhole cover was missing, one could be hit by a rushing car without observing the traffic light, and so forth. Some mobile phone users are already aware of the crisis, and they keep looking up and down to allocate some focus to danger spying; however, the statistics data revealed by US government make such efforts frustrating: about 1,152 pedestrians are injured in US in the year 2010, while they were using mobile phones, and the number doubled in the year 2012. This paper identified the possibility of using mobile phone sensors to develop a walk pattern recognition system. By sampling from embedded sensor, such as accelerometer and gyroscope, the movement pattern of mobile phone users can be computed. We design and implement HeadsUp, a system that warns pedestrian and locks the screen when one looks at the mobile phone while walking. Evaluation results from experiments of 20 testers in real life situation show that, on average, the false negative rate is less than 3%.
Mobile device use while walking, or eyes-busy mobile in- teraction, is a leading cause of life-threatening pedestrian collisions. We introduce CrashAlert, a system that aug- ments mobile devices with a depth camera, to provide dis- tance and location visual cues of obstacles on the user’s path. In a realistic environment outside the lab, CrashAlert users improve their handling of potential collisions, dodg- ing and slowing down for simple ones while lifting their head in more complex situations. Qualitative results outline the value of extending users’ peripheral alertness in eyes- busy mobile interaction through non-intrusive depth cues, as used in CrashAlert. We present the design features of our system and lessons learned from our evaluation.
The appropriate use of non-speech sounds has the potential to add a great deal to the functionality of computer interfaces. Sound is a largely unexploited medium of output, even though it plays an integral role in our everyday encounters with the world, one that is complementary to vision. I argue that sound should be used in computers as it is in the world, where it conveys information about the nature of sound-producing events. Such a strategy leads to auditory icons, which are everyday sounds meant to convey information about computer events by analogy with everyday events. Auditory icons are an intuitively accessible way to use sound to provide multidimensional, organized information to users. These ideas are instantiated in the SonicFinder1, which is an auditory interface I developed at Apple Computer. In this interface, information is conveyed using auditory icons as well as standard graphical feedback. I discuss how events are mapped to auditory icons in the SonicFinder, and illustrate how sound is used by describing a typical interaction with this interface. Two major gains are associated with using sound in this interface: an increase in direct engagement with the model world of the computer and an added flexibility for users in getting information about that world. These advantages seem to be due to the iconic nature of the mappings used between sound and the information it is to convey. I discuss sound effects and source metaphors as methods of extending auditory icons beyond the limitations implied by literal mappings, and speculate on future directions for such interfaces.
It is well recognized that walking while using mobile phones will make people more susceptible at various risks. Existing works to improve smartphone users’ safety are mainly limited to detecting incoming vehicles. They are not able to address some more common and equally dangerous accidents such as trips, falling from stairs, platforms, or falling into an open manhole. These hazards are generally caused by a sudden change of ground. In this paper, we propose InfraSee, a system that is able to detect sudden change of ground for pedestrian mobile phone users. InfraSee augments smartphones with a small infrared sensor which measures the distance of the ground surface from the sensor. The temporal variation of distance can provide information about the change of ground surface ahead. InfraSee also leverages the information of smartphone sensors to improve detection accuracy, to reduce energy consumption, and to avoid unnecessary alarms. We have carried out extensive experiments in different scenarios and by different users. The results show that InfraSee is able to reliably detect about 80 percent change of ground surfaces. In addition, InfraSee can reliably identify the awareness of smartphone users and reduce unnecessary alarms.
It is well recognized that walking while using mobile phones will make people more susceptible at various risks. Existing studies to improve smartphone users' safety are mainly limited to detecting incoming vehicles. They are not able to address some more common and equally dangerous accidents such as trips, falling from stairs, platforms or falling into an open manhole. These hazards are generally caused by sudden change of ground. In this paper, we propose UltraSee, the first system that is able to detect sudden change of ground for pedestrian mobile phone users. UltraSee augments smartphones with a small ultrasonic sensor which can detect the abrupt change of distance ahead. UltraSee also leverages the context information of smartphone usage such as screen status and holding orientation to improve detection accuracy and reduce energy consumption as well as unnecessary alarms. We have carried out extensive experiments in different scenarios and by different users. The results show that UltraSee can achieve accident detection rate of 94% with false positive rate of 4.4% and reduce unnecessary alarms by 90%. In terms of energy consumption, UltraSee costs only about 20% energy compared to the existing works that only rely on smartphone cameras.
Early user interface (UI) practitioners were trained in cognitive psychology, from which UI design rules were based. But as the field has evolved since the publication of the first edition of this book, designers enter the field from many disciplines. Practitioners today have enough experience in UI design that they have been exposed to design rules, but it is essential that they understand the psychology behind the rules in order to effectively apply them. In this completely updated and revised edition, Jeff Johnson provides you with just enough background in perceptual and cognitive psychology that UI design guidelines make intuitive sense rather than being just a list or rules to follow. In this completely updated edition, you'll find new chapters on human choice & decision making and hand-eye coordination & attention, as well as new examples, figures, and explanations throughout.
Icons are now routinely used in human-computer interactions. Despite their widespread use, however, we argue that icons are far more diverse and complex than normally realized. This article examines some of the history behind the evolution of icons from simple pictures to much richer and more complex representational devices. Then we develop and present a new framework that distinguishes: (1) different kinds of sign relations; (2) different kinds of referent relations; and (3) differences between sign and referent relations. In addition, we highlight a fundamental symmetry between icons and symbols, and use this framework to raise a number of basic questions about the kinds of representational issues and challenges designers will need to consider as they create the next generation of icons for user interfaces.
In the context of emergency warnings, auditory icons, which convey information about system events by analogy with everyday events, have the potential to be understood more quickly and easily than abstract sounds. To test this proposal, an experiment was carried out to evaluate the use of auditory icons for an in-vehicle collision avoidance application. Two icons, the sounds of a car horn and of skidding tyres, were compared with two conventional warnings, a simple tone and a voice saying 'ahead'. Participants sat in an experimental vehicle with a road scene projected ahead, and they were required to brake in response to on-screen collision situations and their accompanying warning sounds. The auditory icons produced significantly faster reaction times than the conventional warnings, but suffered from more inappropriate responses, where drivers reacted with a brake press to a non-collision situation. The findings are explained relative to the perceived urgency and inherent meaning of each sound. It is argued that optimal warnings could be achieved by adjusting certain sound attributes of auditory icons, as part of a structured, user-centred design and evaluation procedure.
M: Fußgänger und ihr nutzungsverhalten mit dem handy/smartphone in europäischen hauptstädten
- W Niewöhner
- S Ritter
- D Wickenkamp
- A Ancona
- I Briki
- K Koch
- M Markmann
- D Müller
- Niewöhner
Niewöhner, W., Ritter, S., Wickenkamp, D., Ancona, A., Briki, I., Koch, K.,
Markmann, M., Müller, D., Niewöhner, M: Fußgänger und ihr nutzungsverhalten
mit dem handy/smartphone in europäischen hauptstädten: Verkehrsbeobachtung.
http://www.dekra-roadsafety.com/de/fussgaenger-ablenkung-smartphones/