No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
Mobile Edge Computing based Mixed Reality Application for the Assistance of Blind and Visually Impaired People
Abstract
Mixed Reality (MR) applications are becoming very popular in different sectors such as communication, education and entertainment for its extensive application areas and also for the wide adoption of mobile and especially wearable devices. Due to weak computational efficiency and short battery life of these devices, MR applications performance can be hampered. Offloading the MR application burden to the cloud server can be a solution to this problem but this approach also creates high communication latency. Mobile Edge Computing (MEC) is an emerging technology which brings cloud close to the user proximity at the base station and utilizes radio access network for maintaining communication with the users. This paper presents a MEC based MR application for assisting blind and visually impaired people. In the proposed scheme, the computational task is offloaded to the nearest MEC server in order to prolong the battery life of the MR devices. Finally, experimental results based on latency and energy consumption are discussed in order to demonstrate the feasibility of the proposed scheme.
... Aside from gaming, EC enhances mixed reality applications, such as limited and visually impaired people assistance [360]. ...
With the increasing stringent QoS constraints (e.g., latency, bandwidth, jitter) imposed by novel applications (e.g., e-Health, autonomous vehicles, smart cities, etc.), as well as the rapidly increasing number of connected IoT (Internet of Things) devices, the core network is becoming increasingly congested. To cope with those constraints, Edge Computing (EC) is emerging as an innovative computing paradigm that leverages Cloud computing and brings it closer to the customer. “EC” refers to transferring computing power and intelligence from the central Cloud to the network’s Edge. With that, EC promotes the idea of processing and caching data at the Edge, thus reducing network congestion and latency. This paper presents a detailed, thorough, and well-structured assessment of Edge Computing and its enabling technologies. Initially, we start by defining EC from the ground up, outlining its architectures and evolution from Cloudlets to Multi-Access Edge Computing. Next, we survey recent studies on the main cornerstones of an EC system, including resource management, computation offloading, data management, network management, etc. Besides, we emphasized EC technology enablers, starting with Edge Intelligence, the branch of Artificial Intelligence (AI) that integrates AI models at resource-constrained edge nodes with significant heterogeneity and mobility. Then, moving on to 5G and its empowering technologies, we explored how EC and 5G complement each other. After that, we studied virtualization and containerization as promising hosting runtime for edge applications. Further to that, we delineated a variety of EC use-case scenarios, e.g., smart cities, e-Health, military applications, etc. Finally, we concluded our survey by highlighting the role of EC integration with future concerns regarding green energy and standardization.
... Therefore, MR is not considered and no decentralized data sharing technique has been proposed in their paper. Authors in [11] proposed MR based application to assist the blind and visually defected person with the support of MEC server. However, they have not investigated the security issues of their proposed system. ...
Internet of Things (IoT) established the foundation of the smart world via its diverse functionalities (e.g., remote data acquisition, automated task execution). This trend continues to military applications too by introducing internet of military things (IoMT). Due to being at infancy level, new technologies require to move forward and assist IoMT to gain maturity. Mixed reality (MR) can be a potential technology which fuses the virtual and actual world. MR can improve the quality of service (QoS) in terms of inventory management, remote mission handling, battlefield assistance, etc. However, data among these applications is surrounded by cyber threats (e.g., illegal data modification, unauthorised data access). Blockchain is another promising technology which brings security in the distributed world. A content sharing scheme for MR application is proposed on the top of blockchain to bring security in the multi-user environment in IoMT. A smart contract is employed to manage security in accessing data by different users. Moreover, an experimental environment is set to observe the performance of the proposed scheme. The analysis manifests that proposed scheme maintains security without affecting the regular performance.
... HoloLens and multiple parrot bebop 2 has been used for the implementation of this system. HoloLens has IMU display and depth camera that help the visual overlay to be displayed properly [5]. 3D map building process using video stream has been done in ground control station. ...
Natural disasters are increasing day by day as the climate crisis becomes more serious. In a disastrous situation, search and rescue missions are very risky, time-consuming, and resource constraints. A hybrid drone-assisted mixed reality-based system (termed as "MR-Drone") is proposed for conducting search and rescue operations very quickly and efficiently in a disastrous situation like an earthquake, floods, fire breakout, etc. In our proposed system, we use drone’s real-time steaming for generating a 3D map of the target area and this map can be shown in mixed reality device like HoloLens for monitoring the rescue mission. Multiple users can monitor the emergency together in a mixed reality environment using MR-Drone thus reduce the rescue time.
With the development of telecommunication technologies and the proliferation of network applications in the past decades, the traditional cloud network architecture becomes unable to accommodate such demands due to the heavy burden on the backhaul links and long latency. Therefore, edge computing, which brings network functions close to end-users by providing caching, computing and communication resources at network edges, turns into a promising paradigm. Benefit from its nature, edge computing enables emerging scenarios and use cases like Augmented Reality (AR) and Internet of Things (IowT). However, it also creates complexities to efficiently orchestrate heterogeneous services and manage distributed resources in the edge network. In this survey, we make a comprehensive review of the research efforts on service orchestration and resource management for edge computing. We first give an overview of edge computing, including architectures, advantages, enabling technologies and standardization. Next, a comprehensive survey of state-of-the-art techniques in the management and orchestration of edge computing is presented. Subsequently, the state-of-the-art research on the infrastructure of edge computing is discussed in various aspects. Finally, open research challenges and future directions are presented as well.
The proliferation of visual impairments is a major issue all over the world. People with vision impairments face a variety of problems in their daily lives. Some of these challenges include the inability to move with total freedom and the capacity to seek and notice items around. As a result, they must entirely rely on family and friends to accomplish even the most basic tasks. This makes them to suffer a lot and it also leads to mental stress. Until 10 years ago, the only assistance available on the market was through the use of guiding dogs and a stick. However, there are numerous gadgets on the market now that can help with this problem. In terms of collision detection, width, and gap, the suggested system outperforms existing object identification systems on the market.KeywordsVisual impairmentNavigationAssistive technologyUltrasonic sensorArduino Uno
Wiring harness is the connection wires used in vehicles that transmit energy and electrical signals to the electrical system. Over the years, the number of connected components and, accordingly, the complexity in the circuit has increased in large manner. Developing maual test bench according to the design is quite difficult task in construction vehicles. The perplexing in the design of large size road construction vehicles is the main problem to develop standard harness in automobile industry. The most common problems such as interchange of switches, malfunctioning of diodes, missing hardware, interchange of wires, etc. Hence, the main objective of the present work is to design a test bench or control panel to test the wiring harness modules of the vehicle (soil compactor) before the cabin floor gets mounted into the vehicle. Previously, all the construction machinery industries are dealing with the manual test bench as the working is done manually in assembly bay and this has some disadvantages like SOP need to be remembered and frequent maintenance is required. In this work designing the Arduino model is accomplished successfully to save the cost and run time of the industry.KeywordsTest benchCabin floorSOP: Standard Operating ProcedureSoil CompactorWiring harness
The augmented reality (AR) applications have been widely used in the field of Internet of Things (IoT) because of good immersion experience for users, but their ultralow delay demand and high energy consumption bring a huge challenge to the current communication system and terminal power. The emergence of mobile-edge computing (MEC) provides a good thinking to solve this challenge. In this article, we study an energy-efficient task offloading and resource allocation scheme for AR in both the single-MEC and multi-MEC systems. First, a more specific and detailed AR application model is established as a directed acyclic graph according to its internal functionality. Second, based on this AR model, a joint optimization problem of task offloading and resource allocation is formulated to minimize the energy consumption of each user subject to the latency requirement and the limited resources. The problem is a mixed multiuser competition and cooperation problem, which involves the task offloading decision, uplink/downlink transmission resources allocation, and computing resources allocation of users and MEC server. Since it is an NP-hard problem and the communication environment is dynamic, it is difficult for genetic algorithms or heuristic algorithms to solve. Therefore, we propose an intelligent and efficient resource allocation and task offloading algorithm based on the deep reinforcement learning framework of multiagent deep deterministic policy gradient (MADDPG) in a dynamic communication environment. Finally, simulation results show that the proposed algorithm can greatly reduce the energy consumption of each user terminal.
Driven by the visions of Internet of Things and 5G communications, recent years have seen a paradigm shift in mobile computing, from the centralized Mobile Cloud Computing towards Mobile Edge Computing (MEC). The main feature of MEC is to push mobile computing, network control and storage to the network edges (e.g., base stations and access points) so as to enable computation-intensive and latency-critical applications at the resource-limited mobile devices. MEC promises dramatic reduction in latency and mobile energy consumption, tackling the key challenges for materializing 5G vision. The promised gains of MEC have motivated extensive efforts in both academia and industry on developing the technology. A main thrust of MEC research is to seamlessly merge the two disciplines of wireless communications and mobile computing, resulting in a wide-range of new designs ranging from techniques for computation offloading to network architectures. This paper provides a comprehensive survey of the state-of-the-art MEC research with a focus on joint radio-and-computational resource management. We also discuss a set of issues, challenges and future research directions for MEC research, including MEC system deployment, cache-enabled MEC, mobility management for MEC, green MEC, as well as privacy-aware MEC. Advancements in these directions will facilitate the transformation of MEC from theory to practice. Finally, we introduce recent standardization efforts on MEC as well as some typical MEC application scenarios.
Mobile augmented reality (MAR) applications are
gaining popularity due to the wide adoption of mobile and
especially wearable devices. Such devices often present limited
hardware capabilities while MAR applications often rely on computationally
intensive computer vision algorithms with extreme
latency requirements. To compensate for the lack of computing
power, offloading data processing to a distant machine is often
desired. However, if this process introduces new constrains in
the application, especially in terms of latency and bandwidth. If
current network infrastructures are not ready for such traffic,
we envision that future wireless networks such as 5G will rapidly
be saturated by resource hungry MAR applications. Moreover,
due to the high variance of wireless networks, MAR applications
should not rely only on the evolution of infrastructures. In this
article we analyze MAR applications and justify their need for
accessing external infrastructure. After a review of the existing
network infrastructures and protocols, we define guidelines for
future real-time and multimedia transport protocols, with a focus
on MAR offloading.
Augmented Reality (AR) introduces vast opportunities to the industry in terms of time and therefore cost
reduction when utilized in various tasks. The biggest obstacle for a comprehensive deployment of mobile AR is that current devices still leave much to be desired concerning computational and graphical performance.
To improve this situation in this paper we introduce an AR Edge Computing architecture with the aim to
offload the demanding AR algorithms over the local network to a high-end PC considering the real-time requirements of AR. As an example use case we implemented an AR Remote Live Support
application. Applications like this on the one hand are strongly demanded in the industry at present, on the other hand by now mostly do not implement a satisfying tracking algorithm lacking computational resources.
In our work we lay the focus on both, the possibilities our architecture offers regarding improvements
of tracking and the challenges it implies in respect of real-time. We found that offloading AR algorithms in real-time is possible with available WiFi making use of standard compression techniques
like JPEG. However it can be improved by future radio solutions offering higher bandwidth to avoid additional latency
contributed by the coding.
The emergence of several new computing applications, such as virtual reality and smart environments, has become possible due to availability of large pool of cloud resources and services. However, the delay-sensitive applications pose strict delay requirements that transforms euphoria into a problem. The cloud computing paradigm is unable to meet the requirements of low latency, location awareness, and mobility support. In this context, Mobile Edge Computing (MEC) was introduced to bring the cloud services and resources closer to the user proximity by leveraging the available resources in the edge networks. In this paper, we present the definitions of the MEC given by researchers. Further, motivation of the MEC is highlighted by discussing various applications. We also discuss the opportunities brought by the MEC and some of the important research challenges are highlighted in MEC environment. A brief overview of accepted papers in our Special Issue on MEC is presented. Finally we conclude this paper by highlighting the key points and summarizing the paper.
Mobile Edge Computing is an emerging technology that provides cloud and IT services within the close proximity of mobile subscribers. Traditional telecom network operators perform traffic control flow (forwarding and filtering of packets), but in Mobile Edge Computing, cloud servers are also deployed in each base station. Therefore, network operator has a great responsibility in serving mobile subscribers. Mobile Edge Computing platform reduces network latency by enabling computation and storage capacity at the edge network. It also
enables application developers and content providers to serve context-aware services (such as collaborative computing) by using real time radio access network information. Mobile and Internet of Things devices perform computation offloading for compute intensive applications, such as image processing, mobile
gaming, to leverage the Mobile Edge Computing services. In this paper, some of the promising real time Mobile Edge Computing application scenarios are discussed. Later on, a state-of-the-art research efforts on Mobile Edge Computing domain is presented. The paper also presents taxonomy of Mobile Edge Computing,
describing key attributes. Finally, open research challenges in successful deployment of Mobile Edge Computing are identified and discussed.
This research investigates which uses of AR have emerged so far in marketing and proposes classification schemas for them, based on the intensity of the augmentation, different contexts of consumption and on marketing functions. Such differentiation is needed in order to better understand the dynamics of augmentation of physical surroundings for commercial purposes and consequently to distinguish between consumer experiences.
JavaScript Object Notation (JSON) is a
lightweight data-interchange format. It is easy for humans
to read and write. It has a data format that is interchangeable
with a programming languages built-in data
structures that eliminates translation time and reduces
complexity and processing time. Moreover, JSON has the
same strengths of XML. Therefore, it’s better to shift
form XML security to JSON security. In this paper, we
will present how to shift from XML encryption to JSON
encryption.
In this paper, we present an innovative Augmented Reality prototype designed for industrial education and training applications. The system uses an Optical See-Through HMD integrating a calibrated camera and a laser pointer to interactively augment an industrial object with virtual sequences designed to train a user for specific maintenance tasks. The training leverages user interactions by simply pointing on a specific object component. The architecture of our prototype involves two main vision-based modules : camera localization and user-interaction handling. The first module includes markerless trackers for camera localization, which can deal with partial occlusions and specular reflections on the metallic object surfaces. In the second module, we developed fast image processing methods for red laser dot tracking. By combining these processing elements, the proposed system is able to interactively augment in real time an industrial object making the learning process more interesting and intuitive.
Usage of augmented reality technology in daily life
is becoming more widespread. This technology is also being
applied in the field of tourism. In this study, a prototype
of mobile application for smart tourism has been developed
by using augmented reality technology. The requirements, the
competences and incompleteness of the methods is described.
The prototype application is developed in the pilot region of
Gökova Mu˘gla. This application aims to introduce important
centers, touristic places, restaurants, hotels and sightseeing places
to domestic and foreign tourists. The intensity, ratings, comments,
current social media data and price information about these
areas will be provided simultaneously on the mobile application.
Image processing techniques and location data will be used for
implementing augmented reality technology.
Mobile Edge Computing (MEC) is an emergent architecture where cloud computing services are extended to the edge of networks leveraging mobile base stations. As a promising edge technology, it can be applied to mobile, wireless and wireline scenarios, using software and hardware platforms, located at the network edge in the vicinity of end-users. MEC provides seamless integration of multiple application service providers and vendors towards mobile subscribers, enterprises and other vertical segments. It is an important component in the 5G architecture which supports variety of innovative applications and services where ultra low latency is required. This paper is aimed to present a comprehensive survey of relevant research and technological developments in the area of MEC. It provides the definition of MEC, its advantages, architectures, and application areas; where we in particular highlight related research and future directions. Finally, security and privacy issues and related existing solutions are also discussed.
To ensure continued competitiveness of 3G technology for the next decade, 3GPP is establishing evolution plans that are following introduction of HSDPA and Enhanced Uplink. The new major step is known as 3G Long Term Evolution (LTE) and is based on several promising technologies, like OFDM and MIMO, involving also the System Architecture Evolution (SAE). Major performance goals addressed by LTE are significantly increased peak data rates, reduced latency, spectrum efficiency, together with lower cost and complexity. This paper presents main mechanisms applied for improving latency in new, evolved system, both in control and user plane.
[poster] classifications of augmented reality uses in marketing