Markku Turunen

Tampere University | UTA · Department of Computer Science

In the light of Industry 4.0, the field of Industrial Maintenance faces a large digital transformation, adopting Extended Reality (XR) technologies to aid industrial operations. For the manufacturing corporations that provide maintenance services, the efficiency of industrial maintenance plays a crucial role in the competitiveness and is tightly re...

Training in virtual reality (VR) is a valuable supplementing tool for advancing knowledge transfer that results in increased efficiency and accuracy of technicians in fieldwork. However, COVID-19 pandemic restrictions made it impossible for VR training centers to operate on a full scale, forcing traditional face-to-face learning sessions to become...

Technical documentation creation is a collaborative process involving several departments in R&D. Even though virtual reality (VR) has been demonstrated to facilitate industrial collaboration and advance the product development lifecycle in earlier studies, it has not been utilized for technical documentation review and risk assessment processes in...

Purpose Many surgical complications can be prevented by careful operation planning and preoperative evaluation of the anatomical features. Virtual dental implant planning in three-dimensional stereoscopic virtual reality environment has advantages over three-dimensional projections on two-dimensional screens. In the virtual environment, the anatomi...

Purpose In dental implantology, the optimal placement of dental implants is important to meet functional and aesthetic requirements. Planning dental implants in virtual three-dimensional (3D) environment is possible using virtual reality (VR) technologies. The three-dimensional stereoscopic virtual reality environment offers advantages over three-d...

Virtual Reality (VR) is a critical emerging technology in industrial contexts, as it facilitates collaboration and supports the product development lifecycle. However, its broad adoption is constrained by complex and high-cost integration. The use of VR among devices with various immersion and control levels may solve this obstacle, and increase th...

Maintaining situational awareness in time-critical operation control is an omni-dimensional optimization problem. For excellent situational awareness, complete information with sufficient time to process it is prerequisite. Making sound judgement with limited time the flight controllers suffer poor information ergonomics as demanding situations cau...

When designing extended reality (XR) applications, it is important to consider multimodal interaction techniques, which employ several human senses simultaneously. Multimodal interaction can transform how people communicate remotely, practice for tasks, entertain themselves, process information visualizations, and make decisions based on the provid...

(1) COVID-19 pandemic restrictions caused a dramatic shift in research activities, forcing the adoption of remote practices and methods. Despite the known benefits of remote testing, there is limited knowledge on how to prepare and conduct such studies in the industrial context where the target users are experts and company employees. (2) In this a...

COVID-19 pandemic has affected the entire world in many ways. It has sparked a prominent pedagogical shift for university level students, as it has changed the way students learn, attend classes, or communicate with teachers. Globally, every student is forced to adopt Emergency Remote Learning (ERL) as a result of immediate transformation of physic...

Developments in sensor technology, artificial intelligence, and network technologies like 5G has made remote operation a valuable method of controlling various types of machinery. The benefits of remote operations come with an opportunity to access hazardous environments. The major limitation of remote operation is the lack of proper sensory feedba...

Maintaining situational awareness in time-critical operation control is an omni-dimensional optimisation problem. For excellent situational awareness, complete information with sufficient time to process it is prerequisite. Making sound judgement with limited time the flight controllers suffer poor information ergonomics as demanding situations cau...

Speech technology has matured so that voice-based reporting utilizing speech-to-text can be applied in various domains. Speech has two major benefits: it enables efficient reporting and speech input improves the quality of the reports since reporting can be done as a part of the workflow without delays between work and reporting. However, designing...

Society’s expectations and assistance for children with special needs is rooted in its cultural, societal, and political backdrop. Previous work on the role of culture on assistive or adaptive technology design for children with special needs identified a three-part framework: lifestyle, socio-technical infrastructure, and monetary and informationa...

There has been a growing awareness of Artificial Intelligence's (AI) inherent biases, limitations, and the challenges in overcoming them. As AI is integrated into to all things technical, there is a valid concern over its diversity, inclusiveness, and accessibility. However, questions such as what does it mean for AI to be inclusive, why is inclusi...

From the written word to televised news, the progression of journalism has seen many different forms. Now, with the increasingly mainstream use of Virtual Reality (VR), journalists are embracing yet another news delivery form; although, the execution of the experiences are still in infancy and often experimental at best (Shin & Biocca, 2017; Sirkku...

Experiences in airports may shape future travel plans and contribute to tourism destination development. However, a chaotic environment and time-consuming procedural routines in airports may result in negative associations towards the host country and its culture. Despite the existence of assistive airport applications, little attention is given to...

It is important to understand how the cultural background, the age and the gender influence the expectations towards social robots. Although past works studied the user adaptation for some months, the users with multiple years of ownership (heavy users) were not subjects of any experiment to compare these criteria over the years. This exploratory r...

CityCompass VR is a collaborative virtual language learning environment that utilizes interactive omnidirectional video (iODV) content. In the application, two remotely located users navigate through cityscapes in order to reach a common goal. One of the users takes the role of a tourist who needs to find a local attraction, and the other one acts...

Tracking the location of people and their mobile devices creates opportunities for new and exciting ways of interacting with public technology. For instance, users can transfer content from public displays to their mobile device without touching it, because location tracking allows automatic recognition of the target device. However, many uncertain...

We present our exploratory work on globally inclusive online collaboration for schoolchildren in India and Finland, using CityCompass, an online virtual navigational application for conversational language learning. User studies with Indian children, who collaborated with a Finnish researcher, showed several barriers towards communication and colla...

Viewing 360° videos on a head-mounted display (HMD) can be an immersive experience. However, viewers must often be guided, as the freedom to rotate the view may make them miss things. We explore a unique, automatic approach to this problem with dynamic guidance methods called social indicators. They use the viewers' gaze data to recognize popular a...

360° videos can be viewed in an immersive manner with a head-mounted display (HMD). However, it is unclear how the viewing experience is affected by basic properties of 360° videos, such as how high they are recorded from, and whether there are people close to the camera. We conducted a 24-participant user study where we explored whether the viewin...

Omnidirectional videos (ODVs) – or 360° videos – are often viewed using a head-mounted display (HMD), allowing users to look around the scene naturally by turning their head. These videos may be populated with visual markers, hotspots, that can contain additional information of points of interest or provide additional functionality. However, optima...

Traveling should be full of excitement and new experiences. However, a chaotic airport environment and constant waiting often halt these pleasurable feelings. Although passengers can spend their time shopping, they are unlikely to connect personally to the products. Furthermore, airport services seldom highlight the local culture that passengers mi...

Virtual reality (VR) is quickly gaining momentum as an immersive medium; however, there is much to learn about the design elements needed to create a positive experience. In this paper, we present the second wave of user testing of a journalistic and cultural VR experience that tells the story of a well-known artist through his art. The storytellin...

We present the lessons learned during the development and evaluation process for UX-sensors, a visual data analytics tool for inspecting logged usage data from flexible manufacturing systems (FMS). Based on the experiences during a collaborative development process with practitioners from one FMS supplier company, we propose guidelines to support o...

In this paper, we build a case for incorporating socio-technical aspirations of different stakeholders, e.g. parents, care-givers, and therapists, to motivate technology acceptance and adoption for children with autism. We base this on findings from two studies at a special school in New Delhi. First, with six children with autism, their parents an...

Although sound event recognition attracted much attention in the scientific community, applications in the robotics domain have not been in the focus. A new database was published in this paper and classifiers were evaluated with this dataset to guide the future practical developments of domestic robots. A corpus (CSIBE-RAW) was collected from the...

With the fourth industrial revolution, Industry 4.0, many work tasks are becoming knowledge intensive. At the forefront of the change are workers that are already mobile, working in the field with customers. We describe the human-centred design process that resulted in the Mobile Service Technician 4.0 concept. The concept illustrates how industria...

Maintaining performance in ubiquitous work environment is increasingly dependent on the quality of physical, cognitive and organizational ergonomics of work. Since digital work environment is the reign of most knowledge workers, there is a need to elaborate the study of work ergonomics by devoting attention to the particular issues of information e...

Our research focuses on facilitating access to cross-cultural collaborative applications for schoolchildren. In this paper, we present two user studies with students from an underprivileged region in Delhi. In the first study, we found that Indian students were hesitant when using the application as compared with Finnish students in a similar study...

Sonification with musical characteristics can engage users, and this dynamic carries value as a mediator between data and human perception, analysis, and interpretation. A user engagement study has been designed to measure engagement levels from conditions within primarily melodic, rhythmic, and chordal contexts. This paper reports findings from th...

We present Pocket Transfers: interaction techniques that allow users to transfer content from situated displays to a personal mobile device while keeping the device in a pocket or bag. Existing content transfer solutions require direct manipulation of the mobile device, making interaction slower and less flexible. Our introduced techniques employ t...

Nine HCI researchers from different cultures, backgrounds, and nationalities came together for two hours to discuss the role of technology in the day-to-day life of nine parents and their children, from Dharavi. The stories shared varied from experiences of parents wanting their children to study more and play videos games less, to a point blank qu...

Gesture interaction provides a multitude of benefits to individuals with developmental disabilities, from enhancing social, motor and cognitive skills to providing a safe and controlled environment for simulating real-world scenarios. As gesture-based applications gain ground in the special education domain, we study their potential in the Indian c...

Omnidirectional video (ODV) provides possibilities for capture and presentation of cultural content for museums and other exhibitions. 360° video capture can record authentic environments and activities, and enables immersive viewing of such material. We resent the potential of ODV by reporting the learnings from long-term user experience data coll...

Interactive omnidirectional video (iODV) is a media format that allows the user to explore and interact with a 360-degree view of the recorded scenery. Recently, novel collaborative applications for presenting iODV content have emerged. Often their goal is to offer as immersive as possible experience to the users. Previous studies suggest that gend...

Despite the recent technological advances, long-term experiments with robots have challenges to keep the users interested after the initial excitement disappears. This paper explores the user expectations by analyzing the long-term owners of Sony AIBO who have been using these robots for years (heavy users). 78 participants filled an on-line questi...

Despite the recent technological advances, long-term experiments with robots have challenges to keep the users interested after the initial excitement disappears. This paper explores the user expectations by analyzing the long-term owners of Sony AIBO who have been using these robots for years (heavy users). 78 participants filled an on-line questi...

Anganwadi workers [1] form the core of healthcare system for a large section of rural and semi-urban population in India. They provide care for newborn babies and play an important role in immunization programs, besides providing health related information to pregnant women. Traditionally these Anganwadi workers use paper based information leaflets...

Government and NGO schools catering to children from low-income urban environments are increasingly introducing technology in the Indian classroom. However, one of the challenges is convincing low-literate parents the potential benefits of technology in education. In this study, we aim to uncover the concerns and expectations of low-income low-lite...

Interactive omnidirectional videos (iODV) can offer informative, entertaining, and immersive experiences, especially when combined with novel platforms such as head-mounted displays. However, omnidirectional videos, and interaction with them, present many unique challenges. In the absence of existing guidelines that accommodate for these challenges...

Omnidirectional video (ODV) is a medium that offers the viewer a 360-degree panoramic video view of the recorded setting. In recent years, various novel platforms for presenting such content have emerged. Many of these applications aim to offer an immersive and interactive experience for the user, but there has been little research on how immersive...

In our study we explored how to design a biography of a late Finnish artist as a VR experience. We conducted a development process assisted by user experience (UX) design methods, which increased the process efficiency, and resulted in a research prototype. Through previous research and our development process, we identified components affecting th...

Virtual Reality (VR) is emerging as a new technological enabler for journalistic storytelling. Leading media companies are investigating how to tell journalistic stories with the help of virtual reality. In the present study we use a lean design thinking based approach to explore VR storytelling for journalism. The case study is based on a recent p...

We present a scalable, semi-automated process for studying the usage of public displays. The process consists of gathering anonymous interaction and skeletal data of passersby during public display deployment and programmatically analyzing the data. We demonstrate the use of the process with the analysis of the Information Wall, a gesture-controlle...

Reproducibility is essential in the testing of robots because verification techniques are required to handle the growing software complexity. This short paper introduces the deterministic test cases (DTCs) for extending the standard testing practices to test incremental changes in behavior-based systems. Recorded sensor data for DTCs and design pat...

The core idea of experience-driven design is to define the intended experience before functionality and technology. This is a radical idea for companies that have built their competences around specific technologies. Although many technology companies are willing to shift their focus towards experience-driven design, reports on real-life cases abou...

Public display deployments are often subjected to various surprising and unwanted effects. These effects are frequently due to external factors properties and phenomena that are unrelated to the deployment. Therefore, we conducted a literature review within the public display domain to investigate the causes behind the reported issues. This work pr...

Mid-air gestures have been largely overlooked for transferring content between large displays and personal mobile devices. To fully utilize the ubiquitous nature of mid-air gestures for this purpose, the authors developed SimSense, a smart space system that automatically pairs users with their mobile devices based on location data. Users can then i...

Gesture-based interaction provides a multitude of benefits to individuals with disabilities, for example, enhancing social, motor and cognitive skills. However, applications that encourage self-efficacy by promoting a life-skill through simulations of real world scenarios are largely missing. We explore the benefits of using a gesture-based applica...

While traditional HCI heuristics can be used to find usability issues also from information visualization systems, specialized heuristics tailored for the information visualization (InfoViz) domain can be more effective and focus on the special characteristics of these systems. In this study, we describe the application of ten information visualiza...

Kirana is a gesture-based application that simulates purchasing experience at a local Indian grocery store. It provides individuals with developmental difficulties a safe and controlled environment to explore the processes of purchasing an item: namely, deciding items to buy (decision making), calculating costs and balance (mathematical skills), an...

New interactive experiences can change the way people experience and perceive public transportation and hence improve its attractiveness. This workshop addresses such interactive experiences in public transportation. The main focus is on new interactive experiences with travel services in public transportation. We invite both practitioners and rese...

Educational games for young children have boomed with the growing abundance of easy to use interfaces, especially on smartphones and tablets. In addition, most major gaming consoles boast of multimodal interaction, including the more novel and immersive gesture-based or bodily interaction; a concept proved by masses of consumers including young chi...

CityCompass promotes collaborative conversational language learning by means of way-findings tasks situated in panoramic views of a city. Two remotely located participants have to navigate these 360 city panoramas as a tourist or a guide, to arrive at a preassigned destination. The application supports three modes of interaction and immersion: trad...

Although process control rooms are advanced digital environments with a multitude of desktop and large displays, there still exists a gap between the interaction technologies being employed in pervasive displays used in other settings and those used in control rooms. Previous research on large displays is extensively geared towards investigating so...

Smart spaces with multiple interactive devices and motion tracking capabilities are becoming more common. However, there is little research on how interaction with one device affects the usage of other devices in the space. We investigate the effects of mobile devices and physical interactive devices on gestural interaction in motion-tracked enviro...