Tomi Heimonen

Tomi Heimonen
University of Wisconsin - Stevens Point | UWSP · Department of Computing and New Media Technologies (CNMT)

Ph.D.

About

71
Publications
10,193
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
796
Citations
Introduction
I teach Human-Technology Interaction and study UX design, multimodal interaction and pervasive information access.
Additional affiliations
August 2015 - present
University of Wisconsin - Stevens Point
Position
  • Professor (Assistant)
Description
  • Teach courses and carry out out research on human-technology interaction.
January 2013 - September 2015
Tampere University
Position
  • PostDoc Position
June 2007 - August 2007
Google Inc.
Position
  • User Experience Researcher Intern
Education
May 2004 - December 2012
Tampere University
Field of study
  • Interactive Technology
September 1997 - January 2004
Tampere University
Field of study
  • Computer Science

Publications

Publications (71)
Article
Full-text available
We present a scalable, semi-automated process for studying the usage of public displays. The process consists of gathering anonymous interaction and skeletal data of passersby during public display deployment and programmatically analyzing the data. We demonstrate the use of the process with the analysis of the Information Wall, a gesture-controlle...
Conference Paper
Full-text available
Public display deployments are often subjected to various surprising and unwanted effects. These effects are frequently due to external factors properties and phenomena that are unrelated to the deployment. Therefore, we conducted a literature review within the public display domain to investigate the causes behind the reported issues. This work pr...
Conference Paper
Full-text available
Much work remains to be done with subjective evaluations of speech-based and multimodal systems. In particular, user experience is still hard to evaluate. SUXES is an evaluation method for collecting subjective metrics with user experiments. It captures both user expectations and user experiences, making it possible to analyze the state of the appl...
Article
The key prerequisite for experience-driven design is to define what experience to design for. User experience (UX) goals concretise the intended experience. Based on our own case studies from industrial environments and a literature study, we propose five different approaches to acquiring insight and inspiration for UX goal setting: Brand, Theory,...
Conference Paper
The core idea of experience-driven design is to define the intended experience before functionality and technology. This is a radical idea for companies that have built their competences around specific technologies. Although many technology companies are willing to shift their focus towards experience-driven design, reports on real-life cases abou...
Article
Full-text available
Background Mobile augmented reality (MAR) apps offer potential support for emergency responders in rural areas. Objective In this report, we described lessons learned from the development process of augmented reality (AR) Farm Mapping to Assist, Protect and Prepare Emergency Responders (MAPPER), a MAR app that provides emergency responders onsite...
Preprint
Full-text available
BACKGROUND Injury data and reports provide valuable information for both public and private organizations to guide programming, policy, and prevention, but in the increasingly complex and dangerous industry of U.S. agriculture, the injury surveillance needed to produce this data is lacking. To address the gap, AgInjuryNews.org was established in 20...
Article
Full-text available
Background: Injury data and reports provide valuable information for both public and private organizations to guide programming, policy, and prevention, but in the increasingly complex and dangerous industry of US agriculture, the injury surveillance needed to produce this data is lacking. To address the gap, AgInjuryNews was established in 2015....
Conference Paper
We present the lessons learned during the development and evaluation process for UX-sensors, a visual data analytics tool for inspecting logged usage data from flexible manufacturing systems (FMS). Based on the experiences during a collaborative development process with practitioners from one FMS supplier company, we propose guidelines to support o...
Preprint
Full-text available
UNSTRUCTURED Introduction: Mobile augmented reality (MAR) applications offer support for emergency responders in rural areas. We describe the lessons learned from the development process of AR MAPPER, a MAR app that provides emergency responders onsite information about the agricultural operation they enter. Methods: Cross-platform frameworks were...
Conference Paper
Full-text available
Maintaining performance in ubiquitous work environment is increasingly dependent on the quality of physical, cognitive and organizational ergonomics of work. Since digital work environment is the reign of most knowledge workers, there is a need to elaborate the study of work ergonomics by devoting attention to the particular issues of information e...
Conference Paper
Our research focuses on facilitating access to cross-cultural collaborative applications for schoolchildren. In this paper, we present two user studies with students from an underprivileged region in Delhi. In the first study, we found that Indian students were hesitant when using the application as compared with Finnish students in a similar study...
Article
Gesture interaction provides a multitude of benefits to individuals with developmental disabilities, from enhancing social, motor and cognitive skills to providing a safe and controlled environment for simulating real-world scenarios. As gesture-based applications gain ground in the special education domain, we study their potential in the Indian c...
Conference Paper
Full-text available
Maintaining performance in ubiquitous work environments is increasingly dependent on the quality of physical, cognitive and organizational ergonomics of work. Since most knowledge workers operate in digital work environments, there is a need to elaborate the study of work ergonomics particularly with respect to information ergonomics in the field o...
Article
Full-text available
This article introduces user experience research that has been carried out by evaluating a video-illustrated science fiction prototype with process control workers. Essentially, the prototype 'A remote operator's day in a future control center in 2025' was aimed at discovering opportunities for new interaction methods and ambient intelligence for t...
Conference Paper
Gesture-based interaction provides a multitude of benefits to individuals with disabilities, for example, enhancing social, motor and cognitive skills. However, applications that encourage self-efficacy by promoting a life-skill through simulations of real world scenarios are largely missing. We explore the benefits of using a gesture-based applica...
Conference Paper
While traditional HCI heuristics can be used to find usability issues also from information visualization systems, specialized heuristics tailored for the information visualization (InfoViz) domain can be more effective and focus on the special characteristics of these systems. In this study, we describe the application of ten information visualiza...
Conference Paper
Kirana is a gesture-based application that simulates purchasing experience at a local Indian grocery store. It provides individuals with developmental difficulties a safe and controlled environment to explore the processes of purchasing an item: namely, deciding items to buy (decision making), calculating costs and balance (mathematical skills), an...
Conference Paper
This paper introduces video-illustrated science fiction prototype 'Remote operator's day in a future control center in 2025' that aimed at discovering opportunities for new interaction methods and smart automation for the future process control work. The theoretical objective was to carry out experience design research in an industrial work context...
Conference Paper
Although process control rooms are advanced digital environments with a multitude of desktop and large displays, there still exists a gap between the interaction technologies being employed in pervasive displays used in other settings and those used in control rooms. Previous research on large displays is extensively geared towards investigating so...
Conference Paper
There exists mounting evidence in favor of computer supported autism interventions at the individual level. However, the potential benefits of using computer supported collaboration to encourage social interactions between individuals with autism and typically developed individuals are underexplored, particularly in developing regions. We present a...
Article
Tässä artikkelissa esitellään elekäyttöliittymien tarjoamia mahdollisuuksia ihmisen ja teknologian välisessä vuorovaikutuksessa. Eleet ovat viime vuosina tulleet osaksi arkikäyttöä lähinnä videopelien kautta. Muunlaisessa käytössä, esimerkiksi julkisilla paikoilla ja ammattilaissovelluksissa, elekäyttöliittymät ovat niiden hyödyntämättömän potentia...
Conference Paper
There exists a large base of evidence for gender differences in human navigation. However, there is not much research on gender differences in collaborative aspects of navigation, including the interaction of individuals during collaborative wayfinding tasks in virtual environments. In light of this, we present a study of a collaborative virtual en...
Article
Full-text available
We introduce a new architecture for e-textbooks which contains two navigational aids: an index and a concept map. We report results from an evaluation in a university setting with 99 students. The interaction sequences of the users were captured during the user study. We found several clusters of user interaction types in our data. Three separate u...
Conference Paper
The case study presented in this paper aimed at discovering opportunities for ambient intelligence and new interaction methods for a future remote crane-operating environment. The theoretical objective was to carry out an experience-driven research project in an industrial work context, and the practical objective was to create and evaluate a futur...
Conference Paper
Industrial maintenance is a complex and knowledgeintensive field. Therefore, maintenance technicians need to have easy access to versatile and situationally relevant knowledge. The aim of this paper is to increase the understanding of maintenance technicians’ interactions and knowledge sharing with colleagues and technology during maintenance work....
Chapter
One of the challenges with designing effective mobile search interfaces is how to present and explore the search results. Category-based result organization and presentation techniques have been suggested in literature as a complement to the traditional ranked result list. In the mobile context categories can facilitate information access by provid...
Conference Paper
Full-text available
Public displays that allow users to interact with them through mid-air gestures are still relatively rare, as many applications rely on touch-based interaction. This paper introduces Information Wall, a gesture-controlled public information display that provides multi-user access to contextually relevant local information using remote pointing and...
Conference Paper
Full-text available
This paper outlines the design and development process of the Dynamic Audio Motion (Dynamo) concept. The Dynamo audio engine was developed for driving dynamic sound interaction states via custom made finite state machine. Further, a generative sound design approach was employed for creating sonic and musical structures. Designed dynamic sound inter...
Conference Paper
This paper outlines the design and development process of the Dynamic Audio Motion (Dynamo) concept. The Dynamo audio engine was developed for driving dynamic sound interaction states via custom made finite state machine. Further, a generative sound design approach was employed for creating sonic and musical structures. Designed dynamic sound inter...
Conference Paper
Understanding the use of public display applications is critical to their successful design. Public displays are typically evaluated in field studies and deployments, where the usage analysis is often based on quantitative metrics and observation-based descriptive models. As an alternative approach, we propose the use of automated analysis methods...
Conference Paper
Full-text available
Bodily movements have traditionally had mostly instrumental value in interaction design. However, movements can also be given a central role in understanding behaviour and in designing technology for humans. This workshop is aiming at taking a fresh, movement-oriented look at the design and evaluation of technology in a wide variety of contexts.
Conference Paper
We present a study of using embodied health information system for developing regions focusing on users not familiar with technology. We designed and developed a health information system with two gesture-based selection techniques: pointing to a screen and touching one's own body part. We evaluated the prototype in user study with 37 semi-literate...
Article
Motivated by the troubling news on decreased exercise amount and increased obesity among children and adolescents, we investigated the possibilities of interactive lighting technology in encouraging children to participate in physical exercise in schools. We have created a story-driven physical exercise game based on light and sound utilizing a rea...
Conference Paper
Full-text available
We present the magnetic cursor, a technique that aims to make distant freehand interaction with targets easier in large-screen public display applications. The magnetic cursor automatically warps to a selectable object that is close by, moves slower while on the object, and shows the relative cursor location visually to the user. Two designs of the...
Conference Paper
Studying pervasive systems in the wild has recently gained significant interest. However, few methods exist that focus on the subjective of user experience of such systems rather than objective metrics, like performance and task success. Especially multimodal interaction in this context poses challenges to understanding how different input and outp...
Conference Paper
In Virtual Learning Environments efficient navigation is a major issue, especially when it is used as a component in the learning process. This paper addresses the challenges in creating meaningful navigation routes from language learning perspective. The work is grounded on findings from a specific case on German language learning, wherein two rem...
Conference Paper
We present a location-based collaborative mobile learning platform called Seek'N'Share. It is comprised of a Web-based learning assignment editor and a mobile application for exploring and capturing multimedia content in the field. The editor enables drag-and-drop creation of learning tasks, areas and points of interest using an intuitive Web inter...
Conference Paper
Full-text available
Lighting has become an integral element in interactive environments as a result of advances in LED and home automation technology. New models for controlling diverse sets of lighting fixtures are needed. Traditional lighting control, where users manipulate the state of individual light fixtures, is not efficient or expressive in situations where a...
Conference Paper
Large-scale public events, such as conferences are becoming increasingly interactive with tools to support Web-based and mobile access to the event program. Multimodal interoperable devices can further improve the event experience. This paper introduces a multi-device, multimodal and multi-user conference program guide (M3PG), which provides access...
Conference Paper
This paper introduces a novel concept to support people flow in complex built environments focusing on mobile interaction with elevators. With the developed mobile application, users can indicate in advance where they are going, while the application handles corresponding elevator calls and informs the user at appropriate times. The application can...
Conference Paper
Full-text available
We report the development and evaluation of a gesture-based interaction prototype for controlling the loading station of a factory automation system. In this context, gesture-based interaction has the potential to free users from the tedious physical controls but it must also account for safety considerations and users’ perceptions. We evaluated th...
Conference Paper
While various recommender approaches are increasingly considered in e-learning, lack of studies of actual use is hindering the development. For several years, we have used non-algorithmic recommender features on an undergraduate course website to help students find pertinent study materials. As students earn credit from adding and evaluating materi...
Conference Paper
Full-text available
We introduce a novel, experiential event guide application for serendipitous exploration of event information on public displays. The application is targeted for complex events, such as cultural festivals, which include a large amount of individual events in numerous geographical locations. The application consists of two interfaces, both used in a...
Conference Paper
We have created story-based exercise games utilizing light and sound to encourage children to participate in physical exercise in schools. Our reasonably priced technological setup provides practical and expressive means for creating immersive and rich experiences to support physical exercise education in schools. Studies conducted in schools showe...
Thesis
Mobile Web search is a rapidly growing information seeking activity employed across different locations, situations, and activities. Current mobile search interfaces are based on the ranked result list, dominant in desktop interfaces. Research suggests that new paradigms are needed for better support of mobile searchers. For this dissertation, two...
Article
Persons with intellectual disabilities benefit from participating in the modern information society, especially the World Wide Web, social media and Internet-mediated communication services. Although several computer-based prototypes and commercial systems have been introduced for accessible in-person communication, currently few applications and s...
Conference Paper
We introduce a multimodal picture-based communication platform for users with intellectual disabilities, and results from our user evaluation carried out with the target user group representatives and their assistants. Our current prototype is based on touchscreen input and symbol and text-to-speech output, but supports also mouse and keyboard inte...
Article
Category-based search result organization holds promise as a means of facilitating mobile information access. This paper presents the results of a longitudinal user study that investigated how a mobile clustering interface is used to search the Web. The author describes the participants’ search behavior and discusses the benefits and limitations of...
Conference Paper
Full-text available
In this paper, we introduce software architecture for interactive lighting applications. The architecture is based on a layered model where the low-level control of lighting hardware is separated froma spatial model and the application logic that integrate user interactions. We provide a detailed description of the design of the different layers an...
Article
We present a multimodal media center interface designed for blind and partially sighted people. It features a zooming focus-plus-context graphical user interface coupled with speech output and haptic feedback. A multimodal combination of gestures, key input, and speech input is utilized to interact with the interface. The interface has been develop...
Conference Paper
Awareness of shared work activities is important for fostering professional relationships. This paper introduces visualization techniques for a meeting support system based on automatic speech recognition and multisensory meeting information capture, including voice levels and participant comments. The system has been deployed in live meetings over...
Conference Paper
Full-text available
In this paper, we present the key lessons learnt from numerous evaluations conducted to measure the quality of spoken and multimodal applications. The issues we address include the relation of laboratory and field studies, long-term and pilot evaluations, unimodality and multimodality, objective and subjective metrics, and user expectations and exp...
Conference Paper
Full-text available
We present a multimodal media center interface based on speech input, gestures, and haptic feedback (hapticons). In addition, the application includes a zoomable context + focus GUI in tight combination with speech output. The resulting interface is designed for and evaluated with different user groups, including visually and physically impaired us...
Conference Paper
Full-text available
We demonstrate interaction with a multimodal media center application. Mobile phone-based interface includes speech and gesture input and haptic feedback. The setup resembles our long-term public pilot study, where a living room environment containing the application was constructed inside a local media museum allowing visitors to freely test the s...
Conference Paper
Full-text available
Parallel coordinates is a visualization technique that provides an unbiased representation of high-dimensional data. The parallel configuration of axes treats data dimensions uniformly and is well suited for exploratory visualization. However, first-time users of parallel coordinate visualizations can find the representation confusing and difficult...
Conference Paper
Mobile Web search engines represent retrieved results using primarily text based result surrogates. Users could benefit from information visualization techniques that provide more information about the results as basis of relevance judgments. We present a query-biased visualization approach that incorporates query occurrence visualization into the...
Conference Paper
We present a multimodal media center user interface with a hands-free speech recognition input method for users with physical disabilities. In addition to speech input, the application features a zoomable context + focus graphical user interface and several other modalities, including speech output, haptic feedback, and gesture input. These feature...
Conference Paper
Understanding mobile information needs and how these needs are addressed is essential in developing mobile information services. We conducted a four-week diary study with experienced and active mobile Internet users, focusing on the physical and situational contexts of their mobile information needs and the information access practices used to fulf...
Conference Paper
Home environment is an exciting application domain for multimodal mobile interfaces. Instead of multiple remote controls, personal mobile devices could be used to operate home entertainment systems. This paper reports a subjective evaluation of multimodal inputs and outputs for controlling a home media center using a mobile phone. A within-subject...
Conference Paper
We present a multimodal media center interface based on speech input, gestures, and haptic feedback. For special user groups, including visually and physically impaired users, the application features a zoomable context + focus GUI in tight combination with speech output and full speech-based control. These features have been developed in cooperati...
Article
Full-text available
Designing an effective mobile search user interface is challenging, as interacting with the results is often complicated by the lack of available screen space and limited interaction methods. We present Mobile Findex, a mobile search user interface that uses automatically computed result clusters to provide the user with an overview of the result s...
Conference Paper
We present initial results from an evaluation of a multimodal in- terface for a mobile route guidance application providing public transport information in Finland. The application includes a range of input and output modalities, such as speech input and output, a fisheye GUI, and contextual predictive text input. The application has been in public...
Conference Paper
Designing an effective mobile search user interface is challenging, as interacting with the results is often complicated by the lack of available screen space and limited interaction methods. This paper presents Mobile Findex; a mobile search user interface that uses automatically computed categories to present the user with an overview of the resu...
Conference Paper
The result lists of popular Web search engines represent retrieved documents with only a title, a brief textual summary and a URL. We present a novel approach that incorporates visualization into the conventional search result interface. For each resulting document, occurrences of the entire query are concisely depicted in the form of a small, docu...
Article
The amount of information is increasing rapidly all the while the devices with which to access the information are shrinking in size. This leads to a problem of presentation: how to display the growing amounts of information effectively on small displays. This thesis introduces a number of information visualization techniques as solutions to the...
Article
Full-text available
Information access and information sharing are two important features in supporting work groups and groupwork. There are a large number of systems proving these functions. However, existing systems often support only few types of terminal devices when users now have a variety of them: WAP phones and terminals, PDA devices, and desktop and portable...

Network