Junehwa Song

Korea Advanced Institute of Science and Technology | KAIST · Department of Computer Science

Situated at the intersection of language, discourse, and communication studies, the present study delves into the dynamics of human-artificial intelligence (AI) interactions. Our study centers on AI-based voice assistants which employ natural language processing to communicate with human users. With a dataset derived from 200 recorded interactions...

Public spaces are created for the convenience of visitors, but frequently, their operation does not match individual visitors' needs. We propose instant social control as a new approach for controlling devices deployed in public spaces, envisioning the democratic and inclusive operation of the spaces. It is an approach to embrace individuals in the...

Rural children in South Korea exhibit higher foreign language anxiety and lower English competency. For such marginalized contexts where local communities cannot support children's learning, we propose and explore a new pedagogical approach, CRAYON (Community-based RelAY Online educatioN). In CRAYON, a pool of non-professional tutors take turns to...

A parent's capacity to understand the mental states of both him/herself and the child is considered to play a significant role in various aspects of parent-child relationship-e.g., lowering parental stress and supporting cognitive development of the child. We propose Dyadic Mirror, a wearable smart mirror which is designed to foster the aforementio...

Wearable sensors are increasingly becoming the primary interface for monitoring human activities. However, in order to scale human activity recognition (HAR) using wearable sensors to million of users and devices, it is imperative that HAR computational models are robust against real-world heterogeneity in inertial sensor data. In this paper, we st...

While having a child is a real blessing, raising the child may require parents to continuously resolve day-to-day conflicts with their child. In this paper, we examine the possibility of a mobile service to help parents deal with the moment of conflict in a peaceful way. Through the consultation with five psychotherapists, we understand the presenc...

Deep-learning (DL) is receiving huge attention as enabling techniques for emerging mobile and IoT applications. It is a common practice to conduct DNN model-based inference using cloud services due to their high computation and memory cost. However, such a cloud-offloaded inference raises serious privacy concerns. Malicious external attackers or un...

Today's smartphone application (hereinafter ‘app’) markets do not provide information on power consumption of apps, which is essential for users. Continuous sensing apps make this problem more severe because significant power is consumed without users' awareness. We propose PowerForecaster to break through such an exhaustive cycle. It provides user...

In this paper, we introduce inertial signals obtained from an earable placed in the ear canal as a new compelling sensing modality for recognising two key facial expressions: smile and frown. Borrowing principles from Facial Action Coding Systems, we first demonstrate that an inertial measurement unit of an earable can capture facial muscle deforma...

In this paper, we propose PrivacyShield, a mobile system for on-demand and selective just-in-time privacy provisioning. PrivacyShield leverages the screen I/O device (screen digitizer) of smartphones to provide gestures (i.e., with phone's screen turned off). Based on subtle gestures, various privacy-protection policies can be configured on-the-fly...

Current in-situ privacy solution approaches are inadequate in protecting sensitive information. They either require extra configuration effort or lack the ability to configure user desired privacy settings. Based on in-depth discussions during a design workshop, we propose PrivacyShield, a mobile system for providing subtle just-in-time privacy pro...

Excerpted from "Card-stunt as a Service: Empowering a Massively Packed Crowd for Instant Collective Expressiveness" from MobiSys 2017, Proceedings of the 15th Annual ACM International Conference on Mobile Systems, Applications, and Services, with permission. https://dl.acm.org/ citation.cfm?id=3081357 © ACM 2017. Imagine a densely packed crowd with...

A mobile GPU constitutes the majority of power consumption on a mobile device and mobile games top as the most popular class of graphics applications. In this demo, we present FROG, a novel frame rate optimization system for mobile gaming applications. FROG makes use of human visual perception to graphics and regulates application's frame rendering...

High-end mobile GPUs are now becoming an integral part of mobile devices. However, a mobile GPU constitutes a major portion of power consumption on the devices, and mobile games top as the most popular class of graphics applications. This paper presents the design and implementation of RAVEN, a novel, on-the-fly frame rate scaling system for mobile...

Consider a massive crowd who gathered together to convey their common voice to public, e.g., supporters of a team sitting together in a stadium, people doing a candlelight vigil in a public square, and so on. Imagine that they hold up their smartphone displays which collectively compose a huge public screen; the crowd's messages are now shown big o...

Imagine a densely packed crowd that gathers to convey a common message, such as people in a candlelight vigil or a protest. We envision an innovation through mobile computing technologies to empower such a crowd by enabling them simply to hold their phones up and create a massive collective visualization on top of them. We propose Card-stunt as a S...

We introduce Zaturi, a system enabling parents to create an audio book for their babies by utilizing micro spare time at work. We define micro spare time at work as tiny fragments of time with low cognitive loads that frequently occur at work, such as waiting for an elevator. We show that putting together micro spare time at work helps a working pa...

Zaturi is a mobile system that enables parents to create an audio book for their children by utilizing their micro spare time. We define micro spare time as tiny fragments of time with low cognitive loads that frequently occur in daily lives, such as waiting for an elevator. Zaturi notifies the parent user of her micro spare time at work in real ti...

Social events such as networking parties are excellent opportunities to expand one's social network and make new social ties, as well as simply have fun and enjoy oneself. With the emergence of pervasive technology, we now have the opportunity to discover face-to-face socializing behaviors of individual guests and support them in their socializing...

In this poster, we propose an emotion analysis method using context information gathered from sensor data. We observe that there are certain situations in which a specific emotion is strongly felt, i.e. dominant. We develop a "scenario-based" approach that focuses on creating such situations with dominant emotion, using a set of context information...

We propose PADA, a new power evaluation tool to measure and optimize power use of mobile sensing applications. Our motivational study with 53 professional developers shows they face huge challenges in meeting power requirements. The key challenges are from the significant time and effort for repetitive power measurements since the power use of sens...

The unique aquatic nature of swimming makes it difficult to use social or technical strategies to mitigate the tediousness of monotonous exercises. In this study, we propose the use of a smartphone-based multiplayer exergame named MobyDick. MobyDick is designed to be played while swimming, where a team of swimmers collaborate to hunt down a virtual...

Excerpted from "PowerForecaster: Predicting Smartphone Power Impact of Continuous Sensing Applications at Pre-Installation Time" from Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems with permission. http://dx.doi.org/10.1145/2809695.2809728 © ACM 2015.

Research shows the critical role of social relationships in behavior change, and the advancement of mobile technologies brings new opportunities of using online social support for persuasive applications. In this paper, we propose Relational Norm Intervention (RNI) model for behavior change, which involves two individuals as a target user and a hel...

We present a place-history-based activity prediction system called Agatha, in order to enable activity-aware mobile services in smart cities. The system predicts a user’s potential subsequent activities that are highly likely to occur given a series of information about activities done before or activity-related contextual information such as visit...

Recently, a number of continuous sensing applications have been actively proposed in research communities and commercially released in the market. However, due to their unique power characteristics, user behavior-dependent battery drain, they bring new challenges for users' power management on these applications. In this demonstration, we present a...

Today's smartphone application (hereinafter 'app') markets miss a key piece of information, power consumption of apps. This causes a severe problem for continuous sensing apps as they consume significant power without users' awareness. Users have no choice but to repeatedly install one app after another and experience their power use. To break such...

Many theories and empirical research show the critical role of social relationships in shaping human behavior. Mobile and persuasive technologies present increased opportunities for affecting people's behavior. We propose the relational intervention model, which provokes a paired helper when the user performs a target behavior. In this demo, we pre...

As an emerging wearable device, a number of commercial smartwatches have been released and widely used. While many people have concerns about the battery life of a smartwatch, there is no systematic study for the main usage of a smartwatch, its battery life, or battery discharging and recharging patterns of real smartwatch users. Accordingly, we kn...

Emerging continuous sensing apps introduce new major factors governing phones' overall battery consumption behaviors: (1) added nontrivial persistent battery drain, and more importantly (2) different battery drain rate depending on the user's different mobility condition. In this paper, we address the new battery impacting factors significant enoug...

In this paper, we introduce a novel smartphone framework called VisitSense that automatically detects and predicts a smartphone user's place visits from ambient radio to enable behavioral targeting for mobile ads in large shopping malls. VisitSense enables mobile app developers to adopt visit-pattern-aware mobile advertising for shopping mall visit...

A mobile apparatus includes a processing planner and a plan processor. The processing planner generates a plurality of resource use plans in response to a context monitoring query (CMQ) of an application, and selects a final plan satisfying a request of the CMQ among the resource use plans. The plan processor executes the final plan. Accordingly, t...

Knowing individuals' relational orientation is imperative for effective offline, as well as online, interactions and collaborations. We use attachment theory to examine the link between Facebook users' relational orientation (in terms of attachment styles: anxiety and avoidance) and their relational activities. Our research examines whether and how...

Our preliminary study reveals that individuals use various management strategies for limiting smartphone use, ranging from keeping smartphones out of reach to removing apps. However, we also found that users often had difficulties in maintaining their chosen management strategies due to lack of self-regulation. In this paper, we present NUGU, a gro...

Continuous mobile sensing applications are emerging. Despite their usefulness, their real-world adoption has been slow. Many users are turned away by the drastic battery drain caused by continuous sensing and processing. In this paper, we propose CoMon+, a novel cooperative context monitoring system, which addresses the energy problem through oppor...

Finding a missing child is an important problem concerning not only parents but also our society. It is essential and natural to use serendipitous clues from neighbors for finding a missing child. In this paper, we explore a new architecture of crowd collaboration to expedite this mission-critical process and propose a crowd-sourced cooperative mob...

Mobile instant messengers serve as major interaction media for everyday chats. Contrary to the belief that a message is seen only by a designated receiver, it can be accidentally exposed to someone nearby and could result in embarrassing moments, for example, when the receiver is viewing pictures together with his friend upon the message arrival. T...

The negative aspects of smartphone overuse on young adults, such as sleep deprivation and attention deficits, are being increasingly recognized recently. This emerging issue motivated us to analyze the usage patterns related to smartphone overuse. We investigate smartphone usage for 95 college students using surveys, logged data, and interviews. We...

Exergame controllers are intended to add fun to monotonous exercise. However, studies on exergame controllers mostly focus on designing new controllers and exploring specific application domains without analyzing human factors, such as performance, comfort, and effort. In this paper, we examine the characteristics of a speed-based exergame controll...

Recent advances of social TV services allow sports fans to watch sports games at any place and to lively interact with other fans via online chatting. Despite their popularity, however, so far little is known about the key properties of such mass interactions in online sports viewing. In this paper, we explore motives for mass interactions in onlin...

Fine-grained place logging with Wi-Fi beacon signatures provides a useful tool for delivering various semantic location-aware services such as reminders and advertisements. Existing solutions however heavily rely on energy-hungry periodic Wi-Fi scanning for place detection in resource limited mobile devices. In this paper, we present PlaceWalker, a...

In this paper, we present Orchestrator, an active resource orchestration framework for a PAN-scale sensor-rich mobile computing platform. Incorporating diverse sensing devices connected to a mobile phone, the platform will serve as a common base to accommodate personal context-aware applications. A major challenge for the platform is to simultaneou...

Smart devices are supporting emerging types of location-based gaming applications to attain collaborations among collocated users in public places like transports. However, they are facing many challenges like the timely performance of back-end game servers for runtime game operation, unreliable cellular network connections, and opportunistic and d...

In this paper, we propose Sinabro, an opportunistic and unobtrusive mobile electrocardiogram (ECG) monitoring system that monitors the user's ECG opportunistically during daily smartphone use. Daily ECG monitoring will open up an unprecedented opportunity for pervasive healthcare applications. It will enable the daily detection and prevention of he...

In this video, we present TalkBetter [3] 1 , a smartphone-supported intervention care service in everyday family conversations for children with language delay. We briefly introduce the problem and risks of early language delay, and emphasize the clinical implication in stimulating the children's language in everyday family conversation. We address...

Language delay is a developmental problem of children who do not acquire language as expected for their chronological ages. Without timely intervention, language delay can act as a lifelong risk factor. Speech-language pathologists highlight that effective parent participation in everyday parent-child conversation is important to treat children's l...

Contentious news issues, such as the health care reform debate, draw much interest from the public; however, it is not simple for an ordinary user to search and contrast the opposing arguments and have a comprehensive understanding of the issues. Providing a classified view of the opposing views of the issues can help readers easily understand the...

This issue of MC2R features the posters and demonstrations submitted to ACM HotMobile 2013.

This paper presents a novel customer malling behavior modeling framework for an urban shopping mall. As an automated computing framework using smartphones, it is designed to provide comprehensive understanding of customer behavior. We prototype the framework in a real-world urban shopping mall. Development consists of three steps; customer data col...

Lifelogging services are emerging as promising mobile applications, pursuing to build a user's autobiographical memories. To date, initial attempts of lifelogging services have been proposed, capturing what I see, hear, meet, and visit. These empirical and environmental contexts, surrounding contexts, may help a user reminisce about the past. On th...

We propose Dungeons & Swimmers, an interactive audio- and motion-based exergame for swimming. As the first of its kind, we explore its design considerations and opportunities stemming from swimming. We gamify the four different stroke types with an auditory feedback. For minimal interference, we develop a single sensor-based wearable prototype dete...

In this paper, we propose SocioPhone, a novel initiative to build a mobile platform for face-to-face interaction monitoring. Face-to-face interaction, especially conversation, is a fundamental part of everyday life. Interaction-aware applications aimed at facilitating group conversations have been proposed, but have not proliferated yet. Useful con...

Vehicular environments require continuous awareness of the road ahead. It is critical that mobile applications used in such environments (e.g., GPS route planners and location-based search) do not distract drivers from the primary task of operating the ...

Local journalism is a vital element for governance and civic engagement in local communities. It not only serves as an accountability mechanism for key local institutions but also enhances communities' problem solving skills by setting important agendas and opening public discussions. However, the Internet is posing serious challenges to local news...

As users are interacting with a large of mobile apps under various usage contexts, user involvements in an app design process has become a critical issue. Despite this fact, existing apps or app store platforms only provide a limited form of user involvements such as posting app reviews and sending email reports. While building a unified platform f...

Social exergames provide immersive experiences of social interaction via online multiplayer games, ranging from simple group exercises (e.g., virtual cycling/rowing) to more structured multiplayer games (e.g., cooperative boat racing). In exergame design, interpersonal synchrony plays an important role as it enhances social rapport and pro-social b...

Social exergames provide immersive experiences of social interaction via online multiplayer games, ranging from simple group exercises (e.g., virtual cycling/rowing) to more structured multiplayer games (e.g., cooperative boat racing). In exergame design, interpersonal synchrony plays an important role as it enhances social rapport and pro-social b...

Our goal is to show that it is possible to automatically infer social relationship types among people who stay together in an organization by analyzing communication patterns. We collected indoor co-location data and instant messenger data from 22 participants for one month. Based on the data, we designed and explored several indicators which are c...

Emerging mobile sensing applications are changing the characteristics of smartphone workloads. Whereas typical mobile applications run alone in the foreground interacting with users, sensing applications concurrently run in the background, providing unobtrusive monitoring services. Such concurrent sensing workloads raise a new challenge incurring s...

In this paper, we propose an in-situ Crowd-aware Sensing Platform, called "CrowdMon", which envisions the cooperation among mobile users in highly crowded urban areas such as metro and square. CrowdMon establishes a spontaneous connection from co-located users in a semantic proximity and enables them to share contextual information such as location...

We demonstrate PosFree, a platform supporting posture-free motion-based mobile games. It allows the developers to support diverse postural gameplay contexts in the motion-based mobile games, without much knowledge on the specific characteristics of motion sensors with respect to posture changes. It detects orientation of mobile devices at runtime a...

On school field trips, chaperoning teachers' foremost con-cern is the safety of the children, particularly ensuring that none of them go missing. However, they have limited atten-tion resources and face many challenges in keeping track of their charges. We present RubberBand, an assistive applica-tion that helps alleviate the teacher's burden. Our...

In this paper, we propose a new class of message routing scheme for a distributed network which can scale up to the needs of a very large number of mobile users. We leverage the work in the GeoKad paper which uses the Distributed Geographic Table, allowing node retrieval from resources that are close to any given region. The paper addresses the pro...

Emerging pervasive games will be immersed into real-life situations and leverage new types of contextual interactions therein. For instance, a player's punching gesture, running activity, and fast heart rate conditions can be used as the game inputs. Although the contextual interaction is the core building blocks of pervasive games, individual game...

Mobile sensing applications (MS apps) are coming into the spotlight as next generation applications on smartphones. These applications continuously monitor a user’s situational contexts using mobile sensors and provide the user with proactive services. To prevent obesity and help weight control, for instance, the smartphone can track daily calories...

Mobile applications that sense continuously, such as location monitoring, are emerging. Despite their usefulness, their adoption in real-world deployment situations has been extremely slow. Many smartphone users are turned away by the drastic battery drain caused by continuous sensing and processing. Also, the extractable contexts from the phone ar...

We envision that diverse social exercising games, or exergames, will emerge, featuring much richer interactivity with immersive game play experiences. Further, the recent advances of mobile devices and wireless networking will make such social engagement more pervasive - people carry portable exergame devices (e.g., jump ropes) and interact with re...

We demonstrate a pervasive social exergame platform called ExerLink that converts exercise intensity to game inputs and intelligently balances intensity/delay variations for fair game play experiences. Also, we show the potential of using multiple exercise devices as game controllers and incorporating multiple heterogeneous controllers into a game....

The behavior observations on young children in new, first-in-the-life environments have significant implications. We can often uniquely observe a child's unforeseen interaction with the environment and peer-children. It would be not only a piece of discovery but a beginning of an open quest worth exploring. Out-of-classroom activities like kinderga...

Bias in the news media is an inherent flaw of the news production process. The bias often causes a sharp increase in political polarization and in the cost of conflict on social issues such as the Iraq war. This article presents NewsCube, a novel Internet news service which aims to mitigate the effect of media bias. NewsCube automatically creates a...

In this demonstration, we will show MobiCon, a context monitoring platform; it runs over smartphones and sensor OSs, and facilitates development and deployment of everyday context-aware applications. For many years, lots of research efforts have been made in building low-cost, yet effective sensor networks for various application domains such as st...

In this paper, we introduce Activity Travel Pattern (ATP) monitoring in a large-scale city environment. ATP represents where city residents and vehicles stay and how they travel around in a complex megacity. Monitoring ATP will incubate new types of value-added services such as predictive mobile advertisement, demand forecasting for urban stores, a...

User context is defined by data generated through everyday physical activity in sensor-rich, resource-limited mobile environments.

In this paper, we propose a novel efficient dataflow execution method for mobile context monitoring applications. As a key approach to minimize the execution overhead, we propose a new dataflow execution model, producer-oriented model. Compared to the conventional consumer-oriented model adopted in stream processing engines, our model significantly...

This paper discusses an approach for transforming solitary exercises into social exergames. We frame our discussion by highlighting the relation between the original exercises and game interactions, and by analyzing an example exergame which is successfully transformed from its original solitary exercise. We present a user study of the exergame tha...