Sri Kurniawan's research while affiliated with University of California, Santa Cruz and other places

Publications (165)

Article
Full-text available
Project-based learning (PBL) has long been recognized as an effective way to teach complex biology concepts. However, not all institutions have the resources to facilitate effective project-based coursework for students. We have developed a framework for facilitating PBL using remote-controlled internet-connected microscopes. Through this approach,...
Preprint
Full-text available
Project-based learning (PBL) has long been recognized as an effective way to teach complex biology concepts. However, not all institutions have the resources to facilitate effective project-based coursework for students. We have developed a framework for facilitating PBL using remote-controlled internet-connected microscopes. Through this approach,...
Conference Paper
Full-text available
Amblyopia is the most common neurological eye disorder worldwide, decreasing vision in approximately 1-5% of the global population. To reduce this loss of visual acuity, occlusion therapy is often beneficial for people with Amblyopia, yet this conventional rehabilitation method often suffers from low compliance and adherence rates due to its repeti...
Article
Full-text available
Many recent breakthroughs in medical diagnostics and drug discovery arise from deploying machine learning algorithms to large-scale data sets. However, a significant obstacle to such approaches is that they depend on high-quality annotations generated by domain experts. This study develops and evaluates BioLumin, a novel immersive mixed reality env...
Article
Full-text available
Most physical therapists would agree that physical rehabilitation is difficult to perform remotely. Consequently, the global COVID-19 pandemic has forced many physical therapists and their clients to adapt to telehealth, especially with video conferencing. In this article, we ask: How has telehealth for physical rehabilitation evolved with the glob...
Conference Paper
Full-text available
Robots are being taught by increasingly broader populations of people who provide training data for machine learning algorithms. Many studies over the past decade have begun demonstrating reproducible robot teaching methodologies and have highlighted benefits in human-robot interaction (HRI). However, there have been few investigations about what i...
Article
Full-text available
Objective: The adoption of telehealth rapidly accelerated due to the global COVID19 pandemic disrupting communities and in-person healthcare practices. While telehealth had initial benefits inenhancing accessibility for remote treatment, physical rehabilitation has been heavily limited due to the lossof hands-on evaluation tools. This paper present...
Conference Paper
Full-text available
We present a novel Unity Game Engine experience, GlobeVR, which leverages an immersive globe to navigate the spread of COVID-19 cases, deaths, and recoveries through a head-mounted display system. We examine GlobeVR through a pilot study involving eight users where we measure task performance , emotional response, system usability, task-load, prese...
Conference Paper
Full-text available
Genome graphs, a new frontier of genomics, have begun to redefine how we approach the reference genomes. These spatial representations of genetic variation are an important step forward in capturing the genetic diversity of life, but are visually challenged by highly variable regions. To make complex graph genomes usable towards visualization, we p...
Conference Paper
Full-text available
There is an open call for technology to be more playful and for the design of tech to be more inclusive of people with disabilities. In the era of COVID19, it is often unsafe for the public in general and people with disabilities in particular to engage in in-person design exercises using traditional methods. This presents a missed opportunity as t...
Conference Paper
Full-text available
Haptic feedback vests afford a unique opportunity to enhance a user’s emotional engagement within the virtual world. In this paper, we present a two-stage study on user experience towards understanding emotional expression through utilizing the Pleasure-Arousal-Dominance model and the International Affective Picture System. We examine an authoring...
Article
Full-text available
Immersive Virtual Reality (iVR) Head-Mounted Display (HMD) systems paired with serious exercise games can positively augment physical rehabilitation process from both engagement and analytics perspectives. This paper presents a serious game for iVR HMD based long term upper-extremity exercise. We demonstrate the capabilities of our game through a c...
Article
Full-text available
Individuals with Autism Spectrum Disorder (ASD) often have visual-motor coordination problems, which may affect their independence. Exergames, videogames that involve physical exertion, had been proven to support visual-motor coordination of individuals with ASD, as they can offer an interactive technological experience to engage them in different...
Article
Full-text available
Physical rehabilitation is often an intensive process that presents many challenges, including a lack of engagement, accessibility, and personalization. Immersive media systems enhanced with physical and emotional intelligence can address these challenges. This review paper links immersive virtual reality with the concepts of therapy, human behavio...
Conference Paper
Full-text available
Immersive Virtual Reality applied to exercise games has a unique potential to both guide and motivate users in performing physical exercise. Advances in modern machine learning open up new opportunities for more significant intelligence in such games. To this end, we investigate the following research question: What if we could train a virtual robo...
Conference Paper
Full-text available
Studies show that adults with developmental disabilities are often at risk of being targets of abuse. With little supporting resources available for both adults and their caretakers on identifying relationship boundaries, victimization rates are consistently and alarmingly high. This study aims to explore the gamification of behavioral learning to...
Article
Full-text available
Upper limb injury often requires repetitive and long-term physical rehabilitation which can result in low adherence due to the repetitive and internally motivated nature of the exercises. Immersive Virtual Reality (iVR) systems enhanced with games can address these challenges. These systems provide a platform for adaptable sensing and analytical to...
Conference Paper
Full-text available
We present a novel approach for fabricating cable-driven robotic systems. Particularly, we show that a biomimetic finger featuring accurate bone geometry, ligament structures, and visco-elastic tendons can be synthesized as a single part using a mutli-material 3D printer. This fabrication method eliminates the need to engineer an interface between...
Article
Full-text available
Inactivity and a lack of engagement with exercise is a pressing health problem in the United States and beyond. Immersive Virtual Reality (iVR) is a promising medium to motivate users through engaging virtual environments. Currently, modern iVR lacks a comparative analysis between research and consumer-grade systems for exercise and health. This pa...
Conference Paper
Full-text available
Therapy can be costly, time-consuming, repetitive, and difficult. Games have the power to teach transferable skills, can turn repetitive tasks into engaging mechanics, have been proven to be effective at delivering various forms of therapy, and can be deployed at large scales. Therapy games represent fertile ground for connected learning. In this w...
Conference Paper
Amblyopia, or "lazy eye" is the world's most common neurological eye disorder. Yet, very little has been done looking into how to make virtual reality (VR) more usable for people with Amblyopia. Furthermore, a trend of using VR for Amblyopia therapy has arisen, making such a study more essential than ever. Our study asks our user base of people wit...
Conference Paper
Full-text available
Previous studies and video games have shown that human spatial reasoning is flexible and can naturally accommodate non-Euclidean spaces. In particular, hyperbolic space has been an effective interface for navigating large, complex datasets. In this study, we seek to test human navigation of hyperbolic space through an immersive virtual reality (VR)...
Chapter
Between 2015 and 2050, the proportion of the world’s population over 60 years will nearly double from 12 to 22%. Maintaining a high quality of life for these people has become an important issue throughout the world. The Web has been shown to have a positive experience on the quality of life and well-being of older adults, by assisting them to main...
Conference Paper
Full-text available
In this paper, we explore how sonic features can be used to represent network data structures that define relationships between elements. Representations of networks are pervasive in contemporary life (social networks, route planning, etc), and network analysis is an increasingly important aspect of data science (data mining, biological modeling, de...
Conference Paper
Full-text available
Immersive Virtual Reality paired with soft robotics may be synergized to create personalized assistive therapy experiences. Virtual worlds hold power to stimulate the user with newly instigated low cost, high-performance commercial Virtual Reality (VR) devices to enable engaging and accurate physical therapy. Soft robotic wearables are a versatile...
Conference Paper
Adults with developmental disabilities (DD) might have visual-motor coordination problems, which may affect their independence. Exergames, videogames that involve physical exertion, can support visual-motor coordination of adults with DD, as they can offer an interactive technological experience to engage them in different motor tasks. In this pape...
Article
Full-text available
Modern immersive virtual reality experiences have the unique potential to motivate patients undergoing physical therapy for performing intensive repetitive task-based treatment and can be utilized to collect real-time user data to track adherence and compliance rates. This article reports the design and evaluation of an immersive virtual reality ga...
Conference Paper
Full-text available
Music therapy is utilized worldwide to connect communities, strengthen mental and physiological wellbeing, and provide new means of communication for individuals with phonological, social, language, and other communication disorders. The incorporation of technology into music therapy has many potential benefits. Existing research has been done in c...
Conference Paper
Full-text available
SpokeIt is a mobile serious game for health designed to support speech articulation therapy. Here, we present SpokeIt as well as 2 preceding speech therapy prototypes we built, all of which use a novel offline critical speech recognition system capable of providing feedback in real-time. We detail key design motivations behind each of them and repo...
Article
For stroke survivors and many other people with upper-extremity impairment, daily life can be difficult without properly functioning arms. Some modern physical therapy exercises focus on rehabilitating people with these troubles by correcting patients’ perceptions of their own body to eventually regain complete control and strength over their arms...
Chapter
Full-text available
Riding public transit can be confusing for everyone, especially in an unfamiliar environment. One needs to figure out which transportation lines to take to reach a destination, when and where to catch a bus or a train, when to exit, and how to negotiate transfers. For those with sensorial or cognitive disabilities, these problems become even more d...
Conference Paper
Full-text available
Traditional forms of physical therapy and rehabilitation are often based on therapist observation and judgment, coincidentally this process oftentimes can be inaccurate, expensive, and non-timely. Modern immersive Virtual Reality systems provide a unique opportunity to make the therapy process smarter. In this paper, we present an immersive virtual...
Conference Paper
Full-text available
We present SpokeIt, a novel speech therapy game co-created with users, medical experts, speech pathologists, developmental psychologists, and game designers. Our serious game for health aims is to augment and support in-office speech therapy sessions with an at-home supported speech therapy experience. SpokeIt was co-created using participatory met...
Conference Paper
Wearable robots can potentially offer their users enhanced stability and strength. These augmentations are ideally designed to actuate harmoniously with the user's movements and provide extra force as needed. The creation of such robots, however, is particularly challenging due to the underlying complexity of the human body. In this paper, we prese...
Conference Paper
Full-text available
Children with speech impairments often find speech curriculums tedious, limiting how often children are motivated to practice. A speech therapy game has the potential to make practice fun, may help facilitate increased time and quality of at-home speech therapy, and lead to improved speech. We explore using conversational real-time speech recogniti...
Conference Paper
Individuals with cerebral palsy (CP) struggle with conditions such as dysarthria, dysphagia, and dyspraxia as they speak. While speech therapy is successful in practice, outside practice requires increased commitment and effort from caregivers. Researchers developed a speech recognition game designed to encourage out-of-office exercises and motivat...
Conference Paper
We present the development and evaluation of an online learning system for people with developmental disabilities (DD) of all ages in collaboration with Imagine! and Hope Services, two not-for-profit organizations that provide care services to people with DD. The system was implemented as an HTML5-based web application for iPad. It includes activit...
Conference Paper
This paper describes a long term user study in which 13 blind participants were asked to use a blind friendly iPhone app, VizSnap -- an app designed to assist blind people in organizing and browsing a photo library without sight -- for a total of two months. VizSnap records audio while the user is aiming the camera, and allows an optional voice mem...
Article
While the prevalence of the Essential Tremor is highly volatile as a result of a conglomeration of factors, it is sometimes reported as almost 20 times more prevalent than Parkinson's disease. A large problem with nailing down the exact proportion is that a tremor could be caused by a menagerie of complicated issues and could present symptoms for a...
Article
This study describes development of an iPad-based speech therapy game to improve speech accuracy in children with cleft lip and palate. Children with cleft palate (CP) require multidisciplinary care, including palatoplasty and speech therapy (ST). There is currently an unmet need for ST for children with CP in resource-poor and rural areas owing t...
Article
We propose a vibrotactile interface in the form of a belt for guiding blind walkers. This interface enables blind walkers to receive haptic directional instructions along complex paths without negatively impacting users' ability to listen and/or perceive the environment the way some auditory directional instructions do. The belt interface was evalu...
Conference Paper
We report a system for gamifying physical therapy for stroke survivors that provides a fully immersive 3D environment. The system consists of a Kinect, an Oculus Rift immersive goggle and a pair of haptic gloves. The Kinect is used to provide bodily gesture for the game as well as to record data to allow assessment of therapy progress regarding bod...
Article
We report an online learning system for adults with developmental disabilities (DD) developed in collaboration with Imagine!, a Colorado based organization that provides support services to people with developmental and cognitive disabilities. Our HTML5 online application includes lessons to teach adults with DD of all ages about numbers, letters a...
Conference Paper
We are developing a location-based information delivery system to facilitate efficient and safe use of public transportation by people who have visual or cognitive impairments. This system comprises Wi-Fi beacons (access points) that are placed at bus stations and inside bus vehicles. Users of this system receive information on their cell phone, wi...
Conference Paper
In professional and educational settings, a document's presentation can be as important as its content. Thus, blind people often rely on sighted help for fear of having their documents treated dismissively or misinterpreted as lack of professionalism or education, by sighted readers when the documents do not meet presentation 'standards'. Still, mo...
Conference Paper
Most children with cleft are required to undertake speech therapy after undergoing surgery to repair their craniofacial defect. However, the untrained ear of a parent can lead to incorrect practice resulting in the development of compensatory structures. Even worse, the boring nature of the cleft speech therapy often causes children to abandon home...
Article
Photography is a visual way to capture a moment in time. Photos can be used for artistic expression, and to remember significant events. Because photo taking, organizing and sharing traditionally requires visual information, those with no or limited sight often have problems with these activities. Previous work has made photo capturing without sigh...
Conference Paper
In an initial user study, three motor-impaired musicians---a composer with a degenerative motor neuron disease, a guitarist who suffered a stroke, and a first-year college student with impaired finger movement---identified prospective areas of research in assistive technology. Participants in the study made use of a range of technologies to adapt c...
Article
Studies showed that people with limited or no vision are taking, storing, organizing, and sharing photos, but there isn't much information of how they do these. While the process for taking photos is somewhat understood, there has been little work researching how exactly blind people are storing, organizing, and sharing their photos without sighted...
Conference Paper
Brain-training software and websites are becoming more prevalent nowadays because of their wide availability and the key idea that they enable people to independently improve their memory and problem solving skills. Such systems offer a simple alternative to expensive specialized stroke rehabilitation software. Our research seeks to investigate the...
Conference Paper
This paper describes the development of an assistive living robot, which is affordable and can be steered over the Internet by family member to remotely monitor and help assess the wellbeing of an older relative living alone. A commercially available iRobot Create platform was used as a starting point for the Assistive Living Robot. Our system (i)...
Conference Paper
Children with cleft palate or lip learn to speak in a way that compensates for the cleft. Their speech becomes unintelligible even after surgery to correct the cleft. Most children undergo speech therapy for many years after the surgery. The boring nature of the cleft speech therapy often causes children to abandon home exercises. We posit that a g...
Conference Paper
Both sighted and visually impaired people value having a photographic memento of a place or an event. However, due to the visually oriented nature of photography and the lack of non-visual cues to indicate the content of the photo, the common belief is that it is difficult for people with limited vision to take, organize and share pictures. However...
Conference Paper
Most work on document creators for blind people mainly concentrates on supporting document writing rather than document formatting, even though blind authors' documents are often treated dismissively when they do not match "expected" standards and many blind authors rely on sighted people to check their documents. Through understanding sighted read...
Conference Paper
While a photograph is a visual artifact, studies reveal that a number of people with visual impairments are also interested in being able to share their memories and experiences with their sighted counterparts in the form of a photograph. We conducted an online survey to better understand the challenges faced by people with visual impairments in sh...
Article
Participating in regular physical activity (PA) can help people maintain a healthy weight, and it reduces their risks of developing cardiovascular diseases and diabetes. Unfortunately, PA declines during early adolescence, particularly in minority populations. This paper explores design requirements for mobile PA-based games to motivate Hispanic te...
Article
Natural language understanding (NLU) systems are promising alternatives to traditional menu-based dialogue systems more commonly employed in games, yet they remain widely under-explored and under-studied. In this paper, we present the results from a qualitative study we conducted on different versions of an NLU interface, inspired by previous resul...
Conference Paper
Full-text available
Design patterns are meant to provide a rubric of problem-solving strategies for common design problems in software engineering. This paper presents the patterns that 34 commercial video games have come to use in representing the birth of a child, and asks, "Where do babies come from?", "What are babies for?", and "How do you support a virtual mothe...
Article
Usability is an important feature for programming languages. However, user studies which compare programming lan-guages or systems are both very expensive and typically inconclusive. In this paper, we posit that discount usabil-ity methods can be successfully applied to programming languages concepts such as language features. We give examples of u...
Article
Full-text available
Technology can improve the quality of life for elderly persons by supporting and facilitating the unique leadership roles that elderly play in groups, communities, and other organizations. Elderly people are often organizational firekeepers. They ...
Article
Full-text available
Media-sharing Web sites are facilitating modern versions of storytelling activities. This study investigates the use of photo-based narratives to support young parents who are geographically separated from their aging parents to share stories about their young children. The case analyses Malaysian young mothers living in the UK, communicating regul...
Conference Paper
Full-text available
The experience of childbirth is highly individualized. Proper preparation and support before, during, and after the onset of labor is key to shortening labor, decreasing the need for interventions during labor, and ultimately increasing maternal happiness. This paper reports the evaluation of The Prepared Partner, a simple game with goals to introd...
Conference Paper
Usability is an important feature for programming languages, and user evaluations can provide invaluable feedback on language design. However, user studies which compare programming languages or systems are often very expensive and typically inconclusive. In this paper, we posit that discount usability methods can be successfully applied to program...
Article
Meaningful choice has often been identified as a key component in a player's engagement with an interactive narrative, but branching stories require tremendous amounts of hand-authored content, in amounts that increase exponentially rather than linearly as more choice points are added. Previous approaches to reducing authorial burden for computer R...
Article
Full-text available
As the popularity of videogames continues to expand in the United States and around the world, it is alarming that the majority of developers are overlooking the needs of play-ers who are deaf. In the US alone, there are close to one million people deaf individuals. Sound is often an inte-gral part of immersing players into a gaming experience. The...