Hiroshi Ishii

• Jerome B. Wiesner Professor
• Managing Director at Massachusetts Institute of Technology

This paper presents our vision of TeleAbsence, extending the concept of telepresence to the past and the afterlife to address the vast emotional and temporal distance caused by the memory of loved ones who drifted apart and faded away. Instead of explicit and literal representations of loved ones, TeleAbsence describes poetic encounters with digita...

This Special Interest Group (SIG) explores the transformative impact of Generative Artificial Intelligence (GenAI) on Human-Computer Interaction (HCI) research processes. The theme here is to answer “question zero”: when to use and when to refrain from using AI tools during the research cycle? The discussion is guided by five research phases common...

Interoceptive signals play a key role in genesis of our conscious experience. Modulation of interoceptive signals holds great potential for developing new human-computer interactions by creating dynamic experiences that are able to engage on user’s emotional level. We present design of a wearable system for modulating interoceptive sympathetic sign...

Many opportunities and challenges in both the control and performative aspects of today's modular synthesizers exist. The user interface prevailing in the world of synthesizers and music controllers has always been revolving around knobs, faders, switches, dials, buttons, or capacitive touchpads, to name a few. This paper presents a novel way of in...

To assist people in practicing mindful breathing and regulate their perceived workload while not disturbing the ongoing foreground task during daily routines, we developed a mobile and personalizable pneumatic-haptic feedback device that provides programmable subtle tactile feedback. The device consists of three soft inflatable actuators embedded w...

This work investigates the structure and mechanical properties of a textile-like material fabricated from polylactic acid (PLA) filament in a fused deposition modeling (FDM) 3D printing process. FDM has expanded access to 3D printing, but the resultant parts are largely limited to rigid forms. The process characterized in this work may expand acces...

Microbe-HCI is a community whose works implicate micro-organisms in HCI. This special interest group is a venue for the first gathering of the community, offering an opportunity for networking and structured discussions. It encourages participation from both active and new researchers to microbe-HCI, with the objective of acquiring an overview of p...

Microbe-HCI is a community whose works implicate micro-organisms in HCI. This special interest group is a venue for the first gathering of the community, offering an opportunity for networking and structured discussions. It encourages participation from both active and new researchers to microbe-HCI, with the objective of acquiring an overview of p...

This work introduces “destaining” as an interactive component for the HCI community. While staining happens unintentionally (e.g., spilling coffee), destaining can be used as an intentional design tool that selectively degrades stains on textiles. We explore the design space using silver doped titanium dioxide (TiO2/Ag), stains and light as a set o...

The home is a place of shelter, a place for family, and for separation from other parts of life, such as work. Global challenges, the most pressing of which are currently the COVID-19 pandemic and climate change have forced extra roles into many homes and will continue to do so in the future. Biodesign integrates living organisms into designed solu...

We introduce a DIY method of creating inflatables and prototyping interactive materials from wasted thermoplastic bags that easily found at home. We used a inexpensive FFF 3D printer, without any customization of the printer, to heat-seal and patterning different types of mono and multilayered thermoplastic bags. We characterized 8 different types...

We introduce HERMITS, a modular interaction architecture for self-propelled Tangible User Interfaces (TUIs) that incorporates physical add-ons, referred to as mechanical shells. The mechanical shell add-ons are intended to be dynamically reconfigured by utilizing the locomotion capability of self-propelled TUIs (e.g. wheeled TUIs, swarm UIs). We de...

We present DefeXtiles, a rapid and low-cost technique to produce tulle-like fabrics on unmodified fused deposition modeling (FDM) printers. The under-extrusion of filament is a common cause of print failure, resulting in objects with periodic gap defects. In this paper, we demonstrate that these defects can be finely controlled to quickly print thi...

We present a wrist-worn mobile heart rate regulator – ambienBeat – which provides closed-loop biofeedback via tactile stimulus based on users’ heartbeat rate (HR). We applied the principle of physiological synchronization via touch to achieve our goal of effortless regulation of HR, which is tightly coupled with mental stress levels. ambienBeat pro...

Modern knitting machines allow the manufacturing of various textile products with complex surface structures and patterns. However, programming these machines requires expert knowledge due to constraints of the process and the programming language. We present a long short-term memory (LSTM) based deep learning model that generates low-level code of...

2020 Association for Computing Machinery. This paper introduces TRANS-DOCK, a docking system for pin-based shape displays that enhances their interaction capabilities for both the output and input. By simply interchanging the transducer module, composed of passive mechanical structures, to be docked on a shape display, users can selectively switch...

2020 Owner/Author. We introduce HERMITS, a modular interaction architecture for self-propelled Tangible User Interfaces (TUIs) that incorporates physical add-ons, referred to as mechanical shells. The mechanical shell add-ons are intended to be dynamically reconfigured by utilizing the locomotion capability of self-propelled TUIs (e.g. wheeled TUIs...

We propose a novel fabrication method for 3D objects based on the principle of spooling. By wrapping off-The-shelf materials such as thread, ribbon, tape or wire onto a core structure, new objects can be created and existing objects can be augmented with desired aesthetic and functional qualities. Our system, WraPr, enables gesture-based modelling...

This paper presents a design space, a fabrication system and applications of creating fluidic chambers and channels at millimeter scale for tangible actuated interfaces. The ability to design and fabricate millifluidic chambers allows one to create high frequency actuation, sequential control of flows and high resolution design on thin film materia...

SCALE provides a framework for load data from distributed load-sensitive modules for exploring force-based interaction. Force conveys not only the force vector itself but also rich information about activities, including way of touching, object location and body motion. Our system captures these interactions on a single pipeline of load data proces...

reSpire lets people bring tangibility to their invisible physiological state through shape-changing fabric deformed by airflow. We explore a way to support mental wellness via improving a self-interaction and interpersonal connectedness. reSpire encourages not only people to focus on their connection to inner body but also to interact with others t...

2019 Copyright held by the owner/author(s). In this paper, we introduce SociaBowl, a dynamic table centerpiece to promote positive social dynamics in 2-way cooperative conversations. A centerpiece such as a bowl of food, a decorative flower arrangement, or a container of writing tools, is commonly placed on a table around which people have conversa...

2019 Copyright is held by the owner/author(s). This research aims to utilize an output method for zero energy pop-up fabrication using chemical inflation as a technique for instant, hardware-free shape change. By applying state-changing techniques as a medium for material activation, we provide a framework for a two-part assembly process starting f...

2019 Copyright held by the owner/author(s). How can people learn advanced motor skills such as front flips and tennis swings without starting from a young age? The answer, following the work of Masters et. al., we believe, is implicitly. Implicit learning is associated with higher retention and knowledge transfer, but that is unable to be explicitl...

Tangible user interfaces have a rich history in HCI research ever since their introduction two decades ago. But what are the practical implications, the commercial potential, and the future of this influential paradigm? This panel starts by looking into the importance of tangible interaction and its current role. It will then draw on the expertise...

In this paper, we introduce SociaBowl, a dynamic table centerpiece to promote positive social dynamics in 2-way cooperative conversations. A centerpiece such as a bowl of food, a decorative flower arrangement, or a container of writing tools, is commonly placed on a table around which people have conversations. We explore the design space for an au...

This research aims to utilize an output method for zero energy pop-up fabrication using chemical inflation as a technique for instant, hardware-free shape change. By applying state-changing techniques as a medium for material activation, we provide a framework for a two-part assembly process starting from the manufacturing side whereby a rigid stru...

Today's mainstream Human-Computer Interaction (HCI) research primarily addresses functional concerns - the needs of users, practical applications, and usability evaluation. Tangible Bits and Radical Atoms are driven by vision and carried out with an artistic approach. While today's technologies will become obsolete in one year, and today's applicat...

How can people learn advanced motor skills such as front flips and tennis swings without starting from a young age? The answer, following the work of Masters et. al., we believe, is implicitly. Implicit learning is associated with higher retention and knowledge transfer, but that is unable to be explicitly articulated as a set of rules. To achieve...

While previously proposed hardware on pin-based shape display has improved various technical aspects, there has been a clear limitation on the haptic quality of variable 'force' feedback. In this paper, we explore a novel haptic interaction design space with 'force' controlled shape display. Utilizing high performance linear actuators with current...

Mole Messenger is a pair of connected creatures that help children share and send messages to their loved ones who may be far away. Each Mole Messenger box houses a pushable mole. When one is pushed, the other pops up, as if traversing to the other side of the globe. The mole can be tapped to carry different color messages when pushed and can be us...

In this art project, the ephemeral and intangible aspects of human's communication are represented by soap-bubble. The shapeless, intangible, and insubstantial speech - once the speech is shouted out through speaker's mouth it disappears unless someone hears it immediately, or even it is heard, the message will be forgotten as time goes - is transf...

2019 ACM. While previously proposed hardware on pin-based shape display has improved various technical aspects, there has been a clear limitation on the haptic quality of variable 'force' feedback. In this paper, we explore a novel haptic interaction design space with 'force' controlled shape display. Utilizing high performance linear actuators wit...

This article presents three classes of textile sensors exploiting resistive, piezoresistive, and capacitive properties of various textile structures enabled by machine knitting with conductive yarn. Digital machine knitting is a highly programmable manufacturing process that has been utilized to produce apparel, accessories, and footwear. By carefu...

2019 Association for Computing Machinery. This paper presents a design space, a fabrication system and applications of creating fluidic chambers and channels at millimeter scale for tangible actuated interfaces. The ability to design and fabricate millifluidic chambers allows one to create high frequency actuation, sequential control of flows and h...

We present a load sensitive surface which provides exact contact position in 3D and a force vector of user's touch from low cost load sensors without any prior knowledge about shape of objects. Load based approach is advantageous since they provide a force vector, however, there have been mathematical ambiguity of the touch position along the line...

We present a tangible memory notebook--reMi--that records the ambient sounds and translates them into a tangible and shareable memory using animated paper. The paper replays the recorded sounds and deforms its shape to generate synchronized motions with the sounds. Computer-mediated communication interfaces have allowed us to share, record and reca...

Recent Virtual Reality (VR) systems render highly immersive visual experiences, yet currently lack tactile feedback for feeling virtual objects with our hands and bodies. Shape Displays offer solid tangible interaction but have not been integrated with VR or have been restricted to desktop-scale workspaces. This work represents a fusion of mobile r...

UPDATED-22 February 2018. In this paper, we describe a novel electronic musical interface, consisting of a strand-like object that can be physically transformed by bending to create various shapes and signifiers. Users are encouraged to explore a visual language in a musical context, as each new shape portrays a different musical instrument with un...

We present a design exploration on how water based droplets in our everyday environment can become interactive elements. For this exploration, we use electrowetting-on-dielectric (EWOD) technology as the underlying mechanism to precisely control motion of droplets. EWOD technology provides a means to precisely transport, merge, mix and split water...

2018 Copyright is held by the owner/author(s). UPDATED—22 February 2018. In this paper, we describe a novel electronic musical interface, consisting of a strand-like object that can be physically transformed by bending to create various shapes and signifiers. Users are encouraged to explore a visual language in a musical context, as each new shape...

Droplet based microfluidics (digital microfluidics) with Electrowetting on dielectric (EWOD) has gained popularity with the promise of being technology for a true lab-on-chip device with applications spanning across assays/library prep, next-gen sequencing and point-of-care diagnostics. Most electrowetting device architecture are linear electrode a...

This article starts with an overview of work on shape-changing line interfaces in the field of HCI, including the authors’ previous work on actuated-line interfaces, LineFORM and ChainFORM. Related research from other fields, such as robotics and material science, are also introduced. Then, several potential implementation methods are compared and...

In this paper, we present AnimaStage: a hands-on animated craft platform based on an actuated stage. Utilizing a pin-based shape changing display, users can animate their crafts made from various materials. Through this system, we intend to lower the barrier for artists and designers to create actuated objects and to contribute to interaction desig...

Hiroshi Ishii conducts research in the MIT Media Lab in two principal areas: the field of Human-Computer Interactions, and the field of interface design linking human beings, digital information and the environment. In this dialogue, Hiroshi describes two of the basic concepts of the Media Lab: the first is to achieve ‘tangible bits’ in human-compu...

In this paper we present Organic Primitives, an enabling toolbox that expands upon the library of input-output devices in HCI and facilitates the design of interactions with organic, fluid-based systems. We formulated color, odor and shape changing material primitives which act as sensor-actuators that convert pH signals into human-readable outputs...

Printflatables is a design and fabrication system for human-scale, functional and dynamic inflatable objects. We use inextensible thermoplastic fabric as the raw material with the key principle of introducing folds and thermal sealing. Upon inflation, the sealed object takes the expected three dimensional shape. The workflow begins with the user sp...

We developed a concept of transformative appetite, where edible 2D films made of common food materials (protein, cellulose or starch) can transform into 3D food during cooking. This transformation process is triggered by water adsorption, and it is strongly compatible with the 'flat packaging' concept for substantially reducing shipping costs and s...

Cells’ biomechanical responses to external stimuli have been intensively studied but rarely implemented into devices that interact with the human body. We demonstrate that the hygroscopic and biofluorescent behaviors of living cells can be engineered to design biohybrid wearables, which give multifunctional responsiveness to human sweat. By deposit...

We developed a concept of transformative appetite, where edible 2D films made of common food materials (protein, cellulose or starch) can transform into 3D food during cooking. This transformation process is triggered by water adsorption, and it is strongly compatible with the 'flat packaging' concept for substantially reducing shipping costs and s...

This paper presents ChainFORM: a linear, modular, actuated hardware system as a novel type of shape changing interface. Using rich sensing and actuation capability, this modular hardware system allows users to construct and customize a wide range of interactive applications. Inspired by modular and serpentine robotics, our prototype comprises ident...

This paper presents a design, simulation, and fabrication pipeline for making transforming inflatables with various materials. We introduce a bending mechanism that creates multiple, programmable shape-changing behaviors with inextensible materials, including paper, plastics and fabrics. We developed a software tool that generates these bending mec...

This paper explores how multi-modal body-syntonic interactive systems may be used to teach children to play the piano beyond the typical focus on reading musical scores and "surface correctness". Our work draws from Dalcroze Eurhythmics, a method of music pedagogy aimed at instilling an understanding of music rooted in the body. We present a Dalcro...

This paper explores how multi-modal body-syntonic interactive systems may be used to teach children to play the piano beyond the typical focus on reading musical scores and "surface correctness". Our work draws from Dalcroze Eurhythmics, a method of music pedagogy aimed at instilling an understanding of music rooted in the body. We present a Dalcro...

This paper explores how an actuated pin-based shape display may serve as a platform on which to build musical instruments and controllers. We designed and prototyped three new instruments that use the shape display not only as an input device, but also as a source of acoustic sound. These cover a range of interaction paradigms to generate ambient t...

To meet the increasing requirements of HCI researchers who are looking into using liquid-based materials (e.g., hydrogels) to create novel interfaces, we present a design strategy for HCI researchers to build and customize a liquid-based smart material printing platform with off-the-shelf or easy-to-machine parts. For the hardware, we suggest a mag...

Current mobile devices do not leverage the rich haptic channel of information that our hands can sense, and instead focus primarily on touch based graphical interfaces. Our goal is to enrich the user experience of these devices through bi-directional haptic and tactile interactions (display and control) around the edge of hand-held devices. We prop...

This paper introduces a new framework to guide the design of interactive music learning systems, focusing on the piano. Taking a Reflective approach, we identify the implicit assumption behind most existing systems-that learning music is learning to play correctly according to the score-and offer an alternative approach. We argue that systems shoul...

This work presents a method for 3D printing hair-like structures on both flat and curved surfaces. It allows a user to design and fabricate hair geometries that are smaller than 100 micron. We built a software platform to let users quickly define the hair angle, thickness, density, and height. The ability to fabricate customized hair-like structure...

Shape changing interfaces give physical shapes to digital data so that users can feel and manipulate data with their hands and bodies. However, physical objects in our daily life not only have shape but also various material properties. In this paper, we propose an interaction technique to represent material properties using shape changing interfac...

This video illustrates the usage of an integrated workbench for learning and composing music on the piano. Built on a Yamaha Disklavier augmented with projection, the system suports music represented either as symbolic notation or as MirrorFugue, where virtual hands projected on the keyboard appear to physically plays the piano [1]. The story of tw...

SoundFORMS creates a new method for composers of electronic music to interact with their compositions. Through the use of a pin-based shape-shifting display, synthesized waveforms are projected in three dimensions in real time affording the ability to hear, visualize, and interact with the timbre of the notes. Two types of music composition are exp...

In the video, we showcased "Second Skin", a self-transforming garment that is activated by living bacteria. The synthetic bio-skin reacts to body heat and sweat, causing flaps around heat zones to open, enabling sweat to evaporate and cool down the body through an organic material flux.

2016 ACM. Shape changing interfaces give physical shapes to digital data so that users can feel and manipulate data with their hands and bodies. However, physical objects in our daily life not only have shape but also various material properties. In this paper, we propose an interaction technique to represent material properties using shape changin...

Current mobile devices do not leverage the rich haptic channel of information that our hands can sense, and instead focus primarily on touch based graphical interfaces. Our goal is to enrich the user experience of these devices through bidirectional haptic and tactile interactions (display and control) around the edge of hand-held devices. We propo...