Antonio Gomes

Massachusetts Institute of Technology | MIT · Computer Science and Artificial Intelligence Laboratory

We present MorePhone, an actuated flexible smartphone with a thin-film E Ink display. MorePhone uses shape memory alloys to actuate the entire surface of the display as well as individual corners. We conducted a participatory study to determine how users associate urgency and notification type with full screen, 1 corner, 2 corner and 3 corner actua...

In this paper, we investigate the use of shape changes in a multi-segmented mobile device for triggering viewport transformations in its graphical interface. We study PaperFold, a foldable device with reconfigurable thin-film electrophoretic display tiles. PaperFold enables users to attach, reorient and fold displays in a mobile form factor that is...

In this paper, we present BitDrones, a platform for the construction of interactive 3D displays that utilize nano quadcopters as self-levitating tangible building blocks. Our prototype is a first step towards supporting interactive mid-air, tangible experiences with physical interaction techniques through multiple building blocks capable of physica...

We present MagicScroll, a rollable tablet with 2 concatenated flexible multitouch displays, actuated scrollwheels and gestural input. When rolled up, MagicScroll can be used as a rolodex, smartphone, expressive messaging interface or gestural controller. When extended, it provides full access to its 7.5" high-resolution multitouch display, providin...

We present WhammyPhone, a novel audio interface that supports physical manipulation of digital audio through bend gestures. WhammyPhone combines a high-resolution flexible display, bend sensors, and a set of intuitive interaction techniques that enable novice users to manipulate sound in a tangible fashion. With WhammyPhone, bend gestures can contr...

We present BitDrones, a toolbox for building interactive real reality 3D displays that use nano-quadcopters as self-levitating tangible building blocks. Our prototype is a first step towards interactive self-levitating programmable matter, in which the user interface is represented using Catomic structures. We discuss three types of BitDrones: Pixe...

In recent years, several workshops and an increasing number of scientific publications have focused on shape-changing interfaces. This work has explored prototypes, theory and evaluations across a variety of domains, including: aesthetic experience, affective computing, adaptive affordances, data visualisation, and remote communication support, to...

The ACM Symposium on User Interface Software and Technology (UIST) is the premier forum for innovations in human-computer interfaces. This year, we curated more than 40 demonstrations, aimed to allow conference attendees to look, touch, and witness new and inspiring technologies live. Here, we selected four projects that showcase the very best in t...

Tablet computers aim to bridge the gap between portability and productivity, reducing the need for users to carry multiple devices. However, despite increases in resolution, their displays are limited in size. This commonly results in sequential rather than parallel options for screen navigation, a significant drawback when multitasking. In this pa...

We present GoonQuad, an emotive quadruped capable of expressing emotional behaviours as a response to human touch. GoonQuad comprises five prerecorded states: angry, cheerful, sleepy, confused and a baseline breathing state. Each state is triggered by human touch in areas specified by the eyebrows and a tattoo, painted with conductive ink. Moreover...

We present Mood Fern: digital flora which responds to touch. Depending on the length and intensity of the touch a subset of leaves physically react. The leaves respond on a spectrum of slight oscillation, imitating the effects of swaying in a slight breeze, to complete deformation, as if they were physically trying to respond in a similar manner. M...

We present PaperFold, a novel shape changing mobile device with multiple reconfigurable touch sensitive thin-film electrophoretic magnetic display tiles. PaperFold explores the perceived benefits of having multiple computing devices combined into a single mobile device featuring multiple detachable displays. In PaperFold, each display tile can act...

Flexible Technology will enable computing devices to become mutable in terms of shape, behavior and movement, allowing them to form a more dynamic relationship with the environment. We present MorePhone, a prototype flexible smartphone that uses shape deformations as its primary means of both haptic and visual notifications. To inform the design of...

Flexible Technology will enable computing devices to become mutable in terms of shape, behavior and movement, allowing them to form a more dynamic relationship with the environment. We present MorePhone, a prototype flexible smartphone that uses shape deformations as its primary means of both haptic and visual notifications. To inform the design of...

Interactive art has emerged as a distinctive genre in media art that relies on digital contents to express the artist's message. Situated within this field, this work presents an approach to multimedia storytelling that allows audience members to control separate but overlapping parts of the story chapters. We believe that the system engages its au...

Engaging children born in the digital age with traditional culture practices is a pedagogical and a technological challenge. In this paper we describe Ilha Musical, an interactive panoramic experience designed to foster appreciation of traditional Madeiran cultural practices in children from the island and abroad. The design employs a rhythm game i...