Content uploaded by Bruno Mesz
Author content
All content in this area was uploaded by Bruno Mesz on May 05, 2021
Content may be subject to copyright.
Gastrosonic and Osmotactile Installations
Multisensory installations
Three pieces for a flattened ontology of the sensorium
Bruno A. Mesz*
Universidad Nacional de Tres de Febrero (UNTREF). Instituto de Investigación en Arte y Cultura (IIAC). Sáenz Peña,
Argentina, bruno.mesz@gmail.com
Sebastián Tedesco
Universidad Nacional de Tres de Febrero (UNTREF). Instituto de Investigación en Arte y Cultura (IIAC). Sáenz Peña,
Argentina, sebastian.tedesco@gmail.com
These installations represent a continuation of a series of works on the aestheticization of scientific experiments: a two-way loop,
where the results of empirical studies in the psychology of multisensory perception are the inspiration for the design of artistic
experiences and objects, which in turn constitute experimental environments or devices to be used in further research. A flattened
ontology of the senses underlies the concept of these works, where the traditional vertical hierarchy between “primary” and
“secondary” senses is relativized and horizontal operations of crossmodal associations that translate some senses into others are
emphasized.
CCS CONCEPTS • Human-centered computing
Additional Keywords and Phrases: Crossmodal correspondences, Multisensory plateware, Taste-sound, Smell-touch
ACM Reference Format:
First Author’s Name, Initials, and Last Name, Second Author’s Name, Initials, and Last Name, and Third Author’s Name, Initials, and
Last Name. 2018. The Title of the Paper: ACM Conference Proceedings Manuscript Submission Template: This is the subtitle of the
paper, this document both explains and embodies the submission format for authors using Word. In Woodstock ’18: ACM Symposium
on Neural Gaze Detection, June 03–05, 2018, Woodstock, NY. ACM, New York, NY, USA, 10 pages. NOTE: This block will be
automatically generated when manuscripts are processed after acceptance.
1 BEYOND INTIMACY (2018)
In this installation, special glasses are used for the participants to experience the effects of sound on wine taste. These
devices consist of a wine glass with sensors that are able to detect three main gestures of the user: grabbing the glass,
airing the wine and the contact between mouth and glass while drinking. The sensing is performed through electrodes
attached to the surface of the cup, next to the edge, and connected to capacitive sensors. These sensors generate an
* Corresponding author.
2
electric field and work by detecting other present fields interacting with it, for example those generated by the body. We
extend the detection area to reach the hand holding the cup, using a special nontoxic metallic paint that is employed
routinely in glassware. To avoid wiring, the sensor data are sent wirelessly to a computer that uses them to trigger
sounds. In this way the intervention of the object is minimal and its use is similar to that of a normal glass. By using the
glasses, we are able to synchronize all kinds of stimuli with the action of drinking for the design of multisensory
experiences.
This work was part of Brain & Wine, the first international forum of oenological neuroscience in Barcelona, where we
experimented with sound compositions intended to emphasize the taste of a young and an aged wine. [1]
Figure 1: Beyond Intimacy
2 EMOTIONAL PLATEWARE (2020)
Inspired by recent research on the effect of atmospheres on the perception of food, this scented video installation
proposes to reflect on the use of digital devices at the table, which is usually considered in its negative aspects; however,
digital technologies also promise opportunities for heightened multisensory culinary experiences. For this installation
we designed prototypes of plateware with embedded digital tablets, on the basis of a cognitive pre-test where we asked
for crossmodal associations of shapes, colors, smells and materials with 4 emotions induced by music: Energetic, Tender,
In awe (“Sobrecogido” in Spanish) and Agitated. [2]
Each video is accompanied with smells presented on perfumery strips: Gas and Dollar Bill smell for Energy, Pear and
Apple for Tenderness, Absolute Rose for Awe, and Sea smell for Agitation. We are currently analyzing the results of a
new crossmodal association test and plan to use them for making real plateware and for designing the environment at
dinners in virtual reality.
3
Figure 2: Emotional Plateware
.
4
3 UNDOCUMENTED EMOTIONS OF TOUCH AND SMELL (2019)
This installation is a recreation of a laboratory environment in which the public can experience a series of abstract
vibrotactile compositions, spatialized over their backs, by reclining on a chaise-longue equipped with vibrotactile
devices, accompanied by aromas that are facilitated by an operator.
After experiencing the compositions, which involved complex vibrotactile and aromatic elements, spectators were
invited to participate in an experiment on crossmodal matching between touch and smell. The experiment used simple
non-spatialized stimuli: sinusoidal AM signals at different modulation rates (intended for inducing tactile sensations of
“roughness” or “softness”) together with odors differing in pleasantness (Leather, Rose, Fish, Citrus).
Figure 3: Undocumented emotions of touch and smell
ACKNOWLEDGMENTS
Juan Cruz Amusategui developed the glass sensor system used in Beyond Intimacy.
The video of the plate for the Energetic emotion has the following soundtrack:
B&LB for percussion. Composer: Santiago Santero. Percussionist: Bruno Lo Bianco
REFERENCES
[1] Mesz, B., Tedesco, S.. (2019). Copas: [Video] https://vimeo.com/338451637
[2] Mesz, B., Tedesco, S.. (2020). Emotional Plteware: Energico [Video] https://vimeo.com/429067427/8823201872
[3] Mesz, B., Tedesco, S.. (2020). Emotional Plteware: Enternecido [Video] https://vimeo.com/429049377/a6f53af82d
[4] Mesz, B., Tedesco, S.. (2020). Emotional Plteware: Sobrecogido[Video] https://vimeo.com/428901361/532e1594bb
[5] Mesz, B., Tedesco, S.. (2020). Emotional Plteware: Agitado [Video] https://vimeo.com/428900121/aa83af61ea
