ArticlePDF Available

Abstract and Figures

We demonstrate the design, fabrication, evaluation, and use of a self-powered microphone that is thin, flexible, and easily manufactured. Our technology is referred to as a Self-powered Audio Triboelectric Ultra-thin Rollable Nanogenerator (SATURN) microphone. This acoustic sensor takes advantage of the triboelectric nanogenerator (TENG) to transform vibrations into an electric signal without applying an external power source. The sound quality of the SATURN mic, in terms of acoustic sensitivity, frequency response, and directivity, is affected by a set of design parameters that we explore based on both theoretical simulation and empirical evaluation. The major advantage of this audio material sensor is that it can be manufactured simply and deployed easily to convert every-day objects and physical surfaces into microphones which can sense audio. We explore the space of potential applications for such a material as part of a self-sustainable interactive system. Video : https://www.youtube.com/watch?v=OLuZHpa_FIM
Content may be subject to copyright.
60
SATURN: A Thin and Flexible Self-powered Microphone Leveraging
Triboelectric Nanogenerator
NIVEDITA ARORA, STEVEN L. ZHANG, FERESHTEH SHAHMIRI, DIEGO OSORIO, YI-CHENG
WANG, MOHIT GUPTA, ZHENGJUN WANG, THAD STARNER, ZHONG LIN WANG, and GREGORY
D. ABOWD, Georgia Institute of Technology, Atlanta, USA
We demonstrate the design, fabrication, evaluation, and use of a self-powered microphone that is thin, exible, and easily
manufactured. Our technology is referred to as a Self-powered Audio Triboelectric Ultra-thin Rollable Nanogenerator
(SATURN) microphone. This acoustic sensor takes advantage of the triboelectric nanogenerator (TENG) to transform
vibrations into an electric signal without applying an external power source. The sound quality of the SATURN mic, in terms
of acoustic sensitivity, frequency response, and directivity, is aected by a set of design parameters that we explore based
on both theoretical simulation and empirical evaluation. The major advantage of this audio material sensor is that it can be
manufactured simply and deployed easily to convert every-day objects and physical surfaces into microphones which can
sense audio. We explore the space of potential applications for such a material as part of a self-sustainable interactive system.
CCS Concepts:
Human-centered computing Interaction devices
;
Hardware Power and energy
;
Communi-
cation hardware, interfaces and storage;
Additional Key Words and Phrases: exible electronics, passive microphone, Triboelectic eect, TENG (Triboelectric Nano-
generator), applications
ACM Reference Format:
Nivedita Arora, Steven L. Zhang, Fereshteh Shahmiri, Diego Osorio, Yi-Cheng Wang, Mohit Gupta, Zhengjun Wang, Thad
Starner, Zhong Lin Wang, and
Gregory
D. Abowd. 2018. SATURN: A Thin and Flexible Self-powered Microphone Leveraging
Triboelectric Nanogenerator. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 2, Article 60 (June 2018), 28 pages.
https://doi.org/10.1145/3214263
1 INTRODUCTION
Sound is a critical source of information for understanding and controlling the environment. Sound is sensed
using a microphone, an acoustic–electric transducer, which outputs an electrical signal that reproduces the
sound pressure variations that it senses. In addition to the obvious applications of recording events for playback
and automated speech recognition, the increased availability of low-cost embedded microphones has resulted
in a variety of other interesting applications. These applications include occupancy detection [
16
,
25
], control
[
30
,
45
,
56
], human behavior studies [
4
], structural maintenance [
15
], health monitoring[
27
,
70
], hearing aids [
5
],
activity recognition [26,40,63,80] and sound source localization [48,62].
This is the corresponding author
Authors’ address: Nivedita Arora, nivedita.arora@gatech.edu; Steven L. Zhang; Fereshteh Shahmiri; Diego Osorio; Yi-Cheng Wang; Mohit
Gupta; Zhengjun Wang; Thad Starner; Zhong Lin Wang; Gregory D. Abowd, Georgia Institute of Technology, Atlanta, USA.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that
copies are not made or distributed for prot or commercial advantage and that copies bear this notice and the full citation on the rst
page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy
otherwise, or republish, to post on servers or to redistribute to lists, requires prior specic permission and/or a fee. Request permissions from
permissions@acm.org.
©2018 Association for Computing Machinery.
2474-9567/2018/6-ART60 $15.00
https://doi.org/10.1145/3214263
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:2 N. Arora et al.
As ubiquitous as microphones may seem today, there is still room for progress. A microphone’s design balances
several important features, including recording quality, form factor (e.g., size, weight, exibility, thickness), and
power consumption. Electronic devices most commonly use electret [
54
] or condenser [
46
] microphones based on
MEMS technology [
11
,
71
]. CMOS–MEMS acoustic devices allow miniaturization and on-chip electronics, but are
active, that is, they require power for operation and sound amplication [
8
,
12
]. Commercially available passive
(or self-powered) microphones do not consume power but are bulky (e.g., a moving coil dynamic microphone [
7
])
or use PVDF lms, which either results in a low sensitivity contact microphone [
1
,
38
] or complex to manufacture
and costly to scale in size [
24
,
53
]. The challenge lies in designing a microphone which is passive and has
sound quality comparable to its active counterparts (acoustic sensitivity
>
25
dBS P L
) while still preserving a
lightweight and versatile form factor [
28
]. Recent advances in materials science have demonstrated the possibility
of such self-powered, easy-to-manufacture sensors that take advantage of the triboelectric nanogenerator (TENG)
to convert mechanical vibrations into electrical energy [
65
,
67
,
69
]. The TENG relies on the triboelectrication
and electrostatic induction eects, which converts tiny mechanical vibrations into electric signal output without
applying an external power. In this paper, we present the design, fabrication, and evaluation of a exible and
self-powered microphone that is made up of a thin and inexpensive PTFE/paper/copper structure.
(a) (b) (c)
Fig. 1.
SATURN Microphone in variety of configurations (a) Close-up of the device (b) Soda bole with flexible microphone
to enable interactions (c) Sensing table to detect location of people around it
Our solution results in a
S
elf-powered
A
udio
T
riboelectric
U
ltra-thin
R
ollable
N
anogenerator (SATURN)
microphone. This paper provides three research contributions for the SATURN microphone:
Device fabrication
: Inspired by the thin, exible design of a sound energy harvester based on the tribo-
electric nanogenerator (TENG) [
10
], we have developed a simpler and cheaper fabrication technique for
the SATURN Microphone.
Discovering optimal design performance
: Several design parameters impact the performance of the
SATURN microphone, specically the geometry of a SATURN patch, the size and spacing of holes in
the paper layer, and the method of attaching the various layers to each other. In this work, an iterative
evaluation strategy which balanced empirical results against a theoretical understanding of the device
was adopted to guide our design in order to achieve best performance. We built a simulation model of
the SATURN material to examine how design parameters aect the propagation of sound vibrations
across the material. We also empirically characterized the sound quality (acoustic sensitivity, frequency
response, and directivity) in a controlled laboratory setting and oer a comparison against commercially
available alternatives. This theoretical–empirical balance gives us condence that our nal design is both
reproducible and understandable.
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:3
Evaluation of interesting usage contexts
: The SATURN microphone provides an advantageous form
factor which is thin and exible and can be exploited in a number of planar and circular congurations.
We demonstrate the potential of the SATURN microphone in setting where its exibility and passivity are
best utilized. We compare SATURN microphone’s sensitivity to other COTS microphones. We also suggest
device system solutions which exploit the self-powering characteristics of the SATURN microphone for
loud decibel sound event detection.
Demonstration of SATURN microphone design, fabrication and applications can be found at the following link:
www.youtube.com/watch?v=OLuZHpa_FIM
2 RELATED WORK
The last decade saw signicant research eorts towards building low power electronics [
22
,
36
,
47
,
59
,
61
]. In
addition to better power management strategies, there has been a recent push to make embedded devices thin
and exible [
39
,
72
]. To achieve this overreaching vision of self–sustainable exible electronics, materials science
and microelectronics communities have been working on new device designs for sensing [
43
,
52
], computing
[
42
], feedback [
79
], energy harvesting [
50
] and storage [
23
] which leverage new materials, nano-structures, and
printing technologies. The UbiComp research community has often sought ways to make these technological
innovations more practical, reliable and easy to use for various applications [19,20].
To build low (or no) power and versatile form factor electronics, we need to start from individual device
components which follow this trend, so that in the future these components can be assembled together as a
single working unit. An example of one such device component is a self-powered sensor. Energy harvesters
can be redesigned to have high sensitivity for the phenomenon they generate energy from, to create sensors
which do not require power to be operated. A new breed of self-powered sensors based on the triboelectric eect
work exactly on this concept, and one recent example is the Triboelectric Nanogenerator (TENG) [
64
,
65
,
67
].
The design of these sensors is based on the principles of triboelectrication (or contact electrication) and
electrostatic induction and convert any kind of mechanical energy to a highly correlated electrical response. With
their lightweight, low-cost, and high eciency even at low frequency, TENGs have been shown as passive or
self-powered sensors for detecting mechanical motion such as pressure[
33
,
76
], touch[
6
,
17
], vibrations[
3
,
73
],
linear displacement[
34
,
78
], speed [
74
], rotation[
32
], and acceleration[
77
]. Beyond saving power, TENG-based
sensors are exible, fullling the requirements for a sensing unit for skin-like devices. In this paper, we are
inspired by the promise of TENGs and demonstrate how a simpler manufacturing process that does not rely on
any sophisticated nano manufacturing can be used to develop a self-powered sensor for capturing vibrations
from sound.
There have been previous attempts to build triboelectric-based acoustic energy harvesters. Yang et al.[
75
]
designed a resonant air cavity using TENG structure based on aluminum and polyvinylidene uoride (PVDF)
which converted loud sounds (e.g., a clap) to an electrical signal. This approach was redesigned to be exible by Fan
et al. [
10
] using a PTFE-nanowire and paper-based device structure. As an energy harvester, the experiments were
focused on maximizing electrical response at the natural resonant frequency. Thus, only low range frequencies for
loud sounds at high sound pressure were tested. Recently, other nano-structure designs based on a ferroelectric
nanogenerator (FENG) [
31
] and piezoelectric nanogenerator (PENG) [
68
] have also been explored to make exible
acoustic sensors, actuators, and energy harvesters.
The triboelectric eect is not new to researchers wanting to leverage it for interactive purposes. Karagozler
et al. used the triboelectric eect to support simple interactions in a children’s storybook [
19
]. Paradiso’s
Interactive Balloon used the piezoelectric properties of PVDF mounted on a mylar balloon to record sounds [
44
],
demonstrating practical use of a self-sustaining acoustic sensor. These examples, as well as the insights from
the above-mentioned materials science work, inspire our development of the SATURN microphone. What sets
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:4 N. Arora et al.
the work of this paper apart from all of this previous work is a rigorous exploration of the design features that
make triboelectric-based acoustic sensing practical for a variety of interesting application scenarios. These design
features include:
Low-cost fabrication
: Previous work employs nano-fabrication techniques, like inductive coupling
etching-process (ICP etch), microplasma discharge [
31
], and nanowire growth [
10
]. These methods must
be precise, which makes the device fabrication on a practical manufacturing scale dicult, expensive, and
requiring a high skill level for production. We seek a fabrication technique that is inexpensive and does not
signicantly compromise signal quality.
Wider acoustic range
: Low frequency ranges (
<
1000 Hz) and high sound pressure levels are sucient
to demonstrate a device as a sound energy harvester, working at some resonant frequency, but not to
demonstrate the device as a sound sensor. For example, in telephony, the usable frequency band range
for voice is approximately 300 Hz to 3400 Hz. We seek a exible thin sound sensing material which is
sensitive across this wider band of the human audible range. We also want sensitivity beyond the voice
band, including up 4-6 kHz for sound clarity and denition.
Performance reliability
: Fabrication techniques should be reproducible i.e two microphones produced
with the same technique should be similar in acoustic performance.
Our paper hopes to bridge the gap between material science and ubiquitous computing communities for self-
powered, exible acoustic sensors. We explore a simpler fabrication technique for the SATURN microphone versus
the techniques for the original TENG devices. We provide a detailed and reproducible guide to construct SATURN
microphones which can be followed, and improved upon, by others. We evaluate the SATURN microphone’s audio
characteristics and compare it with state-of-the-art microphones. In Section 9, we demonstrate two implemented
applications of the SATURN microphone to show its use in practice. Those implemented applications, however,
only exhibit the passive microphone capabilities of SATURN and still require traditional powered components to
receive and process the audio signal.
3 HOW THE SATURN MICROPHONE WORKS
3.1 Theory of Operation : Triboelectric Nanogenerator
The operation of the SATURN microphone is based on the principle of two, coupled phenomena—electrostatic
induction and contact electrication. Electrostatic induction is the generation of opposite charges on two dierent
materials, while contact electrication or triboelectrication, is charge transfer between two surfaces in contact.
The fundamental theory of triboelectrication lies in Maxwell
'
s displacement current and change in surface
polarization [
66
]. By introducing a thin conducting electrication layer, the charge dierence between the two
polarized surfaces generated due to triboelectricity can be measured. This combined structure is called the
triboelectric nanogenerator (TENG). The polarity and strength of the charges produced are dependent on many
material variables such as surface roughness, temperature, and dielectric constant.
3.2 Device Design
The multi-layered device structure of the SATURN microphone is schematically depicted in Figure 2. It consists
of a thin lm of dielectric polytetrauoroethylene (PTFE), which has a permanent negative charge stored on its
surface, sandwiched between two copper layers. These copper layers act as electrication layers that generate
triboelectric charges upon coming in contact with PTFE. The rst layer of the copper is laminated on the PTFE
itself (bottom layer) while the other is deposited on paper (top layer). The paper in the SATURN microphone
structure is neutral and used only for structural support for the copper electrication layer which comes in
contact with PTFE due to vibration. To minimize the air friction which dampens the vibrations, holes have been
introduced on the paper to act as a mini-resonant cavity for air when sound propagates, resulting in enhancement
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:5
of the vibration eect. Paper is used because of its exibility, lightweight structure, low cost, and ease of cutting
holes.
Fig. 2. Structural design of SATURN Microphone consisting of copper coated paper and PTFE
3.3 Working Mechanism
The SATURN microphone works on the principle of vibration-induced contact and charge generation due to
triboelectrication and electrostatic induction. This process is explained in detail in Figure 3. Propagation of the
sound through air causes compression and rarefaction corresponding to the frequencies present in it.
Fig. 3. Cycle of electricity generation process under external acoustic excitation
When a compression is incident on the SATURN microphone it causes vibrations in its membrane-like structure,
resulting in the copper layer on the paper coming in contact with the PTFE (Figure 3a). Contact electrication
generates charges on both surfaces—PTFE, which has a greater electron anity, is able to gain electrons from the
copper[2] and becomes negatively charged, whereas the copper layer on the paper becomes positively charged.
When subsequent rarefaction separates the paper and the PTFE (Figure 3b), it induces a potential dierence
across the two copper electrodes, causing current to ow from paper towards PTFE if the device is connected to
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:6 N. Arora et al.
an external load. This ow of current reverses the polarity (Figure 3c) of charges on the two copper electrodes
(i.e., now the copper on PTFE has more positive charge than the copper layer on the paper). The next compression
results in the paper moving towards the PTFE again, resulting in a reversed direction of current ow (Figure 3d),
completing the cycle of electricity generation.
4 FABRICATION
The SATURN microphone consists of two attached layers—paper and PTFE, both with a deposition of copper
(Figure 4). The fabrication steps are explained in detail below and depicted in Figure 4.1
Fig. 4.
Fabrication Process : (1) Preparation of micro-hole paper (2) Deposition of copper layer (3) Aaching copper tape as
electrodes (4) Stacking paper and PTFE (5) Gluing paper and PTFE. All dimensions are in mm.
(1) Preparation of micro-hole paper
: We start with standard copier paper of 0.04 mm thickness. 400
µ
m
diameter holes with an even spacing of 200
µ
m are cut into the paper in a grid pattern using a micro-laser
cutter, a Universal Laser System PLS6MW using 9.3
µ
m
CO2
at 80% power and a 700 PPI rastor mode at
20% speed. The hole pattern forms a 4cm x 4cm square grid. A small border of 5mm on one side and 2mm
on the other side is left to be used for attachment to the PTFE layer. This border is kept small to ensure
ease of reproducibility of the cavity created between copper and paper after being attached together.
(2) Deposition of copper layer
: The paper sheet with micro-holes (step 1) and a PTFE sheet (6cm x 6cm
with 0.05 mm thickness) are coated on one side with a thin layer of copper that act as electrodes. The
copper is applied using a standard sputtering technique inside a PVD chamber (a Leskar PVD75) with a
chamber pressure of 6
x
10
6torr. The deposition time is set to 45 minutes, resulting in a 0.15
µ
m copper
layer thickness on the paper and the PTFE. This allows the copper to deposit on the paper but not obstruct
the micro-holes. The border of the perforated-paper is also coated with copper.
1Video of fabrication process: www.youtube.com/watch?v=lTJPWALCYe8
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:7
(3) Attaching copper tape as electrodes
: We attach conductive copper tape to the copper coated side of
the paper and the PTFE in order to extend the electrodes for measurement purposes or to connect to an
external circuit.
(4) Stacking paper and PTFE
: The paper and PTFE are placed on top of each other such that the copper
layer of paper is on top of the non-coated side of PTFE, which is non-conducting. To avoid a short circuit,
we ensure that the copper tape attached to the copper coated side of the paper does not touch the copper
laminated side of the PTFE and vice versa. Finally, the copper tape from the paper is attached to the second
copper tape on the uncoated side of PTFE.
(5) Gluing paper and PTFE
: The paper layer (copper side facing PTFE) is glued to the uncoated PTFE side
using glue dots at nine anchor points.
Structural parameter values mentioned above, like hole size, hole spacing, and attachment points for paper to
PTFE, were determined by performing experiments and simulation, as discussed in detail in Section 5on device
design optimization. The nal thickness of the constructed SATURN microphone patch is measured to be 150
µ
m,
which is comparable to that of standard copier paper. This sensor can be attached to objects using glue on the
edges of copper side of the PTFE layer.
5 DEVICE DESIGN OPTIMIZATION
The main aim of device design optimization for SATURN microphone is to increase electrical response across
wider range of frequencies in order to achieve a better acoustic sensitivity. This allows sounds of lower decibel
levels to be detected, thus opening doors for wide variety of applications.
5.1 Factors Eecting Device Performance
The SATURN microphone consists of paper and PTFE, which are both exible and vibrate to act as two plates
of a capacitor to produce an electrical response. In previous descriptions of the behavior of a Triboelectric
Nanogenerator ([
65
,
66
]), it was assumed that the two layers are rigid. In that case, the open circuit potential
dierence generated by the device as a function of time(t) is given by the equation [41]:
Voc =σx(t)
ϵ0
(1)
where, x(t) is the physical separation distance between the PTFE and paper,
σ
is the charge density generated
on the surface, and
ϵ0
is the relative permittivity of the dielectric. This mathematical model is overly simplied,
and would not work for SATURN microphone because neither the paper nor the PTFE layer are rigid. In practice,
the PTFE layer will be attached to a surface, so we will continue to assume it is rigid. The paper layer, however,
behaves more like a exible membrane and will vibrate. Keeping the vibration of paper in mind we have derived
a modied formula below.
Fig. 5.
Factors eecting potential dierence generation :
σef f ective
surface charge density and
def f ective
separation
distance between the two plates
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:8 N. Arora et al.
The separation distance between the paper and PTFE layers changes over time when we assume that the
paper layer is vibrating, as shown in Figure 5. When our membrane is placed in the Y-Z plane of a right-handed
reference coordinate frame, if we take an innitesimal element with area
dy.dz
at a location
(
0
,y,z)
w.r.t. the
origin, then the potential dierence across the innitesimal element is a slight modication of equation 1and is
given by:
Voc =
σef f
ϵ0
x(y,z,t),(2)
where
σef f
is the eective surface charge density, and the separation distance
x
is a function of
y
,
z
and time,
which varies along y and z for the exible membrane. Hence, the open circuit potential dierence for a exible
paper layer can be written as:
Voc =
σef f
Aϵ0A
x(y,z,t)dydz.(3)
To increase VOC for the SATURN microphone there are two parts in this equation which can be optimized:
(1) σef f : Eective surface charge density which is dependent on the roughness of the PTFE surface; and
(2) def f
: Eective separation distance during exural vibrations is
Ax(y,z,t)dydz
/A and is mainly dependent
on the ability of the paper to vibrate.
5.2 Method of Evaluation
To guide our structural device design we use combination of two evaluation techniques:
(1) Simulation
: a structural modal analysis to simulate the dynamic vibration behavior of the paper in order
to to determine def f , amplitude of eective separation distance; and
(2) Experiment
: an empirical experimentation with fabricated SATURN microphones to determine the
electrical response in a controlled sound environment
5.2.1 Structural Modal Analysis. Modal analysis is the method to identify the natural frequencies of vibrations
of a material and the mode shapes of a structure. The deformed shape of the structure at a specic natural
frequency of vibration is termed as its mode shape of vibration. A thin membrane-like structure such as that
of SATURN microphone has innite modal frequencies and mode shapes. The material response for a given
input load is linear combination of these mode shapes. We used a 3-D nite element (FE) model mesh using
tetrahedral elements to perform the modal analysis using ANSYS.
2
The glued attachments points of the paper
with PTFE (described in Step 5 of the fabrication process in Figure 4), were meshed separately, to be assigned as
xed support (see Figure 6a).
(a) (b)
Fig. 6.
Modal analysis done using ANSYS Inc. soware : (a) 3D Finite Element model of paper with meshed tetrahedral
structure with zoomed in central fixed support point. (b) Modal shapes of paper at dierent natural frequencies.
2http://www.ansys.com/
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:9
We use lower modes of vibrations, i.e., mode shapes with lower natural frequencies, as they are easy to visualize
with the number of peaks and crests less as compared to the mode associated with a higher natural frequency.
Figure 6b shows an example of dierent modes of vibration for paper anchored around the edges.
3
The transverse
deformation, or vertical deection, is plotted with the help of colored contours. For each normal mode shape, the
contours are plotted and arranged from blue to red such that blue represents zero or negligible vertical deection
whereas red represents the location of maximum vertical deection possible.
The value of the vertical defection of a point, obtained from the modal analysis, is referred to as the amplitude
of separation of a point, x(y,z,t) in Equation 3. The integral of the amplitude of separation at each of these points is
def f
or
Ax(y,z,t)dydz
/A. We will choose the structural design which has a higher
def f
during modal analysis,
as it will have a higher electrical response. For structural designs which have the same boundary condition
(points of xation) we can also use
dmax
, maximum amplitude of separation of the same mode shape to compare.
This is because calculating dmax is simpler than determining def f which involves integral.
5.2.2 Acoustic Characterization : Sensitivity and Frequency Response. We use frequency sweep, or chirp as
the input sound recording to observe the electrical response of SATURN microphone to characterize its quality.
Chirp is a sine wave linearly increasing in frequency (20Hz-20kHz) in a particular time period (Figure 7). We
standardize the 1000 Hz frequency to sound pressure level of 94
dBS P L
or 1 Pa pressure. The power in dB re
mV/Pa at 1000 Hz frequency is dened as acoustic sensitivity of microphone. It is used as a representative of the
sound quality of a microphone. JBL Flip 2 speaker (100 Hz-20kHz at frequency response) is used as sound input
device (frequency sweep, tone) for our experiments. The sound loudness was measured using Sound Pressure
Level (SPL) meter by Extech Instruments. The electrical response generated by SATURN microphone is measured
as voltage using Analog Discovery oscilloscope which has 1 Mresistance.
(a) (b)
Fig. 7.
Acoustic Characterization: (a) Chirp sound Input : linearly increasing 20Hz-20000 Hz frequency sweep in 20 seconds
(b) Experimental setup for recording electrical response of SATURN microphone.
Figure 8shows an example of the electrical response for SATURN microphone for the chirp sound input. We
use voltage as a measure of the electrical response, as the current produced by the SATURN device is extremely
small (nano-amps in magnitude), which makes it susceptible to the background noise. The maximum voltage is
achieved at the resonant frequency of approximately 275 Hz. At 1000 Hz, the acoustic sensitivity is -26.63 dB re
3
We used values of 3 GPa Young
'
s modulus of elasticity, 0.04 mm thickness, 47mm x 44mm dimensions, and 1.2
д/cm3
density for the
vibrating paper layer.
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:10 N. Arora et al.
mV/Pa. We will be using both a frequency response curve and acoustic sensitivity to select optimal structural
design parameters.
(a) (b) (c)
Fig. 8.
Example of electrical response from SATURN Microphone for chirp sound input: (a) Voltage time series output
(b) Spectrogram with linearly increasing frequency (c) Acoustic sensitivity variation across the audio frequency band
(20Hz-20kHz).
5.3 Separation Distance Optimization
The paper layer is a critical component to be designed precisely in the SATURN microphone structure to
maximize the separation distance between the two layers and hence the output from the device. To do so, we
introduce various structural changes to the paper layer, described next.
5.3.1 Paern of Holes in the Paper Layer.
(a) (b)
Fig. 9.
Introduction of holes enhances vibration: (a) mini-resonant air cavities formed between paper and PTFE which result
in reduction of air-dampening (b) Example of modal analysis of paper with and without holes showing introduction of holes
increases the dma x and de f f
The introduction of holes in a structure is a well known techniques to enhance vibrations in it. To test this
hypothesis, we performed modal analysis of a sheet of paper (3 GPa Youngś modulus of elasticity, 0.04 mm
thickness, 47mm x 44mm dimensions) and compared it with perforated paper with holes (400
µ
m diameter, 200
µ
m
spacing) (Figure 9). Both the models have similar mode shapes due to similar rigid support points and material
properties. This allows for comparison on the basis of two parameters, both of which are representative of the
voltage response Voc :
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:11
dmax :
The magnitude of maximum transverse deformation of paper with no holes is 145
µ
m, as shown in
the legend in Figure 9, while paper with no holes is 187 µm which is approximately 40 µm less.
def f :
Paper with no holes has eective separation distance of 40
µ
m , while the one with holes is 45.3
µ
m.
Both parameters
dmax
and
def f
, suggest that the holes on the paper can help in the optimization of separation
distance. We can explain this by the following reasons:
Holes allow the air to ow between the two layers, allowing air to pass through the holes and force the
two layers to move away from each other.
Perforated paper has less stiness. Bending stiness of a structure refers to the resistance to transverse
deformation. Thus, the perforated paper layer would result in larger separation distance as compared to
the paper layer without holes.
While introducing holes increases the separation between layers, it also reduces the contact surface area and
thus eective charge density
σ
is decreased, which would decrease the voltage. Thus, there is a trade-o between
contact area and the hole parameters of size, distribution, and pattern. Modeling vibrations of the system to
respect air pressure changes and weight is beyond the scope of this paper. Instead, we provide empirical results
to determine good hole dimensions.
(a) (b) (c)
Fig. 10.
Selection of dimensions for hole on paper: (a) 0.4 mm diameter hole had the best acoustic sensitivity amongst
dierent diameter sizes we tested. (b) Frequency response for dierent hole spacing shows that 0.2 mm spacing performs the
best with 0.4mm diameter. (c) Circular and grid hole paern performance.
Keeping the distance between holes xed at 0.2 mm, we fabricated a 4x4
cm2
SATURN microphone patches
with increasing hole diameter (Figure 10). 0.4 mm diameter hole achieved the best acoustic sensitivity of -26 dB
among our samples. Next keeping the hole diameter at 0.4 mm we increased the spacing between the holes to be
0.2 mm, 0.3 mm, and 0.4 mm i.e having percentage of hole area to be 35%, 26%, and 20% respectively. SATURN
microphone with 0.3 mm spacing gives the best acoustic sensitivity but the device with 0.2 mm spacing performs
slightly better within the rst 2 kHz frequency band, where more than 70% of the sound information is present[
9
].
Next, we experimented with two dierent patterns of holes – concentric and grid – to determine their eect
on the frequency response. The grid pattern of holes performed better than concentric pattern arrangement
We determined previously in our hole distribution study that 35% hole area performs better than the 25% hole
area. Since grid has 35% hole area it performs better than the concentric circle which is 25%. Thus, for all our
future experiments and modal analysis we will choose to use 0.2 mm hole spacing, 0.4 mm hole diameter in a
grid pattern.
5.3.2 Paper and PTFE Aachment Position. By controlling the locations where paper is attached to the PTFE
in the SATURN microphone structure, we can generate motion with a higher amplitude of motion with the
same sound input. This can be done by choosing attachment points which are coincident with the nodes of zero
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:12 N. Arora et al.
movement for majority of the mode shapes possible (Figure 11). We tested two cases for the perforated paper
model: glued across all the edges; and glued at 9 points like a grid.
(a) (b)
Fig. 11. Dierent aachment positions: (a) paper glued to PTFE across all edges (b) paper glued to PTFE at 9 points
Figure 12 shows the modal shapes for mode 3 for paper in the two cases discussed. Just by visual observation
we can notice that mode shape for paper pasted at edges (case 1) is out of phase, creating minimum and maximum
contact with PTFE at the same time, whereas for the 9 glue points (case 2) they are in phase. In addition, as shown
the legend,
dmax
for case 2 is 7
µ
m (194
µ
m
187
µ
m) more than case 1. This trend is also supported by
def f
as
case 2 (52.6
µ
m) is 8
µ
m more than case 1 (45.3
µ
m). By simulations we can conclude that 9 points glue grid has
more separation distance and thus consequently should generate more electrical signal.
(a) (b)
Fig. 12.
Modal analysis demonstrates that grid-glue paern aachment performs beer than glue on all edges: (a) mode 3
of paper glued at all edges showing maximum. separation distance to be 187
µ
m (b) mode 3 of paper glued at 9 points like a
grid with maximum separation distance of 194µm.
We validated these simulation results with empirical measurements. By simply changing the anchoring of the
paper layer to the PTFE, there is a large jump of approx 20 dB (re mV/Pa) in the power of the voltage measured
(Figure 13a ) all across the frequency band.
Having grid like glue pattern allows the edges to vibrate which are otherwise restricted in the glue pattern where
all edges are pasted. This eect becomes more enhanced at higher frequencies (mode 14 shown in Figure 13b),
where edges haver even higher amplitude of separation than even the central nodes. By choosing appropriate
boundary conditions of the xed points, the maximum vibration amplitude can be obtained under certain load
conditions to increase the voltage.
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:13
(a) (b)
Fig. 13.
Impact of gluing paern: (a) Increase of approximately 20 dB with 9-point grid glue paern (red line). (b) Modal
analysis of perforated square paper with holes pasted at 9 points demonstrating involvement of edges which increases the
voltage response.
5.3.3 Changing the Geometry. Changing the geometry of the surface on which sound is incident while
maintaining the same area changes the air pressure which is applied at dierent points. This changes the mode
shapes and aects the way the structure will exchange kinetic-energy and strain-energy at its nodes and anti-
nodes. Thus geometry impacts the amplitude of vibrations which directly impacts the separation distance and
the output voltage.
We tested two dierent geometries with same 1600
mm2
area: a square (4x4
cm2
); and a circle (22.57mm
diameter). Experimentally, up to 1000 Hz the circle and square perform nearly the same. For higher frequencies,
the circle performs almost 10 dB better than the square (Figure 14a). Thus, choosing a circular shape for the
SATURN microphone would improve sound quality. A modal analysis conrms our empirical results. Just by
visual inspection the
dmax
, the amplitude of maximum separation reached by circle is almost 16
µ
m more (Figure
14b) than square. We use Equation 3to calculate
def f
, eective separation amplitude, which was found to be
67.2
µ
m for the circle and 52.6
µ
m for the square, that is approximately 15
µ
m more. After optimizing device
structural parameters both theoretically and empirically for the separation distance, we are able to reach the best
acoustic sensitivity of -25.63 dB (re mV/Pa) at 1000 Hz with a circular shape of 16
cm2
area with a grid pattern of
holes of 0.4mm diameter and 0.2mm spacing glued at 8 equally distant points around the edges and the center to
the PTFE.
(a) (b)
Fig. 14.
Circular shape performs beer than square of the same area : (a) Experimental analysis of eect of geometry on
Frequency response (b) modal analysis for circle and square for mode 3 showing circle has more max. amplitude of separation
5.4 Optimization of Surface Charge Density
5.4.1 Plasma treatment for PTFE surface. Equation 3shows that the voltage response of the SATURN micro-
phone is dependent on the surface charge density, which is the measure of electric charge per unit length. Fan et
al. [
10
] used PTFE polymer nanowires to increase the charge density
σ
by increasing the eective surface area of
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:14 N. Arora et al.
the dielectric surface in contact. Growing nano-wires is a very expensive process which is currently unsuitable
for large scale, low-cost manufacturing. To understand the eect of such nano-structures on PTFE for SATURN
microphone’s performance, we use a simpler, though still relatively expensive, method called plasma treatment.
The PTFE was etched by
O2
plasma produced by a PE-100 Plasma System (from Plasma Etch Inc.)
O2
was
uniformly distributed in the reactor throughout the etching process. Figure 15a shows schematic diagram of
the O2 etching process where a blast of high-speed stream of glow discharge is shot at PTFE. The RF power
input was 300 W using a 13.56 MHz RF generator with RF auto-matching network and the plasma treatment time
was 20 min. Figure 15b shows the scanning electron microscope (SEM) image of PTFE after plasma treatment.
This PTFE was later coated with copper using as general fabrication process explained in section 4. Due to
increased roughness on the PTFE surface resulting in increased contact electrication the performance with
plasma treatment improves by approximately 10 dB across the entire frequency response as shown in Figure
Figure 15c.
Even though there is an increase in the signal quality, with acoustic sensitivity of -16.28 dB re mV/Pa, the cost
addition does may not justify the performance increase for SATURN microphone fabrication in many scenarios.
Therefore for our further experiments we have tried to focus more on regular PTFE rather than one treated with
plasma.
(a) (b) (c)
Fig. 15.
Eect of Plasma treatment on SATURN microphone sensitivity (a) Schematic diagram of
O2
plasma etching (b)
Scanning Electron Microscope (SEM) image of plasma treated PTFE used for SATURN mic manufactured at 500nm scale (c)
Experimental comparison between performance of SATURN microphone fabricated with PTFE treated with and without
plasma
5.5 Intra-device Performance Results
Fig. 16. Intra-device performance of SATURN microphone patch represented as deviation in acoustic sensitivity. (n=6)
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:15
To use the SATURN microphone in applications, it is important to have an understanding of the variation
in its electrical performance between instances of similarly manufactured examples, what we call intra-device
performance. In an ideal device fabrication process, each device should be identical to another, but in practice
deviations may be introduced due to dierent batches of base materials or construction precision. To understand
reproducibility of our fabrication process, we constructed six SATURN microphone devices ( square 4x4
cm2
patches, non-plasma PTFE, optimal holes, grid-like glue attachment).
Figure 16 shows the standard deviation of acoustic sensitivity (1000 Hz tone at 94
dBS P L
) performance. All
devices have
>
-35 dB acoustic sensitivity, with the best performance at -26.44 dB and mean as -29.5 dB. The
intra-device reproducibility has tolerance of 10 db for our fabrication process.
6 MOUNTING OF SATURN MICROPHONE
Just as a pattern of holes allows for greater vibration of the paper layer, so to can the support structure used to
mount the PTFE layer aect its vibration, and thus the electrical response of the SATURN microphone.
6.1 Supported vs Unsupported Back Frame Structures
To understand the eect of a back support, we experimented with two kinds of frames (Figure 17a): a full solid
back support; and a hollow frame, in which we cut a hole to allow more vibration. The material used for the
frame was foam board to which a non-plasma treated 4x4
cm2
SATURN patch with optimal separation distance
parameters was attached.
The performance decreased by approximately 10 dB with the solid back support as compared to the frame
with no support. This is because having a support at the back restricts the free movement of PTFE (Figure 17b).
Interestingly, having back support showed an increase in sensitivity around 6-8kHz, while its framed counterpart
just has a decreasing trend. We studied this further by doing modal analysis combined system of of PTFE (440 MPa
Young
'
s modulus of elasticity, 0.05 mm thickness, 2.2
д/cm3
density) pasted to foam-board (Young’s modulus 0.1
GPa, 0.5mm thickness, 0.3
д/cm3
density). The
def f
, amplitude of eective separation for natural frequencies of
the system at 2887 Hz is 28 mm while 6900 Hz is about 34 mm. This behavior may be attributed to the coherence
of natural frequency of movement for PTFE and back-support. Further consideration of dierent solid back
supports is warranted, as they might produce sensitivity peaks at dierent frequency bands. We address this next.
(a) (b) (c)
Fig. 17.
Eect of dierent support structures on the signal quality : (a) Frames with full back support and unsupported with
hole (b) Frequency response comparison between supported and unsupported (c) Modal analysis of combined PTFE/Foam
structure with full back support at 2887 Hz and 6962 Hz which explains the sudden rise in sensitivity around 6-8 kHz
6.2 Back Support Materials
Even though the framed, unsupported structure is better, there might be situations when a SATURN microphone
needs to be embedded directly onto an object. We embedded the device on dierent material surfaces (Figure 18)
to determined their frequency response. Table 1shows the acoustic sensitivity we recorded from the experiment
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:16 N. Arora et al.
Fig. 18.
Frequency response for dierent frame materials
for full back support
Back Support Material Youngś Modulus (GPa) Sensitivity(dB)
thin foam core 0.1 -30
thick foam board 0.5 -32
cardboard 0.9 -32
wood 3 -35
plastic 10 -37
aluminum 70 -64
Table 1.
Eect of back support material on Acoustic Sensi-
tivity of SATURN : Back support material with lower Youngś
Modulus results in higher sensitivity
versus the Youngś modulus of the material. There is a correlation between the exibility of the material and
the sensitivity of a SATURN microphone mounted on that material. For example, metal, with highest stiness
amongst all materials tested, reduces the vibration more than plastic or wood. Thus the back support material
properties are a factor in determining the signal quality.
6.3 Orientation
(a) (b)
Fig. 19.
Eect on orientation on acoustic sensitivity (a) Schematic diagram of experimental setup showing the SATURN mi-
crophone in vertical and horizontal positions with 94 dB sound incident (b) polar paerns representing SATURN Microphones’
directionality
Changing the orientation of the SATURN microphone changes the sound eld incident on it and consequently
electrical response produced due to the vibrations. For example, a SATURN microphone placed on a table would
receive dierent amplitudes of voltage for its horizontal and vertical orientations.
To understand this better, we performed an experiment with SATURN microphone (4
x
4
cm2
optimal structural
parameters, non-plasma PTFE, attached to foam-board frame with unsupported back) placed horizontally and
vertically as shown in Figure 19. A sound source of 1000 Hz frequency tone at 1 Pa was rotated from 0 to 360
degrees around the microphone to plot the directivity pattern. The SATURN microphone is omnidirectional in both
horizontal and vertical orientations which is useful for applications such as gathering context in the environment.
However, when SATURN is embedded on objects with full back support, we would obtain unidirectional directivity
of the microphone, i.e, a semi circle instead of a circle.
In addition when tested for dierent orientation, there is drop in acoustic sensitivity by 10 dB when SATURN
is placed horizontally in front of the sound source as opposed to vertically. Even though vertical orientation is
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:17
preferred, there may be applications where horizontal placement is required, as such the experimental comparison
is important.
6.4 Patch Size
For a traditional microphone, the size of the diaphragm aects the microphone
'
s sound pressure level handling,
sensitivity, dynamic range and internal noise level. The SATURN microphone is similar to the diaphragm of the
traditional microphone, so it is reasonable to consider how its size impacts performance.
We did a preliminary test of 3 dierent sized SATURN patches ( 8x8
cm2
,4x4
cm2
, 2x2
cm2
), each using the
structural parameters that produce the best results for the 4x4
cm2
patch described earlier (Section 5) and placed
on vertical frame with sound chirp input. The acoustic sensitivity is -18 dB, -25 dB, and -40dB respectively,
suggesting improved performance for a larger SATURN microphone. These preliminary results show a favorable
trend, but a more in depth analysis is needed, and each patch size should be separately optimized, in the same
way we optimized for the 4x4 cm2size.
(a) (b)
Fig. 20.
Eect of SATURN microphone size on the signal quality (a)dierent patch sizes used for experiment (b) Acoustic
sensitivity comparison plot for dierent sizes
6.5 Flexibility
The SATURN microphone has a thin structure which gives it the aordance to be bent. It is important to
understand how the bending impacts the signal quality. Bending of any object adds strain in the object, which
leads to increased potential energy, and loss of ability to vibrate or gain kinetic energy. We study the eect of
bending using 4x4
cm2
SATURN microphone patch with non-plasma PTFE with optimal holes size and xing
point. The patch is bent to 7 dierent radii of curvature corresponding to the central angle theta (5
, 15
, 30
, 45
,
60
, 75
, 100
) as shown in Figure 21a. We performed modal analysis for the curved 3D models of paper with
holes for 4 dierent angles - 5
, 15
, 30
and 45
. Figure 21b shows the eective amplitude of separation,
def f
of
the 4 models for mode nearest to 1000 Hz, the frequency where acoustic sensitivity is dened. Figure 21c is the
snapshot of the corresponding to
def f
. We can see that the with increase in bending
def f
reduces almost linearly.
Next, we performed the experiment to determine change in acoustic sensitivity with increased bending for
fabricated 4x4
cm2
patch. The SATURN patch was embedded in cardboard as shown in the Figure 22a and bent at
7 dierent radii of curvature successively making sure that the cardboard follows the lines of curvature. Figure
22b shows successive drop in acoustic sensitivity with smaller radii of curvature, thus following the expected
trend from modal analyses. Having a SATURN microphone structure and bending it results in an increased
bending stiness, which eects the ability of the SATURN microphone to vibrate and reduces the voltage it can
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:18 N. Arora et al.
achieve. A at SATURN mic patch used can achieve sensitivity of -27.3 dB which reduces by 8 dB for 45 degrees
bent. For the next 45 degrees of bending the drop is much more enhanced as the stiness increases.
(a) (b) (c)
Fig. 21. Eect of flexibility on Eective separation (a) 7 dierent radii of curvature were drawn on paper corresponding to
central angle theta which 4x4
cm2
patch would make when bent (b) plot demonstrating decrease in eective separation
distance with increased bending (c) Modal analysis of 3D meshed model of paper at when subjected to 1 Pa pressure at 1000
Hz
As a result of the design and the fabrication process, the SATURN patch reliability in exible scenarios may be
strongly aected by material stress on the glue points, and tension in the material when transitioning from at to
bended layouts. Some scenarios were tested during the exibility analysis, however a more extensive analysis
on the fabrication process for exible scenarios is required in order to nd a solution that preserve the sound
sensitivity and adaptability to dierent shapes.
(a) (b)
Fig. 22.
Experimental results for eect of flexibility (a) SATURN microphone was bent accurately to follow the curved
curvature line e.g. 30(b) Change in acoustic senstivity (1000Hz @ 94 dBS P L obtained for dierent radii of curvature
7 COMPARISON TO COTS MICROPHONE
There are factors in microphone device design—signal quality, power, form factor (size and exibility) and
cost/ease of manufacture—which dictate whether a given acoustic sensor meets the requirements of any given
acoustic application. Device designers often face the trade-o between the sensor signal quality and the other
design parameters. For example, condenser microphones are used in the recording studio have very high sound
quality but consume power in tens or hundreds of mW and are relatively expensive, all of which is appropriate
for that niche application. Electret microphones, commonly found in consumer electronic devices, consume
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:19
200-500
µ
W to achieve sensitivity greater than -25 dB. They mostly use power as biasing voltage for the MOSFET
or for amplication.
We compared 3 commercially-available o the shelf (COTS) microphones with SATURN mic – 1. iPhone
6s which has invensense INMP441 [
18
] 2. Sparkfun’s MEMS ADMP 401 with 1.5V of DC bias voltage [
58
] 3.
Omni-Directional Foil Electret Microphone with 1.5 DC bias [
57
], in the same lab setting with same input chirp
sound input as used for our previous SATURN mic experiments. We rst performed these experiment in a quiet
room with 45
dBS P L
measured as silence. The SNR was calculated by subtracting the power of the ambient/silent
recordings (noise) of the microphone being studied from the power obtained by the chirp input (signal). Since
all measurements were done in the same room settings, it is fair to do a comparative measurement of dierent
microphones.
Fig. 23. SNR Comparison with COTS Mic
Mic 1kHz 5kHz Power(µW)
SATURN plasma 74 60 0
SATURN non-plasma 64.3 50 0
MEMS ADMP-401 67 62 375
Foil electret condenser 58 63 750
iPhone(INMP441) 82 86 2880+
Table 2.
SNR(dB) at 1kHz, 5kHz and Power con-
sumed for dierent mic
Figure 23 shows the Signal-to-noise-ratio(SNR) plot wrt to frequency and the table 2provides the summary
of SNR at 1 kHz and 5 kHz as well as power required by each microphone for operation. At 1000 Hz iPhone’s
microphone performed 20 dB better than the non plasma-treated PTFE SATURN microphone and approximately
10 dB better than the plasma-treated PTFE SATURN microphone. This was expected given the iPhone microphone
has both hardware and software ampliers to improve the quality of signal. The SNR curve of the self-powered
SATURN microphone with plasma treatment is comparable to Sparkfun ADMP 401 and Foil electret condenser
with 1.5 V bias, up to 5000 kHz. The passive SATURN microphone is competitive with some active microphones
in terms of signal quality till 5000 Hz. In addition to being self-powered, SATURN microphone’s exibility lends
it the ease of being embedded in dierent physical objects.
A MEMS microphone is another interesting comparison point. These are also small microphones that can be
embedded in objects. They oer low power consumption [
29
] of approximately 40
µ
W at -20 dB sensitivity. While
this may seem like a small power budget, it would not be appropriate for scenarios requiring a large number of
microphones or very long life. It would be better to use that power budget for other local computing tasks[
13
]
or communication[
61
]. MEMS is also a fairly complex micro-fabrication techniques compared to our SATURN
design.
8 POWER HARVESTING ANALYSIS
We performed an experiment to determine the peak voltage and peak power of the SATURN microphone as
functions of the external load resistance at its resonance frequency. The resonant frequency of the SATURN
microphone can vary slightly with each fabricated patch. Thus, we rst perform a frequency sweep to determine
the system’s maximum
Vope nci r cu it
of 0.9 Volts at 255 Hz with a 105
dBS P L
sound source. The measurements
for the experiment were done using a capacitative oscilloscope (Kiethley 6514). Next, the external loads were
changed successively using a variable resistance box (Elenco electronics) and the corresponding
Vpea kp ea k
was
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:20 N. Arora et al.
recorded. As shown in Figure 24a, the output
Vpea kp ea k
increases quickly as the resistance increases from 0.1
to 2 M
and approaches an asymptote at 8 M
resistance. When we wish to use the SATURN microphone
as a sensor, a load resistance of 8 M
would give the best result. Such high resistance,however, is not ideal for
general electronic circuits. We suggest using a load resistance of 2 M
when connecting the SATURN mic as an
audio sensor. Figure 24b shows the power vs load resistance curve, where power is calculated as
V2
pp /Rl oad
. A
maximum power of 6.9 micro Watt can be generated from the SATURN microphone at a load impedance of 0.9
Mwhen excited by a 255 Hz tone at 105 dBS P L .
(a) (b)
Fig. 24.
Determination of load resistance : (a) peak voltage (b) peak power of 4x4
cm2
SATURN microphone as functions of
the external load resistance at resonance frequency
Going further, we analyzed the 4x4
cm2
SATURN non-plasma microphone patch as a power harvestor. The
power curve and
Vpp
with a load of 0.9 M
at dierent frequencies is shown in Figure 25. The voltage is
approximately 0.5 Vpp at 150 Hz and rises to 2.5 Vpp and then comes back down again at 350 Hz. The same
behavior is shown in the power curve, with a maximum of 6499 nW.
Fig. 25.
SATURN as power harvester : Voltage and power generated for dierent
working frequencies
Size of patch 4x4 cm2
Type of patch Non-plasma
Resonant Frequency 255Hz
Load Impedance 0.9M
Max. Vpp 2.5V
Max. Power 6944 nW
Table 3.
Summary table of power
generated by SATURN at 105 dBS P L
9 EXPLORING THE APPLICATION SPACE
We explore dierent application scenarios where the SATURN microphone can be embedded in everyday
settings. The applications mentioned are exploratory in nature, and are shown to demonstrate that the quality
of the audio signal recovered by SATURN microphone in dierent congurations is good enough to support a
variety of interesting situations. The rst two applications take advantage of SATURN as a passive microphone
with a thin and exible form factor. However, the full application still requires signal acquisition and processing
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:21
from traditional computing devices. The third example, while not implemented, demonstrates the potential for
using SATURN and its power harvesting capability to provide a more end-to-end service.
9.1 Localization of Speakers around a Tabletop
The SATURN microphone is a skin-like sensor that can be placed on dierent at or curved surfaces in a room
like a curtain, wall, or a table top to gather context. Multiple SATURN microphone patches can easily be placed
on the surface of a table, and in combination can be used to localize a speaker. As people speak, the location
can simply be determined by comparing voltage output of multiple SATURN microphone patches. The patch
placed near to the speaker will pick up more signal than one placed further such that even a simple algorithm of
threshold amplitude comparison can detect which speaker is actively talking. Figure 26 shows a simple example of
such localization. When speaker A (yellow) speaks, the closer SATURN microphone (1) has higher amplitude than
the other microphone (2). Similarly, when speaker B (blue) starts speaking, the closer microphone (2) has higher
amplitude than the other microphone (1). Such infrastructure can be expanded to multiple parts of the table, given
the number of speakers. We could even imagine placing the SATURN microphones on the walls/ceilings/oors in
order to localize speakers within the entire room using more sophisticated processing of the combined signals.
Fig. 26.
Localization of speakers around a tabletop : Multiple SATURN microphones are placed on the table for localization
of speaker. The SATURN microphone placed nearer to the the speaker has more voltage output e.g. the microphone 1 has
higher electrical output than microphone 2 when speaker A speaks and vice versa
9.2 A Sound-sensitive Bole
(a) (b) (c) (d)
Fig. 27.
A Sound-sensitive Bole : (a) SATURN microphone embedded in a soda bole (b) user talking to soda bole (c)
recovered audio signal (d) spectrogram
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:22 N. Arora et al.
The SATURN microphone’s exibility and form factor allows the possibility of attaching a microphone to
everyday objects, such as a bottle (Figure 27a). A 4
x
4
cm2
SATURN patch was placed on a soda bottle to enable
interactions. A person may give voice commands like - "let’s share a coca cola" which can enable control like
actuating a display (Figure 27b). The time series graph of live speech is shown in the time series voltage (Figure 27c)
with corresponding spectrogram (Figure 27d), which shows sucient detail to do spectral feature extraction. With
appropriate storage, computation and communication, we can imagine a wide variety of interactive voice-activated
capabilities, and that is a direction we are pursuing.
9.3 Ambient Monitoring of Acoustic Scenes
In Section 8, we characterized the capabilities of SATURN as a power harvesting solution. Here, we demonstrate
how that power can be used to ip a bit in a non-volatile memory cell in response to a loud sound. Next, we
suggest how that bit might be read using a passive RFID mechanism. Such a system could be used for inexpensive,
battery-free ambient monitoring of sources of noise pollution. Going further, we suggest that SATURN could
power radio transmitters being designed in the literature [
35
,
61
] as long as the sound was maintained, allowing
real-time alerts to sounds that exceed a loudness threshold. In this manner, acoustic environmental monitoring
can be performed without the cost and environmental diculties of batteries.
Applications include monitoring for sound thresholds exceeding human hearing tolerance, such as in con-
struction zones, mines, music venues, power stations, airports, spaceports, and military environments. Similarly,
SATURN-based sensors might be used for monitoring events such as landslides, avalanches, polar ice breaking,
mine cave-ins, and mine gas explosions. In a more futuristic application, United Nations could drop SATURN-
based sensors from an airplane into a conict zone. The sensors would monitor the acoustic environment for
the movement of tanks, mortars, or exploding ordinance. Later, an ocer with a reading device might sweep
the eld to interrogate the sensors. In a more extreme scenario, a low ying helicopter might sweep a strong RF
signal over the region and record which sensors report hearing an event. The pattern of reporting sensors can
reveal the direction of travel and point to possible hiding areas for that equipment which could possibly prevent
destruction and loss of lives.
Fig. 28. Recording a loud acoustic event using power generated from a SATURN microphone.
As a motivating example, imagine an airport that would like to monitor its acoustic environment so as to
not exceed safe noise levels for its employees or to keep aircraft noise footprints within airport boundaries as
shown in Figure 28. A SATURN-based system can be tiled on various buildings and at various distances on the
runway. As planes take o, they generate loud sounds due to gears, fans, and air turbulence. The peak in the
sound spectrum generated by aircraft is near the 200-300 Hz band (Figure 45 in [
21
]) with decibel levels reaching
>
105
dbS P L
at 5m
4
. These values are consistent with the resonant frequency of the SATURN patch and would
result in generation of power
>
6.9
µ
W accumulated over dierent frequency bands. Considering the maximum
power transfer theorem (Jacobi’s law) the usable power we can obtain from such phenomenon is approximately
4NASA jet engine spectra : https://www.grc.nasa.gov/WWW/Acoustics/Education/InternArchive/Schifer.htm
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:23
50%. Thus, we might harvest up to 3.4
µ
W. The energy required to program a “1” in a NAND ash memory is 2
µ
J
[
37
]. Given that the sounds we are expecting will probably last for several seconds, there is more than enough
power to record the acoustic event. Going further, SRAM bits can be ipped at approximately 10-100 pW of
power [
14
,
51
], suggesting that rudimentary computation might be performed to determine if the ash memory
bit should be written. A worker can then visit each SATURN site, interrogating the system using a passive RFID
mechanism. When the worker places the active RFID reader above each SATURN system, it reads the state of the
recorded bit and resets the system so that it is ready to catch the next episode.
Going further, after detecting a loud sound, the SATURN system might use its harvested power to power a
RF transmitter to announce the event. For example, Talla et al. [
60
] have recently demonstrated an 915MHz
analog LoRa backscatter communications device that can communicate at greater than 11 bits/sec while hundreds
of meters away from its RF source and receiving antenna. While their system currently uses a battery, their
theoretical IC design consumes only 9.25 micro-watts of power. With sound events lasting on the order of seconds,
one can imagine a SATURN-based system storing power until it has enough to enable a 915Mhz backscatter
transmission to the receiving antenna, announcing the event. As long as the event continues to occur, the SATURN
system can transmit alerts every few seconds to a remote monitoring station.
For applications where the remote monitoring station can be closer, a SATURN-based system might transmit
audio instead of simply an alert. Again, recent work by Talla et al. [
61
] has shown a ”battery-free” phone
which is powered by a transmitter 9.4 meters away. The system requires only 3.48 micro-watts of power to
run continuously, which is barely within the range of what a SATURN patch might produce. Leveraging the
implementation tested by these researchers, one can imagine a system design where SATURN provides both the
power and the signal to stream audio during a loud acoustic event. More practically, however, SATURN might
store power for a few seconds at the beginning of an event and then connect to the remote server to stream audio
for a few seconds. In this manner the system might provide a further transmit distance.
10 DISCUSSION
10.1 Limitations of SATURN Microphone Design
We have discussed how SATURN microphone is a passive audio sensor that may enable systems to save
power on the sensing layer of a low power infrastructure, and although SATURN still requires an external
signal processing, we explored possibilities to leverage signal processing through low power analog wireless
communication and computing.
As part of that goal, for this self-powered design we removed components that required external power to
operate and are common in commercial microphones, such as ampliers. This comes at the price of reduced audio
sensitivity, and as a result the SATURN patch’s performance drops o at frequencies above 5kHz. Though we
have only scratched the surface in terms of optimizing the design for performance, our implemented applications
demonstrate there are already compelling uses for SATURN.
As a result of the design and the materials selected for fabrication, the SATURN patch may be aected by
environmental conditions such as humidity, wind and extreme vibration. Most of the tests conducted were under
controlled environments, and further analysis is required for determining the eect of such adversarial conditions,
as well as overall durability of the design over time.
10.2 Future Work
We were able to improve the SATURN microphone design by introducing new structural parameters, specically
hole dimensions and attachment points in the paper layer. A more comprehensive model of the paper and PTFE
layers and their interactions will provide deeper understanding into the attachment points for patches of dierent
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:24 N. Arora et al.
sizes, shapes and exibility. This could also help design SATURN microphone patches tuned at dierent resonant
frequencies for dierent applications.
We have described a semi-automated manufacturing process for the SATURN microphone. There is great
motivation to explore the automation of the production of SATURN-like microphones. In addition to a more
exhaustive exploration of the design parameters of a single patch, there is an interesting opportunity to explore
very large scale and coordinated SATURN patches that could cover a whole table surface or wall, resulting
in a microphone array. We are investigating ways to connect SATURN patches via printed electronics and
other low-cost scalable manufacturing techniques. Some applications of SATURN microphone patches suggest a
disposable use, such as a label on a bottle. The low cost of SATURN makes that a possibility. Other applications,
such as enabling a tabletop surface or wall to do auditory scene analysis or a building/road surface triggering
noise alerts, consider the long-term use of such a material. The former short-term applications require very
inexpensive manufacturing processes, while the latter require durability.
When we discussed the use of SATURN patches to perform ambient monitoring of acoustic scenes, we
introduced the opportunity to transmit the harvested audio signal o the SATURN patch via mechanisms like
analog backscatter [
61
]. This opens up the possibility of more self-sustained application scenarios, what we
consider the most compelling direction for our future research. To take advantage of SATURN microphone
as a self-powered sensor with high acoustic sensitivity, we should either connect it to low power processor
[
13
,
49
,
55
] which allows for both operation and recognition of sound in about a few tens of micro-watts as
shown in Figure 29 or send the audio to remote base station for recognition using analog backscatter [
61
] which
would only consumes a few micro-watts which can be harvested from the environment.
Fig. 29.
Low-power realtime local sensing and recognition system design : Schematic diagram of self-powered analog sensor
like SATURN microphone connected to analog recognition SoC like Field Programmable Analog Arrays[13]
11 CONCLUSION
Inspired by earlier work in materials science that demonstrated the opportunities for harvesting energy from
the triboelectric eect, we have presented the design, evaluation and potential use of the SATURN microphone.
The thin and exible two-layer SATURN microphone design has favorable audio performance when compared to
other passive and active microphones and requires no power. SATURN’s simple fabrication process and ease of
deployment on a variety of surfaces enables new opportunities for audio sensing over large indoor/outdoor areas
for both mobile and stationary objects. SATURN may enable battery-less remote sensing for acoustic events,
which has potential applications in controlling noise pollution, workplace safety, environmental monitoring, and
military situation awareness.
ACKNOWLEDGMENTS
The authors would like to thank Dr. Byron Boots, Dr. Jennifer Hasler, Dr. Omer Inan, Dr. Cheng Zhang and Dr.
Mark Clements for their discussions and feedback which help shape this work.
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:25
REFERENCES
[1]
Roberto Aimi. 2007. Percussion instruments using realtime convolution: Physical controllers. In Proceedings of the 7th international
conference on New interfaces for musical expression. ACM, 154–159.
[2]
Thiago AL Burgo, Telma RD Ducati, Kelly R Francisco, Karl J Clinckspoor, Fernando Galembeck, and Sergio E Galembeck. 2012.
Triboelectricity: macroscopic charge patterns formed by self-arraying ions on polymer surfaces. Langmuir 28, 19 (2012), 7407–7416.
[3]
Jun Chen, Guang Zhu, Weiqing Yang, Qingshen Jing, Peng Bai, Ya Yang, Te-Chien Hou, and Zhong Lin Wang. 2013. Harmonic-resonator-
based triboelectric nanogenerator as a sustainable power source and a self-powered active vibration sensor. Advanced materials 25, 42
(2013), 6094–6099.
[4] Tanzeem Choudhury and Alex Pentland. 2003. Sensing and modeling human networks using the sociometer. IEEE, 216.
[5]
Mary T Cord, Rauna K Surr, Brian E Walden, and Laurel Olson. 2002. Performance of directional microphone hearing aids in everyday
life. Journal of the American Academy of Audiology 13, 6 (2002), 295–307.
[6]
Kai Dong, Jianan Deng, Yunlong Zi, Yi-Cheng Wang, Cheng Xu, Haiyang Zou, Wenbo Ding, Yejing Dai, Bohong Gu, Baozhong Sun,
et al
.
2017. 3D Orthogonal Woven Triboelectric Nanogenerator for Eective Biomechanical Energy Harvesting and as Self-Powered
Active Motion Sensors. Advanced Materials 29, 38 (2017), 1702648.
[7] John Eargle. 2012. The Microphone Book: From mono to stereo to surround-a guide to microphone design and application. CRC Press.
[8]
Gary W Elko and Kieran P Harney. 2009. A History of Consumer Microphones: The Electret Condenser Microphone Meets Micro-
Electro-Mechanical-Systems. Acoustics Today 5, 2 (2009), 4–13.
[9]
Tiago H Falk, Chenxi Zheng, and Wai-Yip Chan. 2010. A non-intrusive quality and intelligibility measure of reverberant and dereverber-
ated speech. IEEE Transactions on Audio, Speech, and Language Processing 18, 7 (2010), 1766–1774.
[10]
Xing Fan, Jun Chen, Jin Yang, Peng Bai, Zhaoling Li, and Zhong Lin Wang. 2015. Ultrathin, rollable, paper-based triboelectric
nanogenerator for acoustic energy harvesting and self-powered sound recording. ACS nano 9, 4 (2015), 4236–4243.
[11]
Freeman W Fraim, Preston V Murphy, and Robert J Ferran. 1973. Electrets in miniature microphones. The Journal of the Acoustical
Society of America 53, 6 (1973), 1601–1608.
[12] J Frieden. 2005. Modern sensors. Handbook. Moscow, Technosphere (2005).
[13]
Suma George, Sihwan Kim, Sahil Shah, Jennifer Hasler, Michelle Collins, Farhan Adil, Richard Wunderlich, Stephen Nease, and Shubha
Ramakrishnan. 2016. A programmable and congurable mixed-mode FPAA SoC. IEEE Transactions on Very Large Scale Integration (VLSI)
Systems 24, 6 (2016), 2253–2261.
[14]
Nad Gilbert, Yanqing Zhang, John Dinh, Benton Calhoun, and Shane Hollmer. 2013. A 0.6 V 8 pJ/write non-volatile CBRAM macro
embedded in a body sensor node for ultra low energy applications. In VLSI Circuits (VLSIC), 2013 Symposium on. IEEE, C204–C205.
[15] Victor Giurgiutiu. 2007. Structural health monitoring: with piezoelectric wafer active sensors. Academic Press.
[16]
Ebenezer Hailemariam, Rhys Goldstein, Ramtin Attar, and Azam Khan. 2011. Real-time occupancy detection using decision trees with
multiple sensor types. In Proceedings of the 2011 Symposium on Simulation for Architecture and Urban Design. Society for Computer
Simulation International, 141–148.
[17]
Xu He, Yunlong Zi, Hua Yu, Steven L Zhang, Jie Wang, Wenbo Ding, Haiyang Zou, Wei Zhang, Canhui Lu, and Zhong Lin Wang. 2017.
An ultrathin paper-based self-powered system for portable electronics and wireless human-machine interaction. Nano Energy 39 (2017),
328–336.
[18] Invensense. 2014. Invensense INMP441. https://www.invensense.com/products/digital/inmp441/
[19]
Mustafa Emre Karagozler, Ivan Poupyrev, Gary K Fedder, and Yuri Suzuki. 2013. Paper generators: harvesting energy from touching,
rubbing and sliding. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, 23–30.
[20]
Yoshihiro Kawahara, Steve Hodges, Benjamin S Cook, Cheng Zhang, and Gregory D Abowd. 2013. Instant inkjet circuits: lab-based inkjet
printing to support rapid prototyping of UbiComp devices. In Proceedings of the 2013 ACM international joint conference on Pervasive and
ubiquitous computing. ACM, 363–372.
[21]
Mehdi R Khorrami, Ehab Fares, and Damiano Casalino. 2014. Towards full aircraft airframe noise prediction: lattice Boltzmann
simulations. In 20th AIAA/CEAS aeroacoustics conference. 2481.
[22]
Sunkook Kim, Hyuk-Jun Kwon, Sunghun Lee, Hongshik Shim, Youngtea Chun, Woong Choi, Jinho Kwack, Dongwon Han, MyoungSeop
Song, Sungchul Kim, et al
.
2011. Low Power Flexible Organic Light-Emitting Diode Display Device. Advanced Materials 23, 31 (2011),
3511–3516.
[23] Soo-Jin Kim and Jang-Sik Lee. 2010. Flexible organic transistor memory devices. Nano letters 10, 8 (2010), 2884–2890.
[24]
Sang Choon Ko, Yong Chul Kim, Seung Seob Lee, Seung Ho Choi, and Sang Ryong Kim. 2003. Micromachined piezoelectric membrane
acoustic device. Sensors and Actuators A: Physical 103, 1 (2003), 130–134.
[25]
Timilehin Labeodan, Wim Zeiler, Gert Boxem, and Yang Zhao. 2015. Occupancy measurement in commercial oce buildings for
demand-driven control applications : A survey and detection system evaluation. Energy and Buildings 93 (2015), 303–314.
[26]
Oscar D Lara and Miguel A Labrador. 2013. A survey on human activity recognition using wearable sensors. IEEE Communications
Surveys and Tutorials 15, 3 (2013), 1192–1209.
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:26 N. Arora et al.
[27]
Eric C Larson, Mayank Goel, Gaetano Boriello, Sonya Heltshe, Margaret Rosenfeld, and Shwetak N Patel. 2012. SpiroSmart: using a
microphone to measure lung function on a mobile phone. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. ACM,
280–289.
[28] Jerad Lewis. 2012. Understanding microphone sensitivity. Analog Dialogue 46, 2 (2012), 14–16.
[29] Jerad Lewis and Brian Moss. 2013. MEMS Microphone: The Future for Hearing Aids. Analog Dialogue 47 (2013), 3–5.
[30]
Bo Li, Tara Sainath, Arun Narayanan, Joe Caroselli, Michiel Bacchiani, Ananya Misra, Izhak Shafran, Hasim Sak, Golan Pundak, Kean
Chin, et al. 2017. Acoustic Modeling for Google Home. (2017).
[31]
Wei Li, David Torres, Ramón Díaz, Zhengjun Wang, Changsheng Wu, Chuan Wang, Zhong Lin Wang, and Nelson Sepúlveda. 2017.
Nanogenerator-based dual-functional and self-powered thin patch loudspeaker or microphone for exible electronics. Nature Communi-
cations 8 (2017).
[32]
Long Lin, Sihong Wang, Simiao Niu, Chang Liu, Yannan Xie, and Zhong Lin Wang. 2014. Noncontact free-rotating disk triboelectric
nanogenerator as a sustainable energy harvester and self-powered mechanical sensor. ACS applied materials & interfaces 6, 4 (2014),
3031–3038.
[33]
Long Lin, Yannan Xie, Sihong Wang, Wenzhuo Wu, Simiao Niu, Xiaonan Wen, and Zhong Lin Wang. 2013. Triboelectric active sensor
array for self-powered static and dynamic pressure detection and tactile imaging. ACS nano 7, 9 (2013), 8266–8274.
[34]
Ruiyuan Liu, Xiao Kuang, Jianan Deng, Yi-Cheng Wang, Aurelia C Wang, Wenbo Ding, Ying-Chih Lai, Jun Chen, Peihong Wang, Zhiqun
Lin, et al
.
2018. Shape Memory Polymers for Body Motion Energy Harvesting and Self-Powered Mechanosensing. Advanced Materials
(2018), 1705195. https://doi.org/10.1002/adma.201705195
[35]
Vincent Liu, Aaron Parks, Vamsi Talla, Shyamnath Gollakota, David Wetherall, and Joshua R Smith. 2013. Ambient backscatter: wireless
communication out of thin air. In ACM SIGCOMM Computer Communication Review, Vol. 43. ACM, 39–50.
[36]
Gaurav Mathur, Peter Desnoyers, Paul Chukiu, Deepak Ganesan, and Prashant Shenoy. 2009. Ultra-low power data storage for sensor
networks. ACM Transactions on Sensor Networks (TOSN) 5, 4 (2009), 33.
[37]
Vidyabhushan Mohan, Trevor Bunker, Laura Grupp, Sudhanva Gurumurthi, Mircea R Stan, and Steven Swanson. 2013. Modeling power
consumption of nand ash memories using ashpower. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
32, 7 (2013), 1031–1044.
[38]
Kei Nakatsuma, Rhoma Takedomi, Takaaki Eguchi, Yasutaka Oshima, and Ippei Torigoe. 2015. Active bioacoustic measurement for
human-to-human skin contact area detection. In SENSORS, 2015 IEEE. IEEE, 1–4.
[39]
Arokia Nathan, Arman Ahnood, Matthew T Cole, Sungsik Lee, Yuji Suzuki, Pritesh Hiralal, Francesco Bonaccorso, Tawque Hasan, Luis
Garcia-Gancedo, Andriy Dyadyusha, et al
.
2012. Flexible electronics: the next ubiquitous platform. Proc. IEEE 100, Special Centennial
Issue (2012), 1486–1517.
[40]
Jun Nishimura and Tadahiro Kuroda. 2008. Eating habits monitoring using wireless wearable in-ear microphone. In Wireless Pervasive
Computing, 2008. ISWPC 2008. 3rd International Symposium on. IEEE, 130–132.
[41]
Simiao Niu, Sihong Wang, Long Lin, Ying Liu, Yu Sheng Zhou, Youfan Hu, and Zhong Lin Wang. 2013. Theoretical study of contact-mode
triboelectric nanogenerators as an eective power source. Energy & Environmental Science 6, 12 (2013), 3576–3583.
[42]
Kenji Nomura, Hiromichi Ohta, Kazushige Ueda, Toshio Kamiya, Masahiro Hirano, and Hideo Hosono. 2003. Thin-lm transistor
fabricated in single-crystalline transparent oxide semiconductor. Science 300, 5623 (2003), 1269–1272.
[43]
Changhyun Pang, Chanseok Lee, and Kahp-Yang Suh. 2013. Recent advances in exible sensors for wearable and implantable devices.
Journal of Applied Polymer Science 130, 3 (2013), 1429–1441.
[44]
Joseph A. Paradiso. 1996. The interactive balloon: Sensing, actuation and behavior in a common object. IBM Systems Journal 35, 3.4
(1996), 473–487.
[45]
Shwetak N Patel and Gregory D Abowd. 2007. Blui: low-cost localized blowable user interfaces. In Proceedings of the 20th annual ACM
symposium on User interface software and technology. ACM, 217–220.
[46]
Michael Pederson, Wouter Olthuis, and Piet Bergveld. 1998. High-performance condenser microphone with fully integrated CMOS
amplier and DC-DC voltage converter. Journal of Microelectromechanical Systems 7, 4 (1998), 387–394.
[47] Massoud Pedram and Jan M Rabaey. 2002. Power aware design methodologies. Springer Science & Business Media.
[48] Arthur N Popper, Richard R Fay, and Arthur N Popper. 2005. Sound source localization. Springer.
[49]
Michael Price, James Glass, and Anantha P Chandrakasan. 2017. A Low-Power Speech Recognizer and Voice Activity Detector Using
Deep Neural Networks. IEEE Journal of Solid-State Circuits (2017).
[50]
Yi Qi and Michael C McAlpine. 2010. Nanotechnology-enabled exible and biocompatible energy harvesting. Energy & Environmental
Science 3, 9 (2010), 1275–1285.
[51]
P Raikwal, V Neema, and A Verma. 2017. High speed 8T SRAM cell design with improved read stability at 180nm technology. In
Electronics, Communication and Aerospace Technology (ICECA), 2017 International conference of, Vol. 2. IEEE, 563–568.
[52] Meital Segev-Bar and Hossam Haick. 2013. Flexible sensors based on nanoparticles. ACS nano 7, 10 (2013), 8366–8378.
[53]
Wan-Ho Seol, Yong Min Lee, and Jung-Ki Park. 2007. Enhancement of the mechanical properties of PVDF membranes by non-solvent
aided morphology control. Journal of Power Sources 170, 1 (2007), 191–195.
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator 60:27
[54]
GM Sessler and JE West. 1973. Electret transducers: a review. The Journal of the Acoustical Society of America 53, 6 (1973), 1589–1600.
[55]
Sahil Shah, Caitlin N Teague, Omer T Inan, and Jennifer Hasler. 2016. A proof-of-concept classier for acoustic signals from the knee
joint on a FPAA. In SENSORS, 2016 IEEE. IEEE, 1–3.
[56]
Richard C Simpson and Simon P Levine. 2002. Voice control of a powered wheelchair. IEEE Transactions on Neural Systems and
Rehabilitation Engineering 10, 2 (2002), 122–125.
[57]
Sparkfun. 2000. Foil Electret microphone datasheet. https://cdn.sparkfun.com/datasheets/Sensors/Sound/CEM-C9745JAD462P2.54R.pdf
[58] Sparkfun. 2012. SparkFun MEMS Microphone Breakout - INMP401 (ADMP401). https://www.sparkfun.com/products/9868
[59] Thad Starner. 2001. The challenges of wearable computing: Part 1. Ieee Micro 21, 4 (2001), 44–52.
[60]
Vamsi Talla, Mehrdad Hessar, Bryce Kellogg, Ali Naja, Joshua R Smith, and Shyamnath Gollakota. 2017. LoRa backscatter: Enabling the
vision of ubiquitous connectivity. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 105.
[61]
Vamsi Talla, Bryce Kellogg, Shyamnath Gollakota, and Joshua R Smith. 2017. Battery-Free Cellphone. Proceedings of the ACM on
Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 2 (2017), 25.
[62]
J-M Valin, François Michaud, Jean Rouat, and Dominic Létourneau. 2003. Robust sound source localization using a microphone array on
a mobile robot. In Intelligent Robots and Systems, 2003.(IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, Vol. 2. IEEE,
1228–1233.
[63]
Tim Van Kasteren, Athanasios Noulas, Gwenn Englebienne, and Ben Kröse. 2008. Accurate activity recognition in a home setting. In
Proceedings of the 10th international conference on Ubiquitous computing. ACM, 1–9.
[64]
Zhong Lin Wang. 2013. Triboelectric nanogenerators as new energy technology for self-powered systems and as active mechanical and
chemical sensors. ACS nano 7, 11 (2013), 9533–9557.
[65]
Zhong Lin Wang. 2015. Triboelectric nanogenerators as new energy technology and self-powered sensors–Principles, problems and
perspectives. Faraday discussions 176 (2015), 447–458.
[66]
Zhong Lin Wang. 2017. On Maxwell’s displacement current for energy and sensors: the origin of nanogenerators. Materials Today 20, 2
(2017), 74 – 82.
[67]
Zhong Lin Wang, Jun Chen, and Long Lin. 2015. Progress in triboelectric nanogenerators as a new energy technology and self-powered
sensors. Energy & Environmental Science 8, 8 (2015), 2250–2282.
[68]
Zhong Lin Wang and Jinhui Song. 2006. Piezoelectric nanogenerators based on zinc oxide nanowire arrays. Science 312, 5771 (2006),
242–246.
[69]
Zhong Lin Wang and Aurelia Chi Wang. 2018. Triboelectric Nanogenerator for Self-Powered Flexible Electronics and Internet of Things.
In Meeting Abstracts. The Electrochemical Society, 1533–1533.
[70]
Kajiro Watanabe, Yosuke Kurihara, Tetsuo Nakamura, and Hiroshi Tanaka. 2010. Design of a low-frequency microphone for mobile
phones and its application to ubiquitous medical and healthcare monitoring. IEEE Sensors Journal 10, 5 (2010), 934–941.
[71]
JW Weigold, TJ Brosnihan, J Bergeron, and X Zhang. 2006. A MEMS condenser microphone for consumer applications. In Micro Electro
Mechanical Systems, 2006. MEMS 2006 Istanbul. 19th IEEE International Conference on. IEEE, 86–89.
[72] William S Wong and Alberto Salleo. 2009. Flexible electronics: materials and applications. Vol. 11. Springer Science & Business Media.
[73]
Minyi Xu, Peihong Wang, Yi-Cheng Wang, Steven L Zhang, Aurelia Chi Wang, Chunli Zhang, Zhengjun Wang, Xinxiang Pan, and
Zhong Lin Wang. 2018. A Soft and Robust Spring Based Triboelectric Nanogenerator for Harvesting Arbitrary Directional Vibration
Energy and Self-Powered Vibration Sensing. Advanced Energy Materials 8, 9 (2018), 1702432.
[74]
Minyi Xu, Yi-Cheng Wang, Steven L Zhang, Wenbo Ding, Jia Cheng, Xu He, Peng Zhang, Zhengjun Wang, Xinxiang Pan, and Zhong Lin
Wang. 2017. An aeroelastic utter based triboelectric nanogenerator as a self-powered active wind speed sensor in harsh environment.
Extreme Mechanics Letters 15 (2017), 122–129.
[75]
Jin Yang, Jun Chen, Ying Liu, Weiqing Yang, Yuanjie Su, and Zhong Lin Wang. 2014. Triboelectrication-Based Organic Film Nanogen-
erator for Acoustic Energy Harvesting and Self-Powered Active Acoustic Sensing. ACS Nano 8, 3 (2014), 2649–2657.
[76]
Po-Kang Yang, Zong-Hong Lin, Ken C Pradel, Long Lin, Xiuhan Li, Xiaonan Wen, Jr-Hau He, and Zhong Lin Wang. 2015. paper-based
origami triboelectric nanogenerators and self-powered pressure sensors. ACS nano 9, 1 (2015), 901–907.
[77]
Hulin Zhang, Ya Yang, Yuanjie Su, Jun Chen, Katherine Adams, Sangmin Lee, Chenguo Hu, and Zhong Lin Wang. 2014. Triboelectric
nanogenerator for harvesting vibration energy in full space and as self-powered acceleration sensor. Advanced Functional Materials 24,
10 (2014), 1401–1407.
[78]
Steven L Zhang, Ying-Chih Lai, Xu He, Ruiyuan Liu, Yunlong Zi, and Zhong Lin Wang. 2017. Auxetic Foam-Based Contact-Mode
Triboelectric Nanogenerator with Highly Sensitive Self-Powered Strain Sensing Capabilities to Monitor Human Body Movement.
Advanced Functional Materials 27, 25 (2017).
[79]
Lisong Zhou, Alfred Wanga, Sheng-Chu Wu, Jie Sun, Sungkyu Park, and Thomas N Jackson. 2006. All-organic active matrix exible
display. Applied Physics Letters 88, 8 (2006), 083502.
[80]
Yaniv Zigel, Dima Litvak, and Israel Gannot. 2009. A method for automatic fall detection of elderly people using oor vibrations and
sound : Proof of concept on human mimicking doll falls. IEEE Transactions on Biomedical Engineering 56, 12 (2009), 2858–2867.
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
60:28 N. Arora et al.
Received November 2017; revised February 2018; accepted April 2018
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 2, No. 2, Article 60. Publication date: June 2018.
... Each scenario considers one of four major wearable device sensing applications: step counting, sleep tracking, heart rate and blood pressure monitoring, and tone analysis-used by Amazon's novel "Halo" wearable, which claims to provide users insights into their overall mental and emotional state (Aboutamazon, 2020), and this application could be implemented in a batteryless device using the self-powered microphone (Arora et al., 2018). These applications have a health-related purpose and are available on at least one device currently sold to consumers, as well as a research prototype we discussed in section 2.1.2. ...
... Tone analysis is the most difficult application to support with batteryless technology due to the high energy consumption requirements of this application. Even with the use of a self-powered microphone, as demonstrated in previous research (Arora et al., 2018), the application still necessitates intensive computations. However, our results suggest that this application is generally undesirable anyway-a benefit for batteryless wearables. ...
Article
Full-text available
Batteryless wearables use energy harvested from the environment, eliminating the burden of charging or replacing batteries. This makes them convenient and environmentally friendly. However, these benefits come at a price. Batteryless wearables operate intermittently (based on energy availability), which adds complexity to their design and introduces usability limitations not present in their battery-powered counterparts. In this paper, we conduct a scenario-based study with 400 wearable users to explore how users perceive the inherent trade-offs of batteryless wearable devices. Our results reveal users’ concerns, expectations, and preferences when transitioning from battery-powered to batteryless wearable use. We discuss how the findings of this study can inform the design of usable batteryless wearables.
Article
Full-text available
Advancements in live audio processing, specifically in sound classification and audio captioning technologies, have widespread applications ranging from surveillance to accessibility services. However, traditional methods encounter scalability and energy efficiency challenges. To overcome these, Triboelectric Nanogenerators (TENG) are explored for energy harvesting, particularly in live‐streaming sound monitoring systems. This study introduces a sustainable methodology integrating TENG‐based sensors into live sound monitoring pipelines, enhancing energy‐efficient sound classification and captioning by model selection and fine‐tuning strategies. Our cost‐effective TENG sensor harvests ambient sound vibrations and background noise, producing up to 1.2 µW cm⁻² output power and successfully charging capacitors. This shows its capability for sustainable energy harvesting. The system achieves 94.3% classification accuracy using the Hierarchical Token Semantic Audio Transformer (HTS‐AT) model identified as optimal for live sound event monitoring. Additionally, continuous audio captioning using the EnCodec Combining Neural Audio Codec and Audio‐Text Joint Embedding for Automated Audio Captioning model (EnCLAP) showcases rapid and precise processing capabilities that are suitable for live‐streaming environments. The Bidirectional Encoder representation from the Audio Transformers (BEATs) model also demonstrated exceptional performance, achieving an accuracy of 97.25%. These models were fine‐tuned using the TENG‐recorded ESC‐50 dataset, ensuring the system's adaptability to diverse sound conditions. Overall, this research significantly contributes to the development of energy‐efficient sound monitoring systems with wide‐ranging implications across various sectors.
Article
Full-text available
Vibration is a common mechanical phenomenon and possesses mechanical energy in ambient environment, which can serve as a sustainable source of power for equipment and devices if it can be effectively collected. In the present work, a novel soft and robust triboelectric nanogenerator (TENG) made of a silicone rubber-spring helical structure with nanocomposite-based elastomeric electrodes is proposed. Such a spring based TENG (S-TENG) structure operates in the contact-separation mode upon vibrating and can effectively convert mechanical energy from ambient excitation into electrical energy. The two fundamental vibration modes resulting from the vertical and horizontal excitation are analyzed theoretically, numerically, and experimentally. Under the resonant states of the S-TENG, its peak power density is found to be 240 and 45 mW m−2 with an external load of 10 MΩ and an acceleration amplitude of 23 m s−2. Additionally, the dependence of the S-TENG's output signal on the ambient excitation can be used as a prime self-powered active vibration sensor that can be applied to monitor the acceleration and frequency of the ambient excitation. Therefore, the newly designed S-TENG has a great potential in harvesting arbitrary directional vibration energy and serving as a self-powered vibration sensor.
Article
Full-text available
The development of wearable and large-area energy-harvesting textiles has received intensive attention due to their promising applications in next-generation wearable functional electronics. However, the limited power outputs of conventional textiles have largely hindered their development. Here, in combination with the stainless steel/polyester fiber blended yarn, the polydimethylsiloxane-coated energy-harvesting yarn, and nonconductive binding yarn, a high-power-output textile triboelectric nanogenerator (TENG) with 3D orthogonal woven structure is developed for effective biomechanical energy harvesting and active motion signal tracking. Based on the advanced 3D structural design, the maximum peak power density of 3D textile can reach 263.36 mW m−2 under the tapping frequency of 3 Hz, which is several times more than that of conventional 2D textile TENGs. Besides, its collected power is capable of lighting up a warning indicator, sustainably charging a commercial capacitor, and powering a smart watch. The 3D textile TENG can also be used as a self-powered active motion sensor to constantly monitor the movement signals of human body. Furthermore, a smart dancing blanket is designed to simultaneously convert biomechanical energy and perceive body movement. This work provides a new direction for multifunctional self-powered textiles with potential applications in wearable electronics, home security, and personalized healthcare.
Article
Triboelectrification is an effect known to society ever since the ancient Greek era, but it is usually considered a negative effect and avoided in many technologies. We have recently invented a triboelectric nanogenerator (TENG) that is used to convert mechanical energy into electricity by a conjunction of triboelectrification and electrostatic induction. As for this power generation unit, in the inner circuit, a potential is created by the triboelectric effect due to the charge transfer between two thin organic/inorganic films that exhibit opposite tribo-polarity; in the outer circuit, electrons are driven to flow between two electrodes attached on the back sides of the films in order to balance the potential. Ever since the first report of the TENG in January 2012, the output power density of TENG has been improved for five orders of magnitude within 12 months. The area power density reaches 500 W/m ² , and a conversion efficiency of ~50-85% has been demonstrated. The TENG can be applied to harvest all kind mechanical energy that is available but wasted in our daily life, such as human motion, walking, vibration, mechanical triggering, rotating tire, wind, flowing water and more. Alternatively, TENG can also be used as a self-powered sensor for actively detecting the static and dynamic processes arising from mechanical agitation using the voltage and current output signals of the TENG, respectively, with potential applications for touch pad and smart skin technologies. The TENG is possible not only for self-powered portable electronics, but also as a new energy technology with a potential of contributing to the world energy in the near future. [1] Z.L. Wang, Materials Today, 20 (2017) 74-82. [2] “Nanogenerators for Self-Powered Devices and Systems”, by Z.L. Wang, published by Georgia Institute of Technology (first book for free online download): http://smartech.gatech.edu/handle/1853/39262 [3] Z.L. Wang, L. Lin, J. Chen. S.M. Niu, Y.L. Zi “Triboelectric Nanogenerators”, Springer, 2016. http://www.springer.com/us/book/9783319400389 [4] Z.L. Wang “Triboelectric Nanogenerators as New Energy Technology for Self-Powered Systems and as Active Mechanical and Chemical Sensors”, ACS Nano 7 (2013) 9533-9557. [5] Z.L. Wang, J. Chen, L. Lin “Progress in triboelectric nanogenerators as new energy technology and self-powered sensors”, Energy & Environmental Sci, 8 (2015) 2250-2282.
Book
The localization of sound is a fundamental requirement for all auditory systems and has motivated much research. This comprehensive volume brings together topics from many specialties that have been touched upon in other volumes of the Springer Handbook of Auditory Research. Reviewing sound source localization capacities and mechanisms in a variety of organisms, this volume provides a synthesis and update on the topic that is both original and timely. The authors treat sound source localization in a comparative context with an emphasis on modeling and computational mechanisms. About the Editors: Arthur N. Popper is Professor in the Department of Biology and Co-Director of the Center for Comparative and Evolutionary Biology of Hearing at the University of Maryland, College Park. Richard R. Fay is Director of the Parmly Hearing Institute and Professor of Psychology at Loyola University of Chicago.
Article
This paper describes digital circuit architectures for automatic speech recognition (ASR) and voice activity detection (VAD) with improved accuracy, programmability, and scalability. Our ASR architecture is designed to minimize off-chip memory bandwidth, which is the main driver of system power consumption. A SIMD processor with 32 parallel execution units efficiently evaluates feed-forward deep neural networks (NNs) for ASR, limiting memory usage with a sparse quantized weight matrix format. We argue that VADs should prioritize accuracy over area and power, and introduce a VAD circuit that uses an NN to classify modulation frequency features with 22.3-μW power consumption. The 65-nm test chip is shown to perform a variety of ASR tasks in real time, with vocabularies ranging from 11 words to 145,000 words and full-chip power consumption ranging from 172 μW to 7.78 mW.
Article
With the development of internet of things and sensor networks, self-powered sensors are highly desirable. In this study, we present a simple but practical design of an aeroelastic flutter based triboelectric nanogenerator (AF-TENG) that could harvest energy from wind and serve as an active wind speed sensor. The fabricated AF-TENG consists of two copper layers and a membrane in a cuboid acrylic channel. The effect of membrane materials, including fluorinated ethylene propylene (FEP), polytetrafluoroethylene (PTFE) and Kapton (PI), length of membrane, inlet wind speed and humidity on the performance of AF-TENG have been systematically investigated. As wind flows through a designed channel, the membrane moves up and down between copper surfaces periodically, which results in a periodic electrical output signals of the AF-TENG. The corresponding frequency of the AF-TENG signal is found to increase in a robust linear relationship with the wind speed. Interestingly, as environmental humidity increases, the amplitude of voltage and current output of the AF-TENG deceases dramatically, while the frequency of the output remains the same due to high humidity can decrease the charge density in the membrane surface but have no effect on the fluttering motion of the membrane. The real-time wind speed measured through analyzing frequency of the voltage of the AF-TENG agrees well with a commercial wind speed sensor, and the corresponding speed sensitivity is about 0.13 (m/s)/Hz or 7.7 Hz/(m/s). Therefore, the fabricated self-powered AF-TENG has shown potential applications in wireless environmental monitoring networks, even in high humidity environment.