Method for Quantifying Variation in the Resistance of Electronic Cigarette Coils

Abstract

In electronic nicotine delivery systems (ENDS), coil resistance is an important factor in the generation of heat energy used to change e-liquid into vapor. An accurate and unbiased method for testing coil resistance is vital for understanding its effect on emissions and reporting results that are comparable across different types and brands of ENDS and measured in different laboratories. This study proposes a robust, accurate and unbiased method for measuring coil resistance. An apparatus is used which mimics the geometric configuration and assembly of ENDS reservoirs, coils and power control units. The method is demonstrated on two commonly used ENDS devices—the ALTO by Vuse and JUUL. Analysis shows that the proposed method is stable and reliable. The two-wire configuration introduced a positive measurement bias of 0.086 (Ω), which is a significant error for sub-ohm coil designs. The four-wire configuration is far less prone to bias error and is recommended for universal adoption. We observed a significant difference in the coil resistance of 0.593 (Ω) (p < 0.001) between the two products tested. The mean resistance and standard deviation of the reservoir/coil assemblies was shown to be 1.031 (0.067) (Ω) for ALTO and 1.624 (0.033) (Ω) for JUUL. The variation in coil resistance between products and within products can have significant impacts on aerosol emissions.

Full text

International Journal of
Environmental Research
and Public Health
Article
Method for Quantifying Variation in the Resistance of
Electronic Cigarette Coils
Qutaiba M. Saleh 1, Edward C. Hensel 2, * and Risa J. Robinson 2
1Department of Computer Engineering, Rochester Institute of Technology, Rochester, NY 14623, USA;
qms7252@rit.edu
2Department of Mechanical Engineering, Rochester Institute of Technology, Rochester, NY 14623, USA;
rjreme@rit.edu
*Correspondence: echeme@rit.edu
Received: 10 September 2020; Accepted: 22 October 2020; Published: 24 October 2020


Abstract:
In electronic nicotine delivery systems (ENDS), coil resistance is an important factor
in the generation of heat energy used to change e-liquid into vapor. An accurate and unbiased
method for testing coil resistance is vital for understanding its effect on emissions and reporting
results that are comparable across different types and brands of ENDS and measured in different
laboratories. This study proposes a robust, accurate and unbiased method for measuring coil
resistance. An apparatus is used which mimics the geometric configuration and assembly of ENDS
reservoirs, coils and power control units. The method is demonstrated on two commonly used ENDS
devices—the ALTO by Vuse and JUUL. Analysis shows that the proposed method is stable and
reliable. The two-wire configuration introduced a positive measurement bias of 0.086 (
Ω
), which is a
significant error for sub-ohm coil designs. The four-wire configuration is far less prone to bias error
and is recommended for universal adoption. We observed a significant difference in the coil resistance
of 0.593 (
Ω
) (p<0.001) between the two products tested. The mean resistance and standard deviation
of the reservoir/coil assemblies was shown to be 1.031 (0.067) (
Ω
) for ALTO and 1.624 (0.033) (
Ω
) for
JUUL. The variation in coil resistance between products and within products can have significant
impacts on aerosol emissions.
Keywords: coil resistance; e-cigarette; electronic nicotine delivery system; pod style; atomizer
1. Introduction
1.1. Theoretical Foundation
Typical pod-style electronic nicotine delivery systems (ENDS) consist of three subsystems:
the reservoir, power control unit (PCU) and lithium battery. The reservoir includes a mouthpiece,
e-liquid storage compartment, a heating element herein called the coil, sometimes a wick, and an
aerosol generation chamber, sometimes referred to as the atomizer. Reservoirs designed for re-use,
permitting users to refill the reservoir with e-liquids, are sometimes called “open systems.” Reservoirs
designed to be disposable, not intended to permit e-liquid refills by the user, are sometimes called
“closed systems.” Most pod-style ENDS reservoirs are designed with the heating element, or “coil”,
fully integrated with a wick to deliver e-liquid from the reservoir to the heating element such that
thermally generated aerosol mixes with inhaled air for delivery through the mouthpiece to the user.
Other ENDS reservoir designs may permit the user to replace the coil, wick, or adjust the flow path
through the reservoir. The PCU contains electronics which manage the user interface, controls energy
delivered to the pod, and withdraw or replace (recharges) energy to the battery. The lithium battery is
the energy storage unit and provides energy to the PCU and the pod. The three subsystems interact
Int. J. Environ. Res. Public Health 2020,17, 7779; doi:10.3390/ijerph17217779 www.mdpi.com/journal/ijerph

Int. J. Environ. Res. Public Health 2020,17, 7779 2 of 16
with one another in an integrated manner. Variation in one component, such as the coil in the reservoir,
may have different impacts on aerosol generation depending upon its interaction with the PCU and
the battery.
The aerosol generation performance of an ENDS is jointly dependent upon the physical
characteristics of the ENDS pod, PCU and battery [
1
–
6
], characteristics of e-liquid in the
reservoir [
2
,
3
,
5
,
7
], and user behaviors of puffflow rate and puffduration [
1
,
8
–
12
]. Understanding the
theory of ENDS operation elucidates potential effects of variation in resistance arising from interactions
with the PCU and battery. All ENDS are fundamentally heat and mass transfer devices, which are
commonly studied in engineering disciplines [
13
] for medical, industrial, residential and commercial
products. The purpose of the heating coil is to convert electrical power discharge from the battery
into thermal power dissipated inside the coil. The resulting thermal power (W) is distributed via
heat conduction to the surface area of the coil as a heat flux (W/m
2
), which is then transferred to the
surrounding air/e-liquid via heat convection. As the e-liquid solvent temperature reaches its saturation
temperature (the effective boiling point of the e-liquid mixture), mass transfers from the e-liquid
reservoir into the air stream to form an aerosol. The combination of surface heat flux, coil surface
temperature, heat and mass transfer coefficients and e-liquid composition jointly affect the rate of
aerosol generation. The aerosol generated at the interface between the coil and e-liquid experiences
further changes as it progresses through the flow channel of the ENDS toward the user. While the
effectiveness of aerosol generation is impacted by many factors, it is dominated by the electrical
energy from the battery dissipated as thermal energy in the coil. The amount of heat energy, E,
in Joules (J), dissipated in the coil is defined as the product of the instantaneous direct current power,
P, supplied to the coil, in watts (1 W
≡
1 J/Sec), and time duration over which the power is supplied
(Sec). The power is a function of the electrical current, I
coil
(A), flowing through the coil, the voltage,
V
coil
(V), applied across the terminals of the coil, and resistance, R
coil
(
Ω
) of the coil itself as shown in
Equation (1).
P=Vcoil Icoil =V2coil
Rcoil =I2coil Rcoil (1)
The coil resistance is an inherent physical characteristic of the coil which depends primarily
upon the composition and purity of the coil and its geometry. In this study, we include the internal
electrical connections between the coil and the pod housing to quantify the effective resistance of the
coil assembly. The voltage, V
coil
, and current, I
coil
, passing through the coil are related to one another
using the classical definition of Ohm’s law, V
coil
=I
coil ×
R
coil
, from physics [
14
]. The PCU controls
the duration over which power is supplied to the coil. The PCUs employed in early ENDS designs
simply shorted the voltage available from the battery across the coil for an interval of time. As the
battery discharged over time, its available voltage decreased and hence the power delivered to the coil
decreased. All modern ENDS PCU designs control the time duration of power delivery, while some
PCU designs actively control the current, I
coil
, flowing through the coil and other designs actively
control the voltage, V
coil
, applied across the terminals of the coil. Fully understanding the effects of
variation in coil resistance, R
coil
, on aerosol emissions cannot be accomplished without understanding
the logic implemented in the ENDS PCU.
Equation (1) shows that the desired power of an ENDS can be achieved by a specific ratio of coil
resistance and applied voltage. In the lowest-cost ENDS designs, the applied voltage is limited by
physical constraints of the most common lithium batteries, which peaks at approximately 3.7 (V) and
decreases as the battery discharges. Higher-cost ENDS designs may actively control the output voltage
using a “boost” converter [
15
], at the penalty cost of reduced operating time between recharging.
ENDS manufacturers, over time, have sought to increase the power dissipation in the coil in order to
increase the rate of e-liquid aerosolization. Given the physical limitations of low-cost rechargeable
lithium batteries, ENDS designers choose to reduce the coil resistance as the most appealing parameter
to increase power. This is illustrated by an example. Consider an ENDS designer who specified a power
level of 12 (W) and a lithium battery operating at nominally 3.7 (V). Equation (1) dictates that a coil
resistance of 1.14 (
Ω
) should be used. If power of more than 12 (W) is desired, even smaller resistance is

Int. J. Environ. Res. Public Health 2020,17, 7779 3 of 16
required. Otherwise, a stack of two or more batteries connected in series or a DC-to-DC boost converter
can be used to step up the applied voltage [
15
]. Using two batteries is not a desirable solution, because it
increases the cost, weight and volume of the ENDS. Boost converters are increasingly common in
modern ENDS but appear to be primarily used as a means to extend operating lifetime and maintain
steady power while the battery discharges.
The desire for high-power ENDS pushes designers to increasingly use coils with low resistance
values, which led to the introduction of the sub-ohm devices which use coils that have a resistance
of <1 (
Ω
) [
16
,
17
]. Reducing the coil resistance to 0.068 (
Ω
) permits instantaneous power as high as
200 W. The sub-ohm devices are reported to satisfy several features desired by users such as intense
flavor, warm vape and big clouds, which is associated with high airflow that is suitable for the
direct-to-lung inhale style [
18
,
19
]. Sub-ohm coils are mostly available in the box-mod ENDS style;
however, some pod-style ENDS started to use coils with resistances of less than 1 (
Ω
) such as SMOK2
pod (0.8 (
Ω
) and NORD2 (0.3, 0.4, 0.6 (
Ω
)) [
20
], TARGET PM80 (0.2, 0.3, 0.6, 0.8 (
Ω
) [
21
], and Z-BIIP
(0.48 (Ω)) [22].
Several studies investigated the effects of power values on the performance of ENDS devices
while others focused on coil resistance values. As demonstrated with Equation (1), power levels can
be controlled in real time by manipulating the applied voltage and current, or by installing a coil
with a different resistance. The power level of an ENDS may be increased by increasing the applied
voltage (which has the effect of increasing the current) or by decreasing coil resistance values while
keeping the applied voltage constant. The same approach can be followed for decreasing power levels.
For this reason, most of the results achieved from the studies focusing on power and voltage values
can be generalized to coil resistance values with appropriate adjustments and vice versa. However,
it is essential that studies investigating the effect of power on emissions document both the power
dissipation and coil resistance in order to make results generalizable to other products.
1.2. Context of Prior Work
Previous studies have shown that coil resistance affects both the amount of vapor generated and
constituents. Cirillo et al. 2019 [
23
] showed that reducing coil resistance leads to higher concentrations
of some carbonyls and reactive oxygen species (ROS). Their research also reported that vapor generated
by coils with lower resistances has a higher negative impact on cell viability. The same research
group [
24
] also showed in a separate work in 2019 that the production of selected aldehydes increased
as coil resistance decreased from 1.5 (
Ω
) to 0.25 (
Ω
). The effects of the aerosols generated by the
two coils on Sprague–Dawley rats was studied. The rat group exposed to the 0.25 (
Ω
) vape showed
disorganization of alveolar and bronchial epithelium. The same group also showed higher perturbation
of the antioxidant and phase II enzymes compared to the 1.5 (
Ω
) groups. Gillman et al. 2016 [
25
] studied
the effects of changing power on the total yield mass and the formation of aldehyde. Their results
showed that power has significant impact on the concentration of aldehyde in the vapor. Although their
main focus was power, they used several coils with various resistance values to control the power.
This indicates that in this study, the physically important factor is resistance values, as already
demonstrated in Equation (1). Chausse et al., in 2015 [
26
], suggested coil resistance could be the key
to lung toxicity. Their analysis showed that the combination of certain voltage and coil resistance
values may lead to a high impact on human health. Hiler et al. 2019 [
27
] investigated the effects
of changing heating coil resistance on nicotine delivery, puffing topography, subjective effects and
liquid consumption. They used off-the-shelf coils with two resistance values of 0.5 (
Ω
) and 1.5 (
Ω
)
which are supposed to consume a power of 40.5 (W) and 13.5 (W), respectively. Hiler reported that
lower-resistance coils were found to deliver higher nicotine and have higher liquid consumption.
Several prior studies did not document the method used to measure coil resistance or assess variation
in this key parameter. Cirillo et al. 2019 [
23
,
24
], Sleiman et al. 2016 [
28
], Ogunwale et al. 2017 [
29
]
and Soulet et al. 2018 [
30
] reported coil resistance as a study parameter without documenting the
method used to measure resistance. Researchers may be tempted to select off-the-shelf coils with

Int. J. Environ. Res. Public Health 2020,17, 7779 4 of 16
resistance values that suit their study. This approach assumes that the coil resistances reported by
the manufacturer are accurate, neglects manufacturing variation between coils, and may limit study
designs to ENDS brands that offer coils with different resistance values.
Conversely, other studies reported the measurement methods employed. Gillman et al.
2016 [
25
] used a measurement instrument that is specialized in milliohm resistance measurement
(Extech milliohm meter, 380560) which claims high precision and low error rates. Hiler et al. [
27
] used
an off-the-shelf ohm meter “Coil Master 521 TAB v2”, advertised to test homemade coil resistance
and ensure proper operation before yse. The Coil Master [
31
] is reported to have a 510 threaded
connector, compatible with many box-mod ENDS, and is equipped with a fire button which applies
voltage to the coil during test. The manufacturer reports that readings have an error of approximately
+/−0.05 (Ω)
, which corresponds to a reading error of +/
−
10% when the measured coil has a resistance
of 0.5 (
Ω
). The high error margin of this meter suggests that it is generally not appropriate for use in
scientific studies.
In summary, many studies have been performed to assess the impact of power and coil resistance
on emissions and toxicity, but no studies have been performed to evaluate the accuracy of the methods
used to measure coil resistance. Many modern commercially available box-mod ENDs are equipped
with a resistance meter to report coil resistance to the user, but no studies could be found that validate
the reliability of these values.
With the current trend to reduce coil resistance values to sub-ohm levels [
16
,
17
], manufacturing
variations might have greater effects on the actual resistance of the coils, which in turn may give rise to
variation in the composition of emissions from the ENDS. To date, we have found no reports that quantify
such variation nor how it might affect the expected performance of the ENDS. Previous inconsistencies
in reporting coil resistance may be caused by the absence of a robust standard method.
1.3. Study Objectives
This study focuses on demonstrating accurate and robust methods for quantifying: (1) the
effective resistance of the heating coil in a fully assembled pod, (2) variation in effective coil resistance
across pods from a single manufacturer, (3) the repeatability of the test method and apparatus,
and (4) differences in effective coil resistance between manufacturing designs. The proposed methods
are demonstrated on two popular [
32
–
34
] commercially available pod-style ENDS: ALTO by Vuse [
35
]
and JUUL [
36
]. The test fixtures described herein are supported by detailed published protocols [
37
],
enabling researchers to use commercially available test equipment and instructions to fabricate custom
test fixtures for measuring the effective coil resistance of integrated pods from various manufacturers.
2. Materials and Methods
2.1. Constant Current Resistance Measurement Method
The constant current method is commonly used for resistance measurement in conjunction with a
digital multimeter (DMM). Modern DMMs for laboratory use incorporate an integrated voltmeter and
constant current source. The DMM constant current source, I
Source
, is used to supply current to the
device under test (DUT) while measuring the voltage, V
Voltmeter
, across the DUT. The resistance of the
DUT, R
Measured
, is determined as the ratio of measured voltage over the applied current, consistent with
Ohm’s law:
RMeasured =VVoltmeter
ISource
(2)
Two configurations are commonly used with the constant current method. The most common
two-wire configuration is appropriate for general purposes with large DUT resistances on the order of
kilo-ohms and mega-ohms. The four-wire configuration is more appropriate for accurate measurement
of sub-ohm coil resistances. The effect of measurement configuration is assessed herein by using both

Int. J. Environ. Res. Public Health 2020,17, 7779 5 of 16
configurations on a sample of pods from two manufacturers and conducting a repeated-measures
difference between configurations.
2.1.1. Two-Wire Configuration
The schematic shown in Figure 1is known as the two-wire configuration [
38
]. Two terminals
(denoted as the +and
−
terminals) are supplied with a constant current, I
Source
, from the DMM.
two-wire leads are connected from the terminals of the DMM to the opposing ends of the DUT coil
being tested. Kirchoff’s voltage law states that the voltage drop across three components in series is
the summation of the voltage drop across each component in the series. Thus, the voltage, V
Voltmeter
,
measured by the DMM is the summation of the voltage drops across the DUT and the two-wire leads.
Kirchoff’s current law asserts that the steady current flowing through three resistive components in
series are equal. Consequently, the measured current through the DUT will be identical to the current
through the wire leads. Equation (3) shows the calculations in detail, which can be simplified to the
second form if we assume that the two-wire leads are of the same composition, diameter and length.
RMeasured =VVoltmeter
ISource =VLead+VDut +VLead
ISource =RDUT +2×RLead (3)
Int. J. Environ. Res. Public Health 2020, 17, x FOR PEER REVIEW 5 of 16
2.1.1. Two-Wire Configuration
The schematic shown in Figure 1 is known as the two-wire configuration [38]. Two terminals
(denoted as the + and − terminals) are supplied with a constant current, ISource, from the DMM. two-
wire leads are connected from the terminals of the DMM to the opposing ends of the DUT coil being
tested. Kirchoff’s voltage law states that the voltage drop across three components in series is the
summation of the voltage drop across each component in the series. Thus, the voltage, VVoltmeter,
measured by the DMM is the summation of the voltage drops across the DUT and the two-wire leads.
Kirchoff’s current law asserts that the steady current flowing through three resistive components in
series are equal. Consequently, the measured current through the DUT will be identical to the current
through the wire leads. Equation (3) shows the calculations in detail, which can be simplified to the
second form if we assume that the two-wire leads are of the same composition, diameter and length.
𝑅 =𝑉

𝐼
=𝑉
 +𝑉
 +𝑉

𝐼
=𝑅
 +2×𝑅
 (3)
The resistance of wire leads can vary widely between research laboratories and test benches,
easily between 0.010 (Ω) and 1.000 (Ω) depending mainly on their materials and lengths. The
resistance of the wire leads, RLead, introduces a significant bias error between the DMM observed,
RMeasured, and the actual coil, RDUT, when the DUT has low resistance. For example, when measuring
the resistance of an ENDS coil with a true resistance of 1 (Ω) in this configuration with two-wire leads
that have a resistance of 0.050 (Ω) each, the measured value would be approximately 1.1 (Ω), a 10%
bias error in measurement. If we use the same apparatus and wire leads to measure sub-ohm coils,
the percent of bias error would be correspondingly higher. The wire leads are the main source of
error in this configuration. The bias error can be reduced by using very short wire leads with high
electrical conductivity (e.g., gold instead of copper). However, short leads are often difficult to
manipulate in the lab, and this approach does not completely remove the bias introduced by the wire
leads. The four-wire configuration offers a practical and robust approach to removing the bias error
associated with the two-write configuration.
Figure 1. Two-wire resistance measurement schematic. Dotted box labeled digital multimeter (DMM)
is a simplified version of internal schematic of the digital multimeter.
2.1.2. Four-Wire Configuration
Figure 1.
Two-wire resistance measurement schematic. Dotted box labeled digital multimeter (DMM)
is a simplified version of internal schematic of the digital multimeter.
The resistance of wire leads can vary widely between research laboratories and test benches,
easily between 0.010 (
Ω
) and 1.000 (
Ω
) depending mainly on their materials and lengths. The resistance
of the wire leads, R
Lead
, introduces a significant bias error between the DMM observed, R
Measured
,
and the actual coil, R
DUT
, when the DUT has low resistance. For example, when measuring the
resistance of an ENDS coil with a true resistance of 1 (
Ω
) in this configuration with two-wire leads
that have a resistance of 0.050 (
Ω
) each, the measured value would be approximately 1.1 (
Ω
), a 10%
bias error in measurement. If we use the same apparatus and wire leads to measure sub-ohm coils,
the percent of bias error would be correspondingly higher. The wire leads are the main source of error
in this configuration. The bias error can be reduced by using very short wire leads with high electrical
conductivity (e.g., gold instead of copper). However, short leads are often difficult to manipulate in the
lab, and this approach does not completely remove the bias introduced by the wire leads. The four-wire

Int. J. Environ. Res. Public Health 2020,17, 7779 6 of 16
configuration offers a practical and robust approach to removing the bias error associated with the
two-write configuration.
2.1.2. Four-Wire Configuration
The four-wire configuration employs two current wire leads (force +and force
−
) to supply
current through the DUT and two separate sensor wire leads (sense +and sense
−
) to measure the
voltage across the DUT. The four-wire configuration eliminates the bias effect of lead resistances
described in the two-wire resistance measurement configuration [
38
]. Figure 2shows the schematic
of this configuration. The voltmeter has very high resistance (on the order of megaohms) and thus
very low current (on order of picoohms) flows through the sense +/
−
wire leads. Thus, the voltage
drop across the sense +/
−
wire leads is negligible and the voltage measured by the voltmeter is the
same as the voltage cross the DUT. The resistance of the wire lead is totally insignificant, and the
measured resistance is unbiased compared to the two-wire configuration. Random errors such as
those associated with analog-to-digital conversion in the DMM remain in both configurations but are
negligible in comparison to the quantities typically required for characterization of ENDS coils.
Int. J. Environ. Res. Public Health 2020, 17, x FOR PEER REVIEW 6 of 16
The four-wire configuration employs two current wire leads (force + and force −) to supply
current through the DUT and two separate sensor wire leads (sense + and sense −) to measure the
voltage across the DUT. The four-wire configuration eliminates the bias effect of lead resistances
described in the two-wire resistance measurement configuration [38]. Figure 2 shows the schematic
of this configuration. The voltmeter has very high resistance (on the order of megaohms) and thus
very low current (on order of picoohms) flows through the sense +/− wire leads. Thus, the voltage
drop across the sense +/− wire leads is negligible and the voltage measured by the voltmeter is the
same as the voltage cross the DUT. The resistance of the wire lead is totally insignificant, and the
measured resistance is unbiased compared to the two-wire configuration. Random errors such as
those associated with analog-to-digital conversion in the DMM remain in both configurations but are
negligible in comparison to the quantities typically required for characterization of ENDS coils.
Figure 2. Four-wire resistance measurement schematic. Dotted box labeled DMM is a simplified
version of internal schematic of the digital multimeter.
2.2. ENDS Product-Specific Test Fixture
An apparatus was assembled to conduct constant current method resistance measurements in
both the two-wire and four-wire configuration. The DMM used for all resistance measurements in
this study was a Model 34465A from KEYSIGHT™ [39] and supports both the two-wire and four-
wire resistance configurations with several user-selectable ranges (100 (Ω) to 1,000 (MΩ)). The DMM
was set to the “auto scale” option for all observations conducted in this study, resulting in every
observation being measured on the 100 (Ω) range. The DMM was connected to a desktop computer
running the Microsoft Windows™ 10 operating system (Microsoft, Redmond, WA, USA) with a USB-
2 cable. A custom MATLAB™ script (MathWorks, Inc., Naatick, MA, USA) was used to trigger
measurements and collect readings from the DMM and save the data to comma separated value
(CSV) test files for later analysis.
While commercial off-the-shelf (COTS) four-wire leads, commonly called “Kelvin leads”, may
be used to connect the DUT to the DMM, we elected to fabricate custom four-wire leads which were
permanently soldered to each DUT fixture. We determined that COTS Kelvin leads might not be the
best option for measurement of ENDS coil resistance. In some types of ENDS, the coils are separable
from the reservoir and wick. However, during and after usage, the coil is in contact or submerged
with the e-liquid. In other types of ENDS, such as the pod-style device studied here, the coil is
permanently attached within the pod and is submerged in the e-liquid reservoir. In removable pod
Figure 2.
Four-wire resistance measurement schematic. Dotted box labeled DMM is a simplified
version of internal schematic of the digital multimeter.
2.2. ENDS Product-Specific Test Fixture
An apparatus was assembled to conduct constant current method resistance measurements in
both the two-wire and four-wire configuration. The DMM used for all resistance measurements in
this study was a Model 34465A from KEYSIGHT
™
[
39
] and supports both the two-wire and four-wire
resistance configurations with several user-selectable ranges (100 (
Ω
) to 1000 (M
Ω
)). The DMM was set
to the “auto scale” option for all observations conducted in this study, resulting in every observation
being measured on the 100 (
Ω
) range. The DMM was connected to a desktop computer running
the Microsoft Windows
™
10 operating system (Microsoft, Redmond, WA, USA) with a USB-2 cable.
A custom MATLAB
™
script (MathWorks, Inc., Naatick, MA, USA) was used to trigger measurements
and collect readings from the DMM and save the data to comma separated value (CSV) test files for
later analysis.
While commercial off-the-shelf (COTS) four-wire leads, commonly called “Kelvin leads”, may be
used to connect the DUT to the DMM, we elected to fabricate custom four-wire leads which were

Int. J. Environ. Res. Public Health 2020,17, 7779 7 of 16
permanently soldered to each DUT fixture. We determined that COTS Kelvin leads might not be the
best option for measurement of ENDS coil resistance. In some types of ENDS, the coils are separable
from the reservoir and wick. However, during and after usage, the coil is in contact or submerged
with the e-liquid. In other types of ENDS, such as the pod-style device studied here, the coil is
permanently attached within the pod and is submerged in the e-liquid reservoir. In removable pod
ENDS devices, the pods most often make electrical contact with the ENDS PCU using two different
style connectors. Several pod-style ENDS employ two spring-loaded connectors, also known as pogo
pin connectors, for the +and
−
terminals on the PCU side while mating with two corresponding
flat connectors on the pod side. The connectors come in various sizes and shapes across ENDS
designs and, most importantly, they have different distances between the +/
−
terminals. Additionally,
the mechanical means of retaining the pod in the ENDS is different from one manufacturer’s design to
another. Some manufacturers use a friction fit, some use a magnetic clasp, and others may use detents.
This variation between ENDS designs means that the pod-style coil terminals are not directly exposed
and cannot directly connect to COTS Kelvin lead clips. Further, we desired a test fixture which would
allow us to assess the impact of the pod-retaining mechanisms employed in various ENDS designs
on the repeatability of effective coil resistance measurement. Electrical contact resistance caused by
the connectors is a potential confounder in natural environment operations of ENDS products, and is
worth investigation.
Accordingly, this study incorporates a special holding fixture which is unique to each ENDS
product and retains the pod with its integrated coil in position while measurements are made with
the DMM. Each holding fixture uses a scavenged ENDS PCU housing and original manufacturer’s
connectors to mimic the housing, connectors and pod retention employed in the original ENDS to
create a more realistic setup and produce accurate resistance measurements. This study employs
connectors and PCU housing of the same design as the ENDS device under test. Figure 3shows the
holding fixture built for an ALTO-style ENDS with a snap pod retainer as part of its internal structure.
The Model 34465A KEYSIGHT
™
DMM [
39
] is used in conjunction with each unique ENDS holding
fixture. Each test fixture is secured vertically using a table-top vise with the pod housing on the top
end while the four wires are to the bottom. This setup made it easy to position the test fixture and
switch between pods during the experiment.
The process has currently been demonstrated on two ENDS designs. Detailed tutorials for building
resistance measurement holding fixtures are available at [
37
]. The process of building the pod holding
fixture includes multiple steps which are briefly summarized here:
1. Discharge the battery of the ENDS prior to opening the device.
2.
Open the ENDS PCU to access its internal structure. Use standard electrical safety precautions
when working in the presence of possible charge carrying components such as capacitors.
Avoid shorting any electrical leads during disassembly.
3. Remove the battery and the readily accessible PCU electronic components.
4.
Locate the internal side of the connectors. These spring connectors are used to connect the PCU
to the pod or tank section of the ENDS. The spring connectors may be directly soldered to a
printed circuit board (PCB) as in the JUUL, or indirectly connected to the PCB via thin wires as in
the ALTO.
5.
Solder four lead wires, force +/
−
and sense +/
−
, to the ENDS PCU +/
−
connectors, respectively.
Care must be taken not to damage the connectors or gaskets which lie between the ENDS PCU
PCB and the END PCU pod receiver. Details of these connections are important in developing
an accurate and robust fixture and are discussed in detail and with photographic guides in [
37
].
In the case of the device built for ALTO, the four lead wires are soldered to the cut end of the
manufacturer’s thin wires linking the connectors to the PCB, taking care to protect the connector
and surrounding plastics case from soldering heat. These two thin wires will be added to the
measured coil resistance in addition to the resistance of the connectors themselves. These extra
resistances can be measured and subtracted from coil resistance or can be simply neglected if they

Int. J. Environ. Res. Public Health 2020,17, 7779 8 of 16
appeared to be very small. This point is discussed in detail in the Section 3. These thin wires are
inherently present in the ENDS circuitry to supply power to the coil. Their resistance is added to
the coil resistance contribute to the total resistance seen by the ENDS PCU. Some designs of ENDS
PCU may rely on these thin wires to dynamically sense coil resistance. Thus, including the thin
wires in the testing apparatus circuitry represents an accurate measure of the effective resistance
of the pod/coil assembly.
6.
Make a small groove at the end of the ENDS PCU housing to make room to pass the four wires
out from the fixture to the DMM.
7.
Connect color-coded banana plugs to the free end of the four lead wires for inserting into
the DMM.
Int. J. Environ. Res. Public Health 2020, 17, x FOR PEER REVIEW 7 of 16
ENDS devices, the pods most often make electrical contact with the ENDS PCU using two different
style connectors. Several pod-style ENDS employ two spring-loaded connectors, also known as pogo
pin connectors, for the + and − terminals on the PCU side while mating with two corresponding flat
connectors on the pod side. The connectors come in various sizes and shapes across ENDS designs
and, most importantly, they have different distances between the +/− terminals. Additionally, the
mechanical means of retaining the pod in the ENDS is different from one manufacturer’s design to
another. Some manufacturers use a friction fit, some use a magnetic clasp, and others may use
detents. This variation between ENDS designs means that the pod-style coil terminals are not directly
exposed and cannot directly connect to COTS Kelvin lead clips. Further, we desired a test fixture
which would allow us to assess the impact of the pod-retaining mechanisms employed in various
ENDS designs on the repeatability of effective coil resistance measurement. Electrical contact
resistance caused by the connectors is a potential confounder in natural environment operations of
ENDS products, and is worth investigation.
Accordingly, this study incorporates a special holding fixture which is unique to each ENDS
product and retains the pod with its integrated coil in position while measurements are made with
the DMM. Each holding fixture uses a scavenged ENDS PCU housing and original manufacturer’s
connectors to mimic the housing, connectors and pod retention employed in the original ENDS to
create a more realistic setup and produce accurate resistance measurements. This study employs
connectors and PCU housing of the same design as the ENDS device under test. Figure 3 shows the
holding fixture built for an ALTO-style ENDS with a snap pod retainer as part of its internal structure.
The Model 34465A KEYSIGHT™ DMM [39] is used in conjunction with each unique ENDS holding
fixture. Each test fixture is secured vertically using a table-top vise with the pod housing on the top
end while the four wires are to the bottom. This setup made it easy to position the test fixture and
switch between pods during the experiment.
Figure 3. Custom electronic nicotine delivery systems (ENDS) test fixture for Vuse/ALTO pod-style
ENDS coil resistance measurement in conjunction with a Keysight Model 34465A digital multimeter.
The exploded view shows an inside view of the wire connections.
Figure 3.
Custom electronic nicotine delivery systems (ENDS) test fixture for Vuse/ALTO pod-style
ENDS coil resistance measurement in conjunction with a Keysight Model 34465A digital multimeter.
The exploded view shows an inside view of the wire connections.
2.3. Data Sampling Procedure
Each pod to be tested is marked with a unique identification number. Prior to making a resistance
measurement, this ID number is entered into the data logging script. The operator places the pod
to be tested in the holding fixture and presses a button on the computer to initiate data sampling.
The script has the ability to read the resistance using the two-wire and four-wire modes without
additional operator intervention. The tested pod remains inserted between the two-wire and four-wire
measurements. The script can read and report a single observation of coil resistance or can read
and record 120 sequential readings of the same pod taken at one-second intervals, to evaluate the
performance of the fixture and validate stability. Each data reading is tagged with the pod ID, two-wire
vs. four-wire configuration, trial number (for test/re-test repeatability), a time-date stamp (to identify
120 sequential readings), and the numerical value of the resistance reported by the DMM. All readings

Int. J. Environ. Res. Public Health 2020,17, 7779 9 of 16
are made in the same lab under the same environments including the same storage condition and
room temperature.
2.4. Test Specimens
Two popular pod-style ENDS devices were chosen for this study. The Vuse ALTO [
35
] and
JUUL [
36
] ENDS are two of the most popularly used e-cigarettes especially among teenagers [
32
–
34
].
We purchased N=22 Vuse ALTO pods and N=16 JUUL pods filled with nicotine flavor e-liquid with
a manufacturer-reported 5% nicotine concentration. The manufacturers report that ALTO pods are
filled with ~1.8 mL of e-liquid [
35
], while JUUL pods are filled with ~0.7 mL of e-liquid [
36
]. All pods
were new and in the manufacturer’s original sealed packaging until opened for this test. Pods were
purchased from local retail brick-and-mortar establishments and national online vendors. We observed
that the Vuse ALTO pods were identified with N=5 unique manufacturing lots, and the JUUL pods
were identified with N=2 manufacturing lots.
2.5. Statistical Analyses
Descriptive statistics were computed for each ENDS design including the mean, median,
interquartile range and outlier analysis. Standard statistical tests were used to assess all data
collected. Assessment of bias evident between the two-wire and four-wire configuration of the constant
current resistance test method was conducted with a repeated-measure (single-sample) t-test for each
ENDS design studied. Assessment of the one-to-one intra-class correlation coefficient, ICC
1:1
[
40
],
was conducted in the same lab using the same testing apparatus to assess the repeatability of the results
when the same sample of ALTO and JUUL pods were individually tested, and then re-tested after a
5 months interval of time. A total of 120 independent readings using the four-wire configuration of
each uniquely identified pod were taken on two different days, separated by five months between.
The test/re-test correlation coefficient, r
test/re-test
[
40
], was conducted to test the consistency or reliability
of the measurement. Ten readings using the four-wire configuration were taken for each pod and
the pod was removed from the test fixture and inserted back between consecutive readings with a
2–5 s interval. The one-to-one intra-class correlation coefficient, ICC
1:1
[
40
], and test/re-test correlation
coefficient, r
test/re-test
[
40
], were computed and reported for each ENDS studied. Assessment of
differences in mean effective coil resistance between ENDS designs was conducted using a two-sample
t-test under the assumptions of a normal distribution, unequal sample sizes and unequal variances.
The assumption of normally distributed samples was evaluated using a quantile–quantile (Q–Q) plot
of data observations vs. theoretical normal distribution. Assessment of manufacturing variation was
conducted using a normal distribution with point estimates for the mean and standard deviation to
predict the ±6σrange of coil resistances anticipated for mass-produced ENDS pods.
3. Results
Coil resistance test fixtures are built for two pod-style products: ALTO and JUUL. The constant
current resistance measurement method was used to measure N=22 ALTO pods and N=16 JUUL
pods with both the two- and four-wire lead configurations. A sampling distribution of the mean
was conducted for each test specimen, consisting of 120 repeated-measure resistance readings with
the digital multimeter at one-second intervals. Variation between repeated readings exhibited a 95%
confidence interval of less than 0.0002 (
Ω
) for every set of 120 repeated observations per pod and test
configuration (2 wire vs. 4 wire), indicating excellent stability of the test fixture.
The mean resistance value of the N=22 ALTO pods had a range of 1.018–1.304 (
Ω
) for the
two-wire configuration and 0.933–1.214 (
Ω
) for the four-wire configuration. The mean resistance of the
N=16 JUUL pods had a range of 1.631–1.744 (
Ω
) for the two-wire configuration and 1.544–1.659 (
Ω
)
for the four-wire configuration.
Figure 4shows a box plot of four groups of data: the two-wire and four-wire readings for
ALTO pods and JUUL pods. The mean resistance and standard deviation of N=22 ALTO pods was

Int. J. Environ. Res. Public Health 2020,17, 7779 10 of 16
observed to be 1.118 (0.053) (
Ω
) using the two-wire lead configuration and 1.031 (0.052) (
Ω
) using the
four-wire lead configuration. The ALTO data exhibits a slight positive skew and a paired t-test between
the two-wire lead and four-wire lead configurations exhibits a difference in means of
δ
=0.087 (
Ω
)
(
p<0.001
). The mean resistance (and standard deviation) of N=16 JUUL pods was observed to be
1.710 (0.032) (Ω) using the two-wire lead configuration and 1.624 (0.033) (Ω) using the four-wire lead
configuration. The JUUL data exhibits a negative skew and the paired t-test between the two- and
four-wire configurations exhibits a difference in means of
δ
=0.086 (
Ω
) (p<0.001). Results demonstrate
that the two-wire lead configuration exhibits a positive bias of
≈
0.087 (
Ω
), as would be expected due
to the additional resistance (2
×
R
Lead
) present in the two-wire lead test configuration illustrated in
Figure 1. For this reason, only four-wire configuration data is taken to the next analysis step.
Int. J. Environ. Res. Public Health 2020, 17, x FOR PEER REVIEW 10 of 16
0.087 (Ω) (p < 0.001). The mean resistance (and standard deviation) of N = 16 JUUL pods was observed
to be 1.710 (0.032) (Ω) using the two-wire lead configuration and 1.624 (0.033) (Ω) using the four-wire
lead configuration. The JUUL data exhibits a negative skew and the paired t-test between the two-
and four-wire configurations exhibits a difference in means of δ = 0.086 (Ω) (p < 0.001). Results
demonstrate that the two-wire lead configuration exhibits a positive bias of ≈ 0.087 (Ω), as would be
expected due to the additional resistance (2 × R
Lead
) present in the two-wire lead test configuration
illustrated in Figure 1. For this reason, only four-wire configuration data is taken to the next analysis
step.
Figure 4. Box plot and t-test results of ALTO (N = 22) and JUUL (N = 16) coil resistance readings for
the two-wire and four-wire configurations using the constant current method. The differences
between the two-wire and four-wire configurations are 0.087 (Ω) (p < 0.001) and 0.086 (Ω) (p < 0.001)
for ALTO and JUUL, respectively. The magenta difference bars are pointing at the group means while
the red line in the box plot refers to the group medians. The box notches illustrate the 95% confidence
interval on the median.
The test/re-test correlation coefficient, r
test/re-test
, and the one-to-one intra-class correlation
coefficient, ICC
1:1
, were computed to assess the repeatability of the testing apparatus. The one-to-one
intra-class correlation coefficient is conducted on two sets of readings. The first set is the means of
the 120 readings reported for in the previous paragraph. The second set consists of repeated
measurements for the same pods five months later. This comparison will show the stability of the test
fixture and pods over a period of five moths. The ICC
1:1
for ALTO (N = 13) is 0.9997 (13) p < 0.001 and
for JUUL (N = 16) is 0.9960 (16) p < 0.001. The test/re-test correlation coefficient is used to show the
consistency or reliability among measurements. A set of 10 consecutive readings with a 2–5 second
interval is taken for each pod. The test/re-test correlation coefficient for ALTO (N = 17) is 0.9997 (144)
p < 0.001 and for JUUL (N = 16) is 0.9873 (135) p < 0.001.
A quantile–quantile (Q–Q) plot of each data sample obtained using the unbiased four-wire lead
configuration is shown in Figure 5. The data was evaluated against several standard distributions,
and the normal distribution was found to be the closest fit to both ALTO and JUUL data, with a slight
positive and negative skew, respectively, consistent with the box plots in Figure 4.
Figure 4.
Box plot and t-test results of ALTO (N=22) and JUUL (N=16) coil resistance readings for
the two-wire and four-wire configurations using the constant current method. The differences between
the two-wire and four-wire configurations are 0.087 (
Ω
) (p<0.001) and 0.086 (
Ω
) (p<0.001) for ALTO
and JUUL, respectively. The magenta difference bars are pointing at the group means while the red line
in the box plot refers to the group medians. The box notches illustrate the 95% confidence interval on
the median.
The test/re-test correlation coefficient, r
test/re-test
, and the one-to-one intra-class correlation
coefficient, ICC
1:1
, were computed to assess the repeatability of the testing apparatus. The one-to-one
intra-class correlation coefficient is conducted on two sets of readings. The first set is the means of the
120 readings reported for in the previous paragraph. The second set consists of repeated measurements
for the same pods five months later. This comparison will show the stability of the test fixture and
pods over a period of five moths. The ICC
1:1
for ALTO (N=13) is 0.9997 (13) p<0.001 and for JUUL
(N=16) is 0.9960 (16) p<0.001. The test/re-test correlation coefficient is used to show the consistency
or reliability among measurements. A set of 10 consecutive readings with a 2–5 s interval is taken for
each pod. The test/re-test correlation coefficient for ALTO (N=17) is 0.9997 (144) p<0.001 and for
JUUL (N=16) is 0.9873 (135) p<0.001.

Int. J. Environ. Res. Public Health 2020,17, 7779 11 of 16
A quantile–quantile (Q–Q) plot of each data sample obtained using the unbiased four-wire lead
configuration is shown in Figure 5. The data was evaluated against several standard distributions,
and the normal distribution was found to be the closest fit to both ALTO and JUUL data, with a slight
positive and negative skew, respectively, consistent with the box plots in Figure 4.
Int. J. Environ. Res. Public Health 2020, 17, x FOR PEER REVIEW 11 of 16
Figure 5. Q–Q plot of the four-wire coil resistance readings of ALTO (N = 22) and JUUL (N = 16) for a
standard normal distribution. The data was tested against several standard random distributions and
normal distribution was found to be the closest fit.
Figure 6 shows a normalized histogram and fitted pdf for the four-wire resistance readings of
the ALTO and JUUL. The plot shows that both pod products exhibit manufacturing variations in coil
resistance. The mean and standard deviation of the sample distributions from the unbiased four-wire
lead configuration are 1.031 (0.067) (Ω) for the ALTO and 1.624 (0.033) (Ω) for the JUUL. A two-
sample t-test was conducted to assess the effective mean resistance between the two pod products,
demonstrating a result of δ ≈ 0.593 (Ω) (p < 0.001).
Figure 5.
Q–Q plot of the four-wire coil resistance readings of ALTO (N=22) and JUUL (N=16) for a
standard normal distribution. The data was tested against several standard random distributions and
normal distribution was found to be the closest fit.
Figure 6shows a normalized histogram and fitted pdf for the four-wire resistance readings of
the ALTO and JUUL. The plot shows that both pod products exhibit manufacturing variations in
coil resistance. The mean and standard deviation of the sample distributions from the unbiased
four-wire lead configuration are 1.031 (0.067) (
Ω
) for the ALTO and 1.624 (0.033) (
Ω
) for the JUUL.
A two-sample t-test was conducted to assess the effective mean resistance between the two pod
products, demonstrating a result of δ≈0.593 (Ω) (p<0.001).

Int. J. Environ. Res. Public Health 2020,17, 7779 12 of 16
Int. J. Environ. Res. Public Health 2020, 17, x FOR PEER REVIEW 12 of 16
Figure 6. Normalized histogram and fitted Probability Density Function (PDF) for four-wire coil
resistances of ALTO (N = 22) and JUUL (N = 16). The group mean resistance of ALTO pods is 0.593
(Ω) (p < 0.001) less than that of JUUL pods. The sample of ALTO pods tested exhibits more
manufacturing variability than the sample of JUUL pods.
4. Discussion
The four-wire constant current method is the preferred technique for quantifying electronic
cigarette coil resistance. Between-product comparisons may not be reliable when resistance
measurements are taken using the popular two-wire method. Thus, the popular two-wire method
should be avoided in future studies. For example, in our controlled setting, the two-wire method
introduced a bias of 0.086 (Ω), which was 15% of the observed difference between product means of
0.593 (Ω). If care is not taken with the wire lead resistance, the bias can be even larger than 15% and
obfuscate important variation between products. Similarly, if two-wire comparisons are made
between data collected by two different labs with two different apparatus, we may inadvertently
conclude that there is no significant difference between product characteristics or ascribe a difference
to the product which could actually be a result of the test apparatus. While two-wire resistance
measurement methods are common in many laboratory settings, they may not be sufficiently
accurate for measuring the resistance of electronic cigarette coils with a resistance of ≈3 (Ω) or lower.
Results demonstrated that a sample of coils from a single manufacturer procured across
manufacturing lots exhibit variation, which is a significant fraction of the nominal coil resistance.
Such manufacturing variation is expected. The amount of manufacturing variation in coil resistance
associated with a particular product may have significant implications on the emissions resulting
from the use of the product. The coefficient of variation (standard deviation over the mean) was
observed to be 5.1% for ALTO and 2.0% for JUUL. Using the sampling distribution of the mean, it
is reasonable to infer that the ±3σ coil resistance of ALTO and JUUL pods vary by as much as ±15%
and ±6% for ALTO and JUUL, respectively, when considering the true population of large production
lots typical of a national and global distribution channel.
Differences in coil resistance, whether associated with bias error from the two-wire
configuration, variation between products or variation within a single product, may yield important
variations in the emissions of total particulate matter (TPM) and presence of hazardous and
Figure 6.
Normalized histogram and fitted Probability Density Function (PDF) for four-wire coil
resistances of ALTO (N=22) and JUUL (N=16). The group mean resistance of ALTO pods is 0.593 (
Ω
)
(p<0.001) less than that of JUUL pods. The sample of ALTO pods tested exhibits more manufacturing
variability than the sample of JUUL pods.
4. Discussion
The four-wire constant current method is the preferred technique for quantifying electronic
cigarette coil resistance. Between-product comparisons may not be reliable when resistance
measurements are taken using the popular two-wire method. Thus, the popular two-wire method
should be avoided in future studies. For example, in our controlled setting, the two-wire method
introduced a bias of 0.086 (
Ω
), which was 15% of the observed difference between product means of
0.593 (
Ω
). If care is not taken with the wire lead resistance, the bias can be even larger than 15% and
obfuscate important variation between products. Similarly, if two-wire comparisons are made between
data collected by two different labs with two different apparatus, we may inadvertently conclude
that there is no significant difference between product characteristics or ascribe a difference to the
product which could actually be a result of the test apparatus. While two-wire resistance measurement
methods are common in many laboratory settings, they may not be sufficiently accurate for measuring
the resistance of electronic cigarette coils with a resistance of ≈3 (Ω) or lower.
Results demonstrated that a sample of coils from a single manufacturer procured across
manufacturing lots exhibit variation, which is a significant fraction of the nominal coil resistance.
Such manufacturing variation is expected. The amount of manufacturing variation in coil resistance
associated with a particular product may have significant implications on the emissions resulting from
the use of the product. The coefficient of variation (standard deviation over the mean) was observed to
be 5.1% for ALTO and 2.0% for JUUL. Using the sampling distribution of the mean, it is reasonable
to infer that the
±
3
σ
coil resistance of ALTO and JUUL pods vary by as much as
±
15% and
±
6% for
ALTO and JUUL, respectively, when considering the true population of large production lots typical of
a national and global distribution channel.

Int. J. Environ. Res. Public Health 2020,17, 7779 13 of 16
Differences in coil resistance, whether associated with bias error from the two-wire configuration,
variation between products or variation within a single product, may yield important variations in
the emissions of total particulate matter (TPM) and presence of hazardous and potentially hazardous
constituents (HPHCs) in the emissions. Furthermore, the impact of variability in coil resistance in the
pod (or e-cigarette reservoir) on emissions is closely related to the electronics used in the power control
unit (PCU) of the e-cigarette. The PCUs of modern e-cigarettes are far more sophisticated than a simple
battery. However, examining the effect of variation in coil resistance on power dissipated in the coil by
a simple direct current (DC) circuit of a battery across a coil provides insight into the joint impacts of
both the coil and the PCU on emissions.
Consider an electronic cigarette with a nominal coil resistance of 1 (
Ω
) (measured using four-wire
configuration) and powered by a battery with a fully charged voltage of 3.7 (V). To illustrate the point,
consider the PCU as being a simple “on/off” switch with no active voltage or current control and no
supporting pulse width modulation. The nominal power dissipated will be
P=3.72
1.0 =
13.69
(W)
,
as given by Equation (1) and the nominal current flowing through the coil will be I
coil
=V
coil
/R
coil
=
3.7/1.0 =3.7 (A), as determined by Ohm’s Law, Equation (2). It is well known from DC circuit analysis
that the total energy delivered from the coil to the liquid is limited by the product of the nominal
power and duration of activation. Similarly, it is well known from heat and mass transfer analysis
that the rate of mass transfer from the liquid to the aerosol stream is affected by the surface area,
flow path, and flow rate. As the power, P, and energy increase, we can anticipate more emission of
TPM. As the current, I
coil
, increases, the temperature of the coil itself will increase through a well-known
phenomenon known as “Ohmic heating.” We might anticipate, then, that increases in current flowing
through the coil might give rise to increased production of HPHCs in the emissions resulting from
thermal decomposition of e-liquid constituents. Thus, understanding the influence of variation in the
coil resistance of e-cigarettes is essential to understanding emissions.
We demonstrated that the two-wire configuration introduced a positive bias, overestimating the
true value of the coil resistance by 0.086 (
Ω
). If we use this biased estimate of coil resistance, we would
underestimate the power,
P=3.72
1.086 =
12.6
(W)
, and current, I
coil
=3.6 (A), in the coil. These biased
estimates are not conservative, and could very well give rise to apparent inconsistencies observed
between the emissions produced when comparing products to one another.
The same concern holds true when we assess the effect of manufacturing variation between coils
of the same product design. A manufacturing variation of +/
−
15% in coil resistance with a simple PCU
would result in variations in coil power and current dissipation of
−
13%/+18%. As the manufacturing
variation in coils increases, the potential adverse consequences of changes in HPHC emissions also
increases. It has been reported that coils with lower resistance values may have higher negative health
impacts [
23
–
25
,
27
]. Therefore, it is essential to develop a full understanding of the manufacturing
variation in coil resistance associated with electronic cigarettes. This high difference in the expected
instantaneous power has the potential to drastically change the performance of the device, constituents
of the aerosol produced, and the e-liquid consumption rate.
Electronic cigarette power control units (PCUs) which employ active voltage control may mitigate
the adverse impact of variation in coil resistance. Both the ALTO and JUUL are equipped with PCUs
exhibiting active control logic. The sophistication of PCUs varies widely between product designs.
The potential of the PCU to mitigate manufacturing variation in coil resistance deserves further
attention. Little is known about the performance of various PCUs and their limitations.
The robust method introduced herein provides a foundation for investigation of several research
questions, including the following. What resistance variation is exhibited between coils of different
products? What variation in resistance is exhibited within a product design? What are the effects of
resistance variation on the aerosol composition and generation rate? How does the resistance of a coil
change over the course of its operating life? How does the resistance of a coil change during a vaping
session? How do these variations affect the performance, lifetime and safety of the lithium battery?
What is the relation between coil resistance, power, and the performance of the PCU? To what extent

Int. J. Environ. Res. Public Health 2020,17, 7779 14 of 16
can the PCU overcome variations in coil resistance? What is the effect of using interchangeable coils
(such as the now common 510 threaded reservoir) in conjunction with PCUs on emissions? How does
this framework inform potential adverse health consequences of product misuse and product hacking?
5. Conclusions
The preferred constant current resistance measurement method using four-wire leads is
demonstrated to provide stable, accurate, repeatable and unbiased observations of the resistance of
pod-style electronic cigarette coil assemblies. The commonly employed two-wire lead configuration is
demonstrated to introduce a positive bias, the magnitude of which is dependent upon the laboratory
testing apparatus and impedes reproducing results between independent laboratories. The constant
current four-wire lead method is recommended as the standard method for measuring the resistance of
electronic cigarette coil assemblies. The coil resistance measurement method, which was demonstrated
using two brands of pod-style electronic cigarettes, is broadly applicable to other brands and styles of
electronic cigarettes.
A quantile–quantile assessment demonstrated that the manufacturing variation in the effective
coil resistance of pod assemblies for two brands of popular electronic cigarettes is normally distributed.
The mean coil resistance of pods varies significantly between the brands of electronic cigarettes tested,
demonstrating that the sample mean resistance of the ALTO pods was 0.593 (
Ω
) lower than the mean
resistance of JUUL pods (p<0.001). Furthermore, the sample of ALTO (N=22) pods tested exhibited a
mean and 99% confidence interval of 1.031
±
0.0405 (
Ω
), while that of the JUUL (N=16) pods exhibited
a mean and 99% confidence interval of 1.624
±
0.0243 (
Ω
). The resistance measurement method is
thus valuable for assessing variations between brands of electronic cigarettes and for quantifying
manufacturing variation which may be anticipated within a single product brand. Products exhibiting
larger manufacturing variation in coil resistance may result in the wider variability of emissions
generated from those products. As a result, it is recommended that the distribution of manufacturing
coil resistance (using the constant current four-wire lead method) be reported in future comprehensive
emissions studies and new product applications for coils and coil assemblies.
Author Contributions:
Conceptualization, Q.M.S. and E.C.H.; methodology, Q.M.S. and E.C.H.; software, Q.M.S.
and E.C.H.; validation, Q.M.S., E.C.H. and R.J.R.; formal analysis, Q.M.S. and E.C.H.; investigation, Q.M.S., E.C.H.
and R.J.R.; resources, E.C.H. and R.J.R.; data curation, Q.M.S. and E.C.H.; writing—original draft preparation,
Q.M.S. and E.C.H.; writing—review and editing, R.J.R.; visualization, Q.M.S. and E.C.H.; supervision, E.C.H.
and R.J.R.; project administration, E.C.H. and R.J.R.; funding acquisition, E.C.H. All authors have read and agreed
to the published version of the manuscript.
Funding:
Research reported in this publication was supported by the National Institute of Environmental Health
Sciences (NIEHS) of the National Institutes of Health and FDA Center for Tobacco Products (CTP) under award
number R21ES029984. The content is solely the responsibility of the authors and does not necessarily represent
the official views of the NIH or the Food and Drug Administration.
Acknowledgments:
The authors would like to acknowledge Gary DiFrancesco who assessed, with laboratory
hardware, the initial ENDS test apparatus build; Shehan Jayasekera for his help with software script for reading
from the DMM; Samantha Emma Sarles for her help with initial ENDS dissection.
Conflicts of Interest: The authors declare no conflict of interest.
References
1.
Robinson, R.J.; Eddingsaas, N.C.; DiFrancesco, A.G.; Jayasekera, S.; Hensel, E.C., Jr. A framework to
investigate the impact of topography and product characteristics on electronic cigarette emissions. PLoS ONE
2018,13, e0206341. [CrossRef] [PubMed]
2.
Bitzer, Z.T.; Goel, R.; Reilly, S.M.; Foulds, J.; Muscat, J.; Elias, R.J.; Richie, J.P., Jr. Effects of solvent and
temperature on free radical formation in electronic cigarette aerosols. Chem. Res. Toxicol.
2018
,31, 4–12.
[CrossRef] [PubMed]
3.
Behar, R.Z.; Luo, W.; McWhirter, K.J.; Pankow, J.F.; Talbot, P. Analytical and toxicological evaluation of flavor
chemicals in electronic cigarette refill fluids. Sci. Rep. 2018,8, 1–11. [CrossRef] [PubMed]

Int. J. Environ. Res. Public Health 2020,17, 7779 15 of 16
4.
Kosmider, L.; Sobczak, A.; Fik, M.; Knysak, J.; Zaciera, M.; Kurek, J.; Goniewicz, M.L. Carbonyl compounds
in electronic cigarette vapors: Effects of nicotine solvent and battery output voltage. Nicotine Tob. Res.
2014
,
16, 1319–1326. [CrossRef] [PubMed]
5.
Farsalinos, K.E.; Voudris, V. Do flavouring compounds contribute to aldehyde emissions in e-cigarettes?
Food Chem. Toxicol. 2018,115, 212–217. [CrossRef]
6.
Farsalinos, K.E.; Spyrou, A.; Tsimopoulou, K.; Stefopoulos, C.; Romagna, G.; Voudris, V. Nicotine absorption
from electronic cigarette use: Comparison between first and new-generation devices. Sci. Rep.
2014
,4, 4133.
[CrossRef]
7.
Eddingsaas, N.; Pagano, T.; Cummings, C.; Rahman, I.; Robinson, R.; Hensel, E. Qualitative analysis of
e-liquid emissions as a function of flavor additives using two aerosol capture methods. Int. J. Environ. Res.
Public Health 2018,15, 323. [CrossRef]
8.
Hensel, E.C.; Eddingsaas, N.C.; DiFrancesco, A.G.; Jayasekera, S.; O’Dea, S.; Robinson, R.J. Framework to
estimate total particulate mass and nicotine delivered to E-cig users from natural environment monitoring
data. Sci. Rep. 2019,9, 1–9. [CrossRef]
9.
Robinson, R.J.; Hensel, E.C. Behavior-based yield for electronic cigarette users of different strength eliquids
based on natural environment topography. Inhal. Toxicol. 2019,31, 484–491. [CrossRef]
10.
Kim, K.-H. Mass change tracking approach as collection guidelines for aerosol and vapor samples released
during e-cigarette smoking. Anal. Methods 2016,8, 2305–2311. [CrossRef]
11.
Korzun, T.; Lazurko, M.; Munhenzva, I.; Barsanti, K.C.; Huang, Y.; Jensen, R.P.; Escobedo, J.O.; Luo, W.;
Peyton, D.H.; Strongin, R.M. E-cigarette airflow rate modulates toxicant profiles and can lead to concerning
levels of solvent consumption. ACS Omega 2018,3, 30–36. [CrossRef] [PubMed]
12.
Robinson, R.; Hensel, E.; Al-Olayan, A.; Nonnemaker, J.; Lee, Y. Effect of e-liquid flavor on electronic cigarette
topography and consumption behavior in a 2-week natural environment switching study. PloS ONE
2018
,
13, e0196640. [CrossRef]
13.
Cengel, Y.; Ghajar, A. Heat and Mass Transfer: Fundamentals and Applications; McGraw-Hill Higher Education:
New York, NY, USA, 2014.
14. Tipler, P.A.; Mosca, G. Physics for Scientists and Engineers; W.H. Freeman: New York, NY, USA, 2003.
15.
Wens, M.; Steyaert, M. Design and Implementation of Fully-Integrated Inductive DC-DC Converters in Standard
CMOS; Springer Science & Business Media: New York, NY, USA, 2011.
16.
Wagener, T.L.; Floyd, E.L.; Stepanov, I.; Driskill, L.M.; Frank, S.G.; Meier, E.; Leavens, E.L.; Tackett, A.P.;
Molina, N.; Queimado, L. Have combustible cigarettes met their match? The nicotine delivery profiles
and harmful constituent exposures of second-generation and third-generation electronic cigarette users.
Tob. Control 2017,26, e23–e28. [CrossRef] [PubMed]
17.
Talih, S.; Salman, R.; Karaoghlanian, N.; El-Hellani, A.; Saliba, N.; Eissenberg, T.; Shihadeh, A. “Juice
Monsters”: Sub-ohm vaping and toxic volatile aldehyde emissions. Chem. Res. Toxicol.
2017
,30, 1791–1793.
[CrossRef] [PubMed]
18.
Soulet, S.; Duquesne, M.; Toutain, J.; Pairaud, C.; Mercury, M. Impact of vaping regimens on electronic
cigarette efficiency. Int. J. Environ. Res. Public Health 2019,16, 4753. [CrossRef]
19.
McAdam, K.; Warrington, A.; Hughes, A.; Adams, D.; Margham, J.; Vas, C.; Davis, P.; Costigan, S.; Proctor, C.
Use of social media to establish vapers puffing behaviour: Findings and implications for laboratory evaluation
of e-cigarette emissions. Regul. Toxicol. Pharmacol. 2019,107, 104423. [CrossRef]
20. SMOK Website. Available online: https://www.smoktech.com/(accessed on 10 April 2020).
21.
Vaporasso Website, TARGET PM80. Available online: https://www.vaporesso.com/vape-kits/target-pm80
(accessed on 24 April 2020).
22.
Innokin Website, Z-BIIP. Available online: https://www.innokin.com/vaporizers/z-biip/(accessed on
24 April 2020).
23.
Cirillo, S.; Urena, J.F.; Lambert, J.D.; Vivarelli, F.; Canistro, D.; Paolini, M.; Cardenia, V.;
Rodriguez-Estrada, M.T.; Richie, J.P.; Elias, R.J. Impact of electronic cigarette heating coil resistance on the
production of reactive carbonyls, reactive oxygen species and induction of cytotoxicity in human lung cancer
cells in vitro. Regul. Toxicol. Pharmacol. RTP 2019,109, 104500. [CrossRef]

Int. J. Environ. Res. Public Health 2020,17, 7779 16 of 16
24.
Cirillo, S.; Vivarelli, F.; Turrini, E.; Fimognari, C.; Burattini, S.; Falcieri, E.; Rocchi, M.B.L.; Cardenia, V.;
Rodriguez-Estrada, M.T.; Paolini, M. The customizable e-cigarette resistanceinfluences toxicological outcomes:
Lung degeneration, inflammation, and oxidative stress-induced in a rat model. Toxicol. Sci.
2019
,172, 132–145.
[CrossRef]
25.
Gillman, I.G.; Kistler, K.A.; Stewart, E.W.; Paolantonio, A.R. Effect of variable power levels on the yield of
total aerosol mass and formation of aldehydes in e-cigarette aerosols. Regul. Toxicol. Pharm.
2016
,75, 58–65.
[CrossRef]
26. Chausse, P.; Naughton, G.; Dutheil, F. Electronic cigarettes. Chest 2015,148, e29–e30. [CrossRef]
27.
Hiler, M.; Karaoghlanian, N.; Talih, S.; Maloney, S.; Breland, A.; Shihadeh, A.; Eissenberg, T. Effects of
electronic cigarette heating coil resistance and liquid nicotine concentration on user nicotine delivery,
heart rate, subjective effects, pufftopography, and liquid consumption. Exp. Clin. Psychopharmacol.
2019
.
[CrossRef] [PubMed]
28.
Sleiman, M.; Logue, J.M.; Montesinos, V.N.; Russell, M.L.; Litter, M.I.; Gundel, L.A.; Destaillats, H.
Emissions from electronic cigarettes: Key parameters affecting the release of harmful chemicals.
Environ. Sci. Technol. 2016,50, 9644–9651. [CrossRef]
29.
Ogunwale, M.A.; Li, M.; Ramakrishnam Raju, M.V.; Chen, Y.; Nantz, M.H.; Conklin, D.J.; Fu, X.-A.
Aldehyde detection in electronic cigarette aerosols. ACS Omega 2017,2, 1207–1214. [CrossRef]
30.
Soulet, S.; Duquesne, M.; Toutain, J.; Pairaud, C.; Lalo, H. Influence of coil power ranges on the e-liquid
consumption in vaping devices. Int. J. Environ. Res. Public Health 2018,15, 1853. [CrossRef]
31.
Coil Master Website. Available online: https://www.coil-master.net/product/coil-master-521-mini-v2
(accessed on 24 April 2020).
32.
Cullen, K.A.; Gentzke, A.S.; Sawdey, M.D.; Chang, J.T.; Anic, G.M.; Wang, T.W.; Creamer, M.R.; Jamal, A.;
Ambrose, B.K.; King, B.A. E-Cigarette use among youth in the United States, 2019. JAMA
2019
,322, 2095–2103.
[CrossRef]
33.
Tan, A.S.; Soneji, S.S.; Choi, K.; Moran, M.B. Prevalence of using pod-based vaping devices by brand among
youth and young adults. Tob. Control 2019. [CrossRef]
34.
Kavuluru, R.; Han, S.; Hahn, E.J. On the popularity of the USB flash drive-shaped electronic cigarette JUUL.
Tob. Control 2019,28, 110–112. [CrossRef]
35. VUSE Website. Available online: https://vusevapor.com/alto-complete-kit (accessed on 10 April 2020).
36. JUUL Webstie. Available online: https://www.juul.com/(accessed on 10 April 2020).
37.
Saleh, Q.; Hensel, E.; Robinson, R. Coil resistance testing apparatus for VUSE ALTO. Available online: https:
//protocols.io/view/coil-resistance-testing-apparatus-for-vuse-alto-bibnkame (accessed on 23 October 2020).
38.
Janesch, J. Two-wire vs. Four-wire Resistance Measurements: Which Configuration Makes Sense for Your
Application. Available online: https://doc.xdevs.com/doc/Keithley/Appnotes/2Wire_4Wire%20Resistance%
20Article.pdf (accessed on 23 October 2020).
39.
Digital Multimeters 34460A, 34461A, 34465A (6
1
2
digit), 34470A (7
1
2
digit). Available online: https:
//www.keysight.com/us/en/assets/7018-03846/data-sheets/5991-1983.pdf (accessed on 10 April 2020).
40.
McGraw, K.O.; Wong, S.P. Forming inferences about some intraclass correlation coefficients. Psychol. Methods
1996,1, 30. [CrossRef]
Publisher’s Note:
MDPI stays neutral with regard to jurisdictional claims in published maps and institutional
affiliations.
©
2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).