ArticlePDF Available

Abstract

Objectives: The increasing and widespread availability of personal technology offers patients and clinicians the opportunity to utilize real-time virtual communication to enhance access to health services. Understanding the perceived value of different modes of care may help to shape the future use of technology. Study design: Cross-sectional surveys of patients and clinicians participating in telehealth virtual video visits (VVVs) in an academic health system. Methods: We administered surveys to 426 unique established patients and 74 attending physicians in our hospital to measure perceptions of the comparative experience of VVVs and office visits; 254 patients and 61 physicians completed the surveys. Results: When comparing VVVs and office visits, 62.6% of patients and 59.0% of clinicians reported no difference in "the overall quality of the visit." VVVs were vastly preferred to office visits by patients for convenience and travel time. A majority (52.5%) of clinicians reported higher efficiency of a VVV appointment. Conclusions: For established patients, VVVs may provide effective follow-up and enhanced convenience when compared with traditional office visits.
40 JANUARY 2019 www.ajmc.com
T
elemedicine visits have been used in the United States to
enhance access to healthcare, most notably for people who
live in remote and underserved areas.1,2 The increasing avail-
ability of personal technology (89% have internet access, 77% are
online daily3) oers patients and clinicians the opportunity to utilize
real-time virtual communication to enhance access for patients
when transportation challenges, schedules, or physical disability
make oce visits dicult in any geography.4 Although face-to-face
interactions may be preferred in some circumstances by patients or
clinicians, the convenience of accessing healthcare consultations
from the home or oce may save lost time at home or work, travel
time, and missed and rescheduled appointments.
5-9
Understanding the
perceived relative value of dierent modes of healthcare services may
help to shape the use of virtual or remote healthcare technologies.
10,11
Eective population health management is a balancing act that
requires consideration of patient needs and preferences for more
exible and timely access to consultation, accountability to payers
by managing high costs, and understanding how to leverage new
technologies.12,13 System learning that demonstrates the value of
dierent types of “visits” for the system and the patient is essential.
14
We initiated the Massachusetts General Hospital (MGH) TeleHealth
program in 2012, oering a range of telemedicine services in 15 clinical
departments. This paper describes experiences with virtual video
visits (VVVs): 2-way audiovisual synchronous videoconferencing
between the MGH clinician and patient. The research reported
here focuses on the patient and clinician experience of a VVV in
a full year of operation to understand its value and comparative
experience with VVVs and oce visits.
METHODS
Study Setting and Telemedicine
Clinicians in 5 specialties (psychiatry, neurology, cardiology,
oncology, and primary care) were trained in how to provide a
VVV throughout the rst year and on a rolling basis. Oncology
and primary care VVVs were not implemented until late in the
data collection period. Clinicians oered VVVs as an option to
Patient and Clinician Experiences With
Telehealth for Patient Follow-up Care
Karen Donelan, ScD, EdM; Esteban A. Barreto, MA; Sarah Sossong, MPH; Carie Michael, SM; Juan J. Estrada, MSc, MBA;
Adam B. Cohen, MD; Janet Wozniak, MD; and Lee H. Schwamm, MD
ABSTRACT
OBJECTIVES: The increasing and widespread availability
of personal technology offers patients and clinicians the
opportunity to utilize real-time virtual communication
to enhance access to health services. Understanding the
perceived value of different modes of care may help to shape
the future use of technology.
STUDY DESIGN: Cross-sectional surveys of patients and
clinicians participating in telehealth virtual video visits
(VVVs) in an academic health system.
METHODS: We administered surveys to 426 unique
established patients and 74 attending physicians in our
hospital to measure perceptions of the comparative
experience of VVVs and office visits; 254 patients and
61physicians completed the surveys.
RESULTS: When comparing VVVs and office visits, 62.6%
of patients and 59.0% of clinicians reported no difference
in“the overall quality of the visit.” VVVs were vastly
preferred to office visits by patients for convenience and
travel time. A majority (52.5%) of clinicians reported higher
efficiency of a VVV appointment.
CONCLUSIONS: For established patients, VVVs may
provide effective follow-up and enhanced convenience when
compared with traditional office visits.
Am J Manag Care. 2019;25(1):40-44
TRENDS
FROM THE FIELD
VOL. 25, NO. 1 41
THE AMERICAN JOURNAL OF MANAGED CARE®
Virtual vs In-Person Office Visits
established patients based on their professional
assessment of the suitability of the mode of
visit for the individual patient’s situation (eg,
patient could communicate eectively in this
mode, physical examination was not critical
at the visit). Clinicians were compensated by
MGH for conducting these VVVs because they
were not covered by payers in Massachusetts.
In advance of the VVV, participating patients
received education, instruction, and phone-
based technology support and testing for
installation of the visit software. Patients were
not charged insurance co-payments for the visit.
Survey Methods
The data reported here come from surveys of patients and clinicians
in the MGH TeleHealth program. This study was reviewed and
approved by the Partners Health Care Oce of Human Research.
The surveys we employed were developed by the MGH Center for
TeleHealth leadership and Mongan Institute Health Policy Center
research team, including experts in survey and health services
research, telemedicine, clinical medicine, and health management.
We included selected patient experience measures developed by
the Consumer Assessment of Healthcare Providers and Systems
(CAHPS)15 andaugmented with items developed for this mode of
visit. Surveys were pretested with patients and rened. Key domains
included technology and communication quality, visit quality and
experience, patient time and costs, and willingness to pay for a VVV.
Of 426 eligible patients, 254 (60%) completed surveys using a
secure web tool. Eligible patients had at least 1 VVV during the
accrual period and at least 1 oce visit in the 6-month period
prior. Initial recruitment was by email request within 1 week of
the VVV. Patients whose email addresses were not functional were
contacted by postal mail or telephone. Persistent nonresponders to
the survey were oered a $10 incentive after 4 weeks of attempts
without reaching the patient. Patients younger than 18 years were
not directly contacted; rather, surveys were sent to their parents.
Of 74 eligible clinicians (physicians, nurse practitioners, psycholo-
gists) who provided at least 1 VVV to program patients during the
study period, 61 (82%) completed surveys online, with recruitment
by email. An Amazon.com gift certicate valued at $50 was oered
to each physician as an honorarium for participation.
The results reported here are descriptive; subgroup comparisons
within patient and clinician populations use χ
2
or t test comparisons
as indicated, and analyses comparing patient and clinician responses
utilize 2-sample t tests of the dierence in proportions. All analyses
were conducted using SPSS version 23 (IBM Corp; Armonk, New York).
RESULTS
Patient characteristics are shown in the eAppendix Table (eAppendix
available at ajmc.com). VVV patients were diverse in age and gender
and were predominantly white and non-Hispanic, consistent with
patient demographics in our system. Patients receiving behavioral
health care are overrepresented due to the rapid uptake of VVV
by those clinicians and patients. No signicant dierences were
measured in characteristics of respondents and nonrespondents.
Clinician respondents were psychologists and psychiatrists
(34%), neurologists (38%), cardiologists (10%), oncologists (2%),
andprimary care clinicians (16%).
Patient Experience of VVVs
Patient experience with a VVV was measured in multiple items.
Responses are shown in the Table by specialty, comparing neurology
and cardiology patient responses with those of the psychiatry patients
(referent). We used 4 measures from the CAHPS Clinician Group visit
to assess patient experience with eciency and communication
during VVVs. Overall, 80% or more respondents answered “yes,
denitely” to these items; 82.3% responded “yes, denitely” to
whether they would recommend VVV to their family and friends.
On a scale of 0 to 10, where 0 is the worst possible visit and 10 is
the best visit, 68.5% rated the visit a 9 or 10.
We asked patients to consider whether the care provided during
their recent VVV could have been provided in another way and
still met their needs, asking “Do you think the health issues you
discussed with clinicians today could just as easily have been
addressed by [insert visit mode]?” Nearly 90% of patients agreed
that theirissues could also have been addressed in an oce visit
(denitely, 70.8%; somewhat, 17.8%) and nearly 60% by telephone
calls (denitely, 23.2%; somewhat, 36.7%). The results for secure
email (denitely, 7.2%; somewhat, 23.5%) and text messaging
(denitely, 3.6%; somewhat, 12.7%) suggest that they are less often
appropriate substitutes (data not shown).
Patient and Clinician Comparisons of Office Visits
and VVVs
The Figure shows patient and clinician responses to a series of
comparative questions about oce visits and VVVs that were asked
of both groups. Expanded data are shown in eAppendix Figures 1
and 2—one with patient data, one with clinician data—and include
TAKEAWAY POINTS
Telemedicine visits have been used to provide healthcare access to more remote populations.
In a busy health system, telehealth visits were incorporated for established patients to allow
patient–clinician interaction in a new, more convenient mode. In the first full year of patient
visits in this new mode, we found that:
Patients rated these visits highly and the majority would recommend them to family and friends.
Using standard measures of patient experience, most patients and clinicians perceived no
loss of communication in virtual video visits compared with office visits, although clinicians
were somewhat more likely to see loss of personal connection as a problem.
Patients perceived considerable added convenience, saved travel time, and expressed
willingness to pay co-payments for this visit option.
Virtual visits are an important and useful option in clinical care.
42 JANUARY 2019 www.ajmc.com
TRENDS FROM THE FIELD
several items that were directed only to one
group or the other.
Most patients (62.6%) and clinicians (59.0%)
reported “no dierence” between virtual and
oce visits on “the overall quality of the visit.
When rating “the personal connection felt
during the visit,” 32.7% of patients and 45.9%
of clinicians reported that the “oce visit is
better,” but more than half of the respondents
(patients, 59.1%; clinicians, 50.8%) said that
there was “no dierence.
Patient Willingness to Pay for VVV
eAppendix Figure 3 shows data on patient
willingness to pay for VVV out of pocket. Patients
were not initially charged co-payments. However,
the majority of patients expressed a willingness
to pay a co-payment of up to $50. Among those
willing to bear the full cost of the VVV, more than
one-third had no current co-payment and all
had private (vs public) insurance. We conducted
bivariate analyses of the willingness to make
co-payments for VVV by both self-reported
travel time and cost of attending oce visits.
Among those who traveled more than 90 minutes
to an oce visit, 51.5% indicated they would
pay a co-payment of more than $50 for a VVV
compared with 30.4% of those who traveled less
than 30 minutes. Among patients who spent
$25 or more on travel to attend an oce visit,
73.2% would pay a co-payment of $26 to $50
for a VVV and 97.6% would pay a co-payment
of $10 to $25 (travel data not shown).
DISCUSSION
Increased interest in new strategies for managing
population health and episodic specialty care,
coupled with the widespread availability of
communications technologies, have encour-
aged the exploration of the appropriate roles
of dierent modes of clinical encounters or
visits.
16,17
Our data—gathered from patients and
clinicians during and following an initial full
year of experience with the MGH Center for
TeleHealth’s VVV implementation—show a high
degree of patient and clinician satisfaction, as
measured by both ratings of overall visit quality
and willingness to recommend the visits.
VVVs are perceived by the majority of patients
as the same as or better than oce visits in
convenience and cost, at the same level of
TABLE. Patient Experience With Virtual Video Visits
Specialties
Total
(N = 254)
Psychiatry
(n = 113)
Neurology
(n = 92)
Cardiology
(n = 30)
Thinking about your most recent virtual
video visit, please tell us how much you
agree with the following items:
I saw my clinician within 15 minutes of
my appointment time. Reference P = .609 P = .284
Yes, definitely agree 88.2% 90.3% 88.0% 83.3%
Yes, somewhat agree 6.3% 6.2% 4.3% 10.0%
No 3.5% 1.8% 4.3% 6.7%
Not answered 2.0% 1.8% 3.3% 0.0%
My clinician explained things in a way
that was easy to understand. Reference P = .046 P = .791
Yes, definitely agree 92.9% 95.6% 88.0% 96.7%
Yes, somewhat agree 3.9% 1.8% 7.6% 3.3%
No 0.8% 0.0% 1.1% 0.0%
Not answered 2.0% 2.7% 3.3% 0.0%
My clinician listened carefully to me. Reference P = .026 P = .791
Yes, definitely agree 92.5% 95.6% 87.0% 96.7%
Yes, somewhat agree 4.7% 1.8% 9.8% 3.3%
No 0.8% 0.0% 1.1% 0.0%
Not answered 2.0% 2.7% 2.2% 0.0%
My clinician spent enough time with me. Reference P = .002 P = .656
Yes, definitely agree 98.8% 94.7% 80.4% 96.7%
Yes, somewhat agree 7.1% 2.7% 15.2% 3.3%
No 1.2% 0.9% 1.1% 0.0%
Not answered 2.0% 1.8% 3.3% 0.0%
On a scale from 0 to 10, where 10 is your
BEST visit and 0 is your WORST possible visit,
how would you rate your virtual video visit?
Reference P = .771 P = .168
9-10 68.5% 66.3% 67.4% 80.0%
7-8 25.2% 27.5% 23.9% 20.0%
6 5.1% 5.3% 6.5% 0.0%
Would you recommend this clinician
toyour family and friends? Reference P = .034 P = .544
Yes, definitely agree 89.0% 93.8% 84.8% 96.7%
Yes, somewhat agree 7.5% 5.3% 8.7% 3.3%
No 1.6% 0.0% 2.2% 0.0%
Not answered 2.0% 0.9% 4.3% 0.0%
Would you recommend a virtual visit to
your family and friends? Reference P = .416 P = .076
Yes, definitely agree 82.3% 86.7% 82.6% 66.7%
Yes, somewhat agree 13.4% 11.5% 10.9% 33.3%
No 0.8% 0.0% 2.2% 0.0%
Not answered 3.5% 1.8% 4.3% 0.0%
Source: Data from the TeleHealth Patient Survey, February 2014-March 2015.
VOL. 25, NO. 1 43
THE AMERICAN JOURNAL OF MANAGED CARE®
Virtual vs In-Person Office Visits
quality and personal connection. Patients appear to value the
face-to-face interactive nature of VVVs; they perceive oce or
telephone encounters as the main alternatives to this new type
of visit, rather than email or structured questionnaires, likely
because they maintain a real-time personal connection. Even
though VVVs represent a great convenience, our data reinforce that
they are unlikely to be a useful substitute for an in-oce visit in
some clinical situations—for example, those with more complexity
and need for physical examination or observation. More research
is needed to study the association of the care delivery modality
(in-person vs telehealth) with total cost and clinical outcomes and to
understand settings in which telehealth aects healthcare value.
14,18
Theregulatory, administrative, and legal environment related to
the conduct of telehealth visits is in constant ux; delivery of care
to established patients across state lines adds further complexity.
The Chronic Care Act of 2017, enacted in 2018, takes some small
steps toward relaxing reimbursement and regulatory restrictions
in selected diseases and insurance markets; hopefully, this trend
will continue.
Limitations
Patient participants were selected for these visits by their clinicians
based on their suitability, as determined during prior oce visits
as established patients. This was not a controlled study. These data
were gathered in the rst full year of VVV implementation in our
system and are primarily from VVVs for a specialty, so they very likely
do not fully reect the challenges or opportunities of using VVVs
in primary care settings. Surveys are subject to sources of error and
bias; we attempted to minimize these with high-quality methods
and response rate enhancement methods. Lastly, Massachusetts
is not among the 31states that now routinely require third-party
reimbursement for telehealth visits; our health system chose to
support reimbursement to clinicians. It is unknown if the level of
reimbursement created positive or negative incentives. Further study
is needed, including improved models to compensate clinicians, to
measure and dene the appropriate mix of virtual and oce visits,
and to understand the role of other modes of care.
CONCLUSIONS
With the inexorable adoption of digital oerings to meet many of the
needs of today’s consumers, it is likely that telehealth will increasingly
be adopted over the next several years. Our data suggest that initial
experiences for patients and clinicians were positive and that, for
most encounters, these VVVs are just as clinically eective and less
expensive for both patient and provider compared with in-person
visits. The fears of distracted, overwhelmed providers and a loss of
human connection between patient and provider have been raised
repeatedly with the rising use of computers in the doctor’s oce.
Interestingly, this issue was not a central concern to participants in
our VVV program, perhaps due to the use of VVVs with established
patients. These visits are not just replacements for in-oce visits; they
hold the possibility of new avenues for care delivery, more frequent
but shorter encounters, and opportunity for earlier intervention.
Further studies are needed to test dierent provider compensation
models to measure and dene the appropriate mix of virtual, oce,
and other modes of care and to establish appropriateness criteria for
the use of telehealth encounters. These issues are all important in
the further use of this technology as part of eective and ecient
patient-centered care and population management.
19
Telehealth
FIGURE. Patient and Clinician Comparisons of Virtual and Office Visits
Full page
0% 20% 40% 60% 80%
100%
Length of visit required to assess and treat patient (provider)
Amount of time I spend with my clinician (patient)
Comfort I feel sharing personal or private information (patient)
Confidence health concern can be taken care of (patient)
The ability to see a physical problem (provider)
Ability to show clinician a physical problem (patient)
Personal connection I feel with the patient (provider)
Personal connection I feel with clinician during the visit (patient)
Overall quality of the visit (provider)
Overall quality of the visit (patient)
Virtual visit is better No difference Office visit is better Does not apply to me/not answered
37.7
12.2
7.2
5.4
6.6
3.6
1.6
5.5
4.9
12.6
49.2
74.4
81.9
79.8
67.2
24.4
50.8
59.1
59.0
62.6
8.2
9.8
8.1
10.8
23.0
31.0
45.9
32.7
34.4
21.7
3.9
3.3
2.8
3.3
3.2
6.5
3.6
2.7
4.8
40.0
44 JANUARY 2019 www.ajmc.com
TRENDS FROM THE FIELD
should further the aims of improving the quality of healthcare
and addressing the Institute of Medicine domains of quality, with
special attention to overcoming existing barriers in access to care,
including the burden of time and nancial costs that patients and
families bear in attending traditional oce visits. n
Author Aliations: Mongan Institute Health Policy Center (KD, EAB, CM),
MGH Center for TeleHealth (JJE, LHS), Department of Neurology (JJE, LHS), and
Department of Psychiatry (JW), Massachusetts General Hospital, Boston, MA; Flare
Capital Partners (SS), Boston, MA; Applied Physics Laboratory, Johns Hopkins
University (ABC), Laurel, MD; Department of Neurology, Johns Hopkins Hospital
and Health System (ABC), Baltimore, MD.
Source of Funding: Massachusetts General Hospital Institutional Funds.
Author Disclosures: Dr Cohen is employed with and provided expert testimony
for Johns Hopkins University Applied Physics Laboratory, which develops health
technology, including telemedicine-related technology. Dr Wozniak’s spouse
has received royalties from UpToDate; consultation fees from Advance Medical,
FlexPharma, Merck, Otsuka, and Gerson Lehman Group; and research support
from RLS Foundation. Dr Schwamm has received a Patient-Centered Outcomes
Research Institute grant on tele–palliative care and is the director of the MGH
Center for TeleHealth. The remaining authors report no relationship or nancial
interest with any entity that would pose a conict of interest with the subject
matter of this article.
Authorship Information: Concept and design (KD, SS, CM, JJE, ABC, JW, LHS);
acquisition of data (KD, EAB, SS, CM, JJE, ABC, JW, LHS); analysis and interpretation
of data (KD, EAB, SS, CM, JJE, ABC, JW, LHS); drafting of the manuscript (KD, EAB,
CM, LHS); critical revision of the manuscript for important intellectual content
(KD, SS, CM, JJE, ABC, JW, LHS); statistical analysis (KD, EAB, CM, JJE, ABC, JW, LHS);
provision of patients or study materials (KD, SS, CM, JJE, ABC, JW, LHS); obtaining
funding (KD, SS, CM, JJE, ABC, JW, LHS); administrative, technical, or logistic support
(KD, SS, CM, JJE, ABC, JW, LHS); and supervision (KD, SS, CM, JJE, ABC, JW, LHS).
Address Correspondence to: Karen Donelan, ScD, EdM, Mongan Institute Health
Policy Center, Massachusetts General Hospital, 100 Cambridge St, Ste 1600, Boston,
MA 02114. Email: kdonelan@mgh.harvard.edu.
REFERENCES
1. Güler NF, Übeyli ED. Theory and applications of telemedicine. J Med Syst. 2002;26(3):199-220.
2. Mehrotra A, Jena AB, Busch AB, Souza J, Uscher-Pines L, Landon BE. Utilization of telemedicine among rural
Medicare beneficiaries. JAMA. 2016;315(18):2015-2016. doi: 10.1001/jama.2016.2186.
3. Perrin A, Jiang J. About a quarter of U.S. adults say they are ‘almost constantly’ online. Pew Research Center
website. pewresearch.org/fact-tank/2018/03/14/about-a-quarter-of-americans-report-going-online-almost-
constantly. Published March 14, 2018. Accessed July 12, 2018.
4. Perrin A, Duggan M. Americans’ internet access: 2000-2015. Pew Research Center website. pewinternet.org/
2015/06/26/americans-internet-access-2000-2015. Published June 26, 2015. Accessed December 21, 2018.
5. Agha Z, Schapira RM, Laud PW, McNutt G, Roter DL. Patient satisfaction with physician-patient communica-
tion during telemedicine. Telemed J E Health. 2009;15(9):830-839. doi: 10.1089/tmj.2009.0030.
6. Perle JG, Langsam LC, Randel A, et al. Attitudes toward psychological telehealth: current and future clinical
psychologists’ opinions of internet-based interventions. J Clin Psychol. 2013;69(1):100-113. doi: 10.1002/jclp.21912.
7. Polinski JM, Barker T, Gagliano N, Sussman A, Brennan TA, Shrank WH. Patients’ satisfaction with and
preference for telehealth visits. J Gen Intern Med. 2015;31(3):269-275. doi: 10.1007/s11606-015-3489-x.
8. Viers BR, Pruthi S, Rivera ME, et al. Are patients willing to engage in telemedicine for their care: a survey
of preuse perceptions and acceptance of remote video visits in a urological patient population. Urology.
2015;85(6):1233-1240. doi: 10.1016/j.urology.2014.12.064.
9. LeRouge CM, Garfield MJ, Hevner AR. Patient perspectives of telemedicine quality. Patient Prefer Adherence.
2015;9:25-40. doi: 10.2147/PPA.S67506.
10. LeRouge C, Hevner A, Collins R, Garfield M, Law D. Telemedicine encounter quality: comparing patient and
provider perspectives of a socio-technical system. Presented at: 37th Annual Hawaii International Conference
on System Sciences; January 5-8, 2004; Big Island, HI. doi: 10.1109/HICSS.2004.1265375.
11. Weinstein RS, Lopez AM, Krupinski EA, et al. Integrating telemedicine and telehealth: putting it all together.
Stud Health Technol Inform. 2008;131:23-38.
12. Meyers D, Peikes D, Genevro J, et al. The roles of patient-centered medical homes and accountable care
organizations in coordinating patient care [AHRQ publication no. 11-M0005-EF]. Agency for Healthcare
Research and Quality website. pcmh.ahrq.gov/sites/default/files/attachments/Roles%20of%20PCMHs%20
And%20ACOs%20in%20Coordinating%20Patient%20Care.pdf. Published December 2010. Accessed
December 21, 2018.
13. Bao Y, Casalino LP, Pincus HA. Behavioral health and health care reform models: patient-centered
medical home, health home, and accountable care organization. J Behav Health Serv Res. 2013;40(1):121-132.
doi:10.1007/s11414-012-9306-y.
14. Adler-Milstein J, Kvedar J, Bates DW. Telehealth among US hospitals: several factors, including
state reimbursement and licensure policies, influence adoption. Health Aff (Millwood). 2014;33(2):207-215.
doi:10.1377/hlthaff.2013.1054.
15. An overview of version 3.0 of the CAHPS Clinician & Group Survey. Agency for Healthcare Research and
Quality website. ahrq.gov/sites/default/files/wysiwyg/cahps/surveys-guidance/cg/about/cg_3-0_overview.pdf.
Published June 17, 2015. Accessed December 21, 2018.
16. Kvedar J, Coye MJ, Everett W. Connected health: a review of technologies and strategies to improve patient
care with telemedicine and telehealth. Health Aff (Millwood). 2014;33(2):194-199.
17. Kim YS. Telemedicine in the USA with focus on clinical applications and issues. Yonsei Med J.
2004;45(5):761-775. doi: 10.3349/ymj.2004.45.5.761.
18. Health policy brief: telehealth parity laws. Health Affairs Blog website. healthaffairs.org/do/10.1377/
hblog20160815.056155/full. Published August 15, 2016. Accessed December 21, 2018.
19. Schwamm LH. Telehealth: seven strategies to successfully implement disruptive technology and transform
health care. Health Aff (Millwood). 2014;33(2):200-206. doi: 10.1377/hlthaff.2013.1021.
Visit ajmc.com/link/3588 to download PDF and eAppendix
eAppendix Table. Respondent Characteristics
Patients
(N = 254)
Gender
Female
135 (53.1%)
Male
119 (46.9%)
Age, years
0-17
68 (26.8%)
18-29
51 (20.1%)
30-59
79 (31.1%)
65
56 (22.0%)
Race
White, non-Hispanic
220 (86.6%)
Other
34 (13.4%)
Insurance type
Private insurance
195 (76.8%)
Medicaid
12 (4.7%)
Medicare
41 (16.1%)
Patient payments
6 (2.4%)
Service or department
Psychiatry
113 (44.5%)
Neurology
92 (36.2%)
Cardiology
30 (11.8%)
Other
19 (7.5%)
Device used for virtual video visit
Desktop computer
44 (17.3%)
Laptop computer
146 (57.5%)
Tablet
56 (22.1%)
Smartphone
2 (0.8%)
Other
3 (1.2%)
Travel time
How long does it take you to travel to MGH for office visits?
40 minutes
63 (24.8%)
41-59 minutes
54 (21.3%)
60-89 minutes
59 (23.2%)
90 minutes
66 (26.0%)
Not answered
12 (4.7%)
eAppendix Figure 1. TeleHealth Patients’ Perceptions of Virtual Video Visits vs Office Visits
Source: Data from MGH TeleHealth Patient Survey.
eAppendix Figure 2. TeleHealth Clinicians’ Perception of Virtual Video Visits vs Office Visits
Source: Data from MGH TeleHealth Clinician Survey.
4.9%
1.6%
6.6%
1.6%
14.8%
21.3%
29.5%
37.7%
52.5%
70.5%
59.0%
50.8%
67.2%
34.4%
62.3%
50.8%
50.8%
49.2%
31.1%
18.0%
34.4%
45.9%
23.0%
27.9%
16.4%
21.3%
13.1%
8.2%
14.8%
4.9%
1.7%
34.4%
0% 20% 40 % 60% 80% 100%
Overall quality of the visit
Personal connection I feel with the patient
The ability to see a physical problem
Ease of ordering tests for the patient
Ease of accessing patient records during the visit
Ease of scheduling followup visits
Workflow outside of the visit (before and after)
Length of visit required to assess and treat patient
Efficiency of the visit
Timely patient access to followup appointments
Virtual visit is bette r No difference Office visit is better Does not apply to me
eAppendix Figure 3. TeleHealth Patients’ Willingness to Pay for Virtual Video Visit
Source: Data from MGH TeleHealth Patient Survey.
18.1%
27.7%
65.4%
18.1%
31.6%
18.1%
56.0%
32.5%
8.7%
7.8%
8.1%
7.8%
020 40 60 80 100
Full cost of visit
Copay $26-50
Copay $10-25
Yes, Definitely Yes, Somewhat No Don't know/Not answered
... Furthermore, patient satisfaction was positive regarding usefulness, ease, and quality of care. Therapists have expressed satisfaction with hybrid models of telerehabilitation, as initial in person assessments support the development of rapport, trust, and therapist-client alliance [43,44]. However, barriers such as limited ability for physical examination, equipment set-up, and on-going telehealth support are important to consider for time and resources [43,44]. ...
... Therapists have expressed satisfaction with hybrid models of telerehabilitation, as initial in person assessments support the development of rapport, trust, and therapist-client alliance [43,44]. However, barriers such as limited ability for physical examination, equipment set-up, and on-going telehealth support are important to consider for time and resources [43,44]. Despite such barriers, therapists have recognized improvements in the functional use of upper limbs in daily activities and the quality and efficiency of telehealth hybrid care [43,44]. ...
... However, barriers such as limited ability for physical examination, equipment set-up, and on-going telehealth support are important to consider for time and resources [43,44]. Despite such barriers, therapists have recognized improvements in the functional use of upper limbs in daily activities and the quality and efficiency of telehealth hybrid care [43,44]. Implementation of hybrid models should be considered depending on the client population and severity of the impairment and/or disease. ...
Article
Full-text available
Purpose This systematic review and meta-analysis aimed to synthesize the evidence and examine the effect of telerehabilitation interventions compared to face-to-face rehabilitation interventions on physical functioning, mental health, and pain reduction among employed individuals, 18 years old and older. Methods Following the Preferred Reporting Items of Systematic Reviews and Meta-Analyses (PRISMA) guidelines, a comprehensive search syntax was created and inputted into Ovid Medline, APA PsycINFO, Ovid Embase, CINAHL, and Scopus. Critical appraisal of the included studies was conducted by two researchers to assess the risk of bias. A meta-analysis was completed for the randomized controlled trials and GRADE was used to determine the certainty of the evidence. Results A total of 16 out of 4319 articles were included in this review. This systematic review and meta-analysis found no significant differences between telerehabilitation interventions for physical functioning, mental health, and pain reduction outcomes compared to traditional rehabilitation interventions. Conclusion The study findings indicate that telerehabilitation is less effective than in-person care for occupational therapy and physical therapy services. Future research may look at addressing the limitations of the current study to produce more conclusive results, such as exploring the length of the intervention, knowledge and confidence of intervention application, and follow-ups. Systematic Review Registration This systematic review has been registered with PROSPERO under registration number CRD42022297849 on April 8th, 2022.
... Telehealth has shown significant advantages in saving time and effort for both patients and providers (Ding et al. 2019;Wang, Kale, and O'Neill 2020;Lu, Chen, and A. Epstein 2021;Xu et al. 2022b;Chung et al. 2019;Xu et al. 2022a), especially during the COVID-19 pandemic (Blandford et al. 2020). However, existing telehealth applications often lack adaptability and usability for older adults, who typically have lower health and technical literacy (Dorsey and Topol 2016;Shaver 2022;Donelan et al. 2019;Kruse et al. 2020;Park, Lee, and Chen 2012). Studies have highlighted the inefficiencies of current communication methods, which often lead to information loss and delays in response (Rubin et al. 2011;Chesser et al. 2016). ...
Article
Full-text available
Despite the plethora of telehealth applications to assist home-based older adults and healthcare providers, basic messaging and phone calls are still the most common communication methods, which suffer from limited availability, information loss, and process inefficiencies. One promising solution to facilitate patient-provider communication is to leverage large language models (LLMs) with their powerful natural conversation and summarization capability. However, there is a limited understanding of LLMs' role during the communication. We first conducted two interview studies with both older adults (N=10) and healthcare providers (N=9) to understand their needs and opportunities for LLMs in patient-provider asynchronous communication. Based on the insights, we built an LLM-powered communication system, Talk2Care, and designed interactive components for both groups: (1) For older adults, we leveraged the convenience and accessibility of voice assistants (VAs) and built an LLM-powered conversational interface for effective information collection. (2) For health providers, we built an LLM-based dashboard to summarize and present important health information based on older adults' conversations with the VA. We further conducted two user studies with older adults and providers to evaluate the usability of the system. The results showed that Talk2Care could facilitate the communication process, enrich the health information collected from older adults, and considerably save providers' efforts and time. We envision our work as an initial exploration of LLMs' capability in the intersection of healthcare and interpersonal communication.
... Our findings were consistent with the evidence base that clinicians find no difference in overall quality, better treatment effectiveness, 14 and express satisfaction with its use, 15 and are in sync with the pattern of surge in telemedicine consultations during the COVID pandemic, 16 especially for depression care. 17 Most of the participating clinicians expressed high levels of satisfaction in delivering pro-bono services through an online platform during the pandemic. ...
Article
Full-text available
Objectives Strict social distancing and lockdown measures imposed to curb transmission during the early phase of the outbreak of the COVID-19 pandemic posed challenges to people’s psychological wellbeing, limited access to social support, and disrupted routine mental health service delivery. In response, a consortium of mental health stakeholders from Goa, India launched the COVIDAV program, which provided pro-bono virtual psychiatric and counselling consultations across India through an online platform. This study describes the acceptability and feasibility of the program from the perspective of various stakeholders. Methods Data were collected via a survey with clinicians who had volunteered on COVIDAV ( n = 40), in depth interviews of the clinicians ( n = 14), and focus group discussion with key collaborators ( n = 1). Process data were mapped at various stages during the online platform’s development and use. The qualitative and quantitative data was analysed using thematic analysis and a descriptive analysis respectively. Results Over 17 months, 63 clinicians conducted 2245 online sessions through the COVID platform, primarily accessed by youth across the country. The clinicians acknowledged the online platform’s ability to enhance access and reduce stigma. Challenges included session time constraints, connectivity issues, and user interface inconsistencies that interfered with clients’ accessibility to the services. High satisfaction rates amongst the service providers were reported, with 79.3% content with the service provision and 82.8% with pro bono contributions through the platform. Conclusions This study illustrates the feasibility, flexibility, and applicability of a rapidly designed pro-bono online platform for delivering mental health care services through the collaboration of stakeholder groups in the mental health care, private, social, and governmental sector. Our findings highlight the potential of rapidly deployed digital platforms, developed via cross-sector partnerships, to meet mental health care needs during unprecedented global emergencies such as the COVID-19 pandemic.
... 7 If health care professionals can better understand the perceived value of telemedicine in a postoperative orthopedic and sports medicine setting, we will be able to better shape the future use of technology and policies in this setting and other healthcare departments. 8,9 Telemedicine can greatly improve access to quality, affordable care for patients while maintaining physical distancing for the safety of both patients and providers. 4 In addition, collaboration between physicians and athletic trainers can help facilitate continuity of care and improved patient outcomes. ...
Article
Objective: Compare patient satisfaction between telemedicine and in-office visits and between providers post-operatively in an orthopedics setting with athletic trainers and physicians. Design: Cross-sectional study Methods: Patients from a Sports Medicine Clinic that received an orthopedic surgical intervention from March 2020-September 2021, and engaged in telemedicine, or an in-office visit post-operatively. Provider type included full-time athletic trainers, resident athletic trainers, physician (MD) resident/fellows, and float athletic trainers. Press-Ganey Patient Experience Surveys were collected at the time of follow up visit, with focus on items, “likelihood to recommend” and “how well staff worked together.” Results: There was a total of 255 patients (age=50±17 years). Providers included the attending physician with full-time athletic trainers (n=134, 52.3%), resident athletic trainers (n=77, 30.1%), MD residents/fellows (n=38, 14.8%), or float athletic trainers (n=6, 2.3%). No significant difference was found with patient satisfaction between in-office (n=175, 68.4%), or telemedicine visits (n=80, 31.3%), (p>.44). Patients were more satisfied with care provided by the full-time athletic trainers compared to MD residents/fellows (p.18). Conclusions: This study demonstrates no significant differences with patient satisfaction between in-office or telemedicine visits. Patients seeing full-time athletic trainers had the highest patient satisfaction, demonstrating the capability of athletic trainers to effectively use telemedicine in a physician practice.
... Therefore, there is a rising need for new pathways to deliver care where TM is predicted to be one of the essential tools to optimize and support treatments in patients' and families' homes (Brewster et al. 2014). Studies have shown that patients are often satisfied with TM because of convenience and no travel time (Donelan et al. 2019;Ramaswamy et al. 2020). However, there are differences in how nurses accept TM into clinical practice (Brewster et al. 2014). ...
Article
Full-text available
To explore how nurses experience facilitators and barriers to the use of video‐consultations for home‐monitoring of patients with cardiac disease. A systematic literature search in PubMed, CINAHL, Scopus, and Web of Science was undertaken, inclusion criteria were qualitative data published between 2013 and 2023 written in English, Norwegian, Swedish, or Danish. Ten studies were included in the qualitative synthesis conducted as described by Braun and Clarke. From the synthesis, a main theme emerged: Nurses' uncertainty toward telemedicine is a risk toward the use of video‐consultations and home‐monitoring. The essence of the findings range from nurses' positive experiences to their frustration concerning the implementation process and the lack of technical support for clinicians and patients. Nurses often felt frustration and uncertainty about the quality of delivered care through virtual consultations. Working with technology in caring for patients with cardiac disease, including video‐consultations and home‐monitoring, nurses experienced a sense of insecurity. Insecurity was identified as a lack of technological knowledge, nurses' feelings of apathy, poorer observation through a video‐consultation, and the lack of organizational support.
Article
A BSTRACT Background and Objectives The utilization of telemedicine has increased dramatically since the onset of the COVID-19 pandemic. In this review, we examined studies published within the past five years that investigated the impact of telemedicine on patient satisfaction. Methods Four investigators utilized PubMed and Google Scholar to find studies published within the past five years that assessed patient satisfaction with telemedicine in the field of adult primary care, using either the Press Ganey or CAHPS surveys. Studies that compared cost and quality of care between telemedicine and in-patient healthcare were also included to address the secondary aims of this study. Results A total of 11 studies out of the 405 that were investigated were selected for this review. Five studies found no significant difference in patient satisfaction between telemedicine and in-person medicine, with one of those showing a patient preference for telemedicine. One study demonstrated significantly higher satisfaction with in-person medicine vs. telemedicine. Another study found that most physicians and patients reported no perceived difference in quality of care between telemedicine and in-person visitation. One study found no difference in patient satisfaction with telemedicine between immigrants and non-immigrants. Another study showed that patients have higher satisfaction when using telemedicine with their PCP vs. an unfamiliar provider. Two studies found telemedicine to be cost-effective. Conclusions Our review concludes that patient satisfaction with telemedicine is not inferior to that with in-person visits. However, further research should be conducted to determine various factors that may affect patient perception and satisfaction.
Article
Synchronous virtual visits aid in longitudinal primary care and fulfill unmet needs for patients and clinicians. Virtual visits are widely accepted for specialty consultation and follow-up; however, novel systems-based programs and processes may support earlier engagement. Evaluate primary care clinician attitudes and perspectives on patient information obtained team-based, nurse-led virtual visits ahead of face to face visits. Study occurred in a large, regional, multispecialty group practice in Eastern Pennsylvania. Participants included primary care physicians, nurse practitioners, and physician assistants. Virtual visits are a component of a large, unified network strategy called the Patient Partnership Model which incorporates technology and remote care to achieve improved access and patient satisfaction. Survey of participating primary care clinicians assessing impact of at-hand medical history, social history, and medications on delivering face to face primary care. Weighted mean of satisfied participants was 3.61 on a 5-point Likert scale. Participants reported satisfaction and acceptability of team-based virtual visits, noting high satisfaction with information exchange and actionability of notes. Participants reported ongoing opportunities to enhance medication reconciliation. Virtual visits continue to evolve and may serve varying roles in primary care.
Chapter
Disparities across social, economic, educational, and environmental realms of health significantly impact illness outcomes, and is highly relevant to infections of the nervous system. Neglected tropical diseases, neurological effects of HIV and syphilis, and emerging pathogens impact vulnerable populations differentially. These disparities are the result of current, evolving, and historical systemic inequities that contribute to the preventable differences in healthcare access and care often experienced by vulnerable communities. In this chapter we highlight clinical cases in which each patient’s care of neurological infections was significantly affected by healthcare inequities. The profound influence of social determinants of health outlined in each of these cases emphasizes the continued to need to identify and address systematic and structural barriers that hinder the possibility of optimal health for all members of our global society.
Article
Full-text available
Background The purpose of this study was to explore the quality attributes required for effective telemedicine encounters from the perspective of the patient. Methods We used a multi-method (direct observation, focus groups, survey) field study to collect data from patients who had experienced telemedicine encounters. Multi-perspectives (researcher and provider) were used to interpret a rich set of data from both a research and practice perspective. Results The result of this field study is a taxonomy of quality attributes for telemedicine service encounters that prioritizes the attributes from the patient perspective. We identify opportunities to control the level of quality for each attribute (ie, who is responsible for control of each attribute and when control can be exerted in relation to the encounter process). This analysis reveals that many quality attributes are in the hands of various stakeholders, and all attributes can be addressed proactively to some degree before the encounter begins. Conclusion Identification of the quality attributes important to a telemedicine encounter from a patient perspective enables one to better design telemedicine encounters. This preliminary work not only identifies such attributes, but also ascertains who is best able to address quality issues prior to an encounter. For practitioners, explicit representation of the quality attributes of technology-based systems and processes and insight on controlling key attributes are essential to implementation, utilization, management, and common understanding.
Article
Full-text available
Discussions of health care delivery and payment reforms have largely been silent about how behavioral health could be incorporated into reform initiatives. This paper draws attention to four patient populations defined by the severity of their behavioral health conditions and insurance status. It discusses the potentials and limitations of three prominent models promoted by the Affordable Care Act to serve populations with behavioral health conditions: the Patient-Centered Medical Home, the Health Home initiative within Medicaid, and the Accountable Care Organization. To incorporate behavioral health into health reform, policymakers and practitioners may consider embedding in the reform efforts explicit tools-accountability measures and payment designs-to improve access to and quality of care for patients with behavioral health needs.
Conference Paper
Full-text available
The effectiveness of the telemedicine encounter is dependent on the use of state-of-the-art technology and the quality of the technology-based interactions. We take a socio-technical approach to understanding quality during telemedicine encounters. This approach has not been well studied in telemedicine service encounter research. To enrich understanding, we use a multimethod (direct observation, interview, focus group, survey) field study to collect and interpret a rich set of data. We conduct this study from two perspectives. First, we focus on the perceptions of the medical providers (e.g. physicians) who directly use the technology and are accountable for patient care. We then compare provider perspectives to those of patients, who act as indirect users of telemedicine technology and are the ultimate consumers of health care services provided via telemedicine. The result of this field study is a comparative framework of quality attributes for telemedicine service encounters that prioritizes the attributes from the provider and patient perspectives.
Article
This study describes trends in telemedicine utilization in Medicare from 2004-2013.Telemedicine may increase access and improve quality, particularly in rural areas.1 Because inadequate reimbursement may limit telemedicine use, 29 states have passed telemedicine parity laws mandating that commercial insurers reimburse telemedicine visits.2 In contrast, Medicare limits telemedicine reimbursement to select live video encounters with the patient at a clinic or facility in a rural area.3 Federal legislation has been proposed to expand Medicare telemedicine coverage. To inform the debate regarding telemedicine expansion, we describe trends in telemedicine utilization in Medicare from 2004-2013.
Article
One-quarter of U.S. patients do not have a primary care provider or do not have complete access to one. Work and personal responsibilities also compete with finding convenient, accessible care. Telehealth services facilitate patients' access to care, but whether patients are satisfied with telehealth is unclear. We assessed patients' satisfaction with and preference for telehealth visits in a telehealth program at CVS MinuteClinics. Cross-sectional patient satisfaction survey. Patients were aged ≥18 years, presented at a MinuteClinic offering telehealth in January-September 2014, had symptoms suitable for telehealth consultation, and agreed to a telehealth visit when the on-site practitioner was busy. Patients reported their age, gender, and whether they had health insurance and/or a primary care provider. Patients rated their satisfaction with seeing diagnostic images, hearing and seeing the remote practitioner, the assisting on-site nurse's capability, quality of care, convenience, and overall understanding. Patients ranked telehealth visits compared to traditional ones: better (defined as preferring telehealth), just as good (defined as liking telehealth), or worse. Predictors of preferring or liking telehealth were assessed via multivariate logistic regression. In total, 1734 (54 %) of 3303 patients completed the survey: 70 % were women, and 41 % had no usual place of care. Between 94 and 99 % reported being "very satisfied" with all telehealth attributes. One-third preferred a telehealth visit to a traditional in-person visit. An additional 57 % liked telehealth. Lack of medical insurance increased the odds of preferring telehealth (OR = 0.83, 95 % CI, 0.72-0.97). Predictors of liking telehealth were female gender (OR = 1.68, 1.04-2.72) and being very satisfied with their overall understanding of telehealth (OR = 2.76, 1.84-4.15), quality of care received (OR = 2.34, 1.42-3.87), and telehealth's convenience (OR = 2.87, 1.09-7.94) CONCLUSIONS: Patients reported high satisfaction with their telehealth experience. Convenience and perceived quality of care were important to patients, suggesting that telehealth may facilitate access to care.
Article
To examine patient preuse acceptance and perceptions of video visit (VV) technology within an ambulatory urology setting. Patients treated by a single urology department from January to June 2013 were identified. A Web-based survey was conducted evaluating patient demographics, preuse perceptions, and acceptance of VV. In total, 1378 patients (25%) completed the survey; of which 868 (63%) were willing to participate in VV for their urologic care. Compared with patients "unlikely," those "likely" to participate in VV were younger (62 vs 65 years), had a college education (77% vs 65%), had previous exposure to videoconference technology (57% vs 38%), were more comfortable discussing new symptoms (56% vs 30%) and sensitive information (48% vs 27%), and played an active role in their healthcare (65% vs 54%). Moreover, patients willing to participate in VV traveled larger distances (>90 minutes; 69% vs 58%), missed more work (>1 day; 39% vs 29%), and incurred greater expenses for their care (>$250; 52% vs 25%) relative to those who were unlikely. After controlling for associated patient characteristics, a high level of agreement among urology-specific questions remained independently associated with greater likelihood of VV acceptance among both male and female patients. A large proportion of patients are willing to participate in VV for their urologic care. This may have significant implications by reducing costs and increasing access to, and quality of, health care services. These findings may assist urologists in strategically directing future efforts to reach diverse patient populations via VV technology. Copyright © 2015 Elsevier Inc. All rights reserved.
Article
Telehealth is widely believed to hold great potential to improve access to, and increase the value of, health care. Gaining a better understanding of why some hospitals adopt telehealth technologies while others do not is critically important. We examined factors associated with telehealth adoption among US hospitals. Data from the Information Technology Supplement to the American Hospital Association's 2012 annual survey of acute care hospitals show that 42 percent of US hospitals have telehealth capabilities. Hospitals more likely to have telehealth capabilities are teaching hospitals, those equipped with additional advanced medical technology, those that are members of a larger system, and those that are nonprofit institutions. Rates of hospital telehealth adoption by state vary substantially and are associated with differences in state policy. Policies that promote private payer reimbursement for telehealth are associated with greater likelihood of telehealth adoption, while policies that require out-of-state providers to have a special license to provide telehealth services reduce the likelihood of adoption. Our findings suggest steps that policy makers can take to achieve greater adoption of telehealth by hospitals.
Article
"Telehealth" refers to the use of electronic services to support a broad range of remote services, such as patient care, education, and monitoring. Telehealth must be integrated into traditional ambulatory and hospital-based practices if it is to achieve its full potential, including addressing the six domains of care quality defined by the Institute of Medicine: safe, effective, patient-centered, timely, efficient, and equitable. Telehealth is a disruptive technology that appears to threaten traditional health care delivery but has the potential to reform and transform the industry by reducing costs and increasing quality and patient satisfaction. This article outlines seven strategies critical to successful telehealth implementation: understanding patients' and providers' expectations, untethering telehealth from traditional revenue expectations, deconstructing the traditional health care encounter, being open to discovery, being mindful of the importance of space, redesigning care to improve value in health care, and being bold and visionary.
Article
With the advent of national health reform, millions more Americans are gaining access to a health care system that is struggling to provide high-quality care at reduced costs. The increasing adoption of electronic technologies is widely recognized as a key strategy for making health care more cost-effective. This article examines the concept of connected health as an overarching structure for telemedicine and telehealth, and it provides examples of its value to professionals as well as patients. Policy makers, academe, patient advocacy groups, and private-sector organizations need to create partnerships to rapidly test, evaluate, deploy, and pay for new care models that use telemedicine.
Article
Objectives: The current study explored differences in acceptance of telehealth interventions amongst currently licensed and future clinicians with a focus on web camera-based intervention. The influence of theoretical orientation was also assessed. Method: An online survey assessed 717 participants comprising 409 licensed psychologists (40.8% female, mean age = 56.57, standard deviation [SD] = 11.01) and 308 doctoral-level students (78.9% female, mean age = 27.66, SD = 5.9) across domains of endorsement and rejection. Results: Binary logistic regression indicated no significant difference between currently licensed and future psychologists in their endorsement of telehealth modalities. Cognitive-behavioral, cognitive, behavioral, and systems psychologists were significantly more accepting of telehealth interventions than were dynamic/analytic or existential therapists. Conclusions: Increasing exposure to telehealth through education as well as continued research on efficacy for specific diagnoses may help psychologists to more effectively determine whether telehealth is the "best fit" for both clinician and client.