ArticlePDF Available

Abstract and Figures

The mobile health (mhealth) app market continues to grow rapidly. However, with the exception of fitness apps and a few isolated cases, most mhealth apps have not gained traction. The barriers preventing patients and care providers from using these apps include: for patients, information that contradicts health care provider advice, manual data entry procedures and poor fit with their treatment plan; for providers, distrust in unknown apps, lack of congruence with workflow, inability to integrate app data into their medical record system and challenges to analyze and visualize information effectively. In this article, the authors build upon previous work to define design requirements for quality mhealth apps and a framework for patient engagement to propose a new reference architecture for the next generation of healthcare mobile apps that increase the likelihood of being useful for and used by patients and health care providers alike.
Content may be subject to copyright.
DOI: 10.4018/IJHCR.2016040103
Copyright © 2016, IGI Global. Copying or distributing in print or electronic forms without written permission of IGI Global is prohibited.

Volume 7 • Issue 2 • April-June 2016


Pannel Chindalo, InfoClin, Toronto, Canada
Arsalan Karim, InfoClin, Toronto, Canada
Ronak Brahmbhatt, InfoClin, Toronto, Canada
Nishita Saha, InfoClin, Toronto, Canada
Karim Keshavjee, InfoClin, Toronto, Canada

The mobile health (mhealth) app market continues to grow rapidly. However, with the exception
of fitness apps and a few isolated cases, most mhealth apps have not gained traction. The barriers
preventing patients and care providers from using these apps include: for patients, information that
contradicts health care provider advice, manual data entry procedures and poor fit with their treatment
plan; for providers, distrust in unknown apps, lack of congruence with workflow, inability to integrate
app data into their medical record system and challenges to analyze and visualize information
effectively. In this article, the authors build upon previous work to define design requirements for
quality mhealth apps and a framework for patient engagement to propose a new reference architecture
for the next generation of healthcare mobile apps that increase the likelihood of being useful for and
used by patients and health care providers alike.

App Design, Architecture, Behavior Change, Health App, mHealth App, Patient Engagement, Patient Reported
Experience Measures (PREM), Patient Reported Outcome Measures (PROM), Self-Management

The popularity and usage of mobile technology continues to boom (Research2guidance, 2015).
Increasingly, people are inclined to seek guidance from smartphones than from other persons (Elias,
2015). Smartphones’ ascendance to this level is highly associated to its practicality in communicating,
information resourcefulness, portability and flexible costs for most people, regardless of their economic
status (Silow-Carroll & Smith, 2013). Mobile health (mhealth) care applications are seeing a similar
boom. Of the millions of apps in circulation, about 45,000 are mhealth apps (Research2guidance,
2015). More than half of these mhealth apps are new on the market. Thirteen percent of these
apps were introduced in the first quarter of 2015. However, most mhealth apps are not used in
healthcare despite their growing popularity (in terms of downloads) and potential medical purposes
(Research2guidance, 2015).
Researchers from various backgrounds have proposed ways that consumers can select useful
mhealth apps for their health and health information needs (Albrecht, 2013; Boudreaux, 2014; Powell,
2014; Kumar, 2013). Several studies have identified hurdles that challenge wide usage, including
poor user interface designs, differing user literacy levels, implementation issues and organizational
structures (Bailey, 2014, Boudreaux 2014; Brown 2013; Caburnay, 2015; McMillan, 2015; McCurdie,
34

Volume 7 • Issue 2 • April-June 2016
35
2012). These efforts have so far not been successful at wooing patients and care providers to greater
use of mhealth apps. Health app developers are caught in a dilemma of not knowing how to overcome
these hurdles.
In this paper, we build upon Albrecht et al.’s “synopsis for apps” in health care (Albrecht, 2014)
to propose a novel reference architecture for mhealth apps that can overcome current barriers. Albrecht
et al provide a comprehensive framework for mhealth app publishers to describe their compliance
with a variety of pragmatic and evidence-informed criteria that are worth considering when evaluating
apps. We found their framework useful as a scaffold for considering important elements of an app
during the design process.
We also build upon the patient engagement framework developed by Balouchi et al. that describes
an enabling environment for engagement and communication between patients and providers
(Balouchi, 2014). We propose a refined approach for engaged communication between patients and
care providers. This approach focuses on the patient and care provider relationship as the starting
place to add value that is likely to grow exponentially in ways we can only now imagine. Our approach
considers the constraints identified by the studies cited above in order to identify the critical functions
that can elevate how apps can deliver added value. Further, we propose an architecture for mhealth
apps that arranges the critical functions identified in order to accomplish the following: (a) capture,
validate and communicate data about the processes and outcomes of a disease; and (b) enable on-
going communication during treatment to enhance the patient-care provider relationship and ensure
patients get the support they need to implement the advice and interventions prescribed by their
health care provider.

We conducted a literature search in PubMed and Google Scholar to identify articles that described
methods to evaluate mobile apps. We utilized the related articles feature to find additional articles.
We also identified articles on mhealth architecture and patient engagement with apps. We conducted
a narrative synthesis of the studies we identified and applied a critical analysis by way of identifying
common hurdles that restrict wide usage of mhealth apps. Our process of deliberation comprised
distributing the studies we identified as critical to the research topic. We had three workings sessions:
one concept development meeting which led to designating responsibilities for drafting the study’s
sections; a rethinking and refinement session and a final interdisciplinary discussion to finalize the
story arc of the study. We also utilized Google Drive file sharing to coordinate our communication.
We used a gap analysis that drew on philosophy, data science, education, life science and business
analyses methods to develop a concept that would overcome the constraints and meet the goals
identified in the introduction. Through analysis, discussion and iteration, we arrived at a proposed
architecture that is evidence-informed, uses validated tools effectively and is situated in a philosophy
that puts a high value on the patient-physician relationship.

Other than fitness tracker apps and some tethered apps provided by insurance companies and
by integrated delivery systems, most mhealth apps in app stores have not gained much traction
(Research2guidance, 2015). We hypothesize that this is due to multiple factors: a) apps may provide
information that conflicts with information received from health care providers (Bierbrier, Lo & Wu,
2014); b) the language and terminology of the app may not be compatible with the patient’s health

Volume 7 • Issue 2 • April-June 2016
36
literacy (Caburnay, 2015); c) the patient has to enter the data himself or herself (Gruman, 2013); d)
the patient has no way to use the information in a meaningful way; e.g., they cannot order diagnostic
testing for or prescribe medications to themselves; e) daily use of the app is not required for most
diseases and therefore the patient does not get into the habit of using it; f) lack of incentives to use,
such as cost savings or social approval; g) providers may not value or use the data collected by patients
in apps downloaded from an app store whose provenance and pedigree is not known or established
(Terry, 2015); h) there is no way for providers to consume (i.e., visualize, analyze, derive meaning
from) the large amounts of data that are collected in apps (Terry, 2015) and i) there is no way for
providers to integrate the app data into their own electronic medical record system (EMR) for analysis
or follow-up or share the data in their EMR with their patient’s apps (Abebe, 2013).
In our search, we identified authors who are pioneering a paradigm that is supportive of a
scientific validation process and a technology convenient platform. The Open mHealth group (Chen,
2012) has developed some sophisticated tools to assist app publishers in designing and developing
useful mhealth apps. Their open source tools allow developers to obtain standardized data from other
systems and display them in high quality visualizations. However, the “architecture” they present is
focused entirely on an information technology view. There is no proposed business architecture or
information architecture. Thus, developers are left to their own devices on how they will connect the
various pieces of technology to create a viable technology. Silow-Carroll and Smith (Silow-Carroll,
2013) describe apps that have had some success in healthcare. They point to several features which
have gained some success, including having apps prescribed by health care providers who monitor
their use and patient outcomes. These exemplars are mostly found in leading health care systems like
Geisinger and Kaiser Permanente. However, they do not propose a comprehensive architecture that
can be used by mhealth developers as a reference architecture.
Our approach, illustrated in Figure 1, is an adaptation of Balouchi et al.’s “enabling environment”
for patient engagement. Successful use of mhealth apps is predicated on having an enabling
environment, including the functions shown in the margins of the diagram (Balouchi, 2014). To this
enabling environment, we propose that mhealth apps must, in addition, provide useful functions to have
value for health care providers and patients. At a high level, this means that the app must be able to
capture clinical information about the patient that providers can use for their clinical decision-making
and treatment recommendations. And, the app must also be able to communicate advice, education,
information and treatment recommendations from providers to the patient. This simple architecture, if
applied correctly, can be a powerful driver of change through on-going feedback, accountability and
congruence between patient and provider; something that is sorely missing in current mhealth apps.
As previously mentioned, some of the leading health systems in the US, such as Geisinger and
Kaiser Permanente, have already started along this path. Other care models such as the Accountable
Care Organizations (ACOs), the Patient Centred Medical Homes (PCMH) and the Ontario Family
Health Teams (FHTs) are all care models that have elements of the enabling environment in place
for chronic disease management. Health care providers working within these organizations already
have the infrastructure and the reimbursement model (salaried or capitation funding) to facilitate use
of mhealth apps within their practice offerings.

Patients and healthcare providers have for centuries operated in a relationship that demonstrates
trust, skills, dependence and knowledge. Yet, most mhealth apps try to avoid getting entangled in
this relationship. It would be helpful to introduce mhealth apps into the patient and health provider
relationship (Edelman & Singer, 2015).
Most commercial mhealth apps do not take into consideration the critical role of the patient-
healthcare provider relationship. A patient and health provider relationship is important for patients
to understand the difference between a gadget for entertainment and a tool for improving health. In
order to understand how seemingly this small difference can have an outsize impact, we have to see
it from patients’ and healthcare providers’ viewpoints. On the one hand, a patient’s perspective is

Volume 7 • Issue 2 • April-June 2016
37
informed by a culture of excitement for hi-tech gadgets that has become part of daily life experiences.
Consumers have developed an insatiable appetite for hi-tech gadgets that compete for their attention.
This high expectation not only drives business, but it also reduces the shelf-life of hi-tech gadgets.
This cultural expectation could explain the lack of retention of mhealth apps. On the other hand, a
healthcare provider’s perspective on hi-tech is very different when it comes to professional practice.
A health provider makes a clear distinction between a gadget for entertainment and how to evaluate
its use in a professional environment. There are a lot of apps that give health information for personal
use, but this type of information may not be credible for a licensed healthcare provider to use when
advising a patient in a healthcare binding relationship. A licensed healthcare provider is trained to
advise patients by using information that is acceptable by a professional code of standards as they
evaluate a patient’s condition and a patient’s overall health story. An evidence-based assessment that
a health provider performs before advising a patient requires an understanding of approved evidence-
based knowledge about the problem, transforming this knowledge in view of the patient’s condition
based on clinical experience and arriving at a final treatment decision based on discussion with the
patient about their values and preferences. For our discussion purpose, it means that both the patient
and the healthcare provider do not consider standalone mhealth apps as credible resources in their
healthcare relationship. In practice, it simply means that an app fails a reality-test to patients and
health providers for reasons of entertainment and unreliable measurements respectively. In order to
gain acceptance, mhealth apps need to be designed to enter, meet, and enhance the patient and the
health provider relationship. A patient and a health provider relationship is based on trust and skills,
as such apps should be designed in a way that they could become valuable resources that fill-in the
gaps in knowledge and support in a patient-provider relationship.
The task of advising patients to perceive apps as a form of “prescription” in order to enhance
treatment and communicate a sense of accountability depends on the health providers’ willingness
to use apps. Patients are likely to associate an mhealth app as a treatment plan when health providers
introduce to it to them in that way. Educating healthcare providers about how an app meets the scientific
standards of measurements and demonstrating how user-friendly designs account for their diverse
clientele’s educational levels and age groups is crucial to their acceptance. User-friendly designs,
Figure 1. Patient-Health provider centered approach (Adapted from Balouchi)

Volume 7 • Issue 2 • April-June 2016
38
ability to capture important information between visits, ability to monitor follow-throughs on patients,
reduced time pressure during encounters and higher productivity are likely to self-advertise apps into
the patient and healthcare provider relationship. Licensed health providers have considerable moral
and psychological influence within the patient-provider relationship to rebrand and introduce mhealth
apps as critical communication devices during monitoring or treatment phases.

Many apps are proving that useful algorithms can be generated without a scientific validating process.
So why do we need a scientific validating process for mhealth apps? We use an illustration from
the sporting industry. It is intriguing to observe how excited people become after a major sporting
event like tennis or soccer. In excitement, people go to soccer fields and tennis courts to emulate the
skills they watched on television. Soon, most fans realize that it requires above average skills and
body conditioning to perform like conditioned athletes. Technology has a way of exciting people
who don’t understand it to think big but are soon disappointed by their lack of skills. Just because
an app can take a blood pressure measurement and produce information about our bodies does not
make patients experts in healthcare. Scales and measurements used for assessing and treating patients
should be left to the experts.
Human ailments are diverse and specializations in health have developed validated ways of
measuring and assessing diseases. mHealth apps could customize these scales and make them available
for patients and healthcare providers. Success in patient treatment has depended on healthcare providers
and patients as “managers” of treatment plans. It makes sense that this relationship be supplied with
first class resources. The expediency of technology could enable treatment resources with an added
value of communicating, monitoring and encouraging the patient in real-time from any location.
It is important to realize that the worth of specialized scales comes to make sense only when a
patient’s information is aligned with it to enable interpretation. The need to make precise interpretation
about a patient’s condition by using verifiable measurements that have been scientifically validated
is critical for making a diagnosis and individualizing a treatment plan to the unique needs of each
patient. The ease of appearance that technology gives healthcare makes it appear flatteringly simple,
but the disciplined body of knowledge it takes to diagnose and set a treatment plan is complex.
Figure 2 describes in further detail the types of information required for appropriate management
of a patient in the context of the patient-provider relationship. More description is provided in the
section entitled, Process and Outcomes.

Inherent within the patient-provider relationship, there is a power and information asymmetry.
Physicians have access to and control access to information generated by the health system, such as
laboratory results, specialist reports, imaging reports and other health care data. Introducing mhealth
apps in this relationship could empower patients and health providers in ways that could improve
health care systems. The current structure positions the patient in a subservient role. The reasons
are obvious, the patient describes the problem, and the expert interprets what it means according to
the patient’s medical history. In practice a healthcare provider may request tests in order to identify
the cause of the problem. As expected the healthcare provider informs and advises a patient about
a diagnosis. In most cases patients have little or superficial knowledge about their diagnosis. When
patients are given an opportunity to ask questions, they are still at a disadvantage of lacking knowledge
to ask informative questions.
Many healthcare providers are well trained in delivering diagnosis news and proceeding further
into treatment plans. In summary patients’ dependence on healthcare providers is necessitated by a
structure that limits patients and healthcare providers to spaces in buildings. There are many ways
that apps would elevate the nature of this relationship. The potential of apps to collect information
from patients during treatment is critical for empowering patients to speak about their experiences

Volume 7 • Issue 2 • April-June 2016
39
in real-time. This process can lead to collecting data based on patients’ experiences and treatment
outcomes in order to improve quality, patient awareness and professionalism.

A trusted structure or framework speaks to the idea that content of apps need to be evidence-based
(Albrecht, 2014). It is well-known that information technology exerts its effect through automating
work flows and work processes; it is not a magic wand. An app is unlikely to provide valuable
information without a defined process on how information should flow.
A validated evidence-based process requires a purposive procedure for ensuring the accuracy of
patient information that is collected. For example, Coleman (2009) provides a chronic disease model
that exemplifies a process of collecting information on a chronic disease.
Figure 2 describes a simple, but powerful information and business workflow that is centered
on the patient-provider relationship. A mhealth app that meets evidence-based content and process
requirements would embody the following properties:
1. It would explicitly identify the patient’s diagnosis to ensure that the patient is eligible for guideline
or other evidence-based content. Further, the physician should make the diagnosis and the app
should be ‘prescribed’ by the physician as part of a course of treatment for the patient (see Figure
3). The app should interoperate with the EMR to allow this prescription functionality to activate
it only when authorized by a licensed provider.
2. It would identify and track the process and proxy metrics for that disease (e.g., frequency of
visits required for monitoring the disease, the biomarkers and/or patient questionnaires used to
monitor disease severity for a particular disease such as HbA1c, blood pressure, PHQ9 scores,
pain scores, etc.). Modern apps and Big Data approaches require as much data as possible to
monitor and evaluate a patient’s progress. Gamification data and other user behavior data is
useful to an extent where its metric is assessed within a context of other validated metrics that
correlate with the disease.
3. Identify and track important outcome measures. This includes clinical outcomes such as heart
attacks, specialist consultations, medical procedures, hospitalization, strokes and death, which
will come from the EMR. Patient reported outcome measures (PROMs) of all types need to be
captured for comprehending patient specific patient health profile and data collection. Patient
reported experience measures (PREMs) are also necessary to understand patient’s subjective
experiences that may have relevance to treatment adherence or goals. Any and all of the above
outcome measures may be relevant for a particular disease and predictable based on process and
proxy measures collected as described above. These need to be part of the mHealth app, since
they are unlikely to be made available by the EMR vendor.
The concepts described above fit very nicely into Albrecht et al.’s framework (Albrecht 2014)
into Item 4 Validity and Reliability, creating new Sub Items which we would label 4.3 Process and
Proxy Measures and 4.4 Outcomes and Outcome Measures.
Figure 2. Communicating process and outcomes in mHealth apps

Volume 7 • Issue 2 • April-June 2016
40
It is important to understand why this functionality must come from the mHealth app and not
from the EMR. Most EMR vendors do not have the clinical knowledge or expertise to develop the
type of functionality required for the mHealth apps described in this paper. mHealth app developers
need to understand the entire value chain for the management of a particular disease and then make
that available to patients and providers in their respective ehealth platforms –the PHR and the EMR.

In order to ensure credibility of the data, which is critical for patient follow-up, the provenance
of information (i.e., where it originates) is very important. For example, a physician should enter
a diagnosis. A patient entered diagnosis, although useful, could be a sign that the physician lacks
commitment to patient engagement, patient self-management and field professionalism. It could also
be erroneously interpreted or understood by the patient. This means that the health care provider
should activate the app to ensure that it is part of a “prescribed” intervention.
The app also needs to have interoperability with EMRs. This would provide the patient with
important information that is recorded in the EMR by a clinician during a patient encounter or that is
reported by various health care organizations to the physicians EMR (Figure 4). Interoperability is also
required for patients to report important information such as process measures and self-monitoring
information back to the physician or their designate for action or to update their records. There are
an increasing number of interoperability platforms available to support this, including Open mHealth
(Open mHealth, 2015), SMART Health IT (Smart Health IT, 2015) and the Apple HealthKit.
For the patient to be able to get appropriate support for questions about new information received
or new symptoms or issues that arise from time to time, the app should allow for messaging back to
Figure 3. Sequence of Interactions between provider and patient in an mHealth app

Volume 7 • Issue 2 • April-June 2016
41
the physician or their designate. The app should also allow the provider to communicate important
updates and disease relevant information to the patient (Figure 3).
The concepts described in this section also fit well into Albrecht et al.’s (Albrecht, 2015)
framework as additions to Item 5 Data requisitioning and management as new Sub Item 5.2 EMR-
App Interoperability and 5.3 App-EMR Messaging.

This paper discusses a novel, interoperable architecture that can help mhealth apps become widely
used as an asset for the enhancement of health care by strengthening the patient-provider relationship.
The paper presents the difficulties that are impeding the acceptance of apps in health care. Although
the hurdles for apps usage in health care are several, the paper focused on introducing apps into the
patient and healthcare provider relationship because of the respect it commands among patients.
By introducing mhealth into the patient and healthcare provider structure, especially physicians,
it would communicate the importance apps can bring to healthcare. It is possible that patients and
culture could eventually woo healthcare practitioners into accepting mhealth apps but the risks of this
approach would require more work. In contrast, most healthcare providers are likely to be persuaded
if apps were to embrace age-old cultural norms and values of the patient-provider relationship, core
scientific methods of using validated measures in order to have confidence in the measurements that
apps generate and interoperability that ensures two way communications. In an effort to differentiate
our approach from providers ‘prescribing’ mhealth apps from the app store, we incorporate validating
capabilities, communication and interoperability as keystones to facilitate patient empowerment,
engagement and follow-up within the context of the patient-provider relationship.
Figure 4. Reference architecture for mHealth app integration with EMRs

Volume 7 • Issue 2 • April-June 2016
42

Abebe, N. A., Capozza, K. L., Des Jardins, T. R., Kulick, D. A., Rein, A. L., Schachter, A. A., & Turske, S. A.
(2013). Considerations for community-based initiatives: Insights from three Beacon Communities. Journal of
Medical Internet Research, 15(10), e221. doi:10.2196/jmir.2803 PMID:24128406
Albrecht, U. V. (2013). Transparency of health-apps for trust and decision making. Journal of Medical Internet
Research, 15(12), e277. doi:10.2196/jmir.2981 PMID:24449711
Albrecht, U. V., Pramann, O., & von Jan, U. (2014). Synopsis for health apps–transparency for trust and decision
making. In Social Media and Mobile Technologies for Healthcare. Hershey, PA, USA: IGI Global.
Bailey, S. C., Belter, L. T., Pandit, A. U., Carpenter, D. M., Carlos, E., & Wolf, M. S. (2014). The availability,
functionality, and quality of mobile applications supporting medication self-management. Journal of the American
Medical Informatics Association, 21(3), 542–546. doi:10.1136/amiajnl-2013-002232 PMID:24163156
Balouchi, S., Keshavjee, K., Zbib, A., Vassanji, K., & Toor, J. (2014). Creating a Supportive Environment
for Self-Management in Healthcare via Patient Electronic Tools. Social Media and Mobile Technologies for
Healthcare, 109.
Bierbrier, R., Lo, V., & Wu, R. C. (2014). Evaluation of the accuracy of smartphone medical calculation apps.
Journal of Medical Internet Research, 16(2), e32. doi:10.2196/jmir.3062 PMID:24491911
Boudreaux, E. D., Waring, M. E., Hayes, R. B., Sadasivam, R. S., Mullen, S., & Pagoto, S. (2014). Evaluating
and selecting mobile health apps: Strategies for healthcare providers and healthcare organizations. Translational
Behavioral Medicine, 4(4), 363–371. doi:10.1007/s13142-014-0293-9 PMID:25584085
Brown, W. III, Yen, P. Y., Rojas, M., & Schnall, R. (2013). Assessment of the Health IT Usability Evaluation
Model (Health-ITUEM) for evaluating mobile health technology. Journal of Biomedical Informatics, 46(6),
1080–1087. doi:10.1016/j.jbi.2013.08.001 PMID:23973872
Caburnay, C. A. (2015). Evaluating diabetes mobile applications for health literate designs and functionality,
2014. Preventing Chronic Disease, 12. PMID:25950568
Chen, C., Haddad, D., Selsky, J., Hoffman, J. E., Kravitz, R. L., Estrin, D. E., & Sim, I. (2012). Making sense of
mobile health data: An open architecture to improve individual-and population-level health. Journal of Medical
Internet Research, 14(4), e112. doi:10.2196/jmir.2152 PMID:22875563
Coleman, K., Austin, B. T., Brach, C., & Wagner, E. H. (2009). Evidence on the Chronic Care Model in the new
millennium. Health Affairs, 28(1), 75–85. doi:10.1377/hlthaff.28.1.75 PMID:19124857
Edelman, D., & Singer, M. (2015). Competing on customer journeys. HBR.org. Retrieved from https://hbr.org/
product/competing-on-customer-journeys/R1511E-PDF-ENG
Elias, J. (2015). In 2016, Users Will Trust Health Apps More Than Their Doctors. Forbes. Retrieved from http://
www.forbes.com/sites/jenniferelias/2015/12/31/in-2016-users-will-trust-health-apps-more-than-their-doctors/
Grumman, J. (2013). What Patients Want from Mobile Apps. Retrieved from http://www.kevinmd.com/
blog/2013/04/patients-mobile-apps.html
HONcode. (n. d.). Operational definition of the HONcode principles. Retrieved from http://www.hon.ch/
HONcode/Webmasters/Guidelines/guidelines.html
Kumar, S., Nilsen, W. J., Abernethy, A., Atienza, A., Patrick, K., Pavel, M., & Hedeker, D. etal. (2013). Mobile
health technology evaluation: The evidence workshop. American Journal of Preventive Medicine, 45(2), 228–236.
doi:10.1016/j.amepre.2013.03.017 PMID:23867031
McCurdie, T., Taneva, S., Casselman, M., Yeung, M., McDaniel, C., Ho, W., & Cafazzo, J. (2012). consumer
apps: The case for user-centered design. Biomedical Instrumentation & Technology, 46(Suppl. 2), 49–56.
doi:10.2345/0899-8205-46.s2.49 PMID:23039777
McMillan, B., Hickey, E., Patel, M.G., & Mitchell, C. (2015). Quality assessment of a sample of mobile app-
based health behavior change interventions using a tool based on the National Institute of Health and Care
Excellence behavior change guidance. Patient education and counseling. Open mHealth. Retrieved from http://
www.openmhealth.org/

Volume 7 • Issue 2 • April-June 2016
43
Peeples, M. M., Iyer, A. K., & Cohen, J. L. (2013). Integration of a mobile-integrated therapy with
electronic health records: Lessons learned. Journal of Diabetes Science and Technology, 7(3), 602–611.
doi:10.1177/193229681300700304 PMID:23759392
Powell, A. C., Landman, A. B., & Bates, D. W. (2014). In search of a few good apps. Journal of the American
Medical Association, 311(18), 1851–1852. doi:10.1001/jama.2014.2564 PMID:24664278
Pruitt, J., & Grudin, J. (2003, June 5-7). Personas: practice and theory. Proceedings of the conference on Designing
for User Experiences DUX ‘03, San Francisco, CA, USA. doi:10.1145/997078.997089
Research2guidance. (2015). App Developer Economics 2015. Retrieved from http://research2guidance.com/
r2g/r2g--App-Developer-Economics-2015.pdf
Silow-Carroll, S., & Smith, B. (2013). Clinical management apps: creating partnerships between providers and
patients. Commonwealth Fund Issue Brief. SMART Health IT. Retrieved from http://smarthealthit.org/
SMART Health IT. (n. d.). Retrieved from http://smarthealthit.org/
Terry, K. (2015). Prescribing mobile apps: What to consider. Retrieved from http://medicaleconomics.
modernmedicine.com/medical-economics/news/prescribing-mobile-apps-what-consider?page=full
... Previous studies have reviewed current apps for HF self-care and found that there are limited number of apps available to support disease management [12,17]. Nevertheless, these studies were unable to effectively evaluate app quality because of their lack of disease specificity within the rating scale design [18,19]. For example, the commonly used Mobile Application Rating Scale (MARS) was able to provide an overall assessment of the quality of apps with respect to engagement, functionality, aesthetics, information, and subjective opinion, but it does not evaluate the usability or effectiveness of the app features specific for the disease population [12,15,18,19]. ...
... Nevertheless, these studies were unable to effectively evaluate app quality because of their lack of disease specificity within the rating scale design [18,19]. For example, the commonly used Mobile Application Rating Scale (MARS) was able to provide an overall assessment of the quality of apps with respect to engagement, functionality, aesthetics, information, and subjective opinion, but it does not evaluate the usability or effectiveness of the app features specific for the disease population [12,15,18,19]. Therefore, generic health apps (eg, WebMD) receive higher app quality scores using the MARS even if they do not have crucial app features (eg, weight management) for proper self-care [17]. ...
... To address this gap, we conducted a systematic search of all the apps currently available exclusively for HF self-care. We used Chindalo et al's peer-reviewed mHealth app reference architecture to define the app design requirements [19]. Contrary to other rating scales, this architecture allows us to combine the evaluative components related to the aesthetics, usability, and HF self-care to effectively evaluate whether the current HF apps are meeting the end user's self-care needs and capabilities [19]. ...
Article
Full-text available
Background Heart failure (HF) is a chronic disease that affects over 1% of Canadians and at least 26 million people worldwide. With the continued rise in disease prevalence and an aging population, HF-related costs are expected to create a significant economic burden. Many mobile health (mHealth) apps have been developed to help support patients’ self-care in the home setting, but it is unclear if they are suited to the needs or capabilities of older adults. Objective This study aimed to identify HF apps and evaluate whether they met the criteria for optimal HF self-care. Methods We conducted a systematic search of all apps available exclusively for HF self-care across Google Play and the App Store. We then evaluated the apps according to a list of 25 major functions pivotal to promoting HF self-care for older adults. Results A total of 74 apps for HF self-care were identified, but only 21 apps were listed as being both HF and self-care specific. None of the apps had all 25 of the listed features for an adequate HF self-care app, and only 41% (31/74) apps had the key weight management feature present. HF Storylines received the highest functionality score (18/25, 72%). Conclusions Our findings suggest that currently available apps are not adequate for use by older adults with HF. This highlights the need for mHealth apps to refine their development process so that user needs and capabilities are identified during the design stage to ensure the usability of the app.
... usability, user engagement, provision of information). [22][23][24] The framework was customized for patients with gestational prediabetes with the consultation of an experienced clinician (K.K.) and a researcher who has experience with the gestational prediabetic population (Y.Q.). The framework uses features found in the literature for the prevention of diabetes in pregnancy and also includes behavior change techniques that are known to be effective in changing behavior along with preferred patient features, as found in the literature. ...
... 28 Hospitals need to decide to build their apps in-house, work with an existing vendor, or prescribe apps to patients to render them effective. 23 In either case, there is a significant cost for systems integration. ...
Article
Full-text available
This study evaluates mobile apps using a theory-based evaluation framework to discover their applicability for patients at risk of gestational diabetes. This study assessed how well the existing mobile apps on the market meet the information and tracking needs of patients with gestational diabetes and evaluated the feasibility of how to integrate these apps into patient care. A search was conducted in the Apple iTunes and Google Play store for mobile apps that contained keywords related to the following concepts of nutrition: diet, tracking, diabetes, and pregnancy. Evaluation criteria were developed to assess the mobile apps on five dimensions. Overall, the apps scored well on education and information functions and scored poorly on engagement functions. There are few apps that provide comprehensive evidence-based educational content, tracking tools, and integration with electronic health records. This study demonstrates the need to develop apps that have comprehensive content, tracking tools, and ability to bidirectionally share data.
... Several studies demonstrate the positive impact of hApps on health-related behaviors including physical activity, diet change, and adherence to medication or therapy [4]. Clinician adoption plays a critical role in the uptake and success of hApps [5,6]. The COVID-19 pandemic has increased end-user interest in hApps, however, hApps face several barriers to wider adoption. ...
Article
Full-text available
Forty-four percent of Canadians over the age of 20 have a non-communicable disease (NCD). Millions of Canadians are at risk of developing the complications of NCDs; millions have already experienced those complications. Fortunately, the evidence base for NCD prevention and behavior change is large and growing and digital technologies can deliver them at scale and with high fidelity. However, the current model of in-person primary care is not designed nor capable of operationalizing that evidence. New developments in artificial intelligence that can predict who will develop NCD or the complications of NCD are increasingly available, making the challenge of delivering disease prevention even more urgent. This paper presents findings from stakeholder engagement on a design architecture to address three initial barriers to large-scale deployment of health management and behavior change evidence: 1) the challenges of regulating mobile health apps, 2) the challenge of creating a value-based rationale for payers to invest in deploying mobile health apps at scale, and 3) the high cost of customer acquisition for delivering mobile health apps to those at risk.
... To be useful, educational content should be provided in a way that is easily accessible by users (Rowland et al. 2020), even among users in remote areas. However, there are several barriers when technology-based tools, such as serious game apps, including unreliable or non-uniform technology, lack of end-user education or literacy and numeracy limitations and interoperability of systems or software dependencies (Chindalo et al. 2016;Gurupur and Wan 2017). To overcome technology challenges when developing serious game apps, it is important to consider these barriers not only when developing the technology, but also when implementing it (Gurupur and Wan 2017). ...
Article
Full-text available
Serious games (i.e., digital games designed for educational purposes) can foster positive learning attitudes and are increasingly used as educational tools. Foodbot Factory is a serious game application (app) that helps children learn about healthy eating based on Canada’s Food Guide principles and has demonstrated to increase nutrition knowledge among this group. This paper describes the process followed to expand Foodbot Factory’s educational content and integrate immersive technologies and innovative features into the app. The revision process, which was guided by the Obesity-Related Behavioral Intervention Trials model, included the following phases: first, an interdisciplinary team of nutrition scientists, education experts, and computer scientists analyzed data from the original pilot study, recently published literature, and feedback from stakeholders to define areas to improve Foodbot Factory. The five original Foodbot Factory modules were evaluated by the team during weekly meetings, where the educational content, interactive features, and other elements that required updates (e.g., aesthetics and accessibility) were identified. Second, prototypes were created and refined until a final version of Foodbot Factory was approved. Nineteen children tested the updated Foodbot Factory and found it “easy to use” (89%) and “fun” (95%). The new version of Foodbot Factory contains 19 learning objectives, including 13 original and six new objectives. Interactive engagement features in the updated Foodbot Factory included augmented reality incorporated into two learning modules; new mini-games were created, including a memory game; an overhaul of the aesthetics; (e.g., new food images); and accessibility features were included to support users with cognitive and vision disabilities.
... The current standard of care involves nurses providing general HF self-care education to patients and CPs during clinic visits and patients being provided standardized HF booklets, based on national guidelines, to take home. However, for patients and CPs to gain the benefits associated with HF education, the information must be simple to understand and specific to the patient [33,48]. Past studies have indicated that individualized education is key to help patients gain the skills needed for adequate self-care, as it accommodates their learning style and level of health literacy [33,49]. ...
Article
Full-text available
Background Heart failure (HF) affects many older individuals in North America, with recurrent hospitalizations despite postdischarge strategies to prevent readmission. Proper HF self-care can potentially lead to better clinical outcomes, yet many older patients find self-care challenging. Mobile health (mHealth) apps can provide support to patients with respect to HF self-care. However, many mHealth apps are not designed to consider potential patient barriers, such as literacy, numeracy, and cognitive impairment, leading to challenges for older patients. We previously demonstrated that a paper-based standardized diuretic decision support tool (SDDST) with daily weights and adjustment of diuretic dose led to improved self-care. Objective The aim of this study is to better understand the self-care challenges that older patients with HF and their informal care providers (CPs) face on a daily basis, leading to the conversion of the SDDST into a user-centered mHealth app. Methods We recruited 14 patients (male: 8/14, 57%) with a confirmed diagnosis of HF, aged ≥60 years, and 7 CPs from the HF clinic and the cardiology ward at the Hamilton General Hospital. Patients were categorized into 3 groups based on the self-care heart failure index: patients with adequate self-care, patients with inadequate self-care without a CP, or patients with inadequate self-care with a CP. We conducted semistructured interviews with patients and their CPs using persona-scenarios. Interviews were transcribed verbatim and analyzed for emerging themes using an inductive approach. Results Six themes were identified: usability of technology, communication, app customization, complexity of self-care, usefulness of HF-related information, and long-term use and cost. Many of the challenges patients and CPs reported involved their unfamiliarity with technology and the lack of incentive for its use. However, participants were supportive and more likely to actively use the HF app when informed of the intervention’s inclusion of volunteer and nurse assistance. Conclusions Patients with varying self-care adequacy levels were willing to use an mHealth app if it was simple in its functionality and user interface. To promote the adoption and usability of these tools, patients confirmed the need for researchers to engage with end users before developing an app. Findings from this study can be used to help inform the design of an mHealth app to ensure that it is adapted for the needs of older individuals with HF.
... These interventions may be delivered through a mobile app on a smart phone, while patient data such as glucose levels and daily diet is being collected as observations. However, connecting patient generated data (observations) with primary care EHR systems is not assumed as standard practice because EHR systems of today are not designed to incorporate this kind of data into a patient's record (Chindalo, Karim, Brahmbhatt, Saha, & Keshavjee, 2016). However, as the market for mHealth grows and its use becomes wide spread among patients and clinicians, there is an increasing demand for interoperability and data integration by its users (Gay & Leijdekkers, 2015). ...
Research
Full-text available
Aim and Objectives: The aim of this research study is to understand the process required to “build from scratch” a FHIR© compliant Cystic Fibrosis (CF) mHealth app. Methodology: A qualitative research approach is adopted, which will focus on a case study. The researchers observations about the process of building a FHIR© compliant mHealth app will be captured in a field diary as qualitative data. The data will be analysed using Grounded Theory with a view to building a theory about the “build from scratch” software engineering process. Results: Analysis of the qualitative data through coding and constant comparative analysis yielded three categories. These three categories were used to develop a Grounded Theory based Conceptual Framework for the development of SMART on FHIR© apps. Conclusions: Although, a Grounded Theory based Conceptual Framework for the development of SMART on FHIR© apps is being proposed within this study, it has been recognised that conflicting attitudes towards electronic healthcare data exchange, privacy and security are barriers to accessing patient information using mHealth apps and devices.
Chapter
Clinical development of a pharmaceutical product plays an important role as it regulates the future of investigational new drug application approval (IND) and approval of new drug application (NDA). This stage comes next to drug discovery and development. Clinical development aims for evaluation of drug molecule for its safety, dose range, effectiveness, side effects, and comparison to current treatment. Computers are rapid, reliable, and efficient electronic devices. Utilization of computer systems has tremendously affected our society, working style, and thereby it has gained immense popularity in almost every sector. The utilization of computers in clinical development helps in data collection as to maintain patient records, adequate quality and quantity of data, analysis and statistical treatment of data, interpretation of graphs and other numerical data, etc. There are many softwares and databases which are used in clinical development of a drug product. Studies like drug interaction, dose calculations, stability studies, statistical evaluation, clinical trial study evaluation, pharmacovigilance safety extensively rely on use of softwares, databases, and computers. This chapter highlights the role of computers in clinical development of pharmaceutical products, importance of computer in clinical development, softwares, databases, and electronic data capture tools.KeywordsClinical trialInvestigational new drugNew drug applicationComputerSoftwaresDatabaseArtificial intelligence
Chapter
mHealth is one of the emerging markets offering numerous opportunities both for the involved stakeholders and for doctors to improve the quality of life of patients. For this reason, a smart analysis of patents and innovations in mHealth together with the identification of the next future challenges is necessary for companies to enter the market and exploit their know-how to match consumer demand. This paper focuses on the analysis of the Intellectual Property Rights in the field of mHealth systems to draw a reference knowledge framework of the mHealth scenario. An up-to-date detailed categorization, the geographical distribution and the identification of top players in mHealth are presented.
Chapter
Full-text available
Consumer electronic healthcare applications and tools, both web-based and mobile apps, are increasingly available and used by citizens around the world. 'eTools' denote the full range of electronic applications that consumers may use to assess, track or treat their disease(s), including communicating with their health care provider. Consumer eTool use is prone to plateauing of use because it is one-sided; i.e., consumers use them without the assistance or advice of a health care provider. Patient eTools that allow patients to communicate with their healthcare providers, exchange data and receive support and guidance between visits is a promising approach that could lead to more effective, sustained and sustainable use of eTools. The key elements of a supportive environment for eTool use include 2-way data integration from patient home monitoring equipment to providers and from provider electronic medical records systems to patient eTools, mechanisms to support provider-patient communication between visits, the ability for providers to easily monitor incoming data from multiple patients and for provider systems to leverage the team environment and delegate tasks to appropriate providers for education and follow-up.
Article
Full-text available
The expansion of mobile health technologies, particularly for diabetes-related applications (apps), grew exponentially in the past decade. This study sought to examine the extent to which current mobile apps for diabetes have health literate features recommended by participants in an Institute of Medicine Roundtable and compare the health literate features by app cost (free or not). We used diabetes-related keywords to identify diabetes-related apps for iOS devices. A random sample of 110 apps (24% of total number of apps identified) was selected for coding. The coding scheme was adapted from the discussion paper produced by participants in the Institute of Medicine Roundtable. Most diabetes apps in this sample addressed diabetes management and therapeutics, and paid apps were more likely than free apps to use plain language strategies, to label links clearly, and to have at least 1 feature (a "back" button) that helps with the organization. Paid apps were more likely than free apps to use strategies that should be more useful and engaging for people with low health literacy. Future work can investigate ways to make free diabetes mobile apps more user-friendly and accessible.
Article
Full-text available
Mobile applications (apps) to improve health are proliferating, but before healthcare providers or organizations can recommend an app to the patients they serve, they need to be confident the app will be user-friendly and helpful for the target disease or behavior. This paper summarizes seven strategies for evaluating and selecting health-related apps: (1) Review the scientific literature, (2) Search app clearinghouse websites, (3) Search app stores, (4) Review app descriptions, user ratings, and reviews, (5) Conduct a social media query within professional and, if available, patient networks, (6) Pilot the apps, and (7) Elicit feedback from patients. The paper concludes with an illustrative case example. Because of the enormous range of quality among apps, strategies for evaluating them will be necessary for adoption to occur in a way that aligns with core values in healthcare, such as the Hippocratic principles of nonmaleficence and beneficence.
Chapter
Full-text available
Unfortunately, many users are unaware of the risks and limits that arise from the use of health-related and medical apps in a medical context. Often, problems arise from insufficient, misleading, or false information, but they also arise from errors within the app or inappropriate hardware that is used for running the app. Provided information is often inadequate to enable users to assess whether a medical or health app is reliable and safe. Laws and regulations that are meant to provide consumer safety (for patients and medical professionals alike) only apply to a limited number of apps with a specific medical purpose. For non-regulated apps used in a health context, there are various projects and initiatives, for example relating to app certification, but not all of these provide the information they collect about an app in a comprehensible and verifiable manner. The app synopsis presented in this chapter aims at alleviating the situation. The authors propose that manufacturers and developers use its clear structure for providing users with information about an app, ideally in a place where they commonly look (e.g. the app stores).
Article
Full-text available
Background: Mobile phones with operating systems and capable of running applications (smartphones) are increasingly being used in clinical settings. Medical calculating applications are popular mhealth apps for smartphones. These include, for example, apps that calculate the severity or likelihood of disease-based clinical scoring systems, such as determining the severity of liver disease, the likelihood of having a pulmonary embolism, and risk stratification in acute coronary syndrome. However, the accuracy of these apps has not been assessed. Objective: The objective of this study was to evaluate the accuracy of smartphone-based medical calculation apps. Methods: A broad search on Google Play, BlackBerry World, and the iTunes App Store was conducted to find medical calculation apps for smartphones. The list of apps was narrowed down based on inclusion and exclusion criteria focusing on functions thought to be relevant by a panel of general internists (number of functions =13). Ten case values were inputted for each function and were compared to manual calculations. For each case, the correct answer was assigned a score of 1. A score for the 10 cases was calculated based on the accuracy of the results for each function on each app. Results: We tested 14 apps and 13 functions for each app if that function was available. We conducted 10 cases for each function for a total of 1240 tests. Most functions tested on the apps were accurate in their results with an overall accuracy of 98.6% (17 errors in 1240 tests). In all, 6 of 14 (43%) apps had 100% accuracy. Although 11 of 13 (85%) functions had perfect accuracy, there were issues with 2 functions: the Child-Pugh scores and Model for End-Stage Liver Disease (MELD) scores on 8 apps. Approximately half of the errors were clinically significant resulting in a significant change in prognosis (8/17, 47%). Conclusions: The results suggest that most medical calculating apps provide accurate and reliable results. The free apps that were 100% accurate and contained the most functions desired by internists were CliniCalc, Calculate by QxMD, and Medscape. When using medical calculating apps, the answers will likely be accurate; however, it is important to be careful when calculating MELD scores or Child-Pugh scores on some apps. Despite the few errors found, greater scrutiny is warranted to ensure full accuracy of smartphone medical calculator apps.
Chapter
Consumer electronic healthcare applications and tools, both Web-based and mobile apps, are increasingly available and used by citizens around the world. "eTools" denote the full range of electronic applications that consumers may use to assess, track, or treat their disease(s), including communicating with their healthcare provider. Consumer eTool use is prone to plateauing of use because it is one-sided (i.e., consumers use them without the assistance or advice of a healthcare provider). Patient eTools that allow patients to communicate with their healthcare providers, exchange data, and receive support and guidance between visits is a promising approach that could lead to more effective, sustained, and sustainable use of eTools. The key elements of a supportive environment for eTool use include 2-way data integration from patient home monitoring equipment to providers and from provider electronic medical records systems to patient eTools, mechanisms to support provider-patient communication between visits, the ability for providers to easily monitor incoming data from multiple patients, and for provider systems to leverage the team environment and delegate tasks to appropriate providers for education and follow-up. This is explored in this chapter.
Article
mHealth apps are mobile device applications intended to improve health outcomes, deliver health care services, or enable health research.1 The number of apps has increased substantially, and more than 40 000 health, fitness, and medical apps currently are available on the market.2 Because apps can be used to inexpensively promote wellness and manage chronic diseases, their appeal has increased with health reform and the increasing focus on value. The bewildering diversity of apps available has made it difficult for clinicians and the public to discern which apps are the safest or most effective.