Co-Creation With TickiT: Designing and Evaluating a Clinical eHealth Platform for Youth

BC Children's Hospital, Division of Adolescent Medicine, University of British Columbia, Vancouver, BC, Canada. .
JMIR research protocols 10/2013; 2(2):e42. DOI: 10.2196/resprot.2865
Source: PubMed


All youth are susceptible to mental health issues and engaging in risky behavior, and for youth with chronic health conditions, the consequences can be more significant than in their healthy peers. Standardized paper-based questionnaires are recommended by the American Academy of Pediatrics in community practice to screen for health risks. In hospitals, psychosocial screening is traditionally undertaken using the Home Education, Eating, Activities, Drugs, Depression, Sex, Safety (HEEADDSS) interview. However, time constraints and patient/provider discomfort reduce implementation. We report findings from an eHealth initiative undertaken to improve uptake of psychosocial screening among youth.
Youth are sophisticated "technology natives." Our objective was to leverage youth's comfort with technology, creating a youth-friendly interactive mobile eHealth psychosocial screening tool, TickiT. Patients enter data into the mobile application prior to a clinician visit. Response data is recorded in a report, which generates alerts for clinicians, shifting the clinical focus from collecting information to focused management. Design goals included improving the patient experience, improving efficiency through electronic patient based data entry, and supporting the collection of aggregated data for research.
This paper describes the iterative design and evaluation processes undertaken to develop TickiT including co-creation processes, and a pilot study utilizing mixed qualitative and quantitative methods. A collaborative industry/academic partnership engaged stakeholders (youth, health care providers, and administrators) in the co-creation development process. An independent descriptive study conducted in 2 Canadian pediatric teaching hospitals evaluated the feasibility of the platform in both inpatient and ambulatory clinical settings, evaluating both providers and patient responses to the platform.
The independent pilot feasibility study included 80 adolescents, 12-18 years, and 38 medical staff-residents, inpatient and outpatient pediatricians, and surgeons. Youth uptake was 99% (79/80), and survey completion 99% (78/79; 90 questions). Youth found it easy to understand (92%, 72/78), easy to use (92%, 72/78), and efficient (80%, 63/79 with completion rate < 10 minutes). Residents were most positive about the application and surgeons were least positive. All inpatient providers obtained new patient information.
Co-creative design methodology with stakeholders was effective for informing design and development processes to leverage effective eHealth opportunities. Continuing stakeholder engagement has further fostered platform development. The platform has the potential to meet IHI Triple Aim goals. Clinical adaptation requires planning, training, and support for health care providers to adjust their practices.

1 Follower
19 Reads
  • Source
    • "By following the principles identified by the International Standards Organization (ISO, 1999) and conducting focus groups with multiple stakeholders, we have identified a number of functionalities relevant to the development of a much-needed electronic psychosocial assessment for youth, as well as other technologies being developed for use in healthcare settings. Further, by only providing a brief description of the proposed e-tool and not constraining stakeholder involvement to the wording of questions or the graphic design of the specific software, we were able to identify a range of additional functionalities likely to improve its applicability, over and above those identified in the study by Whitehouse et al. (2013), or those that could have been identified by the researchers or developers alone. Utilizing the qualitative analysis approach suggested by Hill et al. (2005), whereby requirements are categorized into levels of representativeness across the sample, also allowed us to rank these additional functionalities to ensure that the necessary features could be developed, without wasting unnecessary time and money by ''gold plating.'' "
    [Show abstract] [Hide abstract]
    ABSTRACT: Information Communication Technologies (ICT) have resulted in positive outcomes in a range of clinical studies, however, most have not had widespread subsequent uptake, partly because they were not developed with all stakeholder requirements in mind. In the current study, we engaged stakeholders in the concept development stage of a project to transform a psychosocial assessment into an ICT-enabled format. By engaging the stakeholders in this early process we were able to identify a range of software functionalities that are likely to improve the applicability for users, as well as identify possible barriers to implementation.
    Journal of Technology in Human Services 11/2014; 32(4):275-296. DOI:10.1080/15228835.2014.967906
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: eHealth interventions appear and change so quickly that they challenge the way we conduct research. By the time a randomized trial of a new intervention is published, technological improvements and clinical discoveries may make the intervention dated and unappealing. This and the spate of health-related apps and websites may lead consumers, patients, and caregivers to use interventions that lack evidence of efficacy. This paper aims to offer strategies for increasing the speed and usefulness of eHealth research. The paper describes two types of strategies based on the authors' own research and the research literature: those that improve the efficiency of eHealth research, and those that improve its quality. Efficiency strategies include: (1) think small: conduct small studies that can target discrete but significant questions and thereby speed knowledge acquisition; (2) use efficient designs: use such methods as fractional-factorial and quasi-experimental designs and surrogate endpoints, and experimentally modify and evaluate interventions and delivery systems already in use; (3) study universals: focus on timeless behavioral, psychological, and cognitive principles and systems; (4) anticipate the next big thing: listen to voices outside normal practice and connect different perspectives for new insights; (5) improve information delivery systems: researchers should apply their communications expertise to enhance inter-researcher communication, which could synergistically accelerate progress and capitalize upon the availability of "big data"; and (6) develop models, including mediators and moderators: valid models are remarkably generative, and tests of moderation and mediation should elucidate boundary conditions of effects and treatment mechanisms. Quality strategies include: (1) continuous quality improvement: researchers need to borrow engineering practices such as the continuous enhancement of interventions to incorporate clinical and technological progress; (2) help consumers identify quality: consumers, clinicians, and others all need to easily identify quality, suggesting the need to efficiently and publicly index intervention quality; (3) reduce the costs of care: concern with health care costs can drive intervention adoption and use and lead to novel intervention effects (eg, reduced falls in the elderly); and (4) deeply understand users: a rigorous evaluation of the consumer's needs is a key starting point for intervention development. The challenges of distinguishing and distributing scientifically validated interventions are formidable. The strategies described are meant to spur discussion and further thinking, which are important, given the potential of eHealth interventions to help patients and families.
    Journal of Medical Internet Research 02/2014; 16(2):e36. DOI:10.2196/jmir.2925 · 3.43 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Youth violence (YV) screening during primary care visits is not routinely performed. Electronic previsit questionnaires (PVQs) are viewed favorably by adolescents and can prompt disclosure and discussion of sensitive health topics. This study aimed to determine the efficacy of an electronic PVQ in prompting YV discussions. A 4-month cluster-randomized controlled trial was conducted in a large urban academic primary care clinic. The clinic's 4 practice groups were randomized to intervention or control assignment. A consecutive sample of adolescents aged 13 to 19 years presenting for annual visits were recruited. Participants completed an electronic PVQ (TickiT) either with (intervention) or without (control) YV questions. PVQ results were delivered to physicians before the visit. The frequency of YV discussions was measured using exit surveys of adolescents. Patients who reported YV discussion rated the helpfulness of the discussion. Multilevel mixed effect logistic regression was conducted to compare likelihood of YV discussion between intervention and control groups. A total of 183 adolescents (90% of eligible) participated. Overall, 30% of adolescents reported some YV involvement. Sixty-five percent of the intervention group and 42% of the control group reported discussing YV during their visit. Thirty-one percent of adolescents in the intervention group who disclosed YV involvement reported not having a YV discussion. The intervention group had 2.6 (95% confidence interval 1.2-5.6) times the odds of discussing YV. Sixty-six percent of adolescents who discussed YV with their doctor rated the discussion as very helpful. An electronic PVQ with items related to YV is acceptable and feasible, and it significantly improves frequency of patient-provider YV discussion. Copyright © 2015 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.
    Academic pediatrics 05/2015; 15(3):345-52. DOI:10.1016/j.acap.2015.01.005 · 2.01 Impact Factor