Evaluating health information technology in community-based settings: lessons learned.

Department of Public Health, Weill Cornell Medical College, New York, New York 10065, USA.
Journal of the American Medical Informatics Association (Impact Factor: 3.57). 07/2011; 18(6):749-53. DOI: 10.1136/amiajnl-2011-000249
Source: PubMed

ABSTRACT Implementing health information technology (IT) at the community level is a national priority to help improve healthcare quality, safety, and efficiency. However, community-based organizations implementing health IT may not have expertise in evaluation. This study describes lessons learned from experience as a multi-institutional academic collaborative established to provide independent evaluation of community-based health IT initiatives. The authors' experience derived from adapting the principles of community-based participatory research to the field of health IT. To assist other researchers, the lessons learned under four themes are presented: (A) the structure of the partnership between academic investigators and the community; (B) communication issues; (C) the relationship between implementation timing and evaluation studies; and (D) study methodology. These lessons represent practical recommendations for researchers interested in pursuing similar collaborations.

1 Bookmark
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Community-based research in public health focuses on social, structural, and physical environmental inequities through active involvement of community members, organizational representatives, and researchers in all aspects of the research process. Partners contribute their expertise to enhance understanding of a given phenomenon and to integrate the knowledge gained with action to benefit the community involved. This review provides a synthesis of key principles of community-based research, examines its place within the context of different scientific paradigms, discusses rationales for its use, and explores major challenges and facilitating factors and their implications for conducting effective community-based research aimed at improving the public's health.
    Annual Review of Public Health 02/1998; 19:173-202. · 6.63 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Many interventions to improve the success of information technology (IT) implementations are grounded in behavioral science, using theories, and models to identify conditions and determinants of successful use. However, each model in the IT literature has evolved to address specific theoretical problems of particular disciplinary concerns, and each model has been tested and has evolved using, in most cases, a more or less restricted set of IT implementation procedures. Functionally, this limits the perspective for taking into account the multiple factors at the individual, group, and organizational levels that influence use behavior. While a rich body of literature has emerged, employing prominent models such as the Technology Adoption Model, Social-Cognitive Theory, and Diffusion of Innovation Theory, the complexity of defining a suitable multi-level intervention has largely been overlooked. A gap exists between the implementation of IT and the integration of theories and models that can be utilized to develop multi-level approaches to identify factors that impede usage behavior. We present a novel framework that is intended to guide synthesis of more than one theoretical perspective for the purpose of planning multi-level interventions to enhance IT use. This integrative framework is adapted from PRECEDE/PROCEDE, a conceptual framework used by health planners in hundreds of published studies to direct interventions that account for the multiple determinants of behavior. Since we claim that the literature on IT use behavior does not now include a multi-level approach, we undertook a systematic literature analysis to confirm this assertion. Our framework facilitated organizing this literature synthesis and our analysis was aimed at determining if the IT implementation approaches in the published literature were characterized by an approach that considered at least two levels of IT usage determinants. We found that while 61% of studies mentioned or referred to theory, none considered two or more levels. In other words, although the researchers employ behavioral theory, they omit two fundamental propositions: (1) IT usage is influenced by multiple factors and (2) interventions must be multi-dimensional. Our literature synthesis may provide additional insight into the reason for high failure rates associated with underutilized systems, and underscores the need to move beyond the current dominant approach that employs a single model to guide IT implementation plans that aim to address factors associated with IT acceptance and subsequent positive use behavior.
    Journal of Biomedical Informatics 07/2003; 36(3):218-27. · 2.48 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: The Massachusetts eHealth Collaborative and the New York City Primary Care Information Project have provided financial subsidies and extensive support to help hundreds of independent medical practices successfully adopt electronic health records. Their efforts address overcoming key barriers such as the amount of start-up funds needed, productivity lost during implementation, and the difficulty of choosing the right system. Their approaches differ: the Massachusetts project emphasizes continuity of care within selected communities; New York emphasizes improvements in preventive care and chronic disease management across a population. Both, however, offer valuable insights that can be applied elsewhere.
    Health Affairs 03/2009; 28(2):345-56. · 4.64 Impact Factor

Full-text (2 Sources)

Available from
May 23, 2014