Publications (30)76.12 Total impact
-
Article: A protocol for advanced psychometric assessment of surveys.
[show abstract] [hide abstract]
ABSTRACT: Background and Purpose. In this paper, we present a protocol for advanced psychometric assessments of surveys based on the Standards for Educational and Psychological Testing. We use the Alberta Context Tool (ACT) as an exemplar survey to which this protocol can be applied. Methods. Data mapping, acceptability, reliability, and validity are addressed. Acceptability is assessed with missing data frequencies and the time required to complete the survey. Reliability is assessed with internal consistency coefficients and information functions. A unitary approach to validity consisting of accumulating evidence based on instrument content, response processes, internal structure, and relations to other variables is taken. We also address assessing performance of survey data when aggregated to higher levels (e.g., nursing unit). Discussion. In this paper we present a protocol for advanced psychometric assessment of survey data using the Alberta Context Tool (ACT) as an exemplar survey; application of the protocol to the ACT survey is underway. Psychometric assessment of any survey is essential to obtaining reliable and valid research findings. This protocol can be adapted for use with any nursing survey.Nursing research and practice. 01/2013; 2013:156782. -
Article: Self-reported patient safety competence among new graduates in medicine, nursing and pharmacy.
[show abstract] [hide abstract]
ABSTRACT: BACKGROUND: As efforts to address patient safety (PS) in health professional (HP) education increase, it is important to understand new HPs' perspectives on their own PS competence at entry to practice. This study examines the self-reported PS competence of newly registered nurses, pharmacists and physicians. METHODS: A cross-sectional survey of 4496 new graduates in medicine (1779), nursing (2196) and pharmacy (521) using the HP Education in PS Survey (H-PEPSS). The H-PEPSS measures HPs' self-reported PS competence on six socio-cultural dimensions of PS, including culture, teamwork, communication, managing risk, responding to risk and understanding human factors. The H-PEPSS asks about confidence in PS learning in classroom and clinical settings. RESULTS: All HP groups reported feeling more confident in the dimension of PS learning related to effective communication with patients and other providers. Greater confidence in PS learning was reported for learning experiences in the clinical setting compared with the class setting with one exception-nurses' confidence in learning about working in teams with other HPs deteriorated as they moved from thinking about learning in the classroom setting to thinking about learning in the clinical setting. CONCLUSIONS: Large-scale efforts are required to more deeply and consistently embed PS learning into HP education. However, efforts to embed PS learning in HP education seem to be hampered by deficiencies that persist in the culture of the clinical training environments in which we educate and acculturate new HPs.BMJ quality & safety 11/2012; -
Article: Identifying resident care areas for a quality improvement intervention in long-term care: a collaborative approach.
[show abstract] [hide abstract]
ABSTRACT: BACKGROUND: In Canada, healthcare aides (also referred to as nurse aides, personal support workers, nursing assistants) are unregulated personnel who provide 70-80% of direct care to residents living in nursing homes. Although they are an integral part of the care team their contributions to the resident care planning process are not always acknowledged in the organization. The purpose of the Safer Care for Older Persons [in residential] Environments (SCOPE) project was to evaluate the feasibility of engaging front line staff (primarily healthcare aides) to use quality improvement methods to integrate best practices into resident care. This paper describes the process used by teams participating in the SCOPE project to select clinical improvement areas. METHODS: The study employed a collaborative approach to identify clinical areas and through consensus, teams selected one of three areas. To select the clinical areas we recruited two nursing homes not involved in the SCOPE project and sampled healthcare providers and decision-makers within them. A vote counting method was used to determine the top five ranked clinical areas for improvement. RESULTS: Responses received from stakeholder groups included gerontology experts, decision-makers, registered nurses, managers, and healthcare aides. The top ranked areas from highest to lowest were pain/discomfort management, behaviour management, depression, skin integrity, and assistance with eating. CONCLUSIONS: Involving staff in selecting areas that they perceive as needing improvement may facilitate staff engagement in the quality improvement process.BMC Geriatrics 09/2012; 12(1):59. · 2.34 Impact Factor -
Article: Should we feed back research results in the midst of a study?
[show abstract] [hide abstract]
ABSTRACT: BACKGROUND: This report is an introduction to a series of three research papers that describe the evolution of the approaches taken by the Translating Research in Elder Care (TREC) research team during its first four years to feed back the research findings to study participants. TREC is an observational multi-method health services research project underway in 36 nursing homes in the prairie provinces of Canada. TREC has actively involved decision makers from the sector in all stages from initial planning, through data collection to dissemination activities. However, it was not planned as a fully integrated knowledge translation project. These three papers describe our progress towards fully integrated knowledge translation--with respect to timely and requested feedback processes. The first paper reports on the process and outcomes of creating and evaluating the feedback of research findings to healthcare aides (unregulated health professionals). These aides provide over 80% of the direct care in our sample and actively requested the feedback as a condition of their continued cooperation in the data acquisition process. The second paper describes feedback from nursing home administrators on preliminary research findings (a facility annual report) and evaluation of the reports' utility. The third paper discusses an approach to providing a more in-depth form of feedback (expanded feedback report) at one of the TREC nursing homes. FINDINGS: Survey and interview feedback from healthcare aides is presented in the first paper. Overall, healthcare aides' opinions about presentation of the feedback report and the understand ability, usability, and usefulness of the content were positive. The second paper describes the use of telephone interviews with facility administrators and indicates that the majority of contextual areas (e.g., staff job satisfaction) addressed in facility annual report to be useful, meaningful, and understandable. More than one-half of the administrators would have liked to have received information on additional areas. The third paper explores how a case study that examined how involvement with the TREC study influenced management and staff at one of the TREC nursing homes. The importance of understanding organizational routines and the impact of corporate restructuring were key themes emerging from the case study. In addition, the Director of Care suggested changes to the structure and format of the feedback report that would have improved its usefulness. CONCLUSIONS: We believe that these findings will inform others undertaking integrated knowledge translation activities and will encourage others to become more engaged in feedback processes.Implementation Science 09/2012; 7(1):87. · 3.10 Impact Factor -
Article: Insights into the impact and use of research results in a residential long-term care facility: a case study.
[show abstract] [hide abstract]
ABSTRACT: BACKGROUND: Engaging end users of research in the process of disseminating findings may increase the relevance of findings and their impact for users. We report findings from a case study that explored how involvement with the Translating Research in Elder Care (TREC) study influenced management and staff at one of 36 TREC facilities. We conducted the study at 'Restwood' (pseudonym) nursing home because the Director of Care engaged actively in the study and TREC data showed that this site differed on some areas from other nursing homes in the province. The aims of the case study were two-fold: to gain a better understanding of how frontline staff engage with the research process, and to gain a better understanding of how to share more detailed research results with management. METHODS: We developed an Expanded Feedback Report for use during this study. In it, we presented survey results that compared Restwood to the best performing site on all variables and participating sites in the province. Data were collected regarding the Expanded Feedback Report through interviews with management. Data from staff were collected through interviews and observation. We used content analysis to derive themes to describe key aspects related to the study aims. RESULTS: We observed the importance of understanding organizational routines and the impact of key events in the facility's environment. We gleaned additional information that validated findings from prior feedback mechanisms within TREC. Another predominant theme was the sense that the opportunity to engage in a research process was reaffirming for staff (particularly healthcare aides)--what they did and said mattered, and TREC provided a means of having one's voice heard. We gained valuable insight from the Director of Care about how to structure and format more detailed findings to assist with interpretation and use of results. CONCLUSIONS: Four themes emerged regarding staff engagement with the research process: sharing feedback reports from the TREC study; the meaning of TREC to staff; understanding organizational context; and using the study feedback for improvement at Restwood. This study has lessons for researchers on how to share research results with study participants, including management.Implementation Science 09/2012; 7(1):90. · 3.10 Impact Factor -
Article: Nursing home administrators' perspectives on a study feedback report: a cross sectional survey.
[show abstract] [hide abstract]
ABSTRACT: BACKGROUND: This project is part of the Translating Research in Elder Care (TREC) program of research, a multi-level and longitudinal research program being conducted in 36 nursing homes in three Canadian Prairie Provinces. The overall goal of TREC is to improve the quality of care for older persons living in nursing homes and the quality of work life for care providers. The purpose of this paper is to report on development and evaluation of facility annual reports (FARs) from facility administrators' perspectives on the usefulness, meaningfulness, and understandability of selected data from the TREC survey. METHODS: A cross sectional survey design was used in this study. The feedback reports were developed in collaboration with participating facility administrators. FARs presented results in four contextual areas: workplace culture, feedback processes, job satisfaction, and staff burnout. Six weeks after FARs were mailed to each administrator, we conducted structured telephone interviews with administrators to elicit their evaluation of the FARs. Administrators were also asked if they had taken any actions as a result of the FAR. Descriptive and inferential statistics, as well as content analysis for open-ended questions, were used to summarize findings. RESULTS: Thirty-one facility administrators (representing thirty-two facilities) participated in the interviews. Six administrators had taken action and 18 were planning on taking action as a result of FARs. The majority found the four contextual areas addressed in FAR to be useful, meaningful, and understandable. They liked the comparisons made between data from years one and two and between their facility and other TREC study sites in their province. Twentytwo indicated that they would like to receive information on additional areas such as aggressive behaviours of residents and information sharing. Twenty-four administrators indicated that FARs contained enough information, while eight found FARs 'too short'. Administrators who reported that the FAR contained enough information were more likely to take action within their facilities than administrators who reported that they needed more information. CONCLUSIONS: Although the FAR was brief, the presentation of the four contextual areas was relevant to the majority of administrators and prompted them to plan or to take action within their facility.Implementation Science 09/2012; 7(1):88. · 3.10 Impact Factor -
Article: The H-PEPSS: an instrument to measure health professionals' perceptions of patient safety competence at entry into practice.
[show abstract] [hide abstract]
ABSTRACT: Enhancing competency in patient safety at entry to practice requires introduction and integration of patient safety into health professional education. As efforts to include patient safety in health professional education increase, it is important to capture new health professionals' perspectives of their own patient safety competence at entry to practice. Existing instruments to measure patient safety knowledge, skills and attitudes have been developed largely to examine the impact of specific patient safety curricular initiatives and the psychometric analyses of the instruments used thus far have been exploratory in nature. Confirmatory factor analytic approaches are used to extensively test the Health Professional Education in Patient Safety Survey (H-PEPSS), a newly designed survey rooted in a patient safety competency framework and designed to measure health professionals' self-reported patient safety competence around the time of entry to practice. The H-PEPSS focuses primarily on the socio-cultural aspects of patient safety including culture, teamwork, communication, managing risk and understanding human factors. Results support a parsimonious six-factor measurement model of health professionals' perceptions of patient safety competency. These results support the validity of a reduced version of the H-PEPSS and suggest it can be appropriately used at or near training completion with a variety of health professional groups. Given increased demands for patient safety competency among health professionals at entry to practice and slow, but emerging changes in health professional education, ongoing research to understand the extent of patient safety competency among health professionals around the time of entry to practice will be important.BMJ quality & safety 05/2012; 21(8):676-84. -
Article: A data quality control program for computer-assisted personal interviews.
[show abstract] [hide abstract]
ABSTRACT: Researchers strive to optimize data quality in order to ensure that study findings are valid and reliable. In this paper, we describe a data quality control program designed to maximize quality of survey data collected using computer-assisted personal interviews. The quality control program comprised three phases: (1) software development, (2) an interviewer quality control protocol, and (3) a data cleaning and processing protocol. To illustrate the value of the program, we assess its use in the Translating Research in Elder Care Study. We utilize data collected annually for two years from computer-assisted personal interviews with 3004 healthcare aides. Data quality was assessed using both survey and process data. Missing data and data errors were minimal. Mean and median values and standard deviations were within acceptable limits. Process data indicated that in only 3.4% and 4.0% of cases was the interviewer unable to conduct interviews in accordance with the details of the program. Interviewers' perceptions of interview quality also significantly improved between Years 1 and 2. While this data quality control program was demanding in terms of time and resources, we found that the benefits clearly outweighed the effort required to achieve high-quality data.Nursing research and practice. 01/2012; 2012:303816. -
Article: Safety incidents in family medicine.
[show abstract] [hide abstract]
ABSTRACT: To discuss the characteristics of incidents reported to the Medical Safety in Community Practice (MSCP) safety learning system. Members of family physician offices in the Alberta Health Services--Calgary zone, confidentially reported patient safety incidents via web or fax from September 2007 to August 2010. The incident reporting form contained both open-ended and closed questions. Incidents were reviewed for their characteristics. A total of 19 family practices participated in MSCP. A total of 264 useable reports were collected. Reporting was higher when practices first joined and then decreased. There was an average of 1.4 reports per month. Physicians submitted the majority of reports. Physicians and nurses were more likely to report an incident than office staff. The vast majority of reported incidents were judged to have 'virtually certain evidence of preventability' (93%). Harm was associated with 50% of incidents. Only 1% of the incidents had a severe impact. The top four types of incidents reported were documentation (41.4%), medication (29.7%), clinical administration (18.7%) and clinical process (17.5%). MSCP has developed and implemented the first safety learning system in Canada for family practice. All clinic members were encouraged to submit reports, but most of the incidents were reported by physicians. The vast majority of incidents reported were preventable with limited severity. The most frequently reported types of incidents fell into the categories of documentation and medication. The low reporting rates suggest that for family practices incident reporting may not be the most effective method to determine the types and frequency of incidents in family medicine.BMJ quality & safety 09/2011; 20(12):1005-10. -
Article: Staff, space, and time as dimensions of organizational slack: a psychometric assessment.
[show abstract] [hide abstract]
ABSTRACT: : In the theoretical and research literature, organizational slack has been largely described in terms of financial resources and its impact on organizational outcomes. However, empirical research is limited by unclear definitions and lack of standardized measures. : The aim of this study was to assess the psychometric properties of a new organizational slack measure in health care settings. : A total of 752 nurses and 197 allied health care professionals (AHCPs) employed in seven pediatric Canadian hospitals completed the Alberta Context Tool, an instrument measuring organizational context, which includes the newly developed organizational slack measure. The nine-item, 5-point Likert organizational slack measure includes items assessing staff perceptions of available human resources (staffing), time, and space. We report psychometric assessments, bivariate analyses, and data aggregation indices for the measure. : The findings indicate that the measure has three subscales (staff, space, and time) with acceptable internal consistency reliability (alphas for staff, space, and time, respectively:.83,.63, and.74 for nurses;.81,.52, and.76 for AHCPs), links theory and hypotheses (construct validity), and is related to other relevant variables. Within-group reliability measures indicate stronger agreement among nurses than AHCPs, more reliable aggregation results in all three subscales at the unit versus facility level, and higher explained variance and validity of aggregated scores at the unit level. : The proposed organizational slack measure assesses modifiable organizational factors in hospitals and has the potential to explain variance in important health care system outcomes. Further assessments of the psychometric properties of the organizational slack measure in acute and long-term care facilities are underway.Health care management review 06/2011; 36(3):252-64. · 1.30 Impact Factor -
Article: The care unit in nursing home research: evidence in support of a definition.
[show abstract] [hide abstract]
ABSTRACT: Defining what constitutes a resident care unit in nursing home research is both a conceptual and practical challenge. The aim of this paper is to provide evidence in support of a definition of care unit in nursing homes by demonstrating: (1) its feasibility for use in data collection, (2) the acceptability of aggregating individual responses to the unit level, and (3) the benefit of including unit level data in explanatory models. An observational study design was used. Research (project) managers, healthcare aides, care managers, nursing home administrators and directors of care from thirty-six nursing homes in the Canadian prairie provinces of Alberta, Saskatchewan and Manitoba provided data for the study. A definition of care unit was developed and applied in data collection and analyses. A debriefing session was held with research managers to investigate their experiences with using the care unit definition. In addition, survey responses from 1258 healthcare aides in 25 of the 36 nursing homes in the study, that had more than one care unit, were analyzed using a multi-level modeling approach. Trained field workers administered the Alberta Context Tool (ACT), a 58-item self-report survey reflecting 10 organizational context concepts, to healthcare aides using computer assisted personal interviews. To assess the appropriateness of obtaining unit level scores, we assessed aggregation statistics (ICC(1), ICC(2), η², and ω²), and to assess the value of using the definition of unit in explanatory models, we performed multi-level modeling. In 10 of the 36 nursing homes, the care unit definition developed was used to align the survey data (for analytic purposes) to specific care units as designated by our definition, from that reported by the facility administrator. The aggregation statistics supported aggregating the healthcare aide responses on the ACT to the realigned unit level. Findings from the multi-level modeling further supported unit level aggregation. A significantly higher percentage of variance was explained in the ACT concepts at the unit level compared to the individual and/or nursing home levels. The statistical results support the use of our definition of care unit in nursing home research in the Canadian prairie provinces. Beyond research convenience however, the results also support the resident unit as an important Clinical Microsystem to which future interventions designed to improve resident quality of care and staff (healthcare aide) worklife should be targeted.BMC Medical Research Methodology 01/2011; 11:46. · 2.67 Impact Factor -
Article: ïSCOPE: Safer care for older persons (in residential) environments: A study protocol.
[show abstract] [hide abstract]
ABSTRACT: ABSTRACT: The current profile of residents living in Canadian nursing homes includes elder persons with complex physical and social needs. High resident acuity can result in increased staff workload and decreased quality of work life. Safer Care for Older Persons [in residential] Environments is a two year (2010 to 2012) proof-of-principle pilot study conducted in seven nursing homes in western Canada. The purpose of the study is to evaluate the feasibility of engaging front line staff to use quality improvement methods to integrate best practices into resident care. The goals of the study are to improve the quality of work life for staff, in particular healthcare aides, and to improve residents' quality of life. The study has parallel research and quality improvement intervention arms. It includes an education and support intervention for direct caregivers to improve the safety and quality of their care delivery. We hypothesize that this intervention will improve not only the care provided to residents but also the quality of work life for healthcare aides. The study employs tools adapted from the Institute for Healthcare Improvement's Breakthrough Series: Collaborative Model and Canada's Safer Healthcare Now! improvement campaign. Local improvement teams in each nursing home (1 to 2 per facility) are led by healthcare aides (non-regulated caregivers) and focus on the management of specific areas of resident care. Critical elements of the program include local measurement, virtual and face-to-face learning sessions involving change management, quality improvement methods and clinical expertise, ongoing virtual and in person support, and networking. There are two sustainability challenges in this study: ongoing staff and leadership engagement, and organizational infrastructure. Addressing these challenges will require strategic planning with input from key stakeholders for sustaining quality improvement initiatives in the long-term care sector.Implementation Science 01/2011; 6:71. · 3.10 Impact Factor -
Article: Advancing the argument for validity of the Alberta Context Tool with healthcare aides in residential long-term care.
[show abstract] [hide abstract]
ABSTRACT: Organizational context has the potential to influence the use of new knowledge. However, despite advances in understanding the theoretical base of organizational context, its measurement has not been adequately addressed, limiting our ability to quantify and assess context in healthcare settings and thus, advance development of contextual interventions to improve patient care. We developed the Alberta Context Tool (the ACT) to address this concern. It consists of 58 items representing 10 modifiable contextual concepts. We reported the initial validation of the ACT in 2009. This paper presents the second stage of the psychometric validation of the ACT. We used the Standards for Educational and Psychological Testing to frame our validity assessment. Data from 645 English speaking healthcare aides from 25 urban residential long-term care facilities (nursing homes) in the three Canadian Prairie Provinces were used for this stage of validation. In this stage we focused on: (1) advanced aspects of internal structure (e.g., confirmatory factor analysis) and (2) relations with other variables validity evidence. To assess reliability and validity of scores obtained using the ACT we conducted: Cronbach's alpha, confirmatory factor analysis, analysis of variance, and tests of association. We also assessed the performance of the ACT when individual responses were aggregated to the care unit level, because the instrument was developed to obtain unit-level scores of context. Item-total correlations exceeded acceptable standards (> 0.3) for the majority of items (51 of 58). We ran three confirmatory factor models. Model 1 (all ACT items) displayed unacceptable fit overall and for five specific items (1 item on adequate space for resident care in the Organizational Slack-Space ACT concept and 4 items on use of electronic resources in the Structural and Electronic Resources ACT concept). This prompted specification of two additional models. Model 2 used the 7 scaled ACT concepts while Model 3 used the 3 count-based ACT concepts. Both models displayed substantially improved fit in comparison to Model 1. Cronbach's alpha for the 10 ACT concepts ranged from 0.37 to 0.92 with 2 concepts performing below the commonly accepted standard of 0.70. Bivariate associations between the ACT concepts and instrumental research utilization levels (which the ACT should predict) were statistically significant at the 5% level for 8 of the 10 ACT concepts. The majority (8/10) of the ACT concepts also showed a statistically significant trend of increasing mean scores when arrayed across the lowest to the highest levels of instrumental research use. The validation process in this study demonstrated additional empirical support for construct validity of the ACT, when completed by healthcare aides in nursing homes. The overall pattern of the data was consistent with the structure hypothesized in the development of the ACT and supports the ACT as an appropriate measure for assessing organizational context in nursing homes. Caution should be applied in using the one space and four electronic resource items that displayed misfit in this study with healthcare aides until further assessments are made.BMC Medical Research Methodology 01/2011; 11:107. · 2.67 Impact Factor -
Article: The relationship between organizational leadership for safety and learning from patient safety events.
[show abstract] [hide abstract]
ABSTRACT: To examine the relationship between organizational leadership for patient safety and five types of learning from patient safety events (PSEs). Forty-nine general acute care hospitals in Ontario, Canada. A nonexperimental design using cross-sectional surveys of hospital patient safety officers (PSOs) and patient care managers (PCMs). PSOs provided data on organization-level learning from (a) minor events, (b) moderate events, (c) major near misses, (d) major event analysis, and (e) major event dissemination/communication. PCMs provided data on organizational leadership (formal and informal) for patient safety. Hospitals were the unit of analysis. Seemingly unrelated regression was used to examine the influence of formal and informal leadership for safety on the five types of learning from PSEs. The interaction between leadership and hospital size was also examined. Formal organizational leadership for patient safety is an important predictor of learning from minor, moderate, and major near-miss events, and major event dissemination. This relationship is significantly stronger for small hospitals (<100 beds). We find support for the relationship between patient safety leadership and patient safety behaviors such as learning from safety events. Formal leadership support for safety is of particular importance in small organizations where the economic burden of safety programs is disproportionately large and formal leadership is closer to the front lines.Health Services Research 03/2010; 45(3):607-32. · 2.16 Impact Factor -
Article: The relationship between characteristics of context and research utilization in a pediatric setting.
[show abstract] [hide abstract]
ABSTRACT: Research utilization investigators have called for more focused examination of the influence of context on research utilization behaviors. Yet, up until recently, lack of instrumentation to identify and quantify aspects of organizational context that are integral to research use has significantly hampered these efforts. The Alberta Context Tool (ACT) was developed to assess the relationships between organizational factors and research utilization by a variety of healthcare professional groups. The purpose of this paper is to present findings from a pilot study using the ACT to elicit pediatric and neonatal healthcare professionals' perceptions of the organizational context in which they work and their use of research to inform practice. Specifically, we report on the relationship between dimensions of context, founded on the Promoting Action on Research Implementation in Health Services (PARIHS) framework, and self-reported research use behavior. A cross-sectional survey approach was employed using a version of the ACT, modified specifically for pediatric settings. The survey was administered to nurses working in three pediatric units in Alberta, Canada. Scores for three dimensions of context (culture, leadership and evaluation) were used to categorize respondent data into one of four context groups (high, moderately high, moderately low and low). We then examined the relationships between nurses' self-reported research use and their perceived context. A 69% response rate was achieved. Statistically significant differences in nurses' perceptions of culture, leadership and evaluation, and self-reported conceptual research use were found across the three units. Differences in instrumental research use across the three groups of nurses by unit were not significant. Higher self-reported instrumental and conceptual research use by all nurses in the sample was associated with more positive perceptions of their context. Overall, the results of this study lend support to the view that more positive contexts are associated with higher reports of research use in practice. These findings have implications for organizational endeavors to promote evidence-informed practice and maximize the quality of care. Importantly, these findings can be used to guide the development of interventions to target modifiable characteristics of organizational context that are influential in shaping research use behavior.BMC Health Services Research 01/2010; 10:168. · 1.66 Impact Factor -
Article: Development and assessment of the Alberta Context Tool.
[show abstract] [hide abstract]
ABSTRACT: The context of healthcare organizations such as hospitals is increasingly accepted as having the potential to influence the use of new knowledge. However, the mechanisms by which the organizational context influences evidence-based practices are not well understood. Current measures of organizational context lack a theory-informed approach, lack construct clarity and generally have modest psychometric properties. This paper presents the development and initial psychometric validation of the Alberta Context Tool (ACT), an eight dimension measure of organizational context for healthcare settings. Three principles guided the development of the ACT: substantive theory, brevity, and modifiability. The Promoting Action on Research Implementation in Health Services (PARiHS) framework and related literature were used to guide selection of items in the ACT. The ACT was required to be brief enough to be tolerated in busy and resource stretched work settings and to assess concepts of organizational context that were potentially modifiable. The English version of the ACT was completed by 764 nurses (752 valid responses) working in seven Canadian pediatric care hospitals as part of its initial validation. Cronbach's alpha, exploratory factor analysis, analysis of variance, and tests of association were used to assess instrument reliability and validity. Factor analysis indicated a 13-factor solution (accounting for 59.26% of the variance in 'organizational context'). The composition of the factors was similar to those originally conceptualized. Cronbach's alpha for the 13 factors ranged from .54 to .91 with 4 factors performing below the commonly accepted alpha cut off of .70. Bivariate associations between instrumental research utilization levels (which the ACT was developed to predict) and the ACT's 13 factors were statistically significant at the 5% level for 12 of the 13 factors. Each factor also showed a trend of increasing mean score ranging from the lowest level to the highest level of instrumental research use, indicating construct validity. To date, no completely satisfactory measures of organizational context are available for use in healthcare. The ACT assesses several core domains to provide a comprehensive account of organizational context in healthcare settings. The tool's strengths are its brevity (allowing it to be completed in busy healthcare settings) and its focus on dimensions of organizational context that are modifiable. Refinements of the instrument for acute, long term care, and home care settings are ongoing.BMC Health Services Research 12/2009; 9:234. · 1.66 Impact Factor -
Article: Development of a measure of patient safety event learning responses.
[show abstract] [hide abstract]
ABSTRACT: To define patient safety event (PSE) learning response and to provide preliminary validation of a measure of PSE learning response. Ten focus groups with front-line staff and managers, an expert panel, and cross-sectional survey data from patient safety officers in 54 general acute hospitals. A mixed methods study to define a measure of learning responses to patient safety failures that is rooted in theory, expert knowledge, and organizational practice realities. Learning response items developed from the literature were modified and validated in front-line staff and manager focus groups and by an expert panel and second group of external experts. Actual learning responses gleaned from survey data were examined using exploratory factor analyses and reliability analysis. Unique learning response items were identified for minor, moderate, major events, and major near misses by an expert panel. A two-factor model of major event learning response was identified (factor 1=event analysis, factor 2=dissemination/communication of learnings). Organizations engage in greater learning responses following major events than less severe events and, for major events, organizations engage in more factor 1 responses than factor 2 learning responses. Eleven to 13 items can measure learning responses to PSEs of differing severity. The items are feasible, grounded in theory, and reflect expert opinion as well as practice setting realities. The items have the potential for use to assess current practice in organizations and set future improvement goals.Health Services Research 10/2009; 44(6):2123-47. · 2.16 Impact Factor -
Article: Categorizing errors and adverse events for learning: a provider perspective.
[show abstract] [hide abstract]
ABSTRACT: There is little agreement in the literature as to what types of patient safety events (PSEs) should be the focus for learning, change and improvement, and we lack clear and universally accepted definitions of error. In particular, the way front-line providers or managers understand and categorize different types of errors, adverse events and near misses and the kinds of events this audience believes to be valuable for learning are not well understood. Focus groups of front-line providers, managers and patient safety officers were used to explore how people in healthcare organizations understand and categorize different types of PSEs in the context of bringing about learning from such events. A typology of PSEs was developed from the focus group data and then mailed, along with a short questionnaire, to focus group participants for member checking and validation. Four themes emerged from our data: (1) incidence study categories are problematic for those working in organizations; (2) preventable events should be the focus for learning; (3) near misses are an important but complex category, differentiated based on harm potential and proximity to patients; (4) staff disagree on whether events causing severe harm or events with harm potential are most valuable for learning. A typology of PSEs based on these themes and checked by focus group participants indicates that staff and their managers divide events into simple categories of minor and major events, which are differentiated based on harm or harm potential. Confusion surrounding patient safety terminology detracts from the abilities of providers to talk about and reflect on a range of PSEs, and from opportunities to enhance learning, reduce event reoccurrence and improve patient safety at the point of care.Healthcare quarterly (Toronto, Ont.) 01/2009; 12 Spec No Patient:154-60. -
Article: Advancing measurement of patient safety culture.
[show abstract] [hide abstract]
ABSTRACT: To examine the psychometric and unit of analysis/strength of culture issues in patient safety culture (PSC) measurement. Two cross-sectional surveys of health care staff in 10 Canadian health care organizations totaling 11,586 respondents. A cross-validation study of a measure of PSC using survey data gathered using the Modified Stanford PSC survey (MSI-2005 and MSI-2006); a within-group agreement analysis of MSI-2006 data. Extraction Methods. Exploratory factor analyses (EFA) of the MSI-05 survey data and confirmatory factor analysis (CFA) of the MSI-06 survey data; Rwg coefficients of homogeneity were calculated for 37 units and six organizations in the MSI-06 data set to examine within-group agreement. The CFA did not yield acceptable levels of fit. EFA and reliability analysis of MSI-06 data suggest two reliable dimensions of PSC: Organization leadership for safety (alpha=0.88) and Unit leadership for safety (alpha=0.81). Within-group agreement analysis shows stronger within-unit agreement than within-organization agreement on assessed PSC dimensions. The field of PSC measurement has not been able to meet strict requirements for sound measurement using conventional approaches of CFA. Additional work is needed to identify and soundly measure key dimensions of PSC. The field would also benefit from further attention to strength of culture/unit of analysis issues.Health Services Research 10/2008; 44(1):205-24. · 2.16 Impact Factor -
Article: Patient safety in cancer care: a time for action.
CancerSpectrum Knowledge Environment 05/2007; 99(8):579-80. · 14.07 Impact Factor
Top co-authors
Top Journals
Institutions
-
2012–2013
-
University of Ottawa
Ottawa, Ontario, Canada -
York University
- School of Health Policy and Management
Toronto, Ontario, Canada
-
-
2004–2012
-
The University of Calgary
- Department of Family Medicine
Calgary, Alberta, Canada
-
-
2009–2011
-
University of Alberta
- Faculty of Nursing
Edmonton, Alberta, Canada
-
-
2002
-
University of Toronto
- Department of Medicine
Toronto, Ontario, Canada
-
