Evaluation and program planning Journal Impact Factor & Information

Publisher: Elsevier

Current impact factor: 0.89

Impact Factor Rankings

Additional details

5-year impact 0.99
Cited half-life >10.0
Immediacy index 0.07
Eigenfactor 0.00
Article influence 0.34
ISSN 1873-7870

Publisher details


  • Pre-print
    • Author can archive a pre-print version
  • Post-print
    • Author can archive a post-print version
  • Conditions
    • Authors pre-print on any website, including arXiv and RePEC
    • Author's post-print on author's personal website immediately
    • Author's post-print on open access repository after an embargo period of between 12 months and 48 months
    • Permitted deposit due to Funding Body, Institutional and Governmental policy or mandate, may be required to comply with embargo periods of 12 months to 48 months
    • Author's post-print may be used to update arXiv and RepEC
    • Publisher's version/PDF cannot be used
    • Must link to publisher version with DOI
    • Author's post-print must be released with a Creative Commons Attribution Non-Commercial No Derivatives License
    • Publisher last reviewed on 03/06/2015
  • Classification

Publications in this journal

  • [Show abstract] [Hide abstract]
    ABSTRACT: Information on costs of programs addressing community integration for persons with serious mental illness in the United States, essential for program planning and evaluation, is largely lacking. To address this knowledge gap, community integration programs identified through directories and snowball sampling were sent an online survey addressing program costs and organizational attributes. 64 Responses were received for which annual per person costs (APPC) could be computed. Programs were categorized by type of services provided. Program types differed in median APPCs, though median APPCs identified were consistent with the ranges identified in the limited literature available. Multiple regression was used to identify organizational variables underlying APPCs such as psychosocial rehabilitation program type, provision of EBPs, number of volunteers, and percentage of budget spent on direct care staff, though effects sizes were moderate at best. This study adds tentative prices to the menu of community integration programs, and the implications of these findings for choosing, designing and evaluating programs addressing community integration are discussed.
    Evaluation and program planning 11/2015; 54:112-120. DOI:10.1016/j.evalprogplan.2015.10.005
  • [Show abstract] [Hide abstract]
    ABSTRACT: Maintaining contact with and collecting outcome data from adolescent study participants can present a significant challenge for researchers conducting longitudinal studies. Establishing an organized and effective protocol for participant follow-up is crucial to reduce attrition and maintain high retention rates. This paper describes our methods in using and adapting the evidence-based Engagement, Verification, Maintenance, and Confirmation (EVMC) model to follow up with adolescents 6 and 12 months after implementation of a health program. It extends previous research by focusing on two key modifications to the model: (1) the central role of cell phones and texting to maintain contact with study participants throughout the EVMC process and, (2) use of responsive two-way communication between staff and participants and flexible administration modes and methods in the confirmation phase to ensure that busy teens not only respond to contacts, but also complete data collection. These strategies have resulted in high overall retention rates (87-91%) with adolescent study participants at each follow-up data collection point without the utilization of other, more involved tracking measures. The methods and findings presented may be valuable for other researchers with limited resources planning for or engaged in collecting follow-up outcome data from adolescents enrolled in longitudinal studies.
    Evaluation and program planning 11/2015; 54:102-111. DOI:10.1016/j.evalprogplan.2015.10.003
  • [Show abstract] [Hide abstract]
    ABSTRACT: This exploratory study attempts to demonstrate the potential utility of crowdsourcing as a supplemental technique for quantifying transcribed interviews. Crowdsourcing is the harnessing of the abilities of many people to complete a specific task or a set of tasks. In this study multiple samples of crowdsourced individuals were asked to rate and select supporting quotes from two different transcripts. The findings indicate that the different crowdsourced samples produced nearly identical ratings of the transcripts, and were able to consistently select the same supporting text from the transcripts. These findings suggest that crowdsourcing, with further development, can potentially be used as a mixed method tool to offer a supplemental perspective on transcribed interviews.
    Evaluation and program planning 10/2015; 54:63-73. DOI:10.1016/j.evalprogplan.2015.09.002
  • [Show abstract] [Hide abstract]
    ABSTRACT: This article is part of a long term project "Promoting the Occupational Well-Being of School Staff-Action Research Project in Finland and Estonia, 2009-2014." The purpose of this article is to describe the significance of action plans in the promotion of the occupational well-being of primary and upper secondary school staff in Finland and Estonia from 2010 to the turn of the year 2011-2012. An electronic open questionnaire was sent to occupational well-being groups in Finland (N=18) and in Estonia (N=39). In Finland, the questionnaire was responded to by 16 (n=16) occupational well-being groups, and in Estonia, by 38 (n=38) groups. The qualitative data were analyzed using the inductive-deductive method and content analysis. The obtained results indicate that the schools had named goals for action plans in all aspects of the promotion of occupational well-being in schools (worker and work, working conditions, professional competence, working community) and that these goals were mainly realized in the schools in a systematic way. Schools felt that the action plan for occupational well-being helped them to set goals for occupational well-being and that the planned actions were realized in a more systematic way than before.
    Evaluation and program planning 10/2015; 54:74-81. DOI:10.1016/j.evalprogplan.2015.10.004
  • [Show abstract] [Hide abstract]
    ABSTRACT: In this study, a utilization-focused process evaluation framework was used to explore client and service providers' experiences of Crisis Management Services (CMS), their perceptions of the services provided, and the process of client engagement CMS offers. CMS is a strength-based program that targets individuals who experience crises every day. The Community-University Institute for Social Research facilitated the evaluation by engaging academic expertise in a coordinated collaborative approach to community-university partnerships. Semi-structured interviews were conducted with the clients and service providers. The general inductive approach was used for transcript analysis with seven themes emerging. A conceptual model of service delivery is presented, which integrates the interviews conducted with clients and service providers. Results affirm that the establishment of a close personal strength-based relationship is key to client engagement. Collaborative goal setting with informal and formal community resources viewed as potential assets, characterizes the process that enables clients to live at their optimal level of independence. This study is unique as it provides valuable insight on the perspectives of vulnerable individuals in crisis situations. Through the establishment of community-university partnerships the gap between scholarly research and its applicability to community organizations is narrowed with opportunities for improving the quality of life enhanced.
    Evaluation and program planning 10/2015; 54:50-62. DOI:10.1016/j.evalprogplan.2015.09.001
  • [Show abstract] [Hide abstract]
    ABSTRACT: This study shows the use of SWOT to analyse students' perceptions of an environmental education joint master's programme in order to determine if it runs as originally planned. The open answers given by students highlight the inter-university nature of the master's, the technological innovation used as major points, and the weaknesses in the management coordination or the duplicate contents as minor points. The external analysis is closely linked with the students' future jobs, their labour opportunities available to them after graduation. The innovative treatment of the data is exportable to the evaluation of programmes of other degrees because it allows the description linked to its characteristics and its design through the students' point of view.
    Evaluation and program planning 10/2015; 54:41-49. DOI:10.1016/j.evalprogplan.2015.10.001
  • [Show abstract] [Hide abstract]
    ABSTRACT: This paper presents a model for effective planning of support services for small and medium-sized enterprises (SMEs). The idea is to scrutinize and measure the suitability of support services in order to give recommendations for the improvement of a support planning process. We examined the applied support services and matched them with the problems and needs of SMEs, based on the survey conducted in 2013 on a sample of 336 SMEs in Serbia. We defined and analysed the five research questions that refer to support services, their consistency with the SMEs' problems and needs, and the relation between the given support and SMEs' success. The survey results have shown a statistically significant connection between them. Based on this result, we proposed an eight-phase model as a method for the improvement of support service planning for SMEs. This model helps SMEs to plan better their requirements in terms of support; government and administration bodies at all levels and organizations that provide support services to understand better SMEs' problems and needs for support.
    Evaluation and program planning 10/2015; 54. DOI:10.1016/j.evalprogplan.2015.09.004
  • [Show abstract] [Hide abstract]
    ABSTRACT: Background: Following violent conflict, the continued presence of landmines and unexploded ordnance pose a barrier to rebuilding livelihoods. Mine action removes these explosive remnants of conflict to enable communities to safely return contaminated land to productive use. There is limited understanding, however, of how, why, in what context and in what respects mine action contributes to livelihoods. Yet, such information is required for effective resource allocation, checking underlying program assumptions, understanding benefits and potential harms. Methods: The evaluation was undertaken in the Lao People's Democratic Republic. It used an interpretive case study design and applied the principles of realist evaluation. Program staff and local government authorities were interviewed (N=37) and program beneficiaries. In total, 38 individual interviews with program beneficiaries were conducted and eighteen focus group interviews (9 with males, 9 with females), each with 6-9 participants. Results: The evaluation identified two main mechanisms through which the program 'worked': (1) communication pre- and post-clearance and (2) the delivery of the product (cleared land). Conclusion: The realist approach helped to refine the program theory, highlighted the role of self- and task-efficacy and community communication, assisted in identifying contextual factors that influence outcomes and suggested a revision of expected outcomes.
    Evaluation and program planning 10/2015; 54. DOI:10.1016/j.evalprogplan.2015.09.005
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Objective: To develop a framework for evaluating and monitoring a primary health care service, integrating hospital and community services. Method: A targeted literature review of primary health service evaluation frameworks was performed to inform the development of the framework specifically for remote communities. Key principles underlying primary health care evaluation were determined and sentinel indicators developed to operationalise the evaluation framework. This framework was then validated with key stakeholders. Results: The framework includes Donabedian's three seminal domains of structure, process and outcomes to determine health service performance. These in turn are dependent on sustainability, quality of patient care and the determinants of health to provide a comprehensive health service evaluation framework. The principles underpinning primary health service evaluation were pertinent to health services in remote contexts. Sentinel indicators were developed to fit the demographic characteristics and health needs of the population. Consultation with key stakeholders confirmed that the evaluation framework was applicable. Conclusion: Data collected routinely by health services can be used to operationalise the proposed health service evaluation framework. Use of an evaluation framework which links policy and health service performance to health outcomes will assist health services to improve performance as part of a continuous quality improvement cycle.
    Evaluation and program planning 09/2015; 53:91-98. DOI:10.1016/j.evalprogplan.2015.08.006
  • [Show abstract] [Hide abstract]
    ABSTRACT: Citizen Review Panels (CRPs) are groups of citizen volunteers authorized by U.S. federal law to examine state child welfare agencies. These groups inspect policies and practices related to child protection responsibilities and are tasked with making recommendations for systemic improvement. Despite the federal mandate for each state to develop a CRP and the potential of these groups to positively impact child welfare practices, there is a dearth in the literature related to CRPs. Consequently, planning and evaluation processes of these groups vary widely. This study reports on the use of concept mapping (CM) to outline a framework for planning and subsequently evaluating the CRP in one southeastern state. CM is a mixed-method research approach that uses multi-dimensional scaling and hierarchical cluster analyses to explore an area of study. Through these analyses, the method creates visual depictions of conceptual relationships between ideas. Data yielded a seven cluster concept map that CRP members (N=36) utilized for planning processes, and subsequently for developing an internal evaluation tool. Results from this study offer a unifying framework by which CRPs, and similar groups in other areas can utilize for planning and evaluation purposes. After a review of pertinent literature on CRPs, this article explicates CM processes utilized in this study, describes results, discusses lessons learned, and outlines apposite areas for future CRP research.
    Evaluation and program planning 09/2015; 53:99-106. DOI:10.1016/j.evalprogplan.2015.08.001
  • [Show abstract] [Hide abstract]
    ABSTRACT: The Centers for Disease Control and Prevention's Division of Violence Prevention (DVP) funded eight National Academic Centers of Excellence (ACEs) in Youth Violence Prevention from 2005 to 2010 and two Urban Partnership Academic Centers of Excellence (UPACEs) in Youth Violence Prevention from 2006 to 2011. The ACEs and UPACEs constitute DVP's 2005-2011 ACE Program. ACE Program goals include partnering with communities to promote youth violence (YV) prevention and fostering connections between research and community practice. This article describes a qualitative evaluation of the 2005-2011 ACE Program using an innovative approach for collecting and analyzing data from multiple large research centers via a web-based Information System (ACE-IS). The ACE-IS was established as an efficient mechanism to collect and document ACE research and programmatic activities. Performance indicators for the ACE Program were established in an ACE Program logic model. Data on performance indicators were collected through the ACE-IS biannually. Data assessed Centers' ability to develop, implement, and evaluate YV prevention activities. Performance indicator data demonstrate substantial progress on Centers' research in YV risk and protective factors, community partnerships, and other accomplishments. Findings provide important lessons learned, illustrate progress made by the Centers, and point to new directions for YV prevention research and programmatic efforts. Published by Elsevier Ltd.
    Evaluation and program planning 08/2015; 53:80-90. DOI:10.1016/j.evalprogplan.2015.08.005
  • [Show abstract] [Hide abstract]
    ABSTRACT: Google Street View (GSV) can be used as an effective tool to conduct virtual neighborhood audits. We expand on this research by exploring the utility of a GSV-based neighborhood audit to measure and match target and comparison study areas. We developed a GSV-based inventory to measure characteristics of retail alcohol stores and their surrounding neighborhoods. We assessed its reliability and assessed the utility of GSV-based audits for matching target and comparison study areas. We found that GSV-based neighborhood audits can be a useful, reliable, and cost-effective tool for matching target and comparison study areas when archival data are insufficient and primary data collection is prohibitive. We suggest that researchers focus on characteristics that are easily visible on GSV and are relatively stable over time when creating future GSV-based measuring and matching tools. Dividing the study area into small segments may also provide more accurate measurements and more precise matching. Copyright © 2015 Elsevier Ltd. All rights reserved.
    Evaluation and program planning 08/2015; 53:72-79. DOI:10.1016/j.evalprogplan.2015.08.002
  • [Show abstract] [Hide abstract]
    ABSTRACT: The arts have been integral to the human experience fostering innovation in social arrangements, strengthening group cohesion, and merging esthetics with the utilitarian properties of technology. For intervention design research in the human services the arts can harness innovation and creativity in meeting human needs and addressing social issues. Given their capacities to stimulate expression of first person experience through interpretative strategies, the arts can equip people and groups, including researchers, with opportunities to express primary experiential knowledge through creative means, portray useful ways of meeting human needs, educate others about the social issues people experience, and formulate intervention strategies or even models to address the causes and consequences of those issues. In this paper, the authors discuss how the arts can inform and deepen human service intervention design and development and, as a result, advance innovation in the human services. They offer a rationale supporting the inclusion of the arts in the design of human service interventions, examine the contributions of the arts to the formulation of intervention concept and developmental research to further improve interventions, and consider how the arts can advance the reflexivity of intervention designers. The authors draw implications for how researchers can position the arts in the nine steps of intervention design and development the authors offer in this paper. Copyright © 2015 Elsevier Ltd. All rights reserved.
    Evaluation and program planning 07/2015; 53:34-43. DOI:10.1016/j.evalprogplan.2015.07.013
  • [Show abstract] [Hide abstract]
    ABSTRACT: This article describes a pilot study of a "bottom up" dissemination process of a new evidence based intervention for treating early childhood trauma. Clinicians applied to learn Child-Parent Psychotherapy (CPP), imported to Israel from the U.S. A focus group of six graduates of a CPP training program responded to questions concerning their experiences learning and using CPP. All 39 CPP graduates from two cohorts also completed a cross sectional survey related to their use of CPP. Within the focus group, the openness of the workplace and the intervention's characteristics were considered major factors impacting CPP use; the training program was perceived to promote CPP implementation, and lack of supervision and secondary traumatic stress were the major inhibiting factors. Using CPP-informed therapy, as opposed to CPP with fidelity, was perceived to be one of the main outcomes of the training. Survey results showed that 53% of graduates were using CPP in over three cases, and almost all intended to use CPP within the next year. Ninety-five percent were using CPP principles in their therapeutic work. The implications of importing a new evidence based intervention to a foreign country that utilizes a different dissemination system within a different professional culture are discussed. Copyright © 2015 Elsevier Ltd. All rights reserved.
    Evaluation and program planning 07/2015; 53:18-24. DOI:10.1016/j.evalprogplan.2015.07.012