Article

Logic models: A tool for telling your program's performance story

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract

Program managers across private and public sectors are being asked to describe and evaluate their programs in new ways. People want managers to present a logical argument for how and why the program is addressing a specific customer need and how measurement and evaluation will assess and improve program effectiveness. Managers do not have clear and logically consistent methods to help them with this task. This paper describes a Logic Model process, a tool used by program evaluators, in enough detail that managers can use it to develop and tell the performance story for their program. The Logic Model describes the logical linkages among program resources, activities, outputs, customers reached, and short, intermediate and longer term outcomes. Once this model of expected performance is produced, critical measurement areas can be identified. © 1999 Elsevier Science Ltd. All rights reserved.

No full-text available

Request Full-text Paper PDF

To read the full-text of this research,
you can request a copy directly from the authors.

... Therefore, studies such as this one will be more effective when the results are used in the direction of policy-making and the formulation of health programs. One of the appropriate tools for designing health programs, especially in the field of reproductive health, is the logical model [22]. A logic model is a programming tool used to visualize the inputs and activities of a program and the expected results of the program. ...
... In this phase, a nominal group technique (NGT) will be used to validate the designed program in the presence of a group of experts [22,31]. This technique is an important method for validating programs [32]. ...
... In the second part of the study, the researchers will try to provide a results-based logic model for a healthy public policy to reduce or prevent these procedures by understanding the decision-making process of women and using the points of view of key informants. The logical model is one of the successful tools for planning in health fields [22]. For example, this model has been used in the design of programs to prevent HIV, sexual violence, domestic violence, homelessness in drug addicts and obesity in teenagers [26][27][28][37][38][39]. ...
Article
Full-text available
Background Female genital cosmetic procedures have grown rapidly in most parts of the world. Professional organizations have issued warnings about the complications and long-term consequences of these practices. To be able to adopt the right health policies, it is necessary to know why women decide to perform these procedures. Therefore, the present study will be aim to discover the decision-making process involved in performing female genital cosmetic procedures for Iranian women and construct and validate a results-based logic model for healthy public policy. Methods The present study was conducted in three phases. In the initial phase, a qualitative study will be conducted with the Corbin and Strauss ground theory approach. The participants in the study will be healthy women who desire or have undergone female genital cosmetic procedures without medical indications. In this phase, purposive and theoretical sampling will guide recruitment and data collection. The data will be collected via semi-structured interviews, field notes and observations of individual interactions. The data will be analysed using the approach of Corbin and Strauss (2015). MAXQDA 2007 software was used for managing the process of data analysis. In the second phase, the development of a results-based logic model for a healthy public policy is performed based on the findings of the first phase of the study, interviews with key informants and a review of the results of the literature in this field. Finally, validation of the designed program will be performed by the nominal group technique with the presence of a group of experts in the third phase. Discussion The findings of this study, by identifying women’s main concerns related to the studied phenomenon, the existing context, participants’ reactions and the consequences of the adopted reactions, can be very important in designing a program that fits Iran’s cultural characteristics. In this research, a program using a logical model will be presented that is suitable for policymakers, planners and healthcare service providers to be implemented in the social-cultural context of the study.
... The popularity of logic models stems from their ease of use and perceived utility in guiding program management. [1,[21][22][23]. For collaborators, logic models facilitate program planning and communication [10] by building a shared mental model and common language representing diverse perspectives. ...
... Logic models are not scale-dependent; they can be used in large impact studies, or small pilot studies. They also require few resources to develop, making them a cost-effective tool for articulating a theory of change [23,25,26]. ...
... At the same time, we can build an evidence base of what works by connecting to and building on what is known or learned about the efficacy of interventions. As explained by McLaughlin and Jordan (1999) [23]: ...
Article
Full-text available
Logic models have been the mainstay of evaluation for many years. But what happens when the logic is illogical or incomplete? These widely used popular tools have many shortcomings that can misguide evaluation itself. A systems view remedies these shortcomings and reveals extended logic that can be incorporated into a new kind of logic model that becomes the foundation of system evaluation in the future. In this chapter, we articulate a new model derived directly from the theory of change that aptly guides the evaluation of any complex system, problem, or issue. In addition, we explain how programmatic systems based program evaluations ‘roll up’ to important ideas around collective impact.
... Outcomes are the changes or benefits derived from activities. In education, changes in knowledge of the target population can be given as an example for outcomes (McLaughlin & Jordan, 1999;Savaya & Waysman, 2005). ...
... In the last step, the logic model is shared with the participants to achieve a mutual understanding of each element. All in all, logic modelling can be used for the purposes of program planning, promoting evaluation of an existing program as well as generating a clear and shared understanding of how a program works (Martin & Carey, 2014;McLaughlin & Jordan, 1999). Facilitating communication and cooperation between stakeholders in addition to displaying logical linkages between the elements in a program; logic modeling plays a major role within this current study which particularly attempts to find out any causal connection between writing course activities and program outcomes, thus providing accountability for the program. ...
... The Logic Model 1 (see Figure 3) essentially shows the contextual factors defined as inputs, the planned activities to help realize the outcomes and the intended course outcomes. The main philosophy behind the logic model can be summarized as follows: under certain circumstances (contextual factors, external factors, resources at present), if the program users employ the activities, then they will produce the expected-intended outcomes (McLaughlin & Jordan, 1999). Accordingly, the present Logic Model 1 reveals that although the activities reported by both instructors may be regarded as coherent in relation to the outcomes they support (written in bold), the allocated time for instruction appears to be a barrier for the successful implementation of them. ...
... A logic model graphically depicts the relationships between inputs to programs or projects and their intended outputs and outcomes, thus also showing the underlying theories and assumptions (McLaughlin and Jordan, 1999). Such comprehensive systems thinking is particularly necessary in complex social interventions and open systems, where a simple bivariate relationship between intervention and outcome can never be assumed (Anderson et al., 2011). ...
... A logic model illustrates the relationships between inputs to programs or projects and their intended outputs and outcomes (McLaughlin and Jordan, 1999). The model is presented graphically in Fig. 3 to make the assessment of a complex issue as clear as possible. ...
... Logic models can be referred to as 'chains of reasoning' or 'logical framework'. (11) The model allows for the connections to be organised between the resources needed to run a program, the actions and activities required to implement the program, and the changes or outcomes to be achieved. (11) With the phases of the logic model in mind, the workshops asked: 'What are the top three possible barriers to inclusion in research or practice?' (table 1). ...
... (11) The model allows for the connections to be organised between the resources needed to run a program, the actions and activities required to implement the program, and the changes or outcomes to be achieved. (11) With the phases of the logic model in mind, the workshops asked: 'What are the top three possible barriers to inclusion in research or practice?' (table 1). From a list of nine types of potential barriers to inclusion, each community was asked to select the most critical barrier within their area of practice or experience. ...
Article
Full-text available
Introduction: The United Kingdom Rare Diseases Framework, published in 2021, addresses the lack of diversity in rare disease research, particularly in clinical trials, due to intersecting issues related to rare disease symptoms and health inequalities. The framework outlines the government's commitment to improving the lives of the 3.5 million people living with rare conditions in the United Kingdom.Objective: The primary objective is to advance equality, diversity, and inclusion in research by developing innovative methods to engage with communities, establish trust, and enhance the participation and voices of underrepresented and underserved communities.Methods: The conference was held in May 2023, bringing together voices with lived experiences from rare and diverse communities to meet and discuss with established researchers, policy influencers and advocates. The evaluation design was developed using the Program Logic Model and utilised a conference evaluation form on barriers to inclusion.Results: The Rare Disease Community identifies disability as the primary obstacle to inclusion. Social Care and Public Health Communities and Clinical Research Communities identified a need for more cultural competency. The Diverse Community selected psychosocial issues, and the Academic Community identified funding as the most significant barrier.Conclusions: The Community of Practice workshops showed the variety of lived experiences and potential barriers people confront for inclusion in research. Listening to individual viewpoints was crucial to creating or repairing community trust. The Academic Community felt that research funders and ethics review boards must adapt their institutional practices to include financial resources for outreach and participation in research design.
... 15,19,20,[30][31][32] These external forces, outside the clinic's control, can support or impede the clinic's success. 15,32,33 As depicted in Figure 1, the context influences all components of the SRFC. ...
... Outputs include data on everyone the SRFC reaches and the size and scope of this reach. 15,33 Contrasted with the outcomes, which are measurable changes in the stakeholders, outputs are information as a result of the delivery of the activities. 15 For example, in order to improve patients' health management, the SRFC needs to know the number of patients who are actually being seen for this type of care. ...
Article
Full-text available
Student-run free clinics (SRFCs) are an important part of the American healthcare system, providing free services to many individuals in need. Patients report improvements after care in an SRFC, and students develop skills requisite for practice. Current literature describes outcomes at SRFCs for patients and students but fails to provide a solid model to guide planning, implementation, and evaluation of SRFCs’ success. This paper presents the SRFC logic model, a contextually based model that is useful throughout the life of an SRFC. The SRFC logic model utilizes a backward design process for planning a new SRFC. The same five components examined in the planning process are performed in reverse order during the implementation and evaluation phases. The planning phase begins by identifying the impact that the SRFC hopes to make, followed by defining the measurable outcomes the SRFC expects to achieve. Outputs are projected to examine the reach of the SRFC. Specific activities to produce the desired output and outcomes are defined. Lastly, the inputs needed to complete the activities are identified. Implementation of the SRFC addresses the same components in a forward direction. Evaluation is performed iteratively, allowing for adjustments to ensure that the SRFC is achieving its targeted outcomes. The logic model described in this paper can be used across healthcare disciplines and settings to plan, implement, and evaluate an SRFC and to demonstrate its significance to all stakeholders.
... To emphasize the two dimensions, the concept of sustainability impact assessment emerged to designate "any process aiming to achieve sustainability goals and to make sustainability issues tangible and understandable based on a decision-guiding approach that helps to identify, structure and evaluate the sustainability impact of past current and/or planned actions" (Trautwein, 2021: 3). While an organization's sustainability impact can be defined in different ways (Souza et al., 2015;Maas and Liket, 2011), the Theory of Change (Funnell and Rogers, 2011;McLaughlin and Jordan, 1999) and its Input-Output-Outcome-Impact approach is often used. It emphasizes that an activity (input) creates countable results (output), which have effects on stakeholders (outcome), thus leading to macro-and medium-level effects and long-term change (impact). ...
Thesis
Full-text available
Traditionally known for their contribution to innovation and the economy, startups are now considered promising organizations for addressing social and environmental issues. However, turning to startups is not straightforward. Not only does such an expectation add to the already challenging task of launching a startup, but the contribution of startups to sustainability is difficult to determine due to the uncertainty that characterizes them. Therefore, the aim of this research is to explore how startups tackle sustainability given the significant uncertainty. While the literature has extensively explored the practices of large companies, little information is available for smaller ones. According to the literature, they not only face less pressure from stakeholders but also seem to perceive fewer benefits in engaging in sustainable development. The field of sustainable entrepreneurship has begun to fill this gap, but the specific case of startups remains largely overlooked. Providing such knowledge is crucial not only for startups but also for their stakeholders and decision-makers who currently lack information on what to expect from startups in terms of social and environmental impact. So far, research has demonstrated the complexity of the subject and suggested frameworks for assessing their contribution to sustainability. However, startups’ perspective is lacking, especially on how they tackle in the absence of shared norms and practices in the entrepreneurial ecosystem. Given the novelty and complexity of the phenomenon, an exploratory approach was favored. A 36-month action research in an incubator of young innovative startups allowed the collection of various types of data, including direct observations, interviews, and archival documents. Instead of aiming for generalization, this qualitative and comprehensive approach seeks to reveal the practices, challenges, and trade-offs of the actors to better understand the mechanisms at play and how actions are taken. The research drew inspiration from issues met on the field, following an abductive process where surprises led to the identification of sub-research questions. The results are articulated around three research articles, highlighting different aspects of the phenomenon. Sustainability for startups is seen as part of the entrepreneurial process (1), as embedded into an entrepreneurial ecosystem (2), and as a new requirement demanded by public actors (3). The immersive framework revealed that actors acted in favor of sustainability based on the meaning they attributed to this still abstract concept, and that this meaning continually evolved through an interactive and interpretative process. Such a symbolic interactionist perspective enriches the literature by proposing an original approach to describing the management of uncertainty in a complex problem. By combining the results of the three research articles, the thesis focused on an entrepreneurial ecosystem in transition and suggested a new definition for sustainable startups. In line with the collective and contextual approach, the research mobilized the concept of improvisation to emphasize that sustainability for startups is not a static object, leading startups to consider their changing environment. The processual approach contributed to both the literature on sustainable entrepreneurship and the emerging field of research on evaluating the impact of sustainability for startups. Practical recommendations for startups and decision-makers were also provided.
... Although it was not explicitly addressed in Mergel et al. (2019)'s study, there seems to be a sequential causal relationship among outputs, outcomes, and impacts. As highlighted in the five-stage model within the program evaluation literature (e.g., Gerrish, 2016;McLaughlin & Jordan, 1999), inputs are translated into activities, which generate outputs such as products, goods, and services for customers. Subsequently, these outputs lead to outcomes, which are then realized as the program's long-term impacts. ...
Article
Full-text available
The use of artificial intelligence (AI) chatbots in the public sector worldwide has increased in recent years. Despite its increasing use, public administration research in this area faces some limitations. First, much of the current research is theoretical and normative, lacking substantial empirical data to assess the results of chatbots. Second, the specific effects of chatbots on government organization operations and their interactions with the public are not well understood. The purpose of this empirical study is to explore how chatbots influence government operations and their relationship with citizens. We conducted in-depth interviews with officials and employees from twenty-two state agencies in the United States. Leveraging insights from public sector innovation and digital transformation literature, our study reveals various process- and product-related outputs and outcomes within organizations and in government-citizen interactions stemming from chatbot use.
... Source: adapted by author from Goeschel, Weiss, Pronovost, 2012. One of the earliest examples of using the model as an evaluation tool was provided by Weiss in 1972 and by McLaughlin and Jordon (1999) who observed: "Evaluators have found the logic model process useful for at least twenty years" (p. 66). ...
Thesis
Full-text available
Tourism is a complex industry with extensive value chains and is frequently engaged as a tool to increase economic growth and development in the Pacific. With the ability to leverage exposure to international markets and facilitate opportunities to increase domestic income while showcasing the unique cultural and social environments of developing communities, tourism offers a progressive foundation for growth. However, how benefits are generated, for whom and in what respects remain highly debated. Limitations to existing evaluation methods have resulted in uncertainties about benefits to developing communities with current academic debates suggesting more sophisticated and context-specific approaches which can adapt to changing environments, capture stakeholders’ views and incorporate methods such as the realist evaluation methodology are required. The research question analysed in this thesis was “What are the advantages of using the realist evaluation methodology when assessing benefits to developing communities through tourism?”. To answer the question, three components of the realist evaluation methodology were applied to examine benefits from tourism in the Solomon Islands. Several pre-existing challenges to benefit developing communities through tourism interventions were identified in a review of literature, confirming limitations to current evaluation methods used to assess development interventions. Subsequently, three subquestions were developed: 1. Are evaluation methods used to support tourism interventions in the Solomon Islands? 2. What are the considerations for developing an evaluation tool to increase benefits to developing communities through tourism interventions in the Solomon Islands? 3. How can using the realist evaluation methodology to evaluate tourism interventions increase benefits to developing communities? Through a mixed methods approach using inductive research methods over two stages, this research examined the advantages of using the realist evaluation methodology to assess tourism as an intervention in a developing country. To capture the contextual layers of stakeholders working in and servicing tourism in the Solomon Islands, survey and focus group participants were recruited using stratified sampling. The Context, Mechanism and Outcome configuration was used to assess the context in which benefits were being generated through tourism and the expected outcomes by stakeholders about the benefits and beneficiaries of tourism interventions. Furthermore, this research has demonstrated how a holistic understanding to increase the effectiveness of tourism interventions can be delivered by evaluating what works, for whom, how and in what circumstances and respects? Realism is a philosophy which sits between positivism, a thing that exists in the real world which can be directly observed and facts can be derived from, and constructivism, referred to as being formed from observations and scrutinised through human senses and the human brain (Pawson, 2006). To the researcher’s knowledge, the realist evaluation methodology which derives from realism, has not previously been used in the Pacific to evaluate tourism interventions. Applying a realist lens, this research has examined the interrelationships between benefits, beneficiaries and impacts from tourism in a developing country. As a sophisticated method, the realist evaluation methodology can overcome some of the existing limitations experienced with frequently applied models including the logical framework, participatory evaluation and impact assessment. These difficulties include applying results and effecting changes in policy and programs, inflexible approaches with predetermined outcomes, a lack of focus on beneficiaries and high costs resulting in reduced benefits. Using a realist approach demonstrated the methodology provided the ability to apply results and develop evidence to inform changes in policy and programs. Furthermore, the flexible approach enabled the researcher to capture all outcomes during the evaluation process which provided a holistic focus on benefits and beneficiaries of tourism in a developing country. Lastly, the methodology was also cost effective and easy to use where stakeholders identified that most, if not all outcomes could be applied to increase local benefits through tourism. With a paucity of research to inform policymakers of likely attitudes amongst stakeholders, varied perceptions about how local people could benefit from tourism interventions existed prior to this research. The research findings demonstrated that rigorous, transparent, and inclusive approaches could assist to identify the underlying causal mechanisms of interventions to sustainably increase benefits to communities. As a small and fragile industry, which can permanently impact local people and the environment, tourism stakeholders have called for sophisticated and systematic evaluation approaches with the capability to strengthen institutional frameworks. The research found that holistic approaches could aid communities to better manage cultural and physical environments to increase local benefits. Building on this knowledge, a conceptual model to evaluate tourism interventions using a realist approach was developed to explain how benefits could be increased through evaluation processes. The model suggests the methodology is implemented through three focus areas (purpose, approach and outcomes), over four phases to examine what works, for whom, how, in what circumstances and respects.
... A full account of ISAFE is presented in the intervention protocol published by Foundations (Davies et al., 2023), but a summary can be seen in the logic model ( Fig. 1). A logic model is a tool that summarises the logical linkages between intervention resources, activities, outputs, and outcomes, in both the shorter and longer terms (McLaughlin & Jordan, 1999). This one was developed by the intervention team in discussion with the evaluation team. ...
Article
Full-text available
There is a long-standing and ongoing problem of practice with at-risk families in child welfare work focusing primarily on mothers and failing to properly engage fathers. The article describes a child welfare innovation from the UK designed to tackle this issue—the ISAFE (Improving Safeguarding through Audited Father-Engagement) intervention, developed by The Fatherhood Institute and The Children’s Social Care Research and Development Centre (CASCADE) at Cardiff University and based on two previous separate interventions which had positive initial evaluations. ISAFE combines in-service social work practitioner training with other elements of organisational development to improve the engagement of fathers. Activities targeting organisational culture are case file audits, identification and training of team champions, and a webinar for service leaders. The practitioner training involves both awareness raising about the importance of engaging men and skills development via an introduction to motivational interviewing. ISAFE’s theory of change is summarised in the form of a logic model. Limitations of the intervention and its evaluation are discussed.
... This model consists of various components, including Inputs, Activities/Strategies, Output, Assumptions, Short-term Outcomes, Medium-term Outcomes, and Impacts/Long-term Outcomes. [48]. ...
Article
Full-text available
Background The maternal role is one of the most challenging yet rewarding roles that women experience in their lives. It begins when a woman becomes pregnant, and as the pregnancy progresses, she prepares to fulfill her role as a mother. A woman's health plays a crucial role in her ability to fulfill the maternal role. Multiple sclerosis (MS), as an autoimmune disease, presents unique challenges in achieving this role. Failing to fulfill the maternal role can have lasting consequences for both the mother and the baby. Given the increasing number of women with MS of reproductive age in Iran and the absence of specific programs for this group during pregnancy and postpartum, researchers have decided to develop a supportive program by exploring the meaning of the maternal role and identifying the needs of these women during this period. Methods/materials This study will be conducted in 3 stages. The first stage involves a qualitative study to explore the meaning of the "maternal role" in women with MS through a descriptive and interpretive phenomenological approach based on Van Manen's method. Data will be collected through semi-structured interviews with pregnant women with MS and mothers with MS who have children under one-year-old, recruited from the Multiple Sclerosis Society of Mashhad, Iran. The second stage will involve designing a support program based on the findings of the phenomenological study, literature review, and exploratory interviews. A logical model will guide the development of the program, and validation will be conducted using the nominal group technique. Discussion This study is the first of its kind in Iran to explore the meaning of the maternal role and develop a support program for women with MS. It is hoped that the results of this study will help address the challenges of motherhood faced by these women.
... This model consists of various components, including Inputs, Activities/Strategies, Output, Assumptions, Short-term Outcomes, Medium-term Outcomes, and Impacts/Long-term Outcomes. [48]. ...
Article
Full-text available
Background The maternal role is one of the most challenging yet rewarding roles that women experience in their lives. It begins when a woman becomes pregnant, and as the pregnancy progresses, she prepares to fulfill her role as a mother. A woman's health plays a crucial role in her ability to fulfill the maternal role. Multiple sclerosis (MS), as an autoimmune disease, presents unique challenges in achieving this role. Failing to fulfill the maternal role can have lasting consequences for both the mother and the baby. Given the increasing number of women with MS of reproductive age in Iran and the absence of specific programs for this group during pregnancy and postpartum, researchers have decided to develop a supportive program by exploring the meaning of the maternal role and identifying the needs of these women during this period. Methods/materials This study will be conducted in 3 stages. The first stage involves a qualitative study to explore the meaning of the "maternal role" in women with MS through a descriptive and interpretive phenomenological approach based on Van Manen's method. Data will be collected through semi-structured interviews with pregnant women with MS and mothers with MS who have children under one-year-old, recruited from the Multiple Sclerosis Society of Mashhad, Iran. The second stage will involve designing a support program based on the findings of the phenomenological study, literature review, and exploratory interviews. A logical model will guide the development of the program, and validation will be conducted using the nominal group technique. Discussion This study is the first of its kind in Iran to explore the meaning of the maternal role and develop a support program for women with MS. It is hoped that the results of this study will help address the challenges of motherhood faced by these women.
... The model is divided into eight stages considering feedback, along with the activity, output, and outcome measurements of each stage of R&D. Multiple resources are inputted into the R&D program process, and various outputs and outcomes appear as a result of R&D (Brown & Svenson, 1988;McLaughlin & Jordan, 1999). Multiple indicators are required to measure R&D performance. ...
Article
Full-text available
Two major approaches in national research and development (R&D) planning, top-down and bottom-up, have been compared in academic research, and their differences and respective advantages have been ascertained. However, studies on which planning method is best for improving R&D efficiency are insufficient. South Korea, a country that spends a high portion of its budget on R&D, has changed the direction of its R&D planning from top-down to bottom-up to improve R&D efficiency. However, few studies have analyzed the impact of this change on R&D efficiency in an empirical way. This study analyzed the efficiency of the R&D planning method, which has yet to be evaluated ex post facto, using a two-stage data envelopment analysis with a focus on the South Korea’s information and communication technology sector. The results showed that government-led planning projects in the research stage, which requires systematic planning due to high uncertainty, can be more efficient than in the development stage, where uncertainty is low. This implies that systematic planning support for research subjects is required to effectively promote the bottom-up R&D method, while the prerequisites of the bottom-up approach must be ensured for it to have its advantages over the top-down approach.
... A logic model can outline what a program is trying to accomplish, how to pinpoint specific areas of assessment that is most needed, and at which timepoints evaluation tools should be disseminated [7]. Driven by theories of change, a logic model is used to identify clear objectives and measure expected results of a program or initiative to improve impact and value [8]. To operationalize the aims defined in the COE-IM, a Logic Model was developed in line with the MCCCC COE goals for CA communities. ...
Article
Full-text available
Background The National Cancer Institute’s (NCI) Cancer Center Support Grants (CCSGs) encourages Cancer Centers to address health disparities and reduce the cancer burden in their Catchment Area (CA) through an organized Community Outreach and Engagement (COE) structure. This paper shares the development of two guide models that fosters the operations of the Mayo Clinic Comprehensive Cancer Center (MCCCC) COE Office and programs, the MCCCC COE Impact Model and the MCCCC COE Logic Model. Methods Following a less than stellar CCSG rating for COE in 2018, the MCCCC developed a transition team to specifically address the critique and create a transformative plan for engaging communities to address cancer burden in the CA. A qualitative research approach was employed, focusing on organizing and displaying the relationship between MCCCC COE processes and outcomes through impact and logic models. An impact model was developed to illustrate the components of the CCSG and connect those components to short- and long-term COE outcomes. A logic model was developed to track and monitor activities for continuous process improvement for all COE activities. Results The impact and logic model serve as a roadmap to monitor progress towards short- and long-term COE goals of the MCCCC. The COE operational strategies draw upon bidirectional partnership, evidence-based practices, and research facilitation to respond to the CCSG critique. Conclusion These strategies demonstrate successful practices in addressing cancer burden, promoting health equity and eliminating cancer disparities in the MCCCC CA.
... The project is structured in line with the six steps in quality intervention development (6SQuID) framework. 16 Study design incorporates applying qualitative [17][18][19][20] and quantitative methodologies, [21][22][23] theoretical perspectives 24,25 and intervention mapping methodologies [26][27][28][29][30] to deliver three interlinked and developmental WPs that answer the research questions and meet the study objectives ( Table 2). ...
Article
Introduction In the UK over two million people are currently living with sight loss with this figure predicted to rise to approx. four million by 2050. Patients who die in palliative and hospice care settings could potentially donate eye tissue, however, the option of eye donation is not routinely raised in end-of-life planning discussions. Research evidence suggests that health care professionals (HCP) are reluctant to discuss eye donation as they perceive it as something that will distress patients and their carers.2–4 Aim This presentation will share findings from the NIHR funded EDiPPPP study regarding the views of patients and carers about the option of eye donation being raised with them as part of end-of-life care planning. Methods This presentation will report primary data from interviews with patients and carers. Findings Findings indicate low levels of patient awareness and low levels of approach to patients and family members about the option of eye donation. Patients support the option of eye donation being raised with them, they expect HCPs to raise the option of ED and patients expect to make the decision regarding ED. Conclusion It is imperative that patients who would want to be a donor are identified and assessed for eligibility as part of high-quality end of life care. Evidence from the past 10 years indicates that little has changed regarding the identification, approach, and referral of potential donors from palliative and hospice care settings. Lack of action may be due to perceptions held by HCPs that patients would be unwilling to engage in discussions regarding the option of eye donation pre their death. This perception that is not substantiated by empirical research. Impact To ensure that eye donation is facilitated for those patients who meet the eligibility criteria and state their wish to be a donor. References • College of Optometrists. Eye Health Research [Internet]. 2019. Available from: https://www.college-optometrists.org/the-college/research.html • Edwards P. Corneal donation within palliative care: a review of the literature. International Journal of Palliative Nursing. 2005; 11 :481–6. • Wells J, Sque M. ‘Living choice’: the commitment to tissue donation in palliative care. Int J Palliat Nurs. 2002 Jan; 8 (1):22–7. • Kent BC. Protection behaviour: a phenomenon affecting organ and tissue donation in the 21st century?. International Journal of Nursing Studies. 2004; 41 :273–84.
... Success in achieving performance objectives is defined by the effective execution of processes for implementing policies, programs, and specific actions, which are determined by management throughout the organization (McLaughlin and Jordan, 1999). ...
Article
Full-text available
Background: In the present era of global industrialization, universities are facing an increasing challenge to nurture human resources that are capable of thriving and excelling in global competition. Universitas Sumatera Utara (USU) serves as one of the largest universities in Indonesia and is counted among the 16 Legal Entity State Universities (LESU). As part of the strategic plan outlined by the relevant ministry, there is a priority program that encourages Indonesian universities to achieve the World Class University (WCU) predicate. This scenario necessitates an enhancement of academic reputation Internationally. Method: An explanatory with a quantitative approach was used, and the data were analyzed using Structural Equation Models (SEM). Results: Consequently, the result showed that strategic intelligence significantly and positively played a role in accelerating the influence of strategic management on the performance of the university in achieving WCU predicate. Typically, strategic management consists of strategy formulation, implementation, evaluation, and control. Conclusion: Strategic intelligence, including the upstream system, input quality, leadership system quality, and sound policy guidance, could be recommended as an appropriate approach to strengthen the capacity and expedite the achievement of USU's targets for the WCU predicate.
... One only has to consider theories of change to see how practice theories are useful. The logic model (McLaughlin & Jordan, 1999), as one example, expresses inputs (e.g., those things we have and do such as a team of practitioners, equipment, a calendar of services), immediate outcomes (e.g., stress reduction, skill development), mid-to long-range outcomes (e.g., improved physical health, self-efficacy) ...
Article
Full-text available
We of­ten rely on our per­so­nal ex­pe­ri­en­ces and the sto­ries we tell our­sel­ves about how out­door the­ra­py works. We also draw on re­se­arch and evi­dence from re­la­ted fields to make claims for our own work. While out­co­mes re­se­arch is ad­van­cing, we lag be­hind in pro­cess and theo­ry-ge­ne­ra­ting re­se­arch. This pa­per cen­ters on po­ten­ti­al ex­plo­ra­ti­ons of im­pli­cit theo­ries in out­door the­ra­pies. Im­pli­cit ele­ments of our prac­ti­ce are dif­fi­cult to iden­ti­fy and de­scri­be, due to their na­tu­re as ta­cit know­ledge (i.e. felt, em­bo­di­ed, and lar­ge­ly in­tui­ti­ve) ari­sing amidst the at­tu­n­e­ment to our­sel­ves, other peo­p­le, and na­tu­re. We pro­po­se a re­se­arch agen­da into im­pli­cit land­scapes ba­sed on th­ree pa­thways. The first pa­thway in­cludes a prac­ti­tio­ner sur­vey to iden­ti­fy their gui­ding theo­ries. The se­cond pa­thway is con­text-sen­si­ti­ve case stu­dies that also em­brace com­ple­xi­ty, whilst the third pa­thway in­qui­ries into mi­cro­pro­ces­ses of ch­an­ge, per­haps not yet ar­ti­cu­la­ted in out­door the­ra­pies re­se­arch.
... It describes the theory of change of social enterprises based on a cause-effect impact logic [38,39]. Originally, the IOOI-framework has been used in various contexts to evaluate and assess the planned and actual results of projects, programs or organizations [40][41][42][43]. Renko [44] states that the intended outcomes of prosocial-motivated entrepreneurs are closely related to the achievement of positive value for customers and other stakeholders as well as a positive change for society or the environment on a system level. ...
Article
Full-text available
The purpose of this article is to advance the sustainable entrepreneurship research context by establishing an in-depth understanding of the aspired successes and related sustainability results of hybrid and non-hybrid start-ups against the background of a multi-level perspective. The insights are generated through an explorative multiple-case-study approach including twelve German start-up companies both hybrid start-ups and non-hybrid start-ups. There is limited research that conceptualizes aspired successes applying a multi-level view to the firm level of start-ups. This article provides comprehensive insights into different success and result categories of sustainable entrepreneurship and provides both future research as well as practitioners with a clear directive of how to navigate in the hybrid start-up context. Finally, the discussed differences and similarities between hybrid start-ups and non-hybrid start-ups draw a clearer though differentiated line between these two archetypes of start-ups.
... Short, intermediate, and long-term outcomes were defined by the Advisory Board using logic models. 25 These outcomes were categorized into four conceptual levels that included participants', 1) Learning, 2) Experience, 3) Behavior, and 4) programmatic Results. 26 Surveys were used to collect feedback related to participants' learning and experience. ...
Article
Full-text available
Clinical and translational research relies on a well-trained workforce, but mentorship programs designed expressly for this workforce are lacking. This paper presents the development of a mentoring program for research staff and identifies key programmatic outcomes. Research staff participating in this program were matched with a senior mentor. Focus groups were conducted to identify key program outcomes. Surveys were administered throughout the program period to assess participants’ experience, gains in skill, and subsequent careers. Analysis of the resultant qualitative and quantitative data are used to characterize the implementation and impact of the program. A total of 47 mentees and 30 mentors participated in program between 2018 and 2023. A comprehensive logic model of short-, intermediate- and long-term outcomes was developed. Participants reported positive valuations of every programmatic outcome assessed including their program experience, learning and research careers. The pool of available mentors also grew as new mentors were successfully recruited for each cohort. This mentorship program developed and implemented by senior research staff successfully provided junior research staff with professional development support, mentorship, and professional development opportunities. Junior and senior health research staff built mentoring relationships that advanced their clinical and translational research careers.
... Logic models have been summarized as "a picture of how your organization does its work" (W.K. Kellogg Foundation, 2004, p. III). These graphic depictions convey the relationship between a program's resources, activities and intended outcomes and strive to articulate a program's underlying theory and assumptions (McLaughlin & Jordan, 1999). They are often referred to as "roadmaps" because they help to make a program's theory more explicit and encourage systematic thinking on the process of change. ...
... The program is proceeding according to the time plan presented in Figure 1. The program began with the development of a logic model, which is a common approach for planning and evaluating projects and/or programs (56) in order to achieve their overall goals (see Figure 2). The logic model will be used to link the problem (needs) to the activities, outputs, outcomes and impacts and through this the model will support planning, monitoring and evaluation of the program. ...
Article
Full-text available
Background The purpose of this paper is to outline the protocol for the research program “UserInvolve,” with the aim of developing sustainable, service user involvement practices in mental health services in Sweden. Methods This protocol outlines the knowledge gap and aim of the UserInvolve-program. It further provides an overview of the research infrastructure, with specific focus on the organization and management of the program as well as the design of the six underlying research projects. These six research projects form the core of the UserInvolve-program and will be carried out during a six-year period (2022–2027). The projects are focused on examining articulations of experiential knowledge in user collectives, on four specific user involvement interventions (shared decision-making, peer support, user-focused monitoring, and systemic involvement methods) and on developing theory and method on co-production in mental health research and practice. Results or conclusion The knowledge gained through the co-production approach will be disseminated throughout the program years, targeting service users, welfare actors and the research community. Based on these research activities, our impact goals relate to strengthening the legitimacy of and methods for co-production in the mental health research and practice field.
... We used a logic model [55] to describe the overall approach taken to develop this TMOUD implementation model (Multimedia Appendix 2). The logic model is based on the application of the 12 SHIFT-Evidence framework rules detailed in Multimedia Appendix 1. ...
Article
Full-text available
Background Telemedicine-delivered medication for opioid use disorder (TMOUD) has become more prevalent during the COVID-19 pandemic, particularly in North America. This is considered a positive development as TMOUD has the potential to increase access to evidence-based treatment for a population heavily affected by the opioid crisis and consequent rising mortality and morbidity rates in relation to opioid use disorder. Despite the increase in the use of TMOUD, there are no established service- and process-focused models to guide the implementation of this intervention. Objective This study aims to develop a process- and service-focused implementation model in collaboration with key stakeholders and bring together peer-reviewed literature, practice-based knowledge, and expert opinions. Methods The simple rules for evidence translation in complex systems framework was applied to guide the development of a 6-step qualitative study. The steps were definition of the scope and objectives of the model, identification of evidence, stakeholder engagement, draft model development, key informant consultation, and final model specification. Results The final specification for the TMOUD implementation model incorporated key strategic priorities, service delivery prerequisites, service design elements, stakeholder identification and engagement, key process domains, and iterative cycles of evaluation and improvement. Conclusions Through stakeholder engagement and key informant consultation, we produced a process- and service-focused TMOUD implementation model. The model is modifiable to different contexts and settings while also in keeping with the current evidence base and national and international standards of high-quality opioid use disorder care.
... The LM is used to plan the actions and activities needed to achieve intended outcomes, highlighting methods to evaluate whether the outcomes have been achieved. The LM illustrates a "theory of action" to support the planning, implementation and evaluation of the programme of work by illuminating relationships between perceived problems and intended outcomes (McLaughlin & Jordan, 1999). Although the LM is a well-established method and tool, it has not been conceptualised and used as a mediating object and second stimulus in team work to guide critical encounters and support negotiations around these. ...
Article
Full-text available
Digital Technologies open opportunities to work and learn in new ways as work environments and practices are transformed. However, digital learning systems often are designed without due consideration of the workplace. This disconnection of learning from work can make it difficult for professionals to apply knowledge learned to their work. Connecting work and learning though the design of digital learning systems requires technical experts, domain specialists and education researchers. We argue that when working in diverse design teams, at times team members face tensions which leave them feeling helpless, voice-less or in paralysis. This paper addresses this problem by placing attention on how to support design processes for digital professional learning by incorporating the knowledge of these diverse actors. The paper begins with a discussion of participatory ‘critical encounters’ to resolve tensions during the design process using a Logic Model as a stimulus tool to support negotiations. This is followed by a case example. The paper concludes with a novel methodology, drawing on the idea of ‘double stimulation’, using a Logic Model as a tool to anticipate and resolve tensions. This methodology helps design digital learning systems in ways that respond to workplace problems, acknowledging that the social context matters.
Article
Full-text available
In our practical duties as medical and dental teachers, we often come across challenging scenarios where we are asked to evaluate our undergraduate medical (MBBS) or dental (BDS) program according to the standards provided by the Pakistan Medical and Dental Council (PM&DC).1 The current review article has been written to comprehensively address all important aspects of such tasks, using the most appropriate Logic model of program evaluation in medical education.2-6 The key terms used in this model are shown in Figure 1. This model is preferred because it provides a systematic and visual depiction of the intricate relationships that exist among the resources that will be used to operate the program, the activities that will be planned, and the outcomes or results that will be hoped to be achieved by the program. This article provides a step-by-step guide on how to use the Logic model for program evaluation of an MBBS program. In the context of clearly stated objectives of the program, the evaluators have to identify the inputs, available resources, activities, outputs and outcomes. All these components are represented visually to construct the Logic model (Figure 2) for the planned evaluation. At each level of the model, the indicators help to determine if the program has successfully achieved its objectives or not. A variety of data collection methods should be employed. Analysis of the collected data helps to come up with formal results of the evaluation. This in turn helps to determine the overall effectiveness of the program and to formulate any suggestions for effecting further improvements in any identified deficient areas. The findings are shared with the stakeholders of the program. A robust logic model for program evaluation thus helps to ascertain whether or not a given educational program is achieving its outlined outcomes and making a positive impact. 7,8
Article
Full-text available
Purpose The logic models at the center of leading environmental, social and governance (ESG) reporting programs, such as the global reporting initiative, impose a dualistic relationship between organizations and social-ecological systems. Coupled with the lack of a real-world alternative, their dualistic approach results in widespread systems thinking-based reducibility errors in business responsibility. To help develop a nondualistic alternative, this study aims to present the idea of neltilistli or “rootedness,” as developed by the ancient Nahua indigenous peoples of Central Mexico. From the perspective of the Nahua, rootedness involves a holistic relationship with one’s body, community and the creative force called “teotl.” Design/methodology/approach The authors draw on the past to speculatively theorize an imagined future using the method of prospective theorizing to draw on a historical social context that is largely missing from current management scholarship. In doing so, the authors engage in a process of imagining a radically different future reality. Findings Integrating a rootedness approach into ESG reporting, particularly in terms of stakeholder relations, enriches it both spatially and temporally. This approach allows researchers and practitioners to replace dualistic thinking with a more holistic approach. Originality/value This paper complements the dualistic assumptions behind ESG reporting programs with a holistic approach based on the rootedness concept of ancient Nahua thought.
Article
Full-text available
Civil Society Organizations (CSOs) promote inclusive governance characterized by accountability, transparency, and participation. The engagement of CSOs’ is a mechanism for citizens and government to work together to achieve development. The study used mixed methods to examine CSOs' engagement in local governance in the four functional areas of planning, budgeting, implementation monitoring, and evaluation within the Province of Bukidnon, Philippines. The results show a moderate level of engagement, with planning having the highest and monitoring and evaluation the lowest. The study reveals a discrepancy between policy and practice, implying compliance may be a stronger motivator than genuine engagement. Furthermore, specific CSO attributes like geographical location, sectors represented, organizational level and number of committees represented significantly affected their level of engagement. This study emphasizes the importance of strengthening systems that empower grassroots voices and foster meaningful collaboration, between civil society groups and local government.
Article
Full-text available
Structured processes to improve the quality and impact of clinical and translational research are a required element of the Clinical and Translational Sciences Awards (CTSA) program and are central to awardees’ strategic management efforts. Quality improvement is often assumed to be an ordinary consequence of evaluation programs, in which standardized metrics are tabulated and reported externally. Yet evaluation programs may not actually be very effective at driving quality improvement: required metrics may lack direct relevance; they lack incentive to improve on areas of relative strength; and the validity of inter-site comparability may be limited. In this article, we describe how we convened leaders at our CTSA hub in an iterative planning process to improve the quality of our CTSA program by intentionally focusing on how data collection activities can primarily advance continuous quality improvement (CQI) rather than strictly serve as evaluative tools. We describe our CQI process, which consists of three key components: (1) Logic models outlining goals and associated mechanisms; (2) relevant metrics to evaluate performance improvement opportunities; and (3) an interconnected and collaborative CQI framework that defines actions and timelines to enhance performance.
Research Proposal
Full-text available
The proposal (or an extended abstract) is about building a new benefits received and provided model for capturing social impact performance. A full length paper is in progress and the reason for uploading this proposal is to gain scholarly feedback from the academic community, who work on accounting for not-for-profit organizations.
Preprint
Full-text available
This article describes the use of an art-based research method used in a case to collect data from an older-population in an independent living community.
Chapter
The academic clinic medical director has complex responsibilities to align patient care, clinic operations, and the clinic’s education mission. Successful academic clinics require leadership and collaborative management with academic affiliates and multiple team professions. In this chapter, we describe the role of the medical director in providing oversight of the teaching faculty, including faculty responsibilities for precepting and teaching trainees, supervising patient care, and mentoring and training their learners to achieve graduated autonomy. The clinic director provides resources for faculty, residents, and staff to utilize data tools and work together to improve health metrics, outcomes, access, and equitable care. Academic primary care clinics may serve as a training site for other health professionals in addition to medicine, which expands the medical director roles to support and facilitate education and collaboration to enhance patient care. Partnership with academic program leaders creates an alliance to optimize scheduling, continuity clinic experience, and teaching the next generation of physicians and other health professionals.
Article
Motivation Previous studies on the effectiveness of capacity building training, drawn from the experience of traditional donors, have been limited in their understanding the impact of the diversity of trainees and the diversity of training on the effectiveness of training. This is particularly problematic given the increasing prevalence of such training and the emergence of new donors with different approaches. Purpose This article investigates the effectiveness of capacity‐building training across different participants and different training types, through the case of an emerging donor, the Republic of Korea (Korea). Korea is distinctive and under‐researched as a country relatively late to join the OECD's Development Assistance Committee (DAC), with several policies explicitly locating capacity‐building training as a diplomatic strategy. Korea has made repeated efforts to diversify participants and types of training to gain a comparative advantage in international development and co‐operation. Methods and Approach The study constructs a generalized linear mixed model (GLMM) to analyse the effectiveness of training across layers of individual diversity (gender, rank, level of national income and extent of democracy) and group diversity (types of trainings). It draws on survey responses from 789 government officials in low‐ and middle‐income countries (LMICs). Findings Training effectiveness differs for diverse participants and training types. Effectiveness tends to decrease as job rank and national income rise, while it increases with the level of democracy. Training that fosters diverse interactions and experiences, such as multi‐country training and invitational training, tends to be more effective than other types. Policy Implications Our results suggest implementing more collaborative and customized training to suit the heterogeneous needs of diverse participants. The results emphasize the need to develop and operate various training types that promote diverse interactions and experiences among participants.
Conference Paper
The need for improving the performance of Integrated Urban Conservation Interventions in terms of outputs, outcomes, and overall achievement of urban conservation goals by using monitoring and evaluation systems (M&E-systems) becomes more and more important and has been stressed and considered by many researchers and organizations recently. Although some attempts have been undertaken in Urban Planning, there is still a lack of an underlying conceptual framework for Key Performance Indicator (KPI) based M&E-systems that draws a holistic picture from an Integrated Urban Conservation point of view on the whole landscape. This paper proposes an analytically derived Integrated Urban Conservation Management Framework (IUCMF), including its functions, structure, and scope. The framework is based on ISO 9001 (Quality Management Systems), DIN 69909–2 (Multi-Project Management), and the Burra Charter Process and allows a high level of application flexibility for M&E-systems developer for a geographically defined area, according to cultural specifics, local features, and available regional data. The framework consists of a strategic and an operational level. The strategic level contains Integrated Urban Conservation policies, charters, and objectives, the objective breakdown according to regional specifics, and evaluation and impact of outcomes. The operational level considers the implementation of Integrated Urban Conservation targets and requirements via interventions at a place of cultural significance and contains program management, project management, and project phases. Inherent to this framework on both levels is the application of Plan-Do-Check-Act method (PDCA) and the Logic Model approach. The PDCA method foresees feedback loops within the IUCMF on a strategic level, but also within the programs and projects on an operational level. The logic model approach is inherent to the operational level, which allows monitoring of project performance. Objective determination and outcome evaluation are linked to the “Plan” and “Check” step on strategic level. Finally, the framework indicates the underlying activities (i.e., purpose factors) of each framework element as a precondition to derive Key Performance Indicators (KPI) for M&E-Systems. The IUCMF shall help researchers in developing appropriate M&E-systems but also policymakers, program managers, and local authorities to receive inputs for informed decisions regarding policy amendments, goal continuation, or project performance.
Article
Full-text available
Hemşirelik lisans eğitim programlarının dinamik ve güncel olmasını sağlayabilmek amacıyla sürekli ve sistematik olarak değerlendirilmesi gereklidir. Ancak, program değerlendirmenin karmaşık bir süreç olması ve bu süreçte genellikle zorlukların yaşanması, bu sürecin bir "kara kutu"ya benzetilmesine neden olmuştur. Bu bağlamda, programların planlanmasında ve değerlendirilmesinde, bir programın anlaşılır olmasını ve tekrarlanmasını sağlayarak takip edebilecek bir çerçeveye ihtiyaç duyulmaktadır. Logic model, böyle bir çerçeve sağlayabilecek program değerlendirme modellerinden biridir. Bu model, bir eğitim programının karmaşık bileşenlerini basitleştirmek için kullanılmaktadır. Ayrıca, genellikle bir diyagram biçiminde sunularak programın mantığını görselleştirmektedir. Bu derlemenin amacı da hemşire eğiticilerin hemşirelikte eğitim programı değerlendirme çalışmalarında bir program değerlendirme modeli olarak kullanabilecekleri Logic Modeli açıklamaktır. Logic model, hedef kitle ve temel varsayımlarla başlamakta olup, amaç belirlemeden çıktılara kadar mantıksal bir sıra sağlamaktadır. Bu modelde girdiler, etkinlikler, ürünler ve çıktılar olmak üzere dört öğe bulunmaktadır. Çıktılar, program etkinliklerinin sonucunda amaçlanan kısa, orta ve uzun vadeli değişikliklerdir. Bir Logic modelinin her bir temel öğesine ilişkin birçok farklı değişkenler program değerlendirmeye dahil edilmektedir.
Chapter
Consultation-liaison psychiatry has evolved rapidly in the last decade, with significant expansion of services across the UK. Now in its third edition, Seminars in Consultation-Liaison Psychiatry provides a current, comprehensive, practically orientated guide that covers clinical topics, education, service development, audit and research. New and updated chapter topics cover the presentation, diagnosis, and management of common conditions, and chapters on organisational topics provide insights into developing and managing the context within which practice takes place. Each chapter is informed by the latest research while remaining hands-on in its focus, structured around common clinical scenarios that liaison staff encounter in hospital settings. A practical guide, this book is packed with essential reading for clinicians working at the interface between mental and physical healthcare.
Article
This study investigates the implementation of the Nutrition North Canada (NNC)-funded cooking circle program in the Inuvialuit (Inuit) hamlet of Paulatuk, Northwest Territories. The objectives of this study are to co-develop a culturally relevant logic model and to conduct a process evaluation of program implementation to identify and assess key enablers and barriers. The co-developed Mukluk Logic Model played an instrumental role in the conceptualization of the process evaluation. The process evaluation results indicated that the long-standing sustainability of the program is related to the consistency of program funding, engaging facilitation practices, and creative utilization of the multi-purpose space for program activities. However, significant barriers limit program sustainability. These include funding amounts and distribution, space and equipment limitations, and human resources challenges. This study illustrates the utility of qualitative process evaluation research in a Canadian Arctic community context and generates important place-based knowledge and insights to better support northern community-based food preparation programs.
Conference Paper
Full-text available
Abstract. Regional development is a multidimensional concept that is determined by many factors. The broad areas of interest are: sustainability and resilience, socio-culture and socio- economy, stakeholder involvement and objectives. This poses a difficult challenge for planning and evaluating activities and measures in regional development. To combine economic and noneconomic factors we propose the integration of existing strategy models into a cohesive strategy framework. This hybrid holistic framework allows the design of a strategy canvas for a practical application in consulting, education, and practice. the framework not only combines the strategic models it integrates them and defines a process of iteration which allows for evaluation and adaptation as well as in planning phase and in realization phase of regional development initiatives.
Article
Full-text available
Abstract Background Over 2 million people in the United Kingdom are living with sight loss with costs to the United Kingdom economy reported as £4.34 billion annually. Conditions that lead to sight loss and impaired vision can be treated if eye tissue is available for corneal transplantation, reconstructive surgery and research into eye diseases. Supply of eye tissue (only available via eye donation) is currently insufficient to meet demand; therefore, new routes are needed. Hospice and hospital-based Palliative Care Services have been reported as potential donation sources of this tissue. Objectives To: (1) scope the size and clinical characteristics of the potential eye donation population from research sites; (2) map the donation climate of each research site; (3) identify factors that enable or challenge service providers to consider the option of eye donation from a local and national perspective; (4) identify service users’ views regarding the option of eye donation and the propriety of discussing eye donation; and (5) develop and pilot an empirically based intervention designed to change behaviours in relation to eye donation. Design A 36-month mixed-methods, multicentre study undertaking three work packages. Settings Three hospice care and three hospital-based palliative care services situated in the North, Midlands and the South of England (one service of each type per region). Participants Work package 1 – 105 service providers. Work package 2 – 62 service users, and 156 service providers in the national survey. Work package 3 – 21 expert consultees (patient and public involvement, cross discipline). Data sources Scoping review, retrospective note review, qualitative interviews/focus groups, participant observation, secondary analysis of primary data, national survey, transparent expert consultation. Results Potential: The retrospective notes review demonstrated that of 1199 deceased patients’ notes, 553 (46%) patients met the criteria for eye donation (56%, n = 337 in hospice care service settings and 36%, n = 216 in hospital palliative care service). Practice: Less than 4% of all cases agreed as eligible for donation had been approached or referred for eye donation. Eye donation is not currently an embedded practice at local and national levels. Perceptions:Service providers were motivated to discuss eye donation but lacked opportunity and capability. Service users were willing and able to hold conversations about eye donation but were not aware of the option and had not had the option discussed with them. Preferences:Service users wanted to be offered the option of eye donation, and service providers wanted bespoke education and training related to eye donation. Evaluation of the developed intervention STEPS – Support Toolkit for Eye donation in Palliative care Settings will follow implementation of the full intervention (expected to begin in October 2022). Limitations Due to the significant impact of the COVID-19 pandemic on clinical sites, partner organisations and national service providers, only two elements of the developed intervention have been pilot tested for proof of concept and the response rate to the national survey was low (8%). Conclusions Significant potential exists for eye donation from hospice care and hospital palliative care services; however, individual and organisational behaviour as well as information system-based changes are needed to maximise this potential. Future work Evaluation of the STEPS – Support Toolkit for Eye donation in Palliative care Settings; Research exploring the wider public knowledge and views regarding eye donation; research exploring the use of language by National Health Service Blood and Transplant-Tissue and Eye Services in their public-facing infographics, communications and campaigns (specifically the use of the term eye donation). Trial registration This trial is registered as ISRCTN14243635: Eye donation from palliative care and hospice care settings. Funding details This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (17/49/42) and will be published in full in Health and Social Care Delivery Research; Vol. 11, No. 20. See the NIHR Journals Library website for further project information.
Article
Despite the evidence demonstrating the importance of physical activity, approximately 50% of US women meet aerobic national physical activity guidelines. There is often a disconnect between successful evidence-based physical activity programs and the translation/dissemination of these programs into community settings; this might be overcome through use of program theory and evaluation. The purpose of this study was to discuss the development of a logic model for a community-based walking program for mothers by providing background on the population and describing program theory, the process of developing the logic model, and logic model components. Participants ( N = 86) were mothers (18–64 yr) with a child 26 yr or younger living in her household. Process evaluations, observational, and focus group data were used in a content analysis to determine major themes, informing the logic model. Findings revealed a set of resources needed to complete program activities. These activities led to short- and long-term outcomes. The overarching goal of the program is to improve the overall health status of families and communities. This logic model may have significant public health effect because it can serve as a framework for other communities wanting to develop, implement, and evaluate a walking program for mothers. To the authors' knowledge, this logic model is the first of its kind and may be used by public health practitioners and communities to promote physical activity, specifically walking, in an underserved population.
Research
Full-text available
התדריך שבפניכם מציג את התורה המקצועית שפותחה במסגרת תוכנית "פנימה". התדריך מסכם ארבע שנות למידה ועבודה עם משפחות על פי מודל השואף לספק חלופה להוצאה למסגרת חוץ- ביתית עבור ילדים ומשפחות בהזנחה חמורה. התדריך הוא תוצאה של עבודת פיתוח ויישום מאומצת, ומבוסס על תובנות מעבודת השדה, על ספרות מקצועית ועל ממצאי מחקר הערכה מעצב אשר ליווה את התוכנית. מטרת התדריך להנגיש לאנשי מקצוע ידע שהצטבר בתוכנית, ולפרוש את תפיסת העולם שבלב התוכנית ואת מודל ההפעלה היישומי שלה. •הפרק הראשון עוסק בתאוריה של הבעיה: הבנת התופעה של ילדים במצבי הזנחה חמורה, הגדרה של מושגי יסוד כמו שכיחות הזנחה, גורמי סיכון להתפתחות מצבי הזנחה והשלכות של הזנחה על ילדים, בליווי נתונים. בנוסף יוצגו גישות מרכזיות לטיפול בילדים ולהגנה על ילדים בהזנחה חמורה על סף הוצאה מהבית. לבסוף, תידון סוגיה המעסיקה תדיר אנשי מקצוע: המתח בין הגנה על ילדים בסיכון, שימור קשרי משפחה קיימים ועבודה מתוך קרבה וקשר. •הפרק השני עוסק בתאוריה של ההתערבות: התפיסה המקצועית, הערכית והחברתית שדרכה אנו מתבוננים בתופעה וניגשים לעבודה עם המשפחות, עבודה על פי העקרונות של פרקטיקה ממוקדת משפחה, עבודה סוציאלית מודעת עוני וטראומה. •הפרק השלישי מציג את תרגום התפיסה המקצועית לפרקטיקה ויביא את עקרונות העבודה הערכיים והמקצועיים של מודל "פנימה". עקרונות אלו מתבססים על עקרונות שגובשו במיזם "מפגש", ועל עקרונות נוספים הייחודיים לתוכנית "פנימה". עקרונות העבודה הללו התגבשו מתוך העשייה והעבודה עם המשפחות, ומתוך למידה על הצרכים הייחודיים של אוכלוסיית פנימה. כל עיקרון מתואר בתדריך הן מההיבט התאורטי הן מההיבט היישומי. •הפרק הרביעי מציג את מודל ההפעלה המקצועי של מודל "פנימה". יוצגו הרקע להקמת התוכנית, מודל העבודה ורכיבי המודל הנדרשים להצלחת ההתערבות: קהל היעד, תחומי הסיוע ומבנה ארגוני של המודל. בנוסף, מוצגים חלקים פרקטיים של יישום המודל: שלבי ההתערבות, מדידה והערכה של תוצאות התוכנית והכשרה והדרכה של אנשי מקצוע. •הפרק החמישי עוסק בהרחבה בשתי סוגיות משמעותיות במודל "פנימה": שיפור תנאי המחיה של המשפחות, והמקרה של הוצאת ילדים מהבית במהלך התכנית. החלק העוסק בשיפור תנאי המחיה מציג את הדרכים האפשריות לשיפור תנאי המחיה במסגרת התכנית, דוגמאות לסיוע ואת ההשפעה של תהליך זה על המשפחות. החלק העוסק במקרה של השמה חוץ-ביתית של ילדים, מציג את הדילמות והמורכבות הרבה עימה מתמודדות המשפחות ואת תפקידו של צוות התכנית בליווי המשפחות במקרה זה. •הפרק השישי מסכם את התדריך ומציג סיפורי טיפול של משפחות, הורים וילדים אשר עברו תהליך עומק בתוכנית, דרך העיניים של עו"ס התוכנית אשר ליוותה את המשפחות. סיפורים אלו מספקים הצצה לעולמן המורכב של המשפחות, לרגעי המשבר וההצלחה, כמו גם לעבודה הרגישה והמורכבת של אנשי המקצוע הפועלים בתוכנית. לאורך התדריך נשזרו ציטוטים ממחקר ההערכה ודוגמאות מן השדה, במטרה לשקף את החוויה האישית של המשפחות המשתתפות בתוכנית ושל הצוות המקצועי. הציטוטים והדוגמאות מדגישים את הרגישות והמורכבות הכרוכות בנסיבות חיי המשפחות ובעבודה עימן.
Research
Full-text available
בפניכם תדריך המציג את "התורה המקצועית" שפותחה במסגרת מיזם "מפגש". התדריך מסכם חמש שנות למידה וחקר של תופעת ההזנחה של ילדים ובני נוער, תוך מפגש משפחות המתמודדות עימה וטיפול בהן. התדריך הוא תוצאה של עבודת פיתוח ויישום מאומצת, ומבוסס על תובנות מעבודת השדה כמו גם על ממצאי המחקר המלווה. מטרת התדריך לאפשר לאנשי מקצוע גישה לידע שנצבר במיזם, לתפיסת העולם שגובשה בו ולמודל ההפעלה היישומי שלו. התדריך כולל חמישה פרקים, שכל אחד מהם מסכם היבט חיוני בהבנת המודל כולו: בפרק הראשון מתוארת התאוריה של הבעיה: היקף תופעת ההזנחה, חומרתה, נזקיה החמורים לטווח קצר וארוך, הקשיים במדידתה ובהגדרתה, ריבוי והצטלבות גורמי הסיכון לה לצד חוסר תשומת לב מספקת אליה מבחינה תאורטית, אמפירית ופרקטית. בפרק השני מוצגת תפיסת העולם הערכית-חברתית שבאמצעותה אנו בוחנים את התופעה, ותוך כך מוצגים גם אתגר הסיוע למשפחות שיש בהן מצבי הזנחה, משמעותה של עבודה מבוססת קרבה וקשר, עבודה על פי עקרונות הפרדיגמה של עבודה סוציאלית מודעת עוני ותפקידו החברתי של העובד הסוציאלי בהתמודדות עם הזנחה. בפרק השלישי מובאת התאוריה של הבעיה, ובו מפורטים עקרונות העבודה הערכיים-מקצועיים של מודל "מפגש", שעוצבו תוך עבודה עם משפחות המתמודדות עם מצבי הזנחה. תחת כל עיקרון מפורטים תיאור העיקרון, עיגון תאורטי של העיקרון, אופן יישום העיקרון ואתגרים ביישום העיקרון. 11 בפרק הרביעי מפורט מודל ההפעלה היישומי, ומוצגים רכיבי המודל הנדרשים להצלחת ההתערבות, לרבות הגדרת קהל היעד, תחומי הסיוע, שלבי ההתערבות, כלי לאבחון, הערכת מצבי הזנחה ומעקב אחרים, מודל ארגוני והיבטים שונים של יישום המודל. הפרק החמישי מציג סיפורי טיפול, המאירים היבטים ורגעים מתוך הטיפול במשפחות המתמודדות עם הזנחה במסגרת מיזם "מפגש". לאורך פרקי התדריך מובאים קולותיהן של המשפחות שהשתתפו במיזם "מפגש" ואף של אנשי מקצוע שפעלו במסגרתו. מכיוון שמיזם זה פועל מתוך עמדה מקצועית של סקרנות ונכונות לשאול שאלות ולקבל עליהן סוגים שונים של תשובות ממגוון שותפים לדרך, אנשי מקצוע ולקוחות כאחד – אך טבעי לכלול בתדריך גם קולות אלה, כך שהקורא יוכל ללמוד גם מהם. אנו תקווה כי תדריך זה יסייע בידיכם, אנשי מקצוע המבקשים לעזור למשפחות ולהיטיב עימן. השתדלנו לכלול בו את המידע הנדרש לשם כך. עוד אנו מקווים כי הצלחנו להביא לידי ביטוי את מלוא המורכבות, האישית והחברתית, של תופעת ההזנחה, ואת האופן שבו המשפחות שלנו מנסות להיאבק בה יום יום, בדרכן.
Article
This article argues that a logic model is an effective analytical tool to examine the opening ceremony of the Los Angeles 1984 Olympics as an exercise in soft power. Specifically, it uses a logic model as a guide to emphasize how the Los Angeles 1984 Olympics provided a structure to share values and culture with the intention to influence. Although this is not an evaluative inquiry, the evaluative framework lends itself to identifying the resources required for the creation of the opening ceremony and the formal presentation. For instance, a review of interurban competition (competition between cities or regions that attract economic activities), management and boycotts as inputs of the Los Angeles Games reveal the presentation of American culture and values during the Olympic opening ceremony. The purpose of this article is to implement a logic model as means for understanding the cultural programming of the Olympics by first identifying the unique inputs for the Los Angeles 1984 Olympics and analysing the visual presentation of the opening ceremony.
Article
Full-text available
Extending strategic planning to the full range of Common Agricultural Policy (CAP) interventions could improve the impacts of this controversial public policy. Science, particularly agricultural economics, can play a role in improving the quality of planning and implementation of a reformed CAP. The preparation of Member States' Strategic Plans (SP) is rather formalistic, while the plans are not very rigorously designed. A major weakness is related to the CAP's political-economic characteristics and lies in the selection and definition of interventions: financially strong but poorly targeted interventions tend to be pre-fixed, which prevents a stronger focus on the results and quality of planning. The intervention logic functions as a black box, as the links between policy priorities and interventions are merely implied, with no clear, evidence-based links. Therefore, European decision makers should re-examine the concept of CAP SP and especially improve a support system and capacity building for SP designers. Greater involvement of academic research and scientific methods and tools in the preparation, monitoring and evaluation of plans, could significantly improve the quality of planning. This would require increased investment in research and dialogue among representatives of academia, government and the nongovernmental sector.
Article
Private equity (PE) broadly refers to a wide range of investments that are not available on public stock markets, which may include different investment strategies such as venture capital (VC), growth equity, and buyouts (Gilligan & Wright, 2020). In other words, PE funds are pooled investment vehicles managed by a firm, similar to a mutual fund or hedge fund (US Securities and Exchange Commission, 2022). The umbrella PE term may cause some confusion as VC investments typically refer to early-stage ventures whereas growth investment strategies typically focus on acquiring more established firms (Gilligan & Wright, 2020). Additionally, because PE funds are only available to “accredited investors” and not to the general public through public exchanges, there may be confusion regarding who actually invests in these vehicles (US Securities and Exchange Commission, 2022). Institutional investors, which may include pension plans or university endowments, have access to these PE funds, so many Americans may be indirectly invested in PE through their employer-sponsored retirement plan (US Securities and Exchange Commission, 2022).
Article
Full-text available
Digital technologies can elevate product-service systems (PSS) to smart PSS, which focus on performance rather than ownership and are considered a means for dematerialization. However, transitioning to smart PSS does not guarantee sustainability. To understand the impact of smart PSS holistically, we take a two-pronged approach. First, we use the theory of change to conceptualize the causal link between sustainable smart PSS and their ultimate impact. We develop a three-step causal logic framework consisting of design, causation, and impact. Within this framework, we identify the business model properties of sustainable smart PSS as design characteristics and categorize the eventual impacts based on the triple bottom line. We introduce the term multi-causal pathway to describe the causation processes underlining the possibility of non-linearity and multi-causality. Second, we conduct a systematic literature review to investigate the mechanisms linking design and impact. Based on an analysis of 63 publications, we identify 17 specific mechanisms and group them into four types: information, resource, empowerment, and adverse mechanisms. Visualizing our results, we develop a morphological box as a toolkit for managers to develop their own impact-oriented logic model by identifying and activating the multi-causal pathway that fosters the desired sustainability effects. Moreover, discussing our framework, we develop research propositions and managerial questions for impact design. By linking the theory of change with the business model impact, we contribute toward a conceptual synthesis for understanding the impact of (sustainable) smart PSS.
Book
The Handbook of Practical Program Evaluation provides tools for managers and evaluators to address questions about the performance of public and nonprofit programs. Neatly integrating authoritative, high-level information with practicality and readability, this guide gives you the tools and processes you need to analyze your program's operations and outcomes more accurately. This new fourth edition has been thoroughly updated and revised, with new coverage of the latest evaluation methods, including: Culturally responsive evaluation Adopting designs and tools to evaluate multi-service community change programs Using role playing to collect data Using cognitive interviewing to pre-test surveys Coding qualitative data You'll discover robust analysis methods that produce a more accurate picture of program results, and learn how to trace causality back to the source to see how much of the outcome can be directly attributed to the program. Written by award-winning experts at the top of the field, this book also contains contributions from the leading evaluation authorities among academics and practitioners to provide the most comprehensive, up-to-date reference on the topic. Valid and reliable data constitute the bedrock of accurate analysis, and since funding relies more heavily on program analysis than ever before, you cannot afford to rely on weak or outdated methods. This book gives you expert insight and leading edge tools that help you paint a more accurate picture of your program's processes and results, including: Obtaining valid, reliable, and credible performance data Engaging and working with stakeholders to design valuable evaluations and performance monitoring systems Assessing program outcomes and tracing desired outcomes to program activities Providing robust analyses of both quantitative and qualitative data Governmental bodies, foundations, individual donors, and other funding bodies are increasingly demanding information on the use of program funds and program results. The Handbook of Practical Program Evaluation shows you how to collect and present valid and reliable data about programs. © 2015 by Kathryn E. Newcomer and Harry P. Hatry, and Joseph S. Wholey. All rights reserved.
Article
Schematic representations of a program, sometimes referred to as program logic models, have been used for a number of years as a means of clarifying the purposes of the program and casual assumptions on which it is based. This paper discusses some of the benefits of expanding the structure of these logic models by clearly separating implementation and outcome objectives within the objectives hierarchy of the program. Benefits of constructing these logic models for program planning and other purposes are also discussed.
Article
The science and technology (S&T) community in the Canadian federal government is responding to the same pressures as other communities in governments around the world to produce better information for taxpayers on programme achievements. At the heart of this response are a number of organisations, including the Canadian Parliament, the Auditor General, the Treasury Board, and numerous departments and agencies, each with their own perspective on programme evaluation. Members of the evaluation community are prominent in this process, given their expertise in the performance information field. This paper focuses on the evaluation of the S&T initiatives of the Industry Portfolio - a group of 13 organisations reporting to the Industry Minister. The Canadian federal programme evaluation system has been in place for approximately 20 years. Each organisation is responsible for evaluating its own initiatives, under policy set by the Treasury Board. In most cases, an evaluation framework is established at the start of a programme. The framework identifies performance expectations and specific, detailed requirements for ongoing performance monitoring (to serve ongoing management decision making) and for a future programme evaluation study. This includes evaluation issues, performance measures, data collection, analysis and reporting, and evaluation approaches. In the evaluation study systematic research methods are used and, typically, three main issues are examined: programme relevance, success and cost- effectiveness. The evaluation function is prominent in supporting the Canadian Government's enhanced emphasis on programme outcomes and its new approach in reporting to Parliament. As in most fields, it has taken some time to develop a specialised capability for evaluating S&T initiatives, particularly in organisations in which S&T represents but a portion of their overall activities. The traditional approaches used for assessing S&T have expanded from a focus on peer review to include other programme evaluation and internal audit methods. The development of evaluation capacity was sustained through such supportive efforts as the 1986 Treasury Board
Article
Theory-based evaluation examines conditions of program implementation and mechanisms that mediate between processes and outcomes as a means to understand when and how programs work.
Article
Research programs, like other government programs, are now being requested to demonstrate relevance and value added to national social and economic needs. Complexity, unpredictability and other factors make it difficult to define specific performance measures for R&D programs. This paper describes the performance measurement efforts of one technology development program within the U.S. Department of Energy and proposes a strategy for applying this balanced scorecard approach to a fundamental research organization. Simple logical models of the inputs, activities, outcomes and long term results of R&D programs are proposed. A critical few measures of performance that answer questions from multiple audiences are then chosen across this performance spectrum.
Article
An integrated approach to performance measurement, management and reporting is presented which builds on the well known logic diagram approach of evaluation theory. The addition of explicit consideration of reach, defined as clients, co-delivery partners and stakeholders, supports a more holistic, balanced approach to the concept of performance, which has found acceptance among S&T performers and central agencies in Canada and the U.S. The description of the “performance framework approach” is supported by rationale for its use at both operational and strategic levels of S&T management. Also included are discussions of recent complementary work and examples of successful use of the approach.
Article
Program theory oriented evaluations involve construction of a model that describes the logic and context of the program and enables the evaluator to check on program progress and impact before the program is conducted. Such constructions could be done in a multitude of ways: this paper describes the use of a particular tool called chains of reasoning. Chains of reasoning is a combination of text and a graphic image which presents the activities of a program or project, the goals to be attained, additional assumptions and the links between them. The paper uses three cases studies from Norwegian industrial modernization programs to demonstrate the strength of this tool in different settings. The first case study is a formative evaluation, the second an impact/summative evaluation and the third an additionality analysis. The paper concludes with a discussion of the strengths and weaknesses of the tool.
Article
Incl. index, bibliographical references pp. 387-413, biographical note on the author
Logic on Logic Models
  • R Corbeil
Corbeil, R. (1986). " Logic on Logic Models. " Evaluation Newsletter. Ottawa: Office of the Comptroller General of Canada. September.
The three Rs of performance
  • S Montague
Montague, S. (1997). The Three R's of Performance. Ottawa, Canada: Performance Management Network, Inc., September.
Measuring and managing the performance of energy programs: an in-depth case study
  • G B Jordan
  • J H Reed
  • J C Mortensen
Jordan, G.B., Reed, J.H., and Mortensen, J.C. (1997). " Measuring and Managing the Performance of Energy Programs: An In-depth Case Study ", presented at Eighth Annual National Energy Services Conference, Washington, DC, June.
Office of Management and Budget Testimony Before the House Committee on Government Reform and Oversight Hearing
  • J A Koskinen
Koskinen, J. A. (1997). Office of Management and Budget Testimony Before the House Committee on Government Reform and Oversight Hearing. February 12.
The Functions of Program Theory Using Program Theory in Evaluation. New Directions for Program Evaluation
  • L Bickman
Bickman, L. (1987). " The Functions of Program Theory. " In L. Bickman (ed.), Using Program Theory in Evaluation. New Directions for Program Evaluation, no. 33. San Francisco: Jossey-Bass.
Evaluabilty Assessment: Developing Program Theory Using Program Theory in Evaluation. New Directions for Program Evaluation
  • J S Wholey
Wholey, J. S. (1987). " Evaluabilty Assessment: Developing Program Theory. " In L. Bickman (ed.), Using Program Theory in Evaluation. New Directions for Program Evaluation, no. 33. San Francisco: Jossey-Bass.
Science and technology policy evaluation practices in the Government of Canada. Policy evaluation in innovation and technology: towards Best practices. Proceedings of the Organization For Economic Co-operation and Development
  • R Mcdonald
  • G Teather
Logic on logic models. Evaluation newsletter. Ottawa: Office of the Comptroller General of Canada
  • R Corbeil
Progress and future directions in evaluation: perspectives on theory, practice, and methods. New Directions for Program Evaluation
  • C Weiss
Case study research: design and methods
  • R K Yin