ChapterPDF Available

Quality Accountability: Improving Fidelity of Broad Developmentally Focused Interventions

  • June 2008
DOI:10.1093/acprof:oso/9780195327892.003.0011
  • In book: Toward Positive Youth Development (pp.192-212)
Authors:
Charles Smith at QTurn LLC
Charles Smith
  • QTurn LLC
Thomas Akiva at University of Pittsburgh School of Education
Thomas Akiva
  • University of Pittsburgh School of Education
Download full-text PDF
Read full-text
Download citation

Abstract

This chapter describes the Youth Program Quality Intervention (YPQI), a setting-level intervention model designed to raise quality in out-of-school time programs. The YPQI takes managers and staff from a network of youth programs through a process of identifying and addressing strengths and areas for improvement, using a standardized assessment tool. This tool operationalizes a definition of program quality based on providing youth access to key developmental experiences. Descriptive findings about the quality of youth programs are presented. A three-level model of settings also addresses system accountability, management, and the point of service in youth programs. The chapter discusses accountability structures ranging from low stakes to higher stakes, and presents a generic model for setting change.
Content uploaded by Thomas Akiva
Author content
All content in this area was uploaded by Thomas Akiva on Jun 23, 2017
Content may be subject to copyright.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 205
http://site.ebrary.com/id/10254401?ppg=205
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 206
http://site.ebrary.com/id/10254401?ppg=206
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 207
http://site.ebrary.com/id/10254401?ppg=207
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 208
http://site.ebrary.com/id/10254401?ppg=208
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 209
http://site.ebrary.com/id/10254401?ppg=209
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 210
http://site.ebrary.com/id/10254401?ppg=210
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 211
http://site.ebrary.com/id/10254401?ppg=211
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 212
http://site.ebrary.com/id/10254401?ppg=212
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 213
http://site.ebrary.com/id/10254401?ppg=213
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 214
http://site.ebrary.com/id/10254401?ppg=214
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 215
http://site.ebrary.com/id/10254401?ppg=215
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 216
http://site.ebrary.com/id/10254401?ppg=216
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 217
http://site.ebrary.com/id/10254401?ppg=217
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 218
http://site.ebrary.com/id/10254401?ppg=218
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 219
http://site.ebrary.com/id/10254401?ppg=219
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 220
http://site.ebrary.com/id/10254401?ppg=220
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 221
http://site.ebrary.com/id/10254401?ppg=221
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 222
http://site.ebrary.com/id/10254401?ppg=222
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 223
http://site.ebrary.com/id/10254401?ppg=223
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 224
http://site.ebrary.com/id/10254401?ppg=224
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
. Toward Positive Youth Development : Transforming Schools and Community Programs.
: Oxford University Press, USA, . p 225
http://site.ebrary.com/id/10254401?ppg=225
Copyright © Oxford University Press, USA. . All rights reserved.
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
... The three central goals of the Certified Observer Network are to advance individual participants' professional development, positively affect their organizations, and create a sustainable system for network-wide quality improvement. Firstly, drawing on research that links program quality improvement with individuals' awareness of high-quality practices (Akiva & Yohalem, 2006;Hilberg et al., 2003;Pianta, 2010;Smith & Akiva, 2008;Wilson-Ahlstrom & Yohalem, 2007), this professional development aims to educate participants on the APT's 19 research-backed, essential components of high-quality programming and recognize these practices in action. ...
Building Collective Capacity for Program Quality Improvement: Boston Beyond’s Certified Observer Network
Article
Full-text available
  • Mar 2020
This article describes Boston Beyond’s effort to develop a network of out-of-school time program partner staff trained in implementing a program quality observation tool. Participant survey (n = 63) and interview (n = 4) feedback demonstrate that the network is meeting its goals of advancing participants’ professional development, positively impacting organizations, and creating a system-level model of peer-to-peer program quality improvement. Areas of improvement are identified for each goal. Questions of sustainability, planned network improvements, and considerations for others seeking to establish similar networks are discussed.
View
... Feedback of performance has been demonstrated to be a powerful tool in improving practice in a wide array of arenas from individual behavior to organizational performance (Butler and Winne, 1995). In recent years, there has been ample demonstration of the power of feedback in teaching and other human services (Allen et al., 2011;Becker et al., 2013;Cappella et al., 2012;Glisson et al., 2006;Smith and Akiva, 2008). This paper focuses on: (a) the need to measure the social quality of teaching processes in a contextualized manner; (b) the efforts that we have made to develop and measure, with reliability and concurrent validity, teacher practices and classroom processes in secondary, primary, and pre-school classrooms in Uganda, India, and Ghana, respectively, with the Teacher Instructional Practices and Processes System© (TIPPS; Seidman et al., 2013); (c) how these tools can be fed back to teachers and trainees to facilitate reflective practice and continuous improvement; and (d) how such professional supports can lead to enhanced 21stcentury teacher skills and, in turn, 21st-century learners. ...
Improving 21st-century teaching skills: The key to effective 21st-century learners
Article
Full-text available
The development of competencies known as 21st-century skills are garnering increasing attention as a means of improving teacher instructional quality. However, a key challenge in bringing about desired improvements lies in the lack of context-specific understanding of teaching practices and meaningful ways of supporting teacher professional development. This paper focuses on the need to measure the social quality of teaching processes in a contextualized manner. We do so by highlighting the efforts made to develop and measure teacher practices and classroom processes using the Teacher Instructional Practices and Processes System© (TIPPS) in three different contexts: Uganda (secondary), India (primary), and Ghana (pre-school). By examining how such a tool can be used for teacher feedback, reflective practice, and continuous improvement, the hope is to pave the way toward enhanced 21st-century teacher skills and, in turn, 21st-century learners.
View
... Adults ensure a physically and emotionally safe environment. (Gambone, Klem, & Connel, 2002;Little, 2007 Leveraging this research base, we have developed a three-level framework to address the hierarchy of components that can affect and sustain improvements in the quality of after-school settings (Smith, Akiva, & Henry, 2006;Smith & Akiva, 2008): Point-of-Service (POS) is where youth and adults spend time together; Professional Learning Community (PLC) is an organizational level where program managers guide staff through adoption of core tools and practices; and the System Accountability Environment (SAE) contains the values, incentives, and priorities of funders and intermediaries that seek to influence groups of after-school providers through regulation and funding. ...
Final report on the Palm Beach quality improvement system pilot: Model implementation and program quality improvement in 38 after-school programs
Technical Report
Full-text available
  • Jan 2008
Mixed methods study of QIS implementation and effects in afterschool programs in Palm Beach County, Fl.
View
... If the home lives of transgender youth are unsupportive or dismissive, their experiences in schools often are not better and, in many cases, are much worse. Most children and adolescents are enrolled in public or private school systems and an entire body of research has documented for decades the importance of school quality and school effectiveness on both intellectual/academic as well as social and interpersonal development (Mahoney, 2000;Mahoney and Cairns, 1997;Phillips, 1997;Rutter, 1983;Rutter, Maughan, Mortimore, Ouston, and Smith, 1979;Smith and Akiva, 2008;Weinstein, 2008). Several studies document that transgender youth perceived their schools as overtly unsupportive of their gender identities, with some schools perceived as condoning or ignoring hostility and violence perpetrated against transgender students or cisgender students whose gender presentations were not sex-typed (Grossman et al, 2009;Kosciw, Diaz, and Greytak, 2008;Grossman and D'Augelli, 2006;Rivers, 2001;Russell, McGuire, Lee, Larriva, and Laub, 2008;Sausa, 2005). ...
Transgender adolescents and transactional sex
Chapter
  • Nov 2016
A systematic review of the PsycInfo, PsycArticles, MEDLINE, and Academic Search Complete databases was conducted to review the social and behavioral science literature concerning transgender youth and transactional sex engagement. Inclusion criteria required that articles contain original research, sample from a population living in the United States, include transgender youth (ages 13 – 24 or any subrange) as the sample or an identifiable subsample in the analysis, and include a measure of transactional sex engagement. Transactional sex engagement was defined for this review to include exchange of sexual favors or acts for commodities such as money, shelter, food, or substances. Of the 79 articles identified in the search, 10 met inclusion criteria and were reviewed. The methodologies of the articles were analyzed, including their sample sizes, research designs, recruitment strategies, and measures used for key variables such as transgender identity and transactional sex engagement. The findings of the articles were also compared, including reported prevalence of transactional sex engagement, risk and protective factors associated with transactional sex engagement, and prevalence of related factors such as homelessness and education level. This chapter concludes with recommendations and future directions for research on transactional sex engagement and transgender youth.
View
... I intentionally used the term involvement rather than engagement even though my definition of involvement experience is comparable to some definitions of engagement (e.g., Fredricks et al., 2011). 26 With this term I am pushing for a multidimensional understanding of youths' psychological experience in the transactive youth-in-context microsystem, i.e., the point of service (Smith & Akiva, 2008). That is, involvement experience includes multiple psychological aspects of a young person's participation and their in-the-moment reactions to an organized activity. ...
The Psychology of Youth Participation in Organized Activities.
Article
Full-text available
  • Jan 2012
Organized activities for youth, defined as purposeful, structured offerings that are not part of the school curriculum, play an increasingly important role in the learning and development of young people. This dissertation investigates factors related to youth psychological experiences in such voluntary learning settings. The dissertation begins with four propositions: Organized activities are important in young people???s educational ecologies, they are more than school replacements, understanding motivation in these settings is critical, and related scientific advancement will require multiple methodologies. Two empirical studies are presented, focused on staff practices and youth program experience. Both involve multilevel, quantitative analysis using a dataset with over 1000 youth nested in over 60 programs. Findings suggest that particular staff practices relate to specific elements of youth experience???support for active skill-building associates with youth cognitive engagement, and staff welcoming practices associate with youth sense of belonging. The strategy of actively involving youth in the leadership and operation of youth programs correlates positively with multiple youth motivational constructs, including perceived value of the program and leadership-related expectancies. Moderation analyses suggest these positive associations are stronger for older youth. The concluding chapter discusses these findings in the context of current youth development research, the two educational goals of workforce and citizen development, and implications for future directions.
View
View
Brining in the community: Partnerships and quality assurance in 21st century community learning centers.
Article
Full-text available
  • Jan 2008
This paper describes community partnerships in Michigan’s 21st CCLC programs.
View
Moving the needle on moving the needle: Next stage technical guidance for performance based accountability systems in the expanded learning field with a focus on performance levels for the quality of instructional services
Technical Report
Full-text available
  • Jan 2013
This paper includes: (1) An update to lower-stakes accountability theory and nomenclature with four case studies, (2) empirical evidence about reliability of quality ratings composed to represent a program site using longitudinal data from the Palm Beach county QIS, and (3) guidance about how to align benchmarks and incentives in the lower-stakes accountability designs.
View
Youth Engagement and the Quality of Experience in afterschool programs
Article
  • Jan 2008
Research on middle school participants’ engagement in afterschool programs shows that such programs often serve as developmental contexts for promoting “flow” experiences. Compared to when they are in other settings after school, participants in afterschool programs are more likely to experience high concentrated effort and intrinsic motivation, experiences consistent with Csikszentmihalyi’s concept of flow. Organized sports, arts enrichment, and academic enrichment activities were found to be particularly engaging program activities, in contrast to homework completion. The importance of high levels of engagement in promoting learning in afterschool programs leads to implications for practice and policy.
View
Re-engineering the Schools of Tomorrow: Towards Community Sponsorship
Chapter
  • Mar 2013
In this chapter, it is argued that to keep pace with large demographic shifts and the speed of information technologies, schools will have to transform themselves in the direction of optimal learning environments presented in this book in order to survive. The key characteristic of optimal learning environments is consistently demonstrated to be environmental complexity, or providing a powerful combination of environmental challenge and support. While creating optimal learning environments remains a great challenge, much will be accomplished if greater priority is placed on meeting all individual students’ needs, as illustrated by many of the models presented in this book. Youth can be very valuable societal resources, and can thrive when they feel a sense that they matter and belong through taking valued roles to contribute. There is great demand for adding more time to the school day that has already gained traction among policy makers, and is already occurring in a variety of states and cities. The main question for the future of schools appears to be how future schools will be reengineered with respect to time, resources, and staff. Forming strong community partnerships may be the essential ingredient in adapting to the times, expanding not only school time but the number and diversity of community-based engaged learning opportunities. Models of Extended Learning Time and Opportunities (ELTOs) suggest that schools that effectively engage youth in the future will likely move towards an intentionally blending of academic, physical, social, and emotional goals and activities throughout an extended school day.
View
Trans-Theoretical Therapy - Toward A More Integrative Model of Change
Article
Full-text available
Offers transtheoretical therapy as one alternative when seeking a synthesis for the increasing proliferation of therapeutic systems. From a comparative analysis of 18 leading systems, 5 basic processes of change were identified by the present 1st author (1979). They are consciousness raising (feedback, education), conditional stimuli (counterconditioning, stimulus control), catharsis (corrective emotional experiences, dramatic relief), choosing (self-liberation, social liberation), and contingency control (reevaluation, contingency management). Each process can be applied at the level of either the individual's experience or environment. The present authors (see record 1982-31158-001) have identified the following stages of change: contemplation, termination, action, and maintenance. The verbal processes of change—consciousness raising, catharsis, and choosing—are most important during the 1st 2 stages, while behavior therapies (conditional stimuli and contingency control) are needed once a commitment is made. It is suggested that in the transtheoretical model, cognitive restructuring is seen as the result of the individual effectively applying the appropriate processes of change during each of the appropriate stages of change. (27 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
View
Effects of Professional Development on Teachers' Instruction: Results from a Three-Year Longitudinal Study
Article
Full-text available
  • Jun 2002
Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission. The JSTOR Archive is a trusted digital repository providing for long-term preservation and access to leading academic journals and scholarly literature from around the world. The Archive is supported by libraries, scholarly societies, publishers, and foundations. It is an initiative of JSTOR, a not-for-profit organization with a mission to help the scholarly community take advantage of advances in technology. For more information regarding JSTOR, please contact support@jstor.org.
View
The Classroom Assessment Scoring System: Findings from the Prekindergarten Year
Article
Research on teacher-child relationships, classroom environments, and teaching practices provided the rationale for constructing a system for observing and assessing emotional and instructional elements of quality in early childhood educational environments: the Classroom Assessment Scoring System (CLASS). The CLASS provides a framework for observing key dimensions of classroom processes, such as emotional and instructional support, that contribute to quality of the classroom setting from preschool through third grade. This article provides information about the development, field testing, and use of this instrument in prekindergarten. Data from a national sample of 224 prekindergarten classrooms in 6 states are presented to provide reliability and validity information. The full range of the scale was used for the majority of ratings. Ratings reflected generally positive impressions of the classroom environment and teacher-child interactions. Factor scores from the CLASS were related to the Early Childhood Environmental Rating Scale (ECERS) total score and most strongly related to the ECERS interactions and language-reasoning subscales. Implications for policy and professional development from prekindergarten to third grade are discussed.
View
View
Effects of a community initiative on the quality of child care - The Cost, Quality, and Outcomes Study
Article
This study examined the effects of a broad-based community initiative (Smart Start) to improve the quality of child care for preschoolers. Data were collected in 1994 and 1996 from over 180 child care centers in 12 counties implementing the community initiative. The quality of child care, as measured by the Early Childhood Environment Rating Scale (ECERS; Harms & Clifford, 1980), was significantly higher in 1996 than 1994, both across the entire sample and across the subset of 91 centers observed in both years. The quality of child care in 1996 was significantly related to the number of local quality improvement activities in which the child care centers participated. This and additional evidence presented in the paper show that a comprehensive community initiative can improve child care quality if significant funds and activities are focused on the issue.
View
What Are the Effects of Induction and Mentoring on Beginning Teacher Turnover?
Article
  • Sep 2004
In recent years there has been an increase in the number of programs offering support, guidance, and orientation for beginning teachers during the transition into their first teaching job. This study examines whether such programs—collectively known as induction—have a positive effect on the retention of beginning teachers. The data used in the analysis are from the nationally representative 1999–2000 Schools and Staffing Survey. The results indicate that beginning teachers who were provided with mentors from the same subject field and who participated in collective induction activities, such as planning and collaboration with other teachers, were less likely to move to other schools and less likely to leave the teaching occupation after their first year of teaching.
View
View
An Assessment of the North Carolina School-age Child Care Accreditation Initiative
Article
  • Dec 2002
The primary purpose of this study was to determine if participation in the North Carolina Quality Enhancement Initiative (NC QEI) improved the overall quality of the 26 participating school-age child care programs in three North Carolina communities. A paired t-test showed a positive and significant increase in the quality of school-age child care environments and teacher/child interactions over the 9-month period, from pre-initiative to post-initiative. Pre-initiative and pre- to post-initiative difference scores on each dependent measure were grouped together using a cluster analysis. Each cluster of programs was compared to determine relationships between these program variables and the program clusters. A state license and a smaller group size were related to higher quality programs at pre-initiative. Director education, teacher salary, state license, and program size were related to greatest program improvement from pre-initiative to post-initiative. In addition, six of the 10 programs were awarded accreditation by the National School-Age Care Alliance (NSACA). These findings suggest that participation in program improvement initiatives, like the NC QEI, is a viable means of improving the quality of school-age child care programs.
View
Assessing Changes in Employees' Perceptions of Leadership Behavior, Job Design, and Organizational Arrangements and Their Job Satisfaction and Commitment
Article
  • Jan 2003
This exploratory study sought to contribute to a better understanding of organizational change in human service organizations. Employees' perceptions constituted the central features of a model underlying the study, as they were believed to be related to individual level change outcomes. It was hypothesized that employees' perceptions of organizational arrangements, job characteristics, and leadership behavior would be related to their job satisfaction and commitment. Data were collected from 41 employees representing all organizational levels of a human service organization under the study. Results showed that employees' perceptions of leadership behavior were important predictors of job satisfaction and commitment. Additional post-hoc analysis demonstrated that participation and production orientation components of leadership behavior were significant predictors of job satisfaction, explaining 64.3% of its variance. For the commitment variable, the combination of leadership behaviors-participation, work control, and subordinate relations-explained 48.1% of its variance. Study limitations are discussed as well as the implications for social work practice.
View
Understanding Social Workers' Sense of Competence Within the Context of Organizational Change
Article
  • Dec 2000
As large health care systems rapidly evolve, social work administrators struggle to help practioners maintain a sense of competence during a state of flux and uncertainty. Using a sample of social workers (N = 135) from seven Veteran Hospitals and one state hospital, the present study investigated the relationship of job and workers characteristics, change schema, and organizational change to workers' perceived competence. Workers with more practice experience, fewer distacting outside responisibilities, and higher levels of job satisfaction had a higher sense of competence. Positive change schema and positive perceptions of organizational climate were also significant predictors of competence. Organizational climate had a partial mediating effect on the relationship between social workers' change schema and their sense of competence. The findings have implications for social services administrators who are seeking to promote competence among practioners within the context of organizational change.
View