Article

Two perspectives on the indicators of quality in psychiatry residencies: program directors' and residents'.

Department of Mmedical Education, University of Illinois at Chicago College of Medicine, Chicago, IL 60612, USA.
Academic Medicine (Impact Factor: 3.47). 02/2002; 77(1):57-64. DOI: 10.1097/00001888-200201000-00014
Source: PubMed

ABSTRACT To determine whether psychiatry program directors and residents agree on the characteristics most important in determining the quality of a residency program.
The authors carried out factor analyses of the results of two national surveys that asked participants to rate the importance of 41 items in determining the quality of residency programs: a 1997 survey completed by 180 psychiatry residents and a 1998 survey completed by 234 psychiatry program directors and rotation heads.
Residents' factors determining program quality were the interpersonal culture in the program, the curriculum, academic resources and opportunities, clinical resources and opportunities, and outcomes. Program directors' factors were program administration, curriculum and clinical resources, the quality of the institution, the supportiveness of the program, and individual preferences.
Program directors and residents focus on different indicators of the quality of residency programs, differences that can be conceptualized as those between the "producer" and the "consumer" of the program. Four domains appear to underlie the results of the resident and faculty factor analyses: the context, content, culture, and consequences of the program. Multidimensional evaluations by multiple stakeholders may be the most appropriate way to evaluate the quality of residency programs. These results also strongly suggest that the interpersonal culture of a program should be assessed as part of its evaluation process.

0 Followers
 · 
53 Views
  • Source
    • "programs . Yudkowsky R et al , 14 2002 Two perspectives on the To verify if the group of Two hundred and thirty - four Forty - one - item questionnaire , "
    [Show abstract] [Hide abstract]
    ABSTRACT: Research methodologies in psychiatry have followed both the changes in mental health care and the need of updating programs of medical residency. To identify empirical articles in the indexed literature from 1997 to 2002, with the aim of analyzing and discussing methodological aspects of research dealing with the description and assessment of residency programs in psychiatry. The bibliographic survey was performed using MedLine, PsycLit, Web of Science, and Lilacs. Twenty-one articles were identified. Nineteen studies were characterized as exploratory-descriptive and two as experimental. Data collection used questionnaires in 12 of them, and combined techniques in the other seven and the two experimental studies had data collected by tests applied before and after the teaching intervention. Most of the subjects were residents and program directors. Fifteen studies used statistical analysis. All the articles outlined the problems based on literature reviews. Most of the studies made use of standard techniques of social research and only two used experimental procedures. Only three studies employed external measures in order to establish correlations with the collected data. Procedures to validate and assess the reliability of the instrument by means of pilot-studies were absent in 11 studies, what may indicate methodological biases.
    Revista Brasileira de Psiquiatria 10/2003; 25(3):160-5. DOI:10.1590/S1516-44462003000300008 · 1.64 Impact Factor
  • Source
    • "programs . Yudkowsky R et al , 14 2002 Two perspectives on the To verify if the group of Two hundred and thirty - four Forty - one - item questionnaire , "
    [Show abstract] [Hide abstract]
    ABSTRACT: Objectives: Research methodologies in psychiatry have followed both the changes in mental health care and the need of updating programs of medical residency. To identify empirical articles in the indexed literature from 1997 to 2002, with the aim of analyzing and discussing methodological aspects of research dealing with the description and assessment of residency programs in psychiatry. Method: The bibliographic survey was performed using MedLine, PsycLit, Web of Science, and Lilacs. Twenty- one articles were identified. Results: Nineteen studies were characterized as exploratory-descriptive and two as experimental. Data collection used questionnaires in 12 of them, and combined techniques in the other seven and the two experimental studies had data collected by tests applied before and after the teaching intervention. Most of the subjects were residents and program directors. Fifteen studies used statistical analysis. Conclusions: All the articles outlined the problems based on literature reviews. Most of the studies made use of standard techniques of social research and only two used experimental procedures. Only three studies employed external measures in order to establish correlations with the collected data. Procedures to validate and assess the reliability of the instrument by means of pilot-studies were absent in 11 studies, what may indicate methodological biases. Training. Academic psychiatry. Skills. Knowledge. Medical education. Medical training. Residency. Psychiatry. Objetivos: As metodologias de pesquisa na psiquiatria têm acompanhado tanto as transformações nos sistemas de atendimento à saúde mental como a necessidade de atualização dos programas de residência médica. Identi- ficar, analisar e avaliar na literatura indexada entre 1997 e 2002 artigos empíricos relativos à avaliação de programas de residência em psiquiatria. Método: O levantamento bibliográfico foi realizado através dos indexadores MedLine, PsycLit, Web of Science e Lilacs. Foram identificados 21 artigos. Resultados: 19 estudos caracterizam-se como descritivos exploratórios e dois, experimentais. Em 12, a coleta de dados utilizou questionários, em sete, técnicas combinadas e, nos dois estudos experimentais, os dados foram coletados por meio de testes aplicados antes e depois da intervenção. Residentes e diretores de programas constituíram a maioria dos sujeitos. Em 15 trabalhos, a análise de variáveis utilizou procedimentos estatísticos. Conclusões: Todos os artigos delinearam os problemas com base em revisão da literatura. A maioria dos traba- lhos utilizou técnicas comuns na pesquisa social e apenas dois empregaram recursos experimentais. Somente três estudos utilizaram medidas externas para estabelecer correlações com os dados coletados. Procedimentos de validação e aferição de confiabilidade do instrumento, por meio de estudos-piloto, não foram realizados em 11 estudos, o que pode indicar vieses metodológicos.
  • Source
Show more