Figura 1 - available via license: Creative Commons Attribution 4.0 International
Content may be subject to copyright.
-Taxonomia das propriedades de medida para estudo da validade.
Source publication
Objective: to present and discuss conceptual bases and methods for evaluating the content, construct and criterion validity of self-reported measuring instruments. Method: theoretical study based on the concepts of the Consensus-based Standards for the Selection of Health Measurement Instruments and those evaluated in the Evaluating the Measurement...
Similar publications
Background
This study aims to analyze the patient-reported outcome (PRO) of treatment satisfaction in a sample of children, adolescents and young adults with long-duration type 1 diabetes and to determine potential risk factors for poor treatment satisfaction and the intraindividual changes over a 3-year period.
Methods
This study used data from t...
Abstract
In this brief correspondence, we evaluate the potential impact of pivoting from face-to-face supervised to unsupervised home-based exercise programmes to contextualise the coronavirus disease 2019 (COVID-19) pandemic in prostate cancer patients. A meta-analysis was undertaken in fatigue, quality of life, and lean and fat mass outcomes in t...
Abstract Objective Health economic comparisons of various therapies are often based on health-related quality of life (HRQOL) using EQ-5D questionnaires within the framework of clinical trials. This real-world study prospectively evaluates the patient reported outcomes (PROs)-based HRQOL of head-and-neck (H&N) cancer patients undergoing modern radi...
Objectives
To determine the prognostic value of time driven changes in health status on return to work (RTW) in the first 2 years after traumatic injury.
Design
A prospective longitudinal cohort study. All patient-reported outcomes were measured at 1 week, 1, 3, 6, 12 and 24 months after injury.
Setting
Ten participating hospitals in the Netherla...
Objectives
To determine which outcome scores physicians are using in hip preservation surgery, as well as when they are administered, who administers them and on what platform.
Methods
A cross-sectional survey was conducted to examine which patient-reported outcome (PRO) scores are being used by hip preservation surgeons, including hip joint–speci...
Citations
... An in-depth examination of psychometric indicators is crucial in determining the accuracy of results, with the choice of data collection instruments significantly influencing this outcome. Therefore, a comprehensive analysis of psychometric indicators, specifically focusing on validity and reliability, is imperative (Echevarría-Guanilo et al., 2019). Construct validity was scrutinized through Principal Component Analysis (PCA) with varimax rotation, providing insights into the internal structure of the instruments and identifying associated dimensions (Marôco, 2021). ...
Objective: To analyze the mediating effect of supervisor support in the relationship between organizational culture and diversity management in the workplace. Theoretical Framework: This study is based on the Competing Values Framework, which posits that organizational culture encompasses a set of assumptions that are learned and shared by members of an organization. The type of culture influences the level of support provided by supervisors to their team members, which in turn affects how individual differences are perceived and managed. Method: The research employed a quantitative methodology and included 194 participants. Data were collected using the Organizational Culture Assessment Instrument, Organizational Diversity Inventory, and Supervisor Support Scale. Results: Clan culture and adhocracy culture influence the support provided by supervisors to their employees and the way workplace diversity is managed. Additionally, it was found that when supervisor support is introduced into the model as a mediating variable, the effects of clan and adhocracy cultures become insignificant, indicating a full mediation effect. Practical Implications: Raising awareness among leaders about the importance of effectively managing individual differences among employees, as this not only serves as a survival lever for any organization but also contributes to achieving a competitive advantage over competitors. Originality: It is relevant to reflect on why the importance attributed to supervisor support outweighs the importance attributed to organizational culture, considering that culture conveys a sense of identity that enables employees to align with the organization’s values.
... Além disso, ambos possuíam pós-graduação em áreas relevantes à pesquisa, como Enfermagem, oncologia e letras, facilitando a escolha dos termos mais adequados para refletir as semelhanças e diferenças nos hábitos, costumes e práticas sociais e de saúde entre as culturas americana e brasileira. Essa abordagem colaborativa enriqueceu o processo de tradução e aumentou a precisão e relevância da versão adaptada do CBI-B (18,21) . ...
... A retrotradução é crucial no processo de adaptação transcultural de instrumentos, pois garante a equivalência semântica entre ambas as versões. Além disso, permite avaliar a qualidade da tradução inicial, identificar possíveis problemas, assegurar a fidelidade da adaptação e reforçar a confiança nos resultados obtidos em diferentes contextos culturais e linguísticos (18,(20)(21) . ...
... Assim, a construção de uma nova versão A inclusão da sigla "BR" no título do instrumento foi uma estratégia adotada para destacar e identificar a versão brasileira, sendo utilizada também nas adaptações para a Arábia Saudita (CBI-BA), (13) Itália (CBI-B/I), (15) Portugal (CBI-B/P) (16) e China (CBI-B/C) (17) . Essa abordagem é frequentemente empregada em estudos multicêntricos ou colaborativos que envolvem o uso de diferentes versões do mesmo instrumento, haja vista que padroniza a nomenclatura e contribui para uma melhor organização dos pesquisadores (9)(10)18,21) . ...
Objetivo: realizar a adaptação transcultural do Cancer Behavior Inventory - Brief Version para o Brasil. Método: estudo metodológico, realizado de acordo com as diretrizes para estudos de confiabilidade e concordância de relatórios. A adaptação transcultural do instrumento englobou as etapas de Tradução, Síntese, Retrotradução, Revisão pelo comitê de juízes e Pré-teste. Resultados: as etapas de tradução, retrotradução e avaliação pelo comitê de juízes apresentaram poucas alterações, relacionadas principalmente à substituição de termos por sinônimos, supressão de palavras e ajustes gramaticais. No entanto, o item 5 destacou-se por ter uma concordância inferior a 80% em todas as equivalências, o que indica a necessidade de modificações. O índice de validade de conteúdo e o Kappa para este item foram inferiores aos valores recomendados (0,20 e 0,37, respectivamente), evidenciando a importância de revisões adicionais para garantir a precisão e adequação do instrumento. A versão adaptada do instrumento foi submetida a um pré-teste, no qual foram realizadas novas modificações. Conclusão: o instrumento foi adaptado à cultura brasileira de forma criteriosa, resultando em uma versão culturalmente sensível, linguisticamente precisa e que preserva a integridade do instrumento original.
... Content validity assesses the extent to which an instrument covers relevant and comprehensive content areas, ensuring that every important aspect of the theoretical construct it seeks to measure is represented. Instruments that have good content validity reflect the learning objectives appropriately (Echevarría-Guanilo et al., 2019). Construct validity, on the other hand, evaluates whether the measuring instrument assesses the theoretical construct it is intended to measure, as described by Mazurek et al. (2020). ...
In biology learning, test instruments are essential for assessing students' understanding of complex concepts. A test instrument is a crucial factor in learning evaluation; however, its implementation remains minimal. This descriptive quantitative study aims to analyze the quality of test items using the classical approach in terms of validity, reliability, difficulty index, discrimination power, distractor effectiveness, and the Rasch model analysis. The data consists of 30 multiple-choice questions from a biology midterm exam administered to 40 students. Classical test data analysis uses Microsoft Excel, while Rasch model analysis uses Winsteps software. The validity test results from both approaches show 14 valid questions and 16 invalid ones. The reliability scores are 0.619 (adequate) for the classical approach's Cronbach's Alpha, 0.85 (good) for the Rasch model, and 0.65 (weak) for personal reliability. The classical test theory and the Rasch model categorize item difficulty into four levels. The classical approach produces five categories for item discrimination, while the Rasch model identifies three groups based on the item separation index (H=3.45) and two groups based on respondent ability (H=1.96). Distractor effectiveness shows 93.3% functional distractors in the classical test and 80% in the Rasch model. The Rasch model offers greater precision in measuring student ability and detecting bias. Both models should be integrated for comprehensive item analysis. Future tests should focus on improving invalid items and the quality of distractors.
... The presence of chronic diseases in these age groups can serve as an evaluation parameter for the quality and organization capacity of health networks within The instrument content validation process is essential in the process of construction and selection of the topics covered, seeking to make the content more reliable and improve the measuring instrument, so that it can truly represent the theory that supported the construction step and measure how much these items are capable of reproducing the proposed phenomenon (55) . Given this, the (59) . Mirror validation was used as a technique through which a set of instruments was adapted from the PCAT, and factor analysis was carried out on one of them, and on the others, since it was not possible to perform factor analysis due to the size of the sample, mirror validation was carried out, using as reference the instrument in which the factor analysis took place (43,(45)(46) . ...
Objective
to map the scientific literature on the validity of instruments for evaluating the quality of services provided in primary health care for chronic diseases related to systemic arterial hypertension, diabetes mellitus, leprosy and tuberculosis.
Method
scoping review, following the Joanna Briggs Institute method and described in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews. 13 databases and gray literature were included. The selection of studies was carried out after removing duplicates and individual and paired evaluation. The data was extracted based on an elaborate script and presented in tables and charts.
Results
the analysis of 28 selected studies showed that the majority were from Brazil, followed by China and Malaysia. Almost half of the validated instruments were generic, and the specific ones covered the evaluation of diabetes mellitus and leprosy. The types of validation carried out were content and construct.
Conclusion
there is a need to construct specific instruments due to the scarcity of studies on the process of validating instruments for evaluating the quality of services provided by primary health care for chronic diseases.
... El constructo convergente/divergente se refiere a una técnica en la que se utilizan otros instrumentos que miden el mismo constructo teórico y, así, se evalúa si ambos instrumentos presentarán cantidades inversa o directamente proporcionales, permitiendo la validación con base en conceptos teóricos (59) . Se utilizó la validación espejo como técnica mediante la cual se adaptó un conjunto de instrumentos del PCAT, y se realizó análisis factorial con uno de ellos, y con los demás, donde no fue posible realizar análisis factorial debido al tamaño de la muestra, se realizó validación espejo, tomando como referencia el instrumento en el que ocurrió el análisis factorial (43,(45)(46) . ...
Resumen Objetivo: mapear la literatura científica sobre la validación de instrumentos para evaluar la calidad de los servicios prestados en la atención primaria de salud para enfermedades crónicas relacionadas con la hipertensión arterial sistémica, diabetes mellitus, lepra y tuberculosis. Método: revisión de alcance, siguiendo el método del Instituto Joanna Briggs y descrito de acuerdo con el Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews. Se incluyeron 13 bases de datos y literatura gris. La selección de los estudios se realizó previa eliminación de duplicados y evaluación individual y pareada. Los datos se extrajeron basándose en un guión elaborado y se presentaron en cuadros y tablas. Resultados: el análisis de 28 estudios seleccionados mostró que la mayoría era de Brasil, seguidos de China y Malasia. Casi la mitad de los instrumentos validados eran genéricos, y los específicos cubrían la evaluación de diabetes mellitus y lepra. Los tipos de validación realizados fueron de contenido y de constructo. Conclusión: existe la necesidad de construir instrumentos específicos debido a la escasez de estudios sobre el proceso de validación de instrumentos para evaluar la calidad de los servicios prestados por la atención primaria de salud para enfermedades crónicas.
... Additionally, in a scoping review of Øygarden et al 53 on measurement instruments for parental stress during the postpartum period, it was reported that none of the 15 instruments contained information on measurement error, responsiveness, and interpretability. Echevarría-Guanilo et al 54 argue that researchers should have a comprehensive knowledge of psychometric properties to tailor the research design to the most appropriate psychometric properties of the instrument of interest. ...
Cross-cultural validation of self-reported measurement instruments for research is a long and complex process, which involves specific risks of bias that could affect the research process and results. Furthermore, it requires researchers to have a wide range of technical knowledge about the translation, adaptation and pre-test aspects, their purposes and options, about the different psychometric properties, and the required evidence for their assessment and knowledge about the quantitative data processing and analysis using statistical software. This article aimed: 1) identify all guidelines and recommendations for translation, cross-cultural adaptation, and validation within the healthcare sciences; 2) describe the methodological approaches established in these guidelines for conducting translation, adaptation, and cross-cultural validation; and 3) provide a practical guideline featuring various methodological options for novice researchers involved in translating, adapting, and validating measurement instruments. Forty-two guidelines on translation, adaptation, or cross-cultural validation of measurement instruments were obtained from “CINAHL with Full Text” (via EBSCO) and “MEDLINE with Full Text”. A content analysis was conducted to identify the similarities and differences in the methodological approaches recommended. Bases on these similarities and differences, we proposed an eight-step guideline that includes: a) forward translation; 2) synthesis of translations; 3) back translation; 4) harmonization; 5) pre-testing; 6) field testing; 7) psychometric validation, and 8) analysis of psychometric properties. It is a practical guideline because it provides extensive and comprehensive information on the methodological approaches available to researchers. This is the first methodological literature review carried out in the healthcare sciences regarding the methodological approaches recommended by existing guidelines.
... Exploratory factor analysis allows the internal assessment of the instrument, based on the definition of the data structure, which demonstrates the interrelationships between the items and the way in which their grouping explains the formation of one (one-dimensional) or more factors/ dimensions (two-dimensional or multidimensional) (23) . ...
... The exclusion of items does not necessarily mean a loss in the instrument, as it is based on scientific evidence and careful evaluation by expert judges in the area. In fact, the removal of problematic or inappropriate items can improve the quality of the adapted instrument, better reflecting the cultural reality of the country and the customs adopted by its population (17)(18)(19)23) . ...
Objective
To analyze the validity evidence of the Brazilian version of the Cancer Behavior Inventory - Brief Version.
Method
Methodological study, conducted between November and December 2021, with 140 patients undergoing hospital cancer treatment in João Pessoa, Paraíba, Brazil. Psychometric analyses were performed in the adapted version, using exploratory factor analysis and correlation with correlated constructs.
Results
A two-factor and 10-item model was evidenced. The cumulative variance explained about 61% the shared variance of the items. Satisfactory values were observed for the factors in the analyses of composite reliability (0.89 and 0.91, respectively), internal consistency (0.86 and 0.91, respectively) and ORION (0.89 and 0.85, respectively). The expected correlations of self-efficacy with quality of life (convergent) and with anxiety and depression (divergent) were evident.
Conclusion
The Brazilian version of the instrument showed evidence of validity, being considered reliable to assess the self-efficacy of patients undergoing cancer treatment.
Descriptors:
Self Efficacy; Medical oncology; Validation study; Reproducibility of results; Nursing methodology research
... A análise fatorial exploratória permite a avaliação interna do instrumento, a partir da definição da estrutura dos dados, o que demonstra as inter-relações entre os itens e a forma como o seu agrupamento explica a formação de um (unidimensional) ou mais fatores/dimensões (bidimensional ou multidimensional) (23) . ...
... A exclusão de itens não necessariamente significa uma perda no instrumento, haja vista que ocorre com embasamento em evidências científicas e na avaliação cuidadosa de juízes com reconhecida expertise na área. Na verdade, a retirada dos itens problemáticos ou inadequados pode melhorar a qualidade do instrumento adaptado, refletindo melhor a realidade cultural do país e os costumes adotados pela sua população (17)(18)(19)23) . ...
Objective
To analyze the validity evidence of the Brazilian version of the Cancer Behavior Inventory - Brief Version.
Method
Methodological study, conducted between November and December 2021, with 140 patients undergoing hospital cancer treatment in João Pessoa, Paraíba, Brazil. Psychometric analyses were performed in the adapted version, using exploratory factor analysis and correlation with correlated constructs.
Results
A two-factor and 10-item model was evidenced. The cumulative variance explained about 61% the shared variance of the items. Satisfactory values were observed for the factors in the analyses of composite reliability (0.89 and 0.91, respectively), internal consistency (0.86 and 0.91, respectively) and ORION (0.89 and 0.85, respectively). The expected correlations of self-efficacy with quality of life (convergent) and with anxiety and depression (divergent) were evident.
Conclusion
The Brazilian version of the instrument showed evidence of validity, being considered reliable to assess the self-efficacy of patients undergoing cancer treatment.
Descriptors:
Self Efficacy; Medical oncology; Validation study; Reproducibility of results; Nursing methodology research
... En el presente estudio se propuso realizar una revisión sistemática de las propiedades psicométricas de las escalas utilizadas para evaluar las competencias investigativas; debido a que la efectividad de éstas depende en gran medida de su validez (contenido, constructo y criterio) y confiabilidad (Echevarría-Guanilo et al., 2019;Zangaro, 2019). En ese sentido, permiten deducir su capacidad para medir de manera precisa las habilidades requeridas para la investigación, por lo que se debe ser consiente acerca de las limitaciones sobre los instrumentos que se aplican (McKechnie & Fisher, 2022) y su importancia al momento de ser medida, para garantizar que elijamos la mejor herramienta para la pregunta de investigación y la población objetivo (Alavi et al., 2022). ...
El estudio tuvo como finalidad explorar las propiedades psicométricas de las escalas de competencias investigativas publicados en la literatura científica en siete (7) Bases de datos: Scopus, Web of Science, ERIC, Embase, EBSCO, PubMed y SciELO entre el 2014 y junio del 2023. Se sistematizaron 13 documentos, donde se encontró 11 escalas que midieron la validez de contenido utilizando índices como el S-CVI, V de Aiken y correlaciones ítem test. De igual manera, los resultados de los análisis factoriales exploratorios (AFE) y confirmatorios (AFC) presentaron adecuados índices de ajuste como CFI, GFI, TLI, SRMR y RMSEA que validaron la estructura factorial. La confiabilidad se evaluó mayoritariamente a través del coeficiente Alfa de Cronbach, arrojando valores altos y consistentes. Además, se han empleado coeficientes como Omega de McDonald, Omega ordinal, Guttman y Spearman Brown, todos reflejando un valor por encima de .70 y consistencia interna en las mediciones. En síntesis, los instrumentos como el RCS, SRCS, RPCS, SPRDS, EAHIF, AHABI, ERL, cuestionarios de autopercepción y rúbricas han demostrado ser herramientas eficaces en la evaluación y desarrollo de habilidades investigativas. En ese sentido, estas escalas pueden mejorar la evaluación y desarrollo de habilidades investigativas en estudiantes universitarios, y se espera que futuras investigaciones las utilicen para evaluar enfoques pedagógicos y contextos internacionales.
... Echevarría-Guanilo, Gonçalves, & Romanoski, 2019). So, construct validity was looked at using Principal Component Analysis (PCA) with varimax rotation. ...
Sustainability-related endeavors are progressively employed to cultivate a favorable business reputation that enhances consumer loyalty and, as a result, enhances organizational performance. This study is situated within a specific research issue and seeks to examine the mediating function of corporate image in the association between social and moral responsibility, green practices in the workplace, and organizational performance. The study sample consisted of 223 individuals who were employed as workers, ranging in age from 18 to 64 years. The study was operationalized using a quantitative methodology. Data were collected through four questionnaires assessing employees' perceptions of social and moral responsibility, green practices in the workplace, corporate image, and the performance of the organization where they work. The results revealed that social and moral responsibility, green practices in the workplace, and corporate image have a significant positive influence on organizational performance. It was also found that when corporate image enters the model with the status of a mediating variable, the effect of social and moral responsibility on organizational performance decreases but remains significant. These results suggest that when organizational performance is evaluated, the importance attributed to corporate image overlaps with social and moral responsibility. This research highlights the importance of cultivating a positive corporate image. It also helps to increase perceptions of the organization's social and environmental responsibility and to strengthen customer loyalty by improving its reputation and fostering higher levels of trust. These improvements can subsequently increase sales, boost profits, and expand the organization's market share.
