Mohsen Tavakol’s research while affiliated with University of Nottingham and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (61)


Twelve tips for using phenomenology as a qualitative research approach in health professions education
  • Article

March 2025

·

18 Reads

Mohsen Tavakol

·

John Sandars

Phenomenology is a qualitative research approach that seeks to understand the individual meanings of lived experience . This 12 Tips article highlights the importance of understanding the philosophical foundations that inform the choice of phenomenological research study, including descriptive and interpretive phenomenology. The article provides a practical guide to the choice of the most appropriate phenomenological research approach and the process of data collection, iterative data analysis and interpretation, with consideration of the essential aspects of bracketing and reflexivity.



Ensuring fairness in assessment in health professions education: rapid analysis tools to detect differential item functioning across groups
  • Article
  • Full-text available

July 2024

·

9 Reads

·

1 Citation

International Journal of Medical Education

Download

Determining intra-standard-setter inconsistency in the Angoff method using the three-parameter item response theory

September 2023

·

15 Reads

·

3 Citations

International Journal of Medical Education

Objectives: To measure intra-standard-setter variability and assess the variations between the pass marks obtained from Angoff ratings, guided by the latent trait theory as the theoretical model. Methods: A non-experimental cross-sectional study was conducted to achieve the purpose of the study. Two knowledge-based tests were administered to 358 final-year medical students (223 females and 135 males) as part of their normal summative programme of assessments. The results of judgmental standard-setting using the Angoff method, which is widely used in medical schools, were used to determine intra-standard-setter inconsistency using the three-parameter item response theory (IRT). Permission for this study was granted by the local Research Ethics Committee of the University of Nottingham. To ensure anonymity and confidentiality, all identifiers at the student level were removed before the data were analysed. Results: The results of this study confirm that the three-parameter IRT can be used to analyse the results of individual judgmental standard setters. Overall, standard-setters behaved fairly consistently in both tests. The mean Angoff ratings and conditional probability were strongly positively correlated, which is a matter of inter-standard-setter validity. Conclusions: We recommend that assessment providers adopt the methodology used in this study to help determine inter and intra-judgmental inconsistencies across standard setters to minimise the number of false positive and false negative decisions.



Twelve tips to aid interpretation of post-assessment psychometric reports

August 2023

·

43 Reads

·

6 Citations

Post-assessments psychometric reports are a vital component of the assessment cycle to ensure that assessments are reliable, valid and fair to make appropriate pass-fail decisions. Students' scores can be summarised by examination of frequency distributions, central tendency measures and dispersion measures. Item discrimination indicies to assess the quality of items, and distractors that differentiate between students achieving or not achieving the learning outcomes are key. Estimating individual item reliability and item validity indices can maximise test-score reliability and validity. Test accuracy can be evaluated by assessing test reliability, consistency and validity and standard error of measurement can be used to measure the variation. Standard setting, even by experts, may be unreliable and reality checks such as the Hofstee method, P values and correlation analysis can improve validity. The Rasch model of student ability and item difficulty assists in modifying assessment questions, pinpointing areas for additional instruction. We propose 12 tips to support test developers in interpreting structured psychometric reports, including analysis and refinement of flawed items and ensuring fair assessments with accurate and defensible marks.





Psychometrics for physicians: everything a clinician needs to know about assessments in medical education

April 2022

·

205 Reads

·

8 Citations

International Journal of Medical Education

Assessments in medical education, with consequent decisions about performance and competence, have both a profound and far-reaching impact on students and their future careers. Physicians who make decisions about students must be confident that these decisions are based on objective, valid and reliable evidence and are thus fair. An increasing use of psychometrics has aimed to minimise measurement bias as a major threat to fairness in testing. Currently, there is substantial literature on psychometric methods and their applications, ranging from basic to advanced, outlining how assessment providers can improve their exams to make them fairer and minimise the errors attached to assessments. Understanding the mathematical models of some of these methods may be difficult for some assessment providers, and in particular clinicians. This guide requires no prior knowledge of mathematics and describes some of the key methods used to improve and develop assessments; essential for those involved in interpreting assessment results. This article aligns each method to the Standards for educational and psychological testing framework, recognised as the gold standard for testing guidance since the 1960s. This helps the reader develop a deeper understanding of how assessors provide evidence for reliability and validity with consideration to test construction, evaluation, fairness, application, and consequences, and provides a platform to better understand the literature in regards other more complex psychometric concepts that are not specifically covered in this article.


Citations (52)


... Tavakol and colleagues in their paper on ensuring fairness in assessment in health professions education emphasize the important role the SEPT plays in ensuring that potential biases in test development and administration are minimized, and that tests are fair for all intended groups regardless of examinee characteristics. 5 According to the SEPT, fairness includes elements such as fairness in treatment during the testing process, fairness as a lack of measurement bias, fairness in access to the constructs as measured without the test taker being biased by personal characteristics such as age, disability, gender, race, ethnicity or language, which ensures that the test measures only what it is intended to measure, and not factors that are irrelevant. Fairness also includes ensuring the validity of individual test score interpretations for the intended uses. ...

Reference:

A critical analysis of The Royal College of Physicians and Surgeons of Canada examination experience
Ensuring fairness in assessment in health professions education: rapid analysis tools to detect differential item functioning across groups

International Journal of Medical Education

... Also, validation of standard-setting methods is a crucial component of quality assurance in medical education as there are no gold standard methods of standard setting to be named (4)(5). Thirty or more standard-setting methods have been grouped into relative, test-centered, and student-centered (7). Assessments in medical education use criterionreferenced methods (test/examinee) to determine mastery of the candidates and norm-referenced or relative methods to rank examinees (8). ...

Determining intra-standard-setter inconsistency in the Angoff method using the three-parameter item response theory
  • Citing Article
  • September 2023

International Journal of Medical Education

... For example, we have recently merged the Rasch model and the Angoff ratings allowing for a systematic conversion of subjective judgments into an objective measurement scale aiming to provide a deep understanding of item difficulty, considering both empirical data and opinions of standard setters, potentially enhancing the fairness and accuracy of assessments. 7 For more details on these variants, we suggest referring to the Berk guide. 4 Neither pass-mark or pass-mark based decision making are immune from random or systematic errors. ...

Merging relative and absolute methods: The IRT-Angoff method for pass mark identification
  • Citing Article
  • August 2023

... Lastly, the questions were not administered to students. Therefore, psychometric properties such as the difficulty index-which indicates the proportion of correct answers by students-and the discrimination index-which shows how well the question can differentiate between high-performing and low-performing students (Tavakol et al. 2024)-were not evaluated. ...

Twelve tips to aid interpretation of post-assessment psychometric reports
  • Citing Article
  • August 2023

... More of classroom time is then devoted to applying concepts through problem solving and peer collaboration, with teachers facilitating active learning [1,5,6]. This approach not only Contextualizing new inquiries within prior studies is useful in framing educational research [31]. Our earlier research examined senior secondary students' mathematics learning experiences in flipped classrooms, providing foundational insights that inform our present study on teachers' perspectives on the instructional model. ...

The importance of crafting a good introduction to scholarly research: strategies for creating an effective and impactful opening statement

International Journal of Medical Education

... Assessment preparation for high-stakes medical school examinations typically involves many laborious and resourceintensive processes, from blueprinting [1], question item writing and review [2], standard setting [3], to post hoc analysis [4]. The last of these, post hoc analysis, helps to ensure that assessments are reliable, valid, and fair [5] ensuring the integrity of the examination process and assuring stakeholders that assessments effectively evaluate the competencies and knowledge required for the medical degree. ...

Psychometrics for physicians: everything a clinician needs to know about assessments in medical education

International Journal of Medical Education

... The objective structured clinical examination (OSCE) provides an objective, orderly and organised assessment framework, in which medical schools, hospitals, or medical or examination institutions can add corresponding assessment contents and methods according to their teaching and examination syllabus. 1 This method tests the clinical abilities of nurses or nursing students by simulating clinical scenarios. 2 It is also a clinical ability assessment method that emphasises knowledge, skills and attitude. ...

Does widening participation status affect undergraduate medical student performance; a meta-analysis of knowledge-based assessments and OSCE over a 5-year period
  • Citing Article
  • December 2021

... Feedback is one of the most studied educational interventions, and there is much evidence for the role of feedback in enhance learning within the psychology and education literature (Wisniewski Zierer and Hattie 2019). A number of reviews and guides on giving feedback are available (for example, see Veloski et al. 2006;Wulf Shea and Lewthwaite 2010;Tavakol et al. 2022), however, there are specific considerations when giving feedback about the development of clinical skills from a cognitive science perspective. ...

Feedback to support examiners’ understanding of the standard-setting process and the performance of students: AMEE Guide No. 145
  • Citing Article
  • November 2021

... The factor loading is the correlation between the item and the factor; a factor loading of more than 0.30 usually indicates a moderate correlation between the item and the factor. 34 For items cross-loaded on factors, the retention of the item to the factor was determined by two criteria: (1) a higher loading effect of the item onto the factor and (2) the item's interpretability. ...

Factor Analysis: a means for theory and instrument development in support of construct validity

International Journal of Medical Education

... Multifaceted approaches provide exacting and precise methods for distinguishing aspects of high stakes certification and licensure assessments that might otherwise be confounded (Myford & Wolfe, 2009;Smith et al., 1994;Tavakol & Pinner, 2019;Warner et al., 2020). The multifaceted approach incorporates these known components within a singular and unified measurement activity that, like other models of this kind, offers otherwise unavailable degrees of simplicity, elegance, and parsimony (Cano et al., 2016). ...

Using the Many-Facet Rasch Model to analyse and evaluate the quality of objective structured clinical examination: a non-experimental cross-sectional design

BMJ Open