ArticlePDF Available

Evaluating the effectiveness of Uganda’s Supranational TB Reference Laboratory quality management system training program

Authors:
  • National Tuberculosis Reference Laboratory Uganda
  • National Tuberculosis reference laboratory-uganda

Abstract and Figures

Background Achieving the targeted organizational goals through effective training can increase employee satisfaction. Since 2015, the Supranational Reference Laboratory Uganda (SRL Uganda) has trained National Tuberculosis Reference Laboratories (NTRLs) from 21 countries in a variety of areas that cover both technical and programmatic aspects pertinent to TB laboratories. The Laboratory Quality Management System (LQMS) under SRL coordinates actions intended to ensure sustained quality of the laboratory services offered by the National TB Reference Laboratories. In order for laboratory results to be helpful in a clinical or public health setting, they must be accurate, reliable, and timely. The LQMS course aims to provide learners with knowledge on how to attain and maintain this quality. Prior to this study, there was hardly any data available on the effectiveness of LQMS trainings provided by SRL Uganda; using Kirkpatrick model, which is popular among researchers for evaluating the efficacy of the training program, this paper seeks to establish the effectiveness of the LQMS training offered by the SRL Uganda. Method We evaluated the effectiveness of LQMS training within the Uganda’s SRL network for courses offered during the period 2017 and 2021 for participants from the Southern and East African sub-Saharan region. Results In 2017 and 2021, respectively, test results from 10/17 and 9/17 showed overall post-test scores above 80%. Of the 18 labs evaluated, 14 showed improvement; of these, 7 labs were from the Eastern region and the other 7 were from Southern Africa; one facility in this region also maintained its accreditation. In the post-evaluation assessment, attendees of the LQMS course gave feedback of strongly agree and agree variety. Conclusion More SRL Uganda network laboratories in the regions achieved a 5-star SLIPTA level rating and among these, 5 NTRLs got ISO 15189:2012 accredited by the end of 2021, while one maintained its accreditation status. This proves that the Laboratory Quality Management System training program was an effective tool in improving the quality of laboratory services, work practices, and processes.
This content is subject to copyright. Terms and conditions apply.
Dorothyetal. Human Resources for Health (2023) 21:89
https://doi.org/10.1186/s12960-023-00876-8
RESEARCH
Evaluating theeectiveness ofUgandas
Supranational TB Reference Laboratory quality
management system training program
Nakiwala Dorothy1* , Benjamini Niringiyimana1, Wekiya Enock1, Ocung Guido1, Kabugo Joel1, Adam Isa1,
Anita Katuramu1, Orena Beatrice1, Christine Nansubuga Korsah1, Lillian Kyomugasho1, Denis Oola1,
Kenneth Musisi1, Eunjung Kim2, Nayeong Yu2, Ruth Kaliisa2, Yeni Lee2, Bounggui Kim2, Ssenyonga Ronald3,
Noah Kiwanuka3, Katamba Achilles3 and Moses L. Joloba1
Abstract
Background Achieving the targeted organizational goals through effective training can increase employee satisfac-
tion. Since 2015, the Supranational Reference Laboratory Uganda (SRL Uganda) has trained National Tuberculosis
Reference Laboratories (NTRLs) from 21 countries in a variety of areas that cover both technical and programmatic
aspects pertinent to TB laboratories. The Laboratory Quality Management System (LQMS) under SRL coordinates
actions intended to ensure sustained quality of the laboratory services offered by the National TB Reference Labora-
tories. In order for laboratory results to be helpful in a clinical or public health setting, they must be accurate, reliable,
and timely. The LQMS course aims to provide learners with knowledge on how to attain and maintain this quality.
Prior to this study, there was hardly any data available on the effectiveness of LQMS trainings provided by SRL Uganda;
using Kirkpatrick model, which is popular among researchers for evaluating the efficacy of the training program, this
paper seeks to establish the effectiveness of the LQMS training offered by the SRL Uganda.
Method We evaluated the effectiveness of LQMS training within the Uganda’s SRL network for courses offered dur-
ing the period 2017 and 2021 for participants from the Southern and East African sub-Saharan region.
Results In 2017 and 2021, respectively, test results from 10/17 and 9/17 showed overall post-test scores above 80%.
Of the 18 labs evaluated, 14 showed improvement; of these, 7 labs were from the Eastern region and the other 7 were
from Southern Africa; one facility in this region also maintained its accreditation. In the post-evaluation assessment,
attendees of the LQMS course gave feedback of strongly agree and agree variety.
Conclusion More SRL Uganda network laboratories in the regions achieved a 5-star SLIPTA level rating
and among these, 5 NTRLs got ISO 15189:2012 accredited by the end of 2021, while one maintained its accreditation
status. This proves that the Laboratory Quality Management System training program was an effective tool in improv-
ing the quality of laboratory services, work practices, and processes.
Keywords LQMS, SLIPTA, WHO AFRO checklist, NTRL accreditation, Training, Sub-Saharan Africa, SRL
Open Access
© The Author(s) 2023. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which
permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the
original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or
other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line
to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory
regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this
licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecom-
mons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
Human Resources for Health
*Correspondence:
Nakiwala Dorothy
nakiwaladorah@gmail.com
Full list of author information is available at the end of the article
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
Page 2 of 6
Dorothyetal. Human Resources for Health (2023) 21:89
Background
Training is a useful investment and is one of the most
important factors in human resource development [1].
rough training, employers can shape employees’ com-
petencies and develop their potential to perform tasks [2]
more efficaciously toward attainment of organizational
goals. Effective training can improve employee satisfac-
tionby motivating them and making them realize their
potential and career goals [1].
e Uganda National Tuberculosis Reference Labora-
tory (NTRL) which doubles as a Supranational Reference
Laboratory (SRL) since 2013 has immensely expanded
the frontiers of its mandate beyond providing external
quality assurance and supporting disease surveillance
studies in the region; to becoming a training HUB in TB
diagnostic programs.
For the last 7 years since 2015, Uganda has provided
trainings to the regional NTRLs from 21 countries based
in sub-Saharan African on both technical and program-
matic areas. e level of trainings is internationally rec-
ognized with the SRL-Uganda’s training program being
accredited by International Accreditation for Continuous
Education and Training (IACET) in 2021. e trainings
include development of National Strategic Plans (NSP),
preparation of Proficiency Testing (PT) panels, imple-
mentation of phenotypic and genotypic Drug Susceptibil-
ity Testing (DST), Bioinformatics (Genomics), Biosafety
& Biosecurity and implementation of Laboratory Qual-
ity Management System (LQMS), Benchmarking visits
among others.
e most crucial aspect of medical laboratory testing
is the implementation of LQMS that wholly coordinates
activities that direct and control laboratories with regard
to quality (ISO 15189:2012). e LQMS course offered by
SRL-Uganda aims to impart participants with knowledge
on how to achieve quality laboratory results with insights
of accuracy, reliability, and timeliness to positively impact
clinical or public health decisions. e LQMS training is
conducted for 10 days (41 contact hours) with method-
ology of knowledge and skills transfer following didactic
sessions. e training materials were developed by SRL-
Uganda with reference to ISO 15189:2012 and global lab-
oratory initiative (GLI).
For any training course to show effectiveness, there is
need to provide trend analysis of implementation among
the trainees enrolled on the program over time to rec-
ognize achievement of its intended outcomes [3]. It has
been documented that training evaluation is a criti-
cal component of analyzing, designing, developing, and
implementing an effective training program, creating
room to also identify training needs [410].
Using Kirkpatrick model, we evaluated the reaction,
learning, and results impact of QMS training program
within Uganda SRL network participating laboratories
based in two African regions (Eastern, and Southern
Africa) over two time points (2017 and 2021). Kirkpat-
rick’s model assesses the effectiveness of training pro-
grams at four levels: (1) response of the trainee to the
training experience (including training experience); (2)
the learner’s learning outcomes and increases in knowl-
edge, skill, and attitude toward the attendance experience
(how much attendees learned the content after train-
ing). is level usually measured through using a pre-
test and post-test; (3) the students’ change in behavior
and improvement (whether the learning transferred into
practice in the workplace); and (4) results (the ultimate
impact of training) [4, 7, 8].
Methods
Study design andparticipants
is was a retrospective cross-sectional study that was
conducted at the SRL-Uganda to evaluate the effective-
ness of the LQMS offered for the period 2017 and 2021.
e study involved laboratory personnel under the
SRL-Uganda network that underwent two LQMS train-
ing in 2017 and 2021. e countries included Kenya, Tan-
zania, Somalia, South Sudan, Burundi, Eritrea, Rwanda,
and Somaliland from the Eastern region, and Lesotho,
Zimbabwe, Zambia, Malawi, Botswana, Mauritius, Sey-
chelles, Mozambique, and Namibia from the southern
region.
e LQMS training entailed the 12 Quality System
Essentials (QSE) that included Organization, Person-
nel, Equipment, Purchase and Inventory, Process con-
trol, Information Management, Documents and records,
Occurrence Management, Assessment, Process Improve-
ment, Customer service, and Facilities and Safety.
Measurement variables
We used e Kirkpatrick’s Model that is a framework
with four measurable levels designed to evaluate the
effectiveness of training programs, i.e., Reaction, Learn-
ing, Behavior, and Results [4]. ree out of the four lev-
els of the Kirkpatrick’s model were evaluated under this
study as follows:
For Level 1—Reaction; we assessed the general satis-
faction and perception of participants about the training
courses they had received from SRL Uganda. Data were
collected using self-administered evaluation forms at the
end of the training course and these were anonymized to
ensure confidentiality. e evaluation form consisted of
different parameters on which participants were assessed
and this includes Relevance of the training to partici-
pants’ work, overall rating of the training, overall training
objectives/outcomes met, ability to apply the knowledge
and whether the training met participants’ expectations.
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
Page 3 of 6
Dorothyetal. Human Resources for Health (2023) 21:89
For each question, scores were graded using Likert scale
from 1 to 5 (1—strongly disagree, 5—strongly agree).
For Level 2—Learning; participants’ knowledge on the
course content was assessed before and after the LQMS
training course to determine if the learning objectives
had been met. Data on participants’ performance were
collected from pre- and post-tests for this evaluation.
Satisfactory performance was achieved if a participant
scored above 80% in the post-test.
For Level 4—Results; we assessed the outcome and
impact of the training using Data derived from the LQMS
scores using the WHO AFRO SLIPTA assessment check-
list and evidence of record accreditation within the study
period.
Data analysis
We analyzed data using STATA ver 15.0. We performed a
two-sample test for proportion. We described the coun-
tries by region and sex of the participants. Data were pre-
sented in tabular form.
Level 1: Reaction—to determine for each item/ques-
tion: relevance of the training to participants’ work,
overall rating of the training, overall training objec-
tives/outcomes met, ability to apply the knowledge and
whether the training met participants’ expectations,
we summed up the total number of participants who
responded to each category on the Likert scale and we
used a bar graph to present the total number of partici-
pants who responded to each of the five questions along
the categories of the Likert scale.
Level 2: Learning—we compared the proportion of
participants who score 80% between the pre- and post-
test scores by region in 2017 and 2021, respectively. We
assessed for any significant difference (p 0.05) in the
knowledge of participants between the pre- and post-test
scores.
Level 4: Results—we compared the Quality Manage-
ment System status of the laboratories before and after
the LQMS training based on the WHO AFRO SLIPTA
assessment results and certificates of international
accreditation to ISO 15189:2012.
Results
A total of 34 participants from 17 countries in sub-Saha-
ran Africa were evaluated for LQMS trainings organized
in 2017 and 2021 by Uganda SRL. Of these, 20 partici-
pants were from the Southern African region while 14
were from the Eastern African region, we had 20 females
and 14 males (Table1).
An overall post-test score of above 80% was achieved
by 10/17 and 9/17 participants in 2017 and 2021, respec-
tively. ere was a significant (p = 0.001 and < 0.001)
improvement in participants’ knowledge over the two
trainings. Better performance was observed in the South-
ern African region in both 2017 and 2021(Table2).
Of the 17 country laboratories that were assessed, 14
showed improvement, among these, 7 laboratories were
from Eastern African region and 7 from the Southern
African region, 1 facility maintain its accreditation status.
In terms of WHO AFRO SLIPTA star-level rating, there
was a tremendous improvement with more SRL Uganda
supported laboratories progressing from star 0, 1, 2, 3, 5
in 2017 to star 1, 2, 3, and ISO 15189:2012 Accreditation
(Fig.1).
In 2015, from baseline data we had 7 laboratories at 0
stars (Red color), 3 labs at 1 star (Orange color), 2 labs at
2 stars (Yellow color), 3 labs at 3 stars (Blue color) and 2
labs at 5 stars (Green color). After the initial LQMS train-
ing in 2017, we observed a tremendous improvement
where a number of labs moved from star 0 (Red color)
to star 3 (Blue color) and 5 (Green color) and eventually
8 laboratories got accredited for ISO 15189:2012 by 2022
post-LQMS training.
Strongly agree and agree were the only evaluation
responses from all the participants that attended LQMS
training in both 2017 and 2021 as reflected in Fig.2
Discussion
In this cross-section study, we evaluated the effectiveness
of LQMS training program at Supranational Reference
Laboratory Network. e study focused on the three
domains of the Kirkpatrick’s program evaluation model
that includes reaction, learning, and results.
e findings of the study indicated that the LQMS
training program was effective based on the three
domains.
As far as reaction is concerned, participants were sat-
isfied with the LQMS training in terms of relevance to
their work, training objectives/outcomes, participants’
expectations met and will be able to apply the knowl-
edge gained. ese findings are similar to studies con-
ducted by [11], effect of in-service educational courses
on human resources’ efficiency from university experts’
Table 1 Number of participants that attended the LQMS
training in 2017 and 2021 by region and sex
Eastern African region (Kenya, Tanzania, Somalia, South Sudan, Burundi, Eritrea,
Rwanda and Somaliland), Southern African region (Lesotho, Zimbabwe, Zambia,
Malawi, Botswana, Mauritius, Seychelles, Mozambique and Namibia)
African regions Sex Overall
Male Female
Eastern 9 5 14
Southern 11 9 20
Total 20 14 34
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
Page 4 of 6
Dorothyetal. Human Resources for Health (2023) 21:89
point of view suggested that half of the staff believed that
the workshop was perfect.
Our study findings showed that participants from two
regions had a significant improvement in knowledge over
the two LQMS trainings with an overall countries’ labo-
ratories post-test score of 10/17 and 9/17 respectively in
2017 and 2021. e finding further showed a better per-
formance in the Southern Africa region in the 2 years
compared to the Eastern region. e results suggest that
the training program was one of the effective way in
increasing participant knowledge. In line with our study,
[12] found that training was effective in increasing the
participants’ learning and knowledge in study where they
examined the effect of in-service training on cardiopul-
monary resuscitation using Kirkpatrick’s model [12].
In this study, we show that 14 (78%) country labora-
tories significantly improved as per the WHO AFRO
SLIPTA assessment and international accreditation
(includes maintenance and attainment). Half of the coun-
tries’ laboratories were from the Eastern Africa region.
ese results showed that participants used the knowl-
edge attained to improve practices and processes in their
laboratories. It is possible that some of the improvement
we observed was due to post-training activities such as
technical assistance and regular follow-up supervisory
visits, ongoing mentorship, and affordable, cost-effective
bench marking visits to countries with similar operating
environments, backgrounds, and cultures [13, 14] as well
as other special fundings. e extensive Proficiency Test-
ing Program offered by SRL Uganda to regional NTRLs
at no cost was crucial in removing a stumbling block
toward accreditation.
Further analysis of the results revealed that two
labs did not significantly improve while three labs
kept their star rating of three stars. High staff turno-
ver, poor knowledge transfer, a limited leadership
Table 2 Performance scores from the LQMS training in 2017 and 2021 (using the learning level in the Kirkpatrick’s Evaluation Model
with an 80% cut off)
African regions 2017 Two
proportions
p-value
Pre-test Post-test
Eastern 0/7 2/7
Southern 1/10 8/10
Overall-1 1/17 10/17 0.001
2021
Pre-test Post-test
Eastern 0/6 2/6
Southern 0/11 7/11
Overall-2 0/17 9/17 < 0.001
Fig. 1 Choropleth map of ECSA/SRL-Uganda supported countries comparison by WHO AFRO SLIPTA level rating at baseline (2015), mid project
(2018) and current level (2022), (before and after project intervention) (2015–2022)
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
Page 5 of 6
Dorothyetal. Human Resources for Health (2023) 21:89
commitment to quality improvement, and the belief
that TB is not a big problem making it a non-prior-
ity area worth funding all could have played a role in
this, despite being heavily resourced [15] Due to the
full-time commitment and participation of LQMS
mentored staff, we were able to witness that labora-
tories in conflict zones with equally limited resources
made a significant shift from star 0 to star 1 despite
the upheavals. In addition, SRL Uganda is currently
providing them continuous technical support as they
move closer to ISO 15189:2012 accreditation. The
strength of this study is that it included representative
participants from East and Southern Africa region and
tasked them with the sole responsibility of enhancing
the quality of TB diagnostic services. This study used
the standardized structured tools to collect data used
in evaluating the training program.
The study did not evaluate the third level of the
Kirkpatrick model and was limited by availability of
published data on all the four Kirkpatrick model lev-
els to compare our findings with findings elsewhere.
The training program evaluation was further limited
by the ability of participants to reply to the surveys in
English with varied clarity, which led to some confus-
ing or shortened responses, which further limited the
responses for program evaluation. The choice of the
study design limited comparability of our results with
laboratories that did not receive LQMS training.
Conclusion
e Laboratory Quality Management System training
program was effective in improving the quality of labo-
ratory work practices and processes. Further research
ought to be carried out in assessing the 3rd level (behav-
ior) of Kirkpatrick’s model in assessing the impact of
LQMS training on improving the quality of laboratory
services and to understand the causal relationship and
isolate the impact of the training program from other
concurrent or subsequent support.
Acknowledgements
We would like to express our gratitude to the distinguished participants from
the various countries that participated in the LQMS mentorship programme
run by SRL Uganda and significantly applied the knowledge and skills they
acquired to raising the quality of TB laboratory services.
Author contributions
ND, BN, WE, OG, KJ, IA, AK, LK, DO and MLJ contributed to the conception of
the study; ND, BN, WE, OG, KJ, IA, AK, LK, DO, SR, NK, KA and MLJ contributed
to the design of the work; ND, BN, WE, OG, KJ, IA, AK, LK, DO, SR, NK, KA and
MLJ contributed to the acquisition and analysis of data; ND, BN, WE, OG, KJ, IA,
AK, OB, CNK, LK, DO, KM, EK, NY, RK, YL, BK, SR, NK, KA and MLJ contributed to
the interpretation of data; ND, BN, WE, OG, KJ, IA, AK, OB, CNK, LK, DO, KM, EK,
NY, RK, YL, BK, SR, NK , KA and MLJ drafted the work and substantively revised
it; ND, BN, WE, OG, KJ, IA, AK, OB, CNK, LK, DO, KM, EK, NY, RK, YL, BK, SR, NK, KA
and MLJ approved the submitted version; ND, BN,WE, OG, KJ, IA, AK, OB, CNK,
LK, DO, KM, EK, NY, RK, YL, BK, SR, NK, KA and MLJ agreed both to be personally
accountable for the author’s own contributions and to ensure that ques-
tions related to the accuracy or integrity of any part of the work, even ones
in which the author was not personally involved, appropriately investigated,
resolved, and the resolution documented in the literature. All authors read and
approved the final manuscript.
0
2
4
6
8
10
12
14
16
18
20
AgreeStrongly agreeAgree Strongly agree
2017 2021
Participant response
Participant evaluation feedback
Training met my expectation Able to apply the knowledg e Overall training objective outcome Overall rating of the training Training relevant to my work
Fig. 2 Training evaluation feedback for participants that attended the Laboratory Quality Management System (LQMS) training in 2017 and 2021
as organized by SRL Uganda
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
Page 6 of 6
Dorothyetal. Human Resources for Health (2023) 21:89
fast, convenient online submission
thorough peer review by experienced researchers in your field
rapid publication on acceptance
support for research data, including large and complex data types
gold Open Access which fosters wider collaboration and increased citations
maximum visibility for your research: over 100M website views per year
At BMC, research is always in progress.
Learn more biomedcentral.com/submissions
Ready to submit your research
Ready to submit your research
? Choose BMC and benefit from:
? Choose BMC and benefit from:
Funding
The author(s) received no special funding for this work. The financial support
to run all the above activities was part of the funding such as Participants
enrolled into this training program were facilitated by ECSA-Global fund
project and World Vision (For Somaliland) under Funding Number QPA T
ECSA 890(2015-2019) and QPA T ECSA 1832(2019-2022). The review process,
standardization of the developed training material and accreditation of the
training programme was supported by the Korea Foundation for International
Healthcare (KOFIH) under Funding Number 2019130766.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from
the corresponding author on reasonable request.
Declarations
Ethics approval and consent to participate
Ethical permission and approval to conduct the study was sought from
the National Health Laboratory Diagnostic Services REC and a waiver was
obtained from the National Tuberculosis Reference Laboratory Management
to utilize the training data respectively.
Competing interests
The authors declare that they have no competing interests.
Author details
1 National Tuberculosis Reference Laboratory/WHO Supranational Reference
Laboratory, Kampala, Uganda. 2 Korea Foundation for International Health-
care (KOFIH), Seoul, Korea. 3 College of Health Science, Makerere University,
Kampala, Uganda.
Received: 28 November 2022 Accepted: 16 November 2023
References:
1. Heydari MR, Taghva F, Amini M, Delavari S. Using Kirkpatricks model to
measure the effect of a new teaching and learning methods workshop
for health care staff. BMC Res Notes. 2019;12(1):388.
2. Urbancová H, Vrabcová P, Hudáková M, Petrů GJ. Effective training evalu-
ation: the role of factors influencing the evaluation of effectiveness of
employee training and development. Sustainability. 2021;13(5):1–14.
3. Kraiger K, Ford JK, Salas E. Application of cognitive, skill-based, and affec-
tive theories of learning outcomes to new methods of training evalua-
tion. J Appl Psychol. 1993;78:311–28.
4. Bates R. A critical analysis of evaluation practice: the Kirkpatrick model
and the principle of beneficence. Eval Program Plann. 2004;27(3):341–7.
5. Farjad S. The evaluation effectiveness of training courses in university by
Kirkpatrick Model (case study: Islamshahr University). Proc Soc Behav Sci.
2012;1(46):2837–41.
6. Machles D. Situated learning. Prof Saf. 2003;48(9):22–8.
7. Hasani H, Bahrami M, Malekpour A, Dehghani M, Allahyary E, Amini M,
et al. Evaluation of teaching methods in mass CPCR training in different
groups of the society, an observational study. Medicine. 2015;94(21):e859.
8. Patel SR, Margolies PJ, Covell NH, Lipscomb C, Dixon LB. Using instruc-
tional design, analyze, design, develop, implement, and evaluate, to
develop e-learning modules to disseminate supported employment for
community behavioral health treatment programs in New York State.
Front Public Health. 2018. https:// doi. org/ 10. 3389/ fpubh. 2018. 00113.
9. La Duke P. How to evaluate training: using the Kirkpatrick model—Pro-
Quest. 2017. https:// www. proqu est. com/ openv iew/ cc679 8f52b 45be6
2de59 1c1be 70f9a a2/1? pq- origs ite= gscho lar& cbl= 47267. Accessed 18
Nov 2022.
10. Frye AW, Hemmer PA. Program evaluation models and related theories:
AMEE Guide No. 67. Med Teach. 2012;34(5):e288–99.
11. browse.pdf. http:// edcbmj. ir/ browse. php?a_ code=A- 10- 131- 1& slc_ lang=
fa& sid= 1& ftxt=1. Accessed 18 Nov 2022.
12. Dorri S, Akbari M, Dorri SM. Kirkpatrick evaluation model for in-service
training on cardiopulmonary resuscitation. Iran J Nurs Midwifery Res.
2016;21(5):493–7.
13. Maruta T, Motebang D, Mathabo L, Rotz P, Wanyoike J, Peter T. Impact of
mentorship on WHO-AFRO strengthening laboratory quality improve-
ment process towards accreditation (SLIPTA). Afr J Lab Med. 2012;15:1.
14. Guevara G, Parris K, Albalak R, Alemnji G, Gordon F, Irving Y, et al. The
impact of SLMTA in improving laboratory quality systems in the Carib-
bean Region. Afr J Lab Med. 2016;5(2):1–9.
15. Audu RA, Sylvester-Ikondu U, Onwuamah CK, Salu OB, Ige FA, Meshack E,
et al. Experience of quality management system in a clinical laboratory in
Nigeria. Afr J Lab Med. 2012;1(1):18.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in pub-
lished maps and institutional affiliations.
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
1.
2.
3.
4.
5.
6.
Terms and Conditions
Springer Nature journal content, brought to you courtesy of Springer Nature Customer Service Center GmbH (“Springer Nature”).
Springer Nature supports a reasonable amount of sharing of research papers by authors, subscribers and authorised users (“Users”), for small-
scale personal, non-commercial use provided that all copyright, trade and service marks and other proprietary notices are maintained. By
accessing, sharing, receiving or otherwise using the Springer Nature journal content you agree to these terms of use (“Terms”). For these
purposes, Springer Nature considers academic use (by researchers and students) to be non-commercial.
These Terms are supplementary and will apply in addition to any applicable website terms and conditions, a relevant site licence or a personal
subscription. These Terms will prevail over any conflict or ambiguity with regards to the relevant terms, a site licence or a personal subscription
(to the extent of the conflict or ambiguity only). For Creative Commons-licensed articles, the terms of the Creative Commons license used will
apply.
We collect and use personal data to provide access to the Springer Nature journal content. We may also use these personal data internally within
ResearchGate and Springer Nature and as agreed share it, in an anonymised way, for purposes of tracking, analysis and reporting. We will not
otherwise disclose your personal data outside the ResearchGate or the Springer Nature group of companies unless we have your permission as
detailed in the Privacy Policy.
While Users may use the Springer Nature journal content for small scale, personal non-commercial use, it is important to note that Users may
not:
use such content for the purpose of providing other users with access on a regular or large scale basis or as a means to circumvent access
control;
use such content where to do so would be considered a criminal or statutory offence in any jurisdiction, or gives rise to civil liability, or is
otherwise unlawful;
falsely or misleadingly imply or suggest endorsement, approval , sponsorship, or association unless explicitly agreed to by Springer Nature in
writing;
use bots or other automated methods to access the content or redirect messages
override any security feature or exclusionary protocol; or
share the content in order to create substitute for Springer Nature products or services or a systematic database of Springer Nature journal
content.
In line with the restriction against commercial use, Springer Nature does not permit the creation of a product or service that creates revenue,
royalties, rent or income from our content or its inclusion as part of a paid for service or for other commercial gain. Springer Nature journal
content cannot be used for inter-library loans and librarians may not upload Springer Nature journal content on a large scale into their, or any
other, institutional repository.
These terms of use are reviewed regularly and may be amended at any time. Springer Nature is not obligated to publish any information or
content on this website and may remove it or features or functionality at our sole discretion, at any time with or without notice. Springer Nature
may revoke this licence to you at any time and remove access to any copies of the Springer Nature journal content which have been saved.
To the fullest extent permitted by law, Springer Nature makes no warranties, representations or guarantees to Users, either express or implied
with respect to the Springer nature journal content and all parties disclaim and waive any implied warranties or warranties imposed by law,
including merchantability or fitness for any particular purpose.
Please note that these rights do not automatically extend to content, data or other material published by Springer Nature that may be licensed
from third parties.
If you would like to use or distribute our Springer Nature journal content to a wider audience or on a regular basis or in any other manner not
expressly permitted by these Terms, please contact Springer Nature at
onlineservice@springernature.com
... Their responsibilities include examining blood, urine, fluids, and tissues to ensure correct diagnosis and appropriate treatment of patients, as well as improving medical practice as a whole [2,3]. MLPs must also ensure effective quality management to guarantee the precision, reliabil-ity, and accuracy of results, essential to the effectiveness of clinical judgments and the well-being of patients [4,5]. ...
... In addition, QMS training plays an important role in strengthening the quality culture within teams [13], promoting the development and preservation of professionals' knowledge and skills [14,15]. This results in improved accuracy and reliability of results, a crucial factor in clinical laboratories where accurate diagnoses and effective interventions rely heavily on these parameters [5]. ...
Article
Full-text available
Background Professional development plays a key role in improving laboratory quality management by enhancing staff skills and knowledge to implement and maintain the quality management system (QMS). This research aims to identify and prioritize continuing training needs for Moroccan laboratory professionals in QMS and to formulate recommendations for suitable training programs. Methods The present research is a cross-sectional, quantitative study conducted among a larger group of laboratory professionals from September 2021 to May 2023. The data collection tool was a self-administered questionnaire. Statistical data analysis was performed by IBM SPSS version 22.0 software calculating Chi-square. Results A total of 478 people participated in the study. Participants’ training needs on various topics related to quality in medical laboratories ranged from 68.20% to 84.52%, covering several subjects such as quality tools (82.01%), continuous improvement (83.68%), ISO 9001 (83.26%), and ISO 15189 (79.71%). Conclusions The results indicate a favorable trend toward continuing training in QMS. These suggestions should be considered when formulating future training programs to foster strong commitment and continuous improvement of skills, thereby improving the quality of healthcare provision and guaranteeing patient safety.
Article
Full-text available
Although training evaluation is recognized as an important component of the instructional design model, there are no theoretically based models of training evaluation. This article attempts to move toward such a model by developing a classification scheme for evaluating learning outcomes. Learning constructs are derived from a variety of research domains, such as cognitive, social, and instructional psychology and human factors. Drawing from this research, we propose cognitive, skill-based, and affective learning outcomes (relevant to training) and recommend potential evaluation measures. The learning outcomes and associated evaluation measures are organized into a classification scheme. Requirements for providing construct-oriented evidence of validity for the scheme are also discussed.
Article
Full-text available
If an organisation is to develop in today’s highly competitive environment, it cannot do so without continuous training and development of its employees. The benefit to the individual can be assessed by a measurable degree of his knowledge, mastering a certain operation, etc. Evaluating the effectiveness of training is not easy, because very often we work with quantities that are difficult to quantify, and therefore difficult to measure. The prerequisite is the precise definition of educational goals and ensuring the controllability of educational results (training). This article aims to find factors influencing evaluation of effectiveness of employee training and development. The data was obtained from a questionnaire survey in which 207 organisations operating in the Czech Republic participated. The results show that when evaluating the effectiveness of employee training, organisations prefer methods based on subjective evaluation by an evaluator (direct supervisors, colleagues), but also on their own self-evaluation regarding the number of training days. Due to the coronavirus pandemic, current human resources (HR) trends and priorities for 2021 have changed significantly. The systematic process of evaluating employee training effectiveness depends on the business sector (p-value 0.022), on the fact that the organisation is or is not a part of a larger group (p-value 0.000), on (non)existence of an HR department (p-value 0.000), and on the organisation size (p-value 0.000).
Article
Full-text available
Objectives: This study is designed to evaluate the effect of a workshop about new teaching and learning methods on the response, knowledge, and behavior of healthcare staff working a large city healthcare center. Results: Kirkpatrick's program evaluation model showed that the workshop on new teaching and learning methods significantly improved the healthcare staff's satisfaction about the teaching environment of workshops, their knowledge about new teaching and learning methods and their behavior in performing workshops for teaching people. It is recommended that this teaching and learning methods workshop should be considered in educational programs for healthcare staff. Trial registration Trial registration number: IRCT20180619040150N1 approved by Iranian Registry of Clinical Trials at 2018-07-27.
Article
Full-text available
Background Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. Objective This report describes the application of an instructional design framework—Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model—in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. Methods We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. Results Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book. Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that learners rated the modules positively, and self-report of knowledge acquisition was high (mean range: 4.4–4.6 out of 5). About half of learners indicated that they would change their practice after watching the modules (range: 48–51%). All learners who completed the level 1 evaluation demonstrated 80% or better mastery of knowledge on the level 2 evaluation embedded in each module. The CFIR was used to identify implementation barriers and facilitators among the evaluation data which facilitated planning for subsequent implementation support activities in the IPS initiative. Conclusion Instructional design approaches such as ADDIE may offer implementation scientists and practitioners a flexible and systematic approach for the development of e-learning modules as a single component or one strategy in a multifaceted approach for training in EBPs.
Article
Full-text available
Background There are several evaluation models that can be used to evaluate the effect of in-service training; one of them is the Kirkpatrick model. The aim of the present study is to assess the in-service training of cardiopulmonary resuscitation (CPR) for nurses based on the Kirkpatrick's model. Materials and Methods This study is a cross-sectional study based on the Kirkpatrick's model in which the efficacy of in-service training of CPR to nurses was assessed in the Shahadaye Lenjan Hospital in Isfahan province in 2014. 80 nurses and Nurse's aides participated in the study after providing informed consent. The in-service training course was evaluated in reaction, learning, behavior, and results level of the Kirkpatrick model. Data were collected through a researcher-made questionnaire. Results The mean age of the participants was 35 ± 8.5 years. The effectiveness score obtained in the reaction level (first level in the Kirkpatrick model) was 4.2 ± 0.32. The effectiveness score in the second level of model or the learning level was 4.70 ± 0.09, which is statistically significant (P < 0.001). The effectiveness score at the third and fourth level were 4.1 ± 0.34 and 4.3 ± 0.12, respectively. Total effectiveness score was 4.35. Conclusions The results of this study showed that CPR in-service training has a favorable effect on all four levels of the Kirkpatrick model for nurses and nurse's aides.
Article
Full-text available
Background: Past efforts to improve laboratory quality systems and to achieve accreditation for better patient care in the Caribbean Region have been slow. Objective: To describe the impact of the Strengthening of Laboratory Management Toward Accreditation (SLMTA) training programme and mentorship amongst five clinical laboratories in the Caribbean after 18 months. Method: Five national reference laboratories from four countries participated in the SLMTA programme that incorporated classroom teaching and implementation of improvement projects. Mentors were assigned to the laboratories to guide trainees on their improvement projects and to assist in the development of Quality Management Systems (QMS). Audits were conducted at baseline, six months, exit (at 12 months) and post-SLMTA (at 18 months) using the Stepwise Laboratory Quality Improvement Process Towards Accreditation (SLIPTA) checklist to measure changes in implementation of the QMS during the period. At the end of each audit, a comprehensive implementation plan was developed in order to address gaps. Results: Baseline audit scores ranged from 19% to 52%, corresponding to 0 stars on the SLIPTA five-star scale. After 18 months, one laboratory reached four stars, two reached three stars and two reached two stars. There was a corresponding decrease in nonconformities and development of over 100 management and technical standard operating procedures in each of the five laboratories. Conclusion: The tremendous improvement in these five Caribbean laboratories shows that SLMTA coupled with mentorship is an effective, user-friendly, flexible and customisable approach to the implementation of laboratory QMS. It is recommended that other laboratories in the region consider using the SLMTA training programme as they engage in quality systems improvement and preparation for accreditation.
Article
Full-text available
Background The improvment of the quality of testing services in public laboratories is a high priority in many countries. Consequently, initiatives to train laboratory staff on quality management are being implemented, for example, the World Health Organization Regional Headquarters for Africa (WHO-AFRO) Strengthening Laboratory Management Towards Accreditation (SLMTA). Mentorship may be an effective way to augment these efforts. Methods Mentorship was implemented at four hospital laboratories in Lesotho, three districts and one central laboratory, between June 2009 and December 2010. The mentorship model that was implemented had the mentor fully embedded within the operations of each of the laboratories. It was delivered in a series of two mentoring engagements of six and four week initial and follow-up visits respectively. In total, each laboratory received 10 weeks mentorship that was separated by 6–8 weeks. Quality improvements were measured at baseline and at intervals during the mentorship using the WHO-AFRO Strengthening Laboratory Quality Improvement Process Towards Accreditation (SLIPTA) checklist and scoring system. Results At the beginning of the mentorship, all laboratories were at the SLIPTA zero star rating. After the initial six weeks of mentorship, two of the three district laboratories had improved from zero to one (out of five) star although the difference between their baseline (107.7) and the end of the six weeks (136.3) average scores was not statistically significant (p = 0.25). After 10 weeks of mentorship there was a significant improvement in average scores (182.3; p = 0.034) with one laboratory achieving WHO-AFRO three out of a possible five star status and the two remaining laboratories achieving a two star status. At Queen Elizabeth II (QE II) Central Laboratory, the average baseline score was 44%, measured using a section-specific checklist. There was a significant improvement by five weeks (57.2%; p = 0.021). Conclusion The mentorship programme in this study resulted in significant measurable improvements towards preparation for the WHO-AFRO SLIPTA process in less than six months. We recommend that mentorship be incorporated into laboratory quality improvement and management training programmes such as SLMTA, in order to accelerate the progress of laboratories towards achieving accreditation.
Article
Full-text available
To determine the efficacy of different methods of cardiopulmonary resuscitation (CPCR) training in 3 different groups of the society. In a prospective and observational study of 2000 individuals in 3 different groups including G1, G2, and G3 4 different protocols of CPCR training were applied and their efficacy was compared between the groups. Also, 12 months after the study course, 460 participants from 3 groups were asked to take apart in a theoretical and practical examination to evaluate the long-term efficacy of the 4 protocols. Among 2000 individuals took a parted in the study, 950 (47.5%) were G1, 600 (30%) were G2, and 450 (22.5%) were G3. G1 in 4 groups were 2.37 and 2.65 times more successful in pretest theoretical and 2.61 and 18.20 times more successful in practical examinations compared with G2 and G3 and gained highest improvement in CPCR skills. Other groups also showed significantly improved CPCR skills. Comparison of different methods of CPCR learning showed that the workshop using interactive lecture as well as human model, educational film, and reference CPCR book has the highest efficacy in all groups. This protocol of CPCR training showed more efficacy in long-term postdelayed evaluation. On the contrary, medical students had better long-term outcomes from the course. Although G1 and G2 obtained better results in learning CPCR skills, in G3 also the theoretical and practical knowledge were improved significantly. This course increased confidence for doing CPCR in all groups of the study. Considering that the most of the bystanders at emergency states are general population, training this group of the society and increasing their confidence about performing CPCR can be so effective and lifesaving at emergency states. (Clinical trial. Gov registration: NCT02120573)
Article
Full-text available
The Evaluation of any training programme has certain aims to fulfil. These are concerned with the determination of change in the staff behaviour and the change needed in the organizational structure. Hence evaluation of any training program must inform us whether the training programme has been able to deliver the goals and objectives in terms of cost incurred and benefits achieved. Training as the process of developing skills, Habits, Knowledge and attitudes in employees for the purpose of increasing effectiveness of employees in their present positions as well as preparing employees for future positions in organization Purpose of current research is a Evaluation Effectiveness of training courses in Islamshahr University by Kirkpatrick Model. The study is an applied one and the data collection method has been descriptive. The statistical population consisted of personnels, Managers and teachers. The data was collected through the application of sampling, questionnaires. Descriptive statistics were used in order to measure the main indicators of effectiveness Evaluation of training courses. Research findings show that effectiveness of training courses is below the standard level. also data gathered about effectiveness evaluation indicated that reaction, learning, behaviour and organizational levels need to be improved. The study showed that the effectiveness evaluation in the subject centre needed to be improved through implementation of optimizing training design, redefining training roles, providing enough budget, management commitment, attention to individual, job and organizational needs, motivation mechanism, use of ongoing and summative evaluation.