ArticlePDF Available

The impact of the introduction of formalised polypectomy assessment on training in the UK

Authors:

Abstract and Figures

Objective The aim was to describe the impact on polypectomy experience by the mandatory introduction of the Directly Observed Polypectomy Skills tool (DOPyS) and electronic portfolio as part of the formal colonoscopy certification process. Design Applications for colonoscopy certification in the UK in the year prior to the introduction of DOPyS were analysed retrospectively and compared with data collected prospectively for those in the following year. Setting UK National Health Service. Patients None. Interventions None. Main outcome measures The outcomes studied included whether evidence of exposure to polypectomy, endoscopic mucosal resection (EMR) and colonoscopy changed over the 2-year period. The nature of the polyps removed by trainees was also studied. Results Thirty two per cent of candidates in the first year had evidence of any observed polypectomy with 7% of candidates referring to training in EMR. The median number of formative colonoscopy assessments was 3 (range 0–16). All of these candidates in the second year had evidence of polypectomy assessment, with a median number of DOPyS of 7 (range 3–27). Eighty nine per cent of applicants had evidence of assessed EMR. The median number of formative colonoscopy assessments in this cohort was 32 (range 9–199). There was a significant increase in the number of logged polypectomy assessments (p<0.001), experience of EMR (p<0.001) and formative colonoscopy assessments (p<0.001). There was no significant difference in the total number of colonoscopy procedures performed. Conclusions Structured polypectomy assessment improves trainees’ documented exposure to therapeutic endoscopy as well as providing formal evidence of skills acquisition. As polypectomy plays an increasing role globally in colorectal cancer prevention, the DOPyS provides an effective means of assessing and certifying polypectomy.
Content may be subject to copyright.
RESEARCH
The impact of the introduction of
formalised polypectomy assessment
on training in the UK
Kinesh Patel,
1
Omar Faiz,
1
Matt Rutter,
2
Paul Dunckley,
3
Siwan Thomas-Gibson
1
1
Wolfson Unit for Endoscopy,
St Marks Hospital, Harrow, UK
2
University Hospital of North
Tees, Stockport, UK
3
Gloucestershire Royal Hospital,
Gloucester, UK
Correspondence to
Dr Kinesh Patel, Wolfson Unit
for Endoscopy, St Marks
Hospital, Watford Road,
Harrow HA1 3UJ, UK;
kinesh.patel@gmail.com
Received 2 May 2016
Revised 12 June 2016
Accepted 27 June 2016
To cite: Patel K, Faiz O,
Rutter M, et al.Frontline
Gastroenterology Published
Online First: [please include
Day Month Year]
doi:10.1136/flgastro-2016-
100718
ABSTRACT
Objective The aim was to describe the impact
on polypectomy experience by the mandatory
introduction of the Directly Observed
Polypectomy Skills tool (DOPyS) and electronic
portfolio as part of the formal colonoscopy
certification process.
Design Applications for colonoscopy
certification in the UK in the year prior to the
introduction of DOPyS were analysed
retrospectively and compared with data collected
prospectively for those in the following year.
Setting UK National Health Service.
Patients None.
Interventions None.
Main outcome measures The outcomes
studied included whether evidence of exposure
to polypectomy, endoscopic mucosal resection
(EMR) and colonoscopy changed over the 2-year
period. The nature of the polyps removed by
trainees was also studied.
Results Thirty two per cent of candidates in the
first year had evidence of any observed
polypectomy with 7% of candidates referring to
training in EMR. The median number of
formative colonoscopy assessments was 3 (range
016). All of these candidates in the second year
had evidence of polypectomy assessment, with a
median number of DOPyS of 7 (range 327).
Eighty nine per cent of applicants had evidence
of assessed EMR. The median number of
formative colonoscopy assessments in this cohort
was 32 (range 9199). There was a significant
increase in the number of logged polypectomy
assessments (p<0.001), experience of EMR
(p<0.001) and formative colonoscopy
assessments ( p<0.001). There was no significant
difference in the total number of colonoscopy
procedures performed.
Conclusions Structured polypectomy
assessment improves traineesdocumented
exposure to therapeutic endoscopy as well as
providing formal evidence of skills acquisition.
As polypectomy plays an increasing role globally
in colorectal cancer prevention, the DOPyS
provides an effective means of assessing and
certifying polypectomy.
BACKGROUND
Polypectomy is regarded as the most haz-
ardous component of colonoscopy,
1
accounting for the majority of procedure-
associated morbidity, and yet is a necessary
skill for all colonoscopists. Due to the
increase in the worldwide uptake of colon-
oscopy as both a diagnostic tool and the
favoured method for colorectal cancer
screening, the number of polypectomies
performed has continued to increase
year-on-year.
Data from national audits
23
and from
the English Bowel Cancer Screening
Programme
1
have shown that most cases
of bleeding and perforation are related to
polypectomy. Training in polypectomy
has, to date, been variable and poorly
structured.
4
There has been some evi-
dence suggesting poor exposure to poly-
pectomy during training. In one study,
only 60% of trainees had ever been
assessed in polypectomy.
4
A novel assessment tool, the Directly
Observed Polypectomy Skills (DOPyS),
was introduced nationally in the UK in
October 2011 with the intention of both
improving training and facilitating docu-
mentation of competency. This tool con-
tains 34 separate criteria and permits the
deconstruction and assessment of poly-
pectomy for both sessile and peduncu-
lated lesions.
5
At the end of the tool, a
global rating is given from 1 (multiple
errors) to 4 (highly skilled) to signify the
trainers assessment of the trainees
TRAINING MATTERS
Patel K, et al.Frontline Gastroenterology 2016;0:16. doi:10.1136/flgastro-2016-100718 1
group.bmj.com on August 2, 2016 - Published by http://fg.bmj.com/Downloaded from
competency in polypectomy. The methods used to
devise and validate this tool have been described
elsewhere.
6
There have always been a set of minimum require-
ments before an application for certification of com-
petency was permitted. Until October 2011, formal
certification of colonoscopy competence in the UK
was acquired by trainees collecting paper-based port-
folios of their colonoscopy practice. Trainees had to
show evidence of competency in colonoscopy by
using the Directly Observed Procedural Skills (DOPS)
tool for a summative assessment. There was a require-
ment for a minimum number of 200 completed col-
onoscopies. Polypectomy assessment itself was not
compulsory, although trainers could reflect appropri-
ate generic use of therapy during colonoscopy by
marking a single criterion on the generic DOPS tool.
After October 2011, there was a transition to a
paperless electronic certification system.
7
Trainees
were required to complete the same summative DOPS
assessments, in addition to keeping a log of proce-
dures. However, it was also compulsory for those
wishing to be provisionally certified to have com-
pleted a minimum of four snare polypectomy assess-
ments using the DOPyS to resect polyps up to 10 mm
as well as 10 formative colonoscopy DOPS during the
course of their training. Full certification for colonos-
copy and polypectomy was awarded to those who had
attained provisional certification and then had evi-
dence of at least four satisfactory DOPyS, with a
minimum of two assessments tackling both sessile and
pedunculated lesions.
OBJECTIVES
The primary aim was to describe the impact on poly-
pectomy experience by the mandatory introduction of
the DOPyS as part of the formal colonoscopy certifi-
cation process. The secondary aim was to assess the
influence of the release of the electronic certification
system on traineesexposure to colonoscopy.
SETTING
UK National Health Service.
METHODS
All trainee endoscopists applying to Joint Advisory
Group on GI Endoscopy (JAG) for certification of
colonoscopy competence for the 2 years from
October 2010 to October 2012 were included.
The first cohort comprised those using paper port-
folios from October 2010 to September 2011; the
second cohort included those using the mandatory
electronic portfolio from October 2011 to
September 2012.
Applications for certification in the year prior to the
introduction of DOPyS were analysed retrospectively
and compared with data collected prospectively for
those in the following year.
Paper portfolios
Endoscopists were not required to submit procedural
details for each case. Aggregate data were collected
from the logbook on the total lifetime number of col-
onoscopies performed, the number of assessments
submitted for both colonoscopy and polypectomy and
whether applicants had any evidence of performing
supervised or unsupervised polypectomy before certi-
fication of competence in colonoscopy.
If trainees using the paper-based certification system
had any DOPS assessment marked demonstrating
appropriate use of therapy, this was noted as experi-
ence of polypectomy. If trainees had any documented
experience of performing endoscopic mucosal resec-
tion (EMR), this was also recorded.
Electronic portfolios
The size, location and type of lesions resected by trai-
nees while being assessed using the DOPyS were
logged, as well as the overall competency of trainees
to perform polypectomy.
Analysis
Data were analysed using SPSS V.20. To assess the dif-
ferences between the 2 years of data collection, the
MannWhitney U test was used for non-parametric
data. The independent samples t test was used to
compare normally distributed data such as polyp size.
RESULTS
Participants
There were 175 applicants for certification in the first
year compared with 150 applications in the year after
DOPyS was introduced (p=0.99).
Experience of colonoscopy
The median number of colonoscopy procedures prior
to seeking certification per candidate was 287 in the
first year, compared with 206 in the following year.
There was no significant difference in the total
number of colonoscopy procedures undertaken
(p=0.07). These procedural volumes were both above
the requirement to complete at least 200 procedures
before applying for certification.
In the first cohort, the median number of formative
colonoscopy assessments provided was 3 (range 016).
This rose to 32 (range 9199) in the year after the
introduction of the electronic portfolio (p<0.001),
comprising the 10 mandatory DOPS required by the
certification criteria and 22 additional DOPS submit-
ted voluntarily (figure 1).
Experience of polypectomy
Thirty two per cent of candidates using paper portfo-
lios had evidence of any observed polypectomy, with
7% of candidates referring to training in EMR.
In the year following the introduction of DOPyS,
the 150 trainees using the electronic certification
TRAINING MATTERS
2Patel K, et al.Frontline Gastroenterology 2016;0:16. doi:10.1136/flgastro-2016-100718
group.bmj.com on August 2, 2016 - Published by http://fg.bmj.com/Downloaded from
process were assessed resecting a total of 1283 polyps.
All candidates had evidence of polypectomy assess-
ment throughout that year, with a median number of
DOPyS of 7 (range 327). This figure included a
median of 2 DOPyS for stalked lesions and 5 DOPyS
for sessile polyps. Eighty nine per cent of applicants
had evidence of assessed EMR (figure 2).
As expected, there was a significant increase in
the number of recorded polypectomy assessments
(p<0.001), given these were mandatory for the
second cohort. However, both logged experience of
EMR and formative colonoscopy assessments
(p<0.001), which were not obligatory, also increased
(p<0.001).
Polyp characteristics
The majority of polyps resected by trainees (68.5%)
were located in the left colon, but a significant minor-
ity were found more proximally (figure 3).
The polyps removed by trainees had a mean size of
<10 mm in all colonic segments. However, there was
a significant range of polyp sizes seen, with lesions up
to 60 mm documented ( figure 4). Polyps in the left
colon were on average slightly larger (9.1 mm com-
pared with 7.2 mm, p<0.001). The sessile lesions
tackled comprised the majority (61%) of polyps, but
these were significantly smaller than the pedunculated
polyps removed (6.6 mm compared with 10.9 mm,
p<0.001).
The majority of DOPyS assessments (93%) were
scored either 3 or 4, signifying competence at poly-
pectomy (figure 5). There was no difference in polyp
size between the DOPyS scored as 1 or 2 compared
with those scored 3 or 4 (8.0 vs 8.3 mm, p=0.299).
DISCUSSION
These data are the first to describe the implementation
of a nationwide certification system on polypectomy
training. The introduction of structured polypectomy
assessment was both feasible and acceptable, with
similar numbers of trainees applying for certification
after the introduction of the DOPyS. In addition, these
Figure 1 Formative colonoscopy Directly Observed Procedural
Skill (DOPS), submitted with applications for certification.
Figure 2 Traineespolypectomy experience. DOPyS, Directly
Observed Polypectomy Skill; EMR, endoscopic mucosal
resection.
Figure 3 Location of polyps resected by trainees.
Figure 4 Mean and maximum polyp sizes removed by trainees
with assessment.
TRAINING MATTERS
Patel K, et al.Frontline Gastroenterology 2016;0:16. doi:10.1136/flgastro-2016-100718 3
group.bmj.com on August 2, 2016 - Published by http://fg.bmj.com/Downloaded from
data show clear evidence of an increase in trainees
documented exposure to therapeutic lower gastrointes-
tinal endoscopy as well as providing formal evidence of
skills acquisition.
The DOPyS was designed to aid both training and
permit certification of competency. However, it
appears that it is currently being used predominantly
with the latter objective: this may well be related to its
inclusion as a mandatory part of the colonoscopy
competency certification process. Only a very small
proportion (0.4%) of assessments were scored 1
(accepted standards not yet met; frequent errors
uncorrected). These low-scoring DOPyS are likely to
represent formative assessments for trainees in the
early stages of their learning curve.
The reasons for this are likely to be multifactorial.
Given the hazards inherent to the technique, it is
likely that a trainee performing a supervised polypect-
omy with frequent errors would either receive instruc-
tion from the trainer or pass the endoscope to the
more experienced colonoscopist to complete the pro-
cedure. In addition, these evaluations are largely insti-
gated at the behest of the trainee, and it is likely that
there is an element of selection bias with trainees not
requesting trainersformal documented assessment of
procedures that have not been performed well. It is
unlikely that the assessments are representative of the
full learning curve for polypectomy, given they are so
heavily skewed towards exhibiting competency. These
results are not unexpected, in that trainees were
expected to use DOPyS to demonstrate their polypect-
omy skills if they wished to apply for certification.
There is a strong argument for the use of the DOPyS
tool at an earlier stage of training to standardise the
instruction trainees receive when beginning to learn
how to perform a polypectomy for the first time.
However, it would be difficult to make this a manda-
tory requirement of certification, and a more pragmatic
approach may be to encourage trainers to use this tool
to a greater extent than is the case at present.
It is encouraging that all trainees are receiving dedi-
cated separate assessments in both colonoscopy and
polypectomy. Just over 10 years ago, the UK national
audit showed that only 17.0% of colonoscopists had
received supervised training for their first 100 colon-
oscopies.
2
This study shows the significant progress
made in training in a relatively short space of time.
It is also reassuring that trainees are being taught
and assessed in polypectomy on a variety of lesions,
including proximal polyps, which may be more risky
and technically challenging.
18
Most assessed lesions
were <10 mm in size in keeping with the parameters
of the mandatory DOPyS assessment and mirroring
clinical practice. In the faecal occult blood test
(FOBT)-positive Bowel Cancer Screening Programme,
86% of polyps were found to be <10 mm, and it
seems that training experience reflects these figures.
9
The vast majority of polyps found during universal
screening with flexible sigmoidoscopy at age 55 are also
within the same size parameters, emphasising the import-
ance of all endoscopists possessing the skills required to
tackle these common lesions. In this screening setting,
complete polypectomy and retrieval are crucial.
Although larger sized lesions are associated with higher
rates of advanced pathology such as high-grade dysplasia
or villous architecture, these features are not confined to
bigger polyps and occur in lesions <5 mm.
10
Before the introduction of DOPyS, only a very
small minority (7%) of trainees had evidence of EMR
skills. The methodology used to assess this figure was
generous with even a solitary reference to EMR being
counted. These data were obtained from logbooks,
and so the quality and amount of training could not
be easily gleaned.
However, since DOPyS has found its way into
routine clinical practice with trainees performing
more assessments than strictly mandated, this would
suggest that the majority of trainees seem to be receiv-
ing both training and assessment in this invaluable
technique, a skill which many would argue is obliga-
tory for any independent colonoscopy practitioner.
Interestingly, with the introduction of the electronic
portfolio, most trainees considerably surpassed the
minimum requirements for submission of formative
DOPS and DOPyS. This suggests that trainees have
become familiar with this method of assessment and
integrated it into their practice, using it as a training
aid as well as for certification of competency. As poly-
pectomy plays an increasing role globally in colorectal
cancer prevention, the DOPyS provides an effective
means of assessing and certifying polypectomy skills,
including lesion assessment as well as the technical
proficiencies required for a safe, complete resection,
in order to minimise the well-recognised risks asso-
ciated with this technique. It also has the potential to
be a useful tool to help verify endoscopic competence
Figure 5 Overall polypectomy competency scores using the
Directly Observed Polypectomy Skill (DOPyS).
TRAINING MATTERS
4Patel K, et al.Frontline Gastroenterology 2016;0:16. doi:10.1136/flgastro-2016-100718
group.bmj.com on August 2, 2016 - Published by http://fg.bmj.com/Downloaded from
as part of mandatory ongoing clinical revalidation for
those practising independently.
The role of assessment in changing academic behav-
iour is well recognised.
11
The closest parallel with
practical medical skills assessment comes from the
DOPS tool, which is used widely by junior doctors as
part of their electronic portfolios. A study looking at
doctors who had just qualified from medical school
found that most (70%) felt that DOPS helped
improve their clinical skills.
12
However, a systematic
review of several different types of workplace-based
assessments found no available high-quality evidence
from this study or any others that DOPS lead to
objective performance improvement.
13
The LAPCO programme, a UK national training pro-
gramme for laparoscopic colorectal surgery devised to
encourage the widespread uptake of laparoscopic
surgery, has been extensively evaluated
14
and found to
bear some similarity to polypectomy assessment.
Similar to the DOPyS, task deconstruction, hands-on
training and independent expert rating of cases with
feedback are hallmarks of this programme.
15
Analysis
of outcome data has shown significant improvement in
participating surgeons, with expert levels of proficiency
achieved after iterative feedback.
14
The best studied tool with respect to performance
improvement is the multisource feedback, in which
both senior and junior colleagues anonymously
provide ratings of an individuals strengths and weak-
nesses. The ability of this to change behaviour is
reliant on individual characteristics. Studies have
shown that some junior doctors
16
and most sur-
geons
17
were not amenable to change whereas general
practitioners were more likely to be receptive to sug-
gestions.
18
Those who consider change to be neces-
sary, react positively, believe that changes are feasible
and take suitable actions as a result of this are most
likely to benefit from feedback.
13
It is likely that the DOPyS tool would show similar
characteristics, but this has not been evaluated to date.
Specifically, the DOPyS tool focuses predominantly
on technical skills involved in polypectomy. These
are easier to influence than non-technical skills which
require behavioural change and insight. A meta-
analysis of non-technical skills training revealed that
outcome measures used to date in the literature are
seldom clinically applicable.
19
However, the data
described here do show some correlation with non-
technical skills; studies published to date in other
fields may not be applicable to polypectomy.
Several questions remain unanswered from this
work. Whereas there is growing consensus in the lit-
erature as to the number of colonoscopies needed to
attain the technical ability to reach the caecum reli-
ably,
2022
these data are lacking for polypectomy
skills. Given that endoscopists who perform low
volumes of colonoscopies have been associated with
higher complication rates,
23 24
training in
polypectomy is likely to also be a higher risk activity,
and the quality of training and assessment is likely to
vary considerably between specialties, centres and
individual trainers.
25 26
The relative importance of
non-technical skills when undertaking polypectomy at
an introductory level is also not clear, but they are
likely to be important. Assessment of these other skills
is expected to be more difficult than simple technical
ability, but may prove to be beneficial in terms of
improving the rate of skills acquisition.
Key messages
What is already known on this topic?
Training in polypectomy has traditionally been poorly
structured.
Setting standards of competency can drive learning
and training.
The Directly Observed Polypectomy Skills (DOPyS)
tool has been validated in the assessment of poly-
pectomy skills.
What this study adds?
An electronic portfolio helps trainees document profi-
ciency in polypectomy.
The DOPyS provides an effective means of certifying
polypectomy skills nationally.
How might it impact on clinical practice in the
foreseeable future?
Wider uptake of the DOPyS could be used to improve
training to polypectomy novices as well as providing
a means for independently practising individuals to
provide evidence of competency for revalidation.
Contributors ST-G designed the study, helped with
interpretation of results and critically appraised the paper.
KP performed the analysis and drafted the paper. PD helped in
data acquisition. OF and MR critically appraised the paper.
All authors approved the final manuscript. KP is guarantor.
Competing interests None declared.
Provenance and peer review Not commissioned; externally
peer reviewed.
Open Access This is an Open Access article distributed in
accordance with the Creative Commons Attribution Non
Commercial (CC BY-NC 4.0) license, which permits others to
distribute, remix, adapt, build upon this work non-
commercially, and license their derivative works on different
terms, provided the original work is properly cited and the use
is non-commercial. See: http://creativecommons.org/licenses/by-
nc/4.0/
REFERENCES
1 Rutter MD, Nickerson C, Rees CJ, et al. Risk factors for
adverse events related to polypectomy in the English Bowel
Cancer Screening Programme. Endoscopy 2014;46:907.
2 Bowles CJ, Leicester R, Romaya C, et al. A prospective study
of colonoscopy practice in the UK today: are we adequately
prepared for national colorectal cancer screening tomorrow?
Gut 2004;53:27783.
TRAINING MATTERS
Patel K, et al.Frontline Gastroenterology 2016;0:16. doi:10.1136/flgastro-2016-100718 5
group.bmj.com on August 2, 2016 - Published by http://fg.bmj.com/Downloaded from
3 Gavin DR, Valori RM, Anderson JT, et al. The national
colonoscopy audit: a nationwide assessment of the quality and
safety of colonoscopy in the UK. Gut 2013;62:2429.
4 Haycock AV, Patel JH, Tekkis PP, et al. Evaluating changes in
gastrointestinal endoscopy training over 5 years: closing the
audit loop. Eur J Gastroenterol Hepatol 2010;22:36873.
5 Gupta S, Anderson J, Bhandari P, et al. Development and
validation of a novel method for assessing competency in
polypectomy: direct observation of polypectomy skills.
Gastrointest Endosc 2011;73:12329.e2.
6 Gupta S, Bassett P, Man R, et al. Validation of a novel method
for assessing competency in polypectomy. Gastrointest Endosc
2012;75:56875.
7 Mehta T, Dowler K, McKaig B, et al. Development and roll
out of the JETS e-portfolio: a web based electronic portfolio
for endoscopists. Frontline Gastroenterol 2011;2:3542.
8 Choo WK, Subhani J. Complication rates of colonic
polypectomy in relation to polyp characteristics and
techniques: a district hospital experience. J Interv Gastroenterol
2012;2:811.
9 Majumdar D, Patnick J, Nickerson C, et al. Analysis of
colorectal polyps detected in the English NHS Bowel Cancer
Screening Programme with Emphasis on advanced adenoma
and polyp cancer detected. Gut 2012;61:A67.
10 Gschwantler M, Kriwanek S, Langner E, et al. High-grade
dysplasia and invasive carcinoma in colorectal adenomas: a
multivariate analysis of the impact of adenoma and patient
characteristics. Eur J Gastroenterol Hepatol 2002;14:
1838.
11 Newble DI, Jaeger K. The effect of assessments and
examinations on the learning of medical students. Med Educ
1983;17:16571.
12 Morris A, Hewitt J, Roberts CM. Practical experience of using
directly observed procedures, mini clinical evaluation
examinations, and peer observation in pre-registration house
officer (FY1) trainees. Postgrad Med J 2006;82:2858.
13 Miller A, Archer J. Impact of workplace based assessment on
doctorseducation and performance: a systematic review.
BMJ 2010;341:c5064.
14 Coleman MG, Hanna GB, Kennedy R. The National Training
Programme for laparoscopic colorectal surgery in England:
a new training paradigm. Colorectal Dis 2011;13:61416.
15 Miskovic D, Wyles SM, Carter F, et al. Development,
validation and implementation of a monitoring tool for
training in laparoscopic colorectal surgery in the English
National Training Program. Surg Endosc 2011;25:
113642.
16 Burford B, Illing J, Kergon C, et al. User perceptions of
multi-source feedback tools for junior doctors. Med Educ
2010;44:16576.
17 Lockyer J, Violato C, Fidler H. Likelihood of change: a study
assessing surgeon use of multisource feedback data. Te ac h
Learn Med 2003;15:16874.
18 Sargeant JM, Mann KV, Ferrier SN, et al. Responses of rural
family physicians and their colleague and coworker raters to a
multi-source feedback process: a pilot study. Acad Med
2003;78(Suppl 10):S424.
19 Gordon M, Darbyshire D, Baker P. Non-technical skills training
to enhance patient safety: a systematic review. Med Educ
2012;46:104254.
20 Training Committee 20102011Sedlack RE, Shami VM, et al.
Colonoscopy core curriculum. Gastrointest Endosc
2012;76:48290.
21 Sedlack RE. Training to competency in colonoscopy: assessing
and defining competency standards. Gastrointest Endosc
2011;74:35566.e12.
22 Ward ST, Mohammed MA, Walt R, et al. An analysis of the
learning curve to achieve competency at colonoscopy using the
JETS database. Gut 2014;63:1746––54.
23 Lorenzo-Zúñiga V, Moreno de Vega V, Doménech E, et al.
Endoscopist experience as a risk factor for colonoscopic
complications. Colorectal Dis 2010;12:e273e77.
24 Chukmaitov A, Bradley CJ, Dahman B, et al. Association of
polypectomy techniques, endoscopist volume, and facility type
with colonoscopy complications. Gastrointest Endosc
2013;77:43646.
25 Asfaha S, Alqahtani S, Hilsden RJ, et al. Assessment of
endoscopic training of general surgery residents in a North
American health region. Gastrointest Endosc
2008;68:105662.
26 Leyden JE, Doherty GA, Hanley A, et al. Quality of
colonoscopy performance among gastroenterology and surgical
trainees: a need for common training standards for all trainees?
Endoscopy 2011;43:93540.
TRAINING MATTERS
6Patel K, et al.Frontline Gastroenterology 2016;0:16. doi:10.1136/flgastro-2016-100718
group.bmj.com on August 2, 2016 - Published by http://fg.bmj.com/Downloaded from
UK
polypectomy assessment on training in the
The impact of the introduction of formalised
Thomas-Gibson
Kinesh Patel, Omar Faiz, Matt Rutter, Paul Dunckley and Siwan
published online July 21, 2016Frontline Gastroenterol
http://fg.bmj.com/content/early/2016/07/21/flgastro-2016-100718
Updated information and services can be found at:
These include:
References
#BIBL
http://fg.bmj.com/content/early/2016/07/21/flgastro-2016-100718
This article cites 26 articles, 7 of which you can access for free at:
Open Access
http://creativecommons.org/licenses/by-nc/4.0/non-commercial. See:
provided the original work is properly cited and the use is
non-commercially, and license their derivative works on different terms,
permits others to distribute, remix, adapt, build upon this work
Commons Attribution Non Commercial (CC BY-NC 4.0) license, which
This is an Open Access article distributed in accordance with the Creative
service
Email alerting box at the top right corner of the online article.
Receive free email alerts when new articles cite this article. Sign up in the
Collections
Topic Articles on similar topics can be found in the following collections
(43)Open access
Notes
http://group.bmj.com/group/rights-licensing/permissions
To request permissions go to:
http://journals.bmj.com/cgi/reprintform
To order reprints go to:
http://group.bmj.com/subscribe/
To subscribe to BMJ go to:
group.bmj.com on August 2, 2016 - Published by http://fg.bmj.com/Downloaded from
... Currently, trainees learn to perform colonoscopies through guided supervision until they are deemed independent. To assess their skills several validated objective assessments have been created such as the Joint Advisory Group (JAG) on GI Endoscopy Training System Directly Observed Practical Skills (JETS DOPS) [13][14][15][16][17]. Although these tools allow analysis of manual competency, they do not assess visual search strategies and are time and labour intensive. ...
... Other well-used assessment tools include Global Assessment of Gastrointestinal Endoscopic Skills in Colonoscopy (GAGES-C) and the Mayo Colonoscopy Skills Assessment Tool (MCSAT). Although both GAGES-C and JETS e-portfolio are previously validated objective assessment tools for endoscopic skill [13,16], the JETS e-portfolio is also a national requirement for all endoscopy trainees and provides information on key performance indicators such caecal intubation rate, polyp detection rate and whether the trainee is ready for independent practice [14,15]. JETS has been validated by JAG, and additional analysis of learning curve cumulative summation using the JETS database has shown 41% of trainees to be competent after 200 procedures [16]. ...
... Although the multi-centre methodology was beneficial in assessing trainees of various skill levels, it risked variability in supervisor scoring. Since this was recognised, the JETS ePortfolio DOPS was used as it is a national requirement that has been standardised over a decade of use [15]. As UKbased trainee endoscopists are not given ADRs, it was not possible to directly correlate their VGPs with clinical outcomes. ...
Article
Full-text available
Background: Colonoscopy proficiency is significantly influenced by skills achieved during training. Although assessment scores exist, they do not evaluate the impact of visual search strategies and their use is time and labour intensive. Eye-tracking has shown significant differences in visual gaze patterns (VGPs) between expert endoscopists with varying polyp detection rates, so may provide a means of automated assessment and guidance for trainees. This study aimed to assess the feasibility of eye-tracking as a novel assessment method for trainee endoscopists. Methods: Eye-tracking glasses were used to record 26 colonoscopies from 12 endoscopy trainees who were assessed with directly observed procedural scores (DOPS), devised by the Joint Advisory Group (JAG) on GI endoscopy, and a visual analogue score of overall competence. A 'total weighted procedure score' (TWPS) was calculated from 1 to 20. Primary outcomes of fixation duration (FixD) and fixation frequency (FixF) were analysed according to areas of interest (AOIs) with the bowel surface and lumen represented by three concentric rings. Correlation was assessed using Pearson's coefficient. Significance was set at p<.050. Results: Trainees displayed a significant positive correlation between TWPS and FixD (R = 0.943, p<.0001) and FixF (R = 0.936, p<.0001) in the anatomical bowel mucosa peripheries. Conversely, they had significant negative correlations between TWPS and the anatomical bowel lumen (FixD: R= -0.546, p=.004; FixF: R= -0.568, p=.002). Conclusions: Higher objective performance scores were associated with VGPs focussing on bowel mucosa. This is consistent with prior analysis showing peripheral VGPs correspond with higher polyp detection rates. Analysis of VGPs, therefore, has potential for training and assessment in colonoscopy.
... 123 The use of DOPyS improves trainees documented exposure to therapeutic endoscopy, provides formal evidence of polypectomy skills acquisition and serves as an effective tool for assessing and certifying polypectomy in the UK. 111 DOPyS was also used by Patel et al in the validation of Cold Snare Polypectomy Assessment Tool (CSPAT), which was developed specifically for CSP. 124 3.5: For competence at SMSA level 1 polypectomy, a minimum of 2 SMSA level 1 DOPyS should be competently performed using the following methods: cold snare polypectomy, diathermy-assisted resection of stalked polyps and diathermy-assisted EMR. ...
Article
Full-text available
Introduction Joint Advisory Group (JAG) certification in endoscopy is awarded when trainees attain minimum competency standards for independent practice. A national evidence-based review was undertaken to update standards for training and certification in flexible sigmoidoscopy (FS). Methods A modified Delphi process was conducted between 2019 and 2020 with multisociety representation from experts and trainees. Following literature review and Grading of Recommendations, Assessment, Development and Evaluations appraisal, recommendation statements on FS training and certification were formulated and subjected to anonymous voting to obtain consensus. Accepted statements were peer-reviewed by national stakeholders for incorporation into the JAG FS certification pathway. Results In total, 41 recommendation statements were generated under the domains of: definition of competence (13), acquisition of competence (17), assessment of competence (7) and postcertification support (4). The consensus process led to revised criteria for colonoscopy certification, comprising: (A) achieving key performance indicators defined within British Society of Gastroenterology standards (ie, rectal retroversion >90%, polyp retrieval rate >90%, patient comfort <10% with moderate-severe discomfort); (B) minimum procedure count ≥175; (C) performing 15+ procedures over the preceding 3 months; (D) attendance of the JAG Basic Skills in Lower gastrointestinal Endoscopy course; (E) satisfying requirements for formative direct observation of procedural skill (DOPS) and direct observation of polypectomy skill (SMSA level 1); (F) evidence of reflective practice as documented on the JAG Endoscopy Training System reflection tool and (G) successful performance in summative DOPS. Conclusion The UK standards for training and certification in FS have been updated to support training, uphold standards in FS and polypectomy, and provide support to the newly independent practitioner.
... 151 The use of DOPyS improves trainees documented exposure to therapeutic endoscopy, provides formal evidence of polypectomy skills acquisition and serves as an effective tool for assessing and certifying polypectomy in the UK. 139 Evidence: Very low; Recommendation: Strong; Agreement: 100% Statement 2.9 highlighted the importance of applying the correct method for polypectomy according to the size and type of the polyp to reduce risk and improve outcomes. These techniques might be required to remove an SMSA level 1 polyp and thus trainees need to demonstrate competence in each modality. ...
Article
Full-text available
Introduction In the UK, endoscopy certification is awarded when trainees attain minimum competency standards for independent practice. A national evidence-based review was undertaken to update and develop standards and recommendations for colonoscopy training and certification. Methods Under the oversight of the Joint Advisory Group (JAG), a modified Delphi process was conducted between 2019 and 2020 with multisociety expert representation. Following literature review and Grading of Recommendations, Assessment, Development and Evaluations appraisal, recommendation statements on colonoscopy training and certification were formulated and subjected to anonymous voting to obtain consensus. Accepted statements were peer reviewed by JAG and relevant stakeholders for incorporation into the updated colonoscopy certification pathway. Results In total, 45 recommendation statements were generated under the domains of: definition of competence (13), acquisition of competence (20), assessment of competence (8) and postcertification support (4). The consensus process led to revised criteria for colonoscopy certification, comprising: (1) achieving key performance indicators defined within British Society of Gastroenterology standards (ie, unassisted caecal intubation rate >90%, rectal retroversion >90%, polyp detection rate >15%+, polyp retrieval rate >90%, patient comfort <10% with moderate–severe discomfort); (2) minimum procedure count 280+; (3) performing 15+ procedures over the preceding 3 months; (4) attendance of the JAG Basic Skills in Colonoscopy course; (5) terminal ileal intubation rates of 60%+ in inflammatory bowel disease; (6) satisfying requirements for formative direct observation of procedure skills (DOPS) and direct observation of polypectomy skills (Size, Morphology, Site, Access (SMSA) level 2); (7) evidence of reflective practice as documented on the JAG Endoscopy Training System reflection tool; (8) successful performance in summative DOPS. Conclusion The UK standards for training and certification in colonoscopy have been updated, culminating in a single-stage certification process with emphasis on polypectomy competency (SMSA Level 2+). These standards are intended to support training, improve standards of colonoscopy and polypectomy, and provide support to the newly independent practitioner.
Article
Objective The 2023 Joint Advisory Group on Gastrointestinal Endoscopy consensus statements on colonoscopy training and certification in the UK recommend that trainees should be competent in size, morphology, site, access (SMSA) level 2 polypectomy; familiar with classification systems for describing polyps and able to handle common intraprocedural complications. Anecdotal concerns expressed by established colonoscopists regarding their own competence in relation to these new requirements prompted an assessment of the competence and confidence of the existing colonoscopy workforce. Method An anonymous online survey was used to ascertain self-reported competence and confidence in polypectomy among colonoscopists from all professional groups: both medically qualified endoscopists (MEs) (from a medical or surgical background) and clinical endoscopists (CEs), who are nurses or allied health professionals trained to perform independent colonoscopy. Respondents were predominantly from Northwest England. The survey ran between May and August 2023. Attempts were made to identify barriers preventing more advanced practice. Results 120 independent colonoscopists responded (55% medical, 45% clinical). 21% of respondents were confident tackling lesions at SMSA level 4. However, 20% do not remove non-pedunculated lesions >9 mm. The majority of these were CEs. Of those involved in training or supervision, 11% restricted their polypectomy practice to Level 1. Overall, 21% expressed only ‘slight’ or ‘no confidence’ in teaching the SMSA scoring system. CEs involved in training were at least as confident as MEs in teaching aspects of polyp assessment. Lack of support in the event of a complication was of significantly more concern to CEs than MEs (p<0.001). Conclusion The new curriculum presents a technical challenge for only a small minority of established colonoscopists, but we have identified a lack of confidence in teaching about optical diagnosis and the SMSA scoring system. Endoscopy training academies may have a role in educating training supervisors in their region rather than focusing solely on trainees.
Article
Purpose: Practicing endoscopists frequently perform and teach screening colonoscopies and polypectomies, but there is no standardized method to train and assess physicians who perform polypectomy procedures. The authors created a polypectomy simulation-based mastery learning (SBML) curriculum and hypothesized that completion of the curriculum would lead to immediate improvement in polypectomy skills and skill retention at 6 and 12 months after training. Method: The authors performed a pretest-posttest cohort study with endoscopists who completed SBML and were randomized to follow-up at 6 or 12 months from May 2021 to August 2022. Participants underwent SBML training, including a pretest, a video lecture, deliberate practice, and a posttest. All learners were required to meet or exceed a minimum passing standard on a 17-item skills checklist before completing training and were randomized to follow-up at 6 or 12 months. The authors compared simulated polypectomy skills performance on the checklist from pretest to posttest and posttest to 6- or 12-month follow-up test. Results: Twenty-four of 30 eligible participants (80.0%) completed the SBML intervention, and 20 of 24 (83.0%) completed follow-up testing. The minimum passing standard was set at 93% of checklist items correct. The pretest passing rate was 4 of 24 participants (16.7%) compared with 24 of 24 participants (100%) at posttest (P < .001). There were no significant differences in passing rates from posttest to combined 6- and 12-month posttest in which 18 of 20 participants (90.0%) passed. Conclusions: Before training and despite years of clinical experience, practicing endoscopists demonstrated poor performance of polypectomy skills. SBML was an effective method for practicing endoscopists to acquire and maintain polypectomy skills during a 6- to 12-month period.
Article
Modifiable risk factors for postcolonoscopy colorectal cancer include suboptimal lesion detection (missed neoplasms) and inadequate lesion removal (incomplete polypectomy) during colonoscopy. Competent detection and removal of colorectal polyps are thus fundamental to ensuring adequate colonoscopy quality. Several well-researched quality metrics for polyp detection have been implemented into clinical practice, chief among these the adenoma detection rate. Less data are available on quality indicators for polyp removal, which currently include complete resection rates and skills assessment tools. This review summarizes the available literature on quality indicators for the detection and removal of colorectal polyps, as well as interventions to improve them.
Article
Full-text available
Background: Assessment tools are essential for endoscopy training, required to support feedback provision, optimize learner capabilities, and document competence. We aimed to evaluate the strength of validity evidence that supports available colonoscopy direct observation assessment tools using the unified framework of validity. Methods: We systematically searched five databases for studies investigating colonoscopy direct observation assessment tools from inception until April 8, 2020. We extracted data outlining validity evidence from the five sources (content, response process, internal structure, relations to other variables, and consequences) and graded the degree of evidence, with a maximum score of 15. We assessed educational utility using an Accreditation Council for Graduate Medical Education framework and methodological quality using the Medical Education Research Quality Instrument (MERSQI). Results: From 10,841 records, we identified 27 studies representing 13 assessment tools (10 adult, 2 pediatric, 1 both). All tools assessed technical skills, while 10 assessed cognitive and integrative skills. Validity evidence scores ranged from 1-15. The Assessment of Competency in Endoscopy (ACE) tool, the Direct Observation of Procedural Skills (DOPS) tool, and the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT) had the strongest validity evidence, with scores of 13, 15, and 14, respectively. Most tools were easy to use and interpret and required minimal resources. MERSQI scores ranged from 9.5-11.5 (maximum score 14.5). Conclusions: The ACE, DOPS, and GiECAT have strong validity evidence compared to other assessments. Future studies should identify barriers to widespread implementation and report on use of these tools in credentialing examinations.
Article
Background and aims: Colorectal cancer (CRC) prevention by colonoscopy has been lower than expected. We studied CRC prevention outcomes of a colonoscopy protocol based on CLEAR principles, an acronym for: (1) Clean the colon, (2) Look Everywhere, and (3) complete Abnormality Removal. Methods: Observational follow-up study of patients provided screening colonoscopy at a free-standing private ambulatory surgery center in South Carolina by 80 endoscopists from October 2001 to December 2014, followed through December 2015. The colonoscopy protocol, optimized for polyp clearance, featured (1) in-person bowel preparation instructions reinforced by phone; (2) polyp search and removal throughout insertion and gradual withdrawal with circumferential tip movements, and (3) team approach using all personnel present to maximize polyp detection, patient safety, and clear-margin polypectomy including requesting repeat inspection or additional tissue removal. Outcome measures were postscreening lifetime CRC risk relative to SEER-18 and interval cancer rate (postcolonoscopy CRCs among cancer-free patients at screening) RESULTS: Of 25,862 patients (mean age 58.1 years, 52% black, 205,522 person-years, PYO), 159 had CRC at screening and 67 patients developed interval CRC. Interval CRC rate was 3.34/10,000 PYO, 5.79 and 2.24 among patients with and without adenomas, respectively. The rate was similar among older patients (mean 68.5 years at screening) and with prolonged follow-up. Postscreening lifetime CRC risk was 1.6% (bootstrap 95% confidence interval, 1.3% - 1.8%), versus 4.7% in SEER-18, 67% lower. Subgroups with mean screening age 50 and 68.5 years showed risk reductions of 80% and 72%, respectively. Adverse event rate was less than usually reported rates: perforation 2.6/10,000, bleeding with hospitalization 2.4/10,000, and no deaths. Conclusions: A colonoscopy protocol optimized for polyp clearance prevented 67% of CRC compared with SEER-18 population given ongoing population screening.
Article
Screening, followed by colonoscopic polypectomy (or surgery for malignant lesions), prevents incident colorectal cancer and mortality. However, there are variations in effective application of nearly every aspect of the screening process. Screening is a multistep process, and failure in any of single step could result in unnecessary morbidity and mortality. Awareness of variations in operator- and system-dependent performance has led to detailed, comprehensive recommendations in the United States and Europe on how colonoscopy screening should be performed and measured. Likewise, guidance has been provided on quality assurance for non-primary colonoscopy-based screening programs, including strategies to maximize adherence. Quality improvement is now a validated science, and there is clear evidence that higher quality prevents incident cancer and cancer death. Quality must be addressed at the levels of the system, provider, and individuals, to maximize the benefits of screening for any population. We review the important aspects of measuring and improving the quality of colorectal cancer screening.
Article
Ineffective polypectomy technique may lead to incomplete polyp resection, high complication rates, interval colorectal cancer, and costly referral to surgery. Despite its central importance to endoscopy, training in polypectomy is not standardized nor has the most effective training approach been defined. Polypectomy competence is rarely reported and quality metrics for this skill are lacking. Use of tools and measurements to assess polypectomy outcomes is low. There is a need for standardization of training and remediation in polypectomy; defining standards of competent polypectomy and how it is feasibly measured; and integration of polypectomy quality metrics into training programs and the accreditation process.
Article
Full-text available
The number of colonoscopies required to reach competency is not well established. The primary aim of this study was to determine the number of colonoscopies trainees need to perform to attain competency, defined by a caecal intubation rate (CIR) ≥90%. As competency depends on completion, we also investigated trainee factors that were associated with colonoscopy completion. The Joint Advisory Group on GI Endoscopy in the UK has developed a trainee e-portfolio from which colonoscopy data were retrieved. Inclusion criteria were all trainees who had performed a total of ≥20 colonoscopies and had performed ≤50 colonoscopies prior to submission of data to the e-portfolio. The primary outcome measure was colonoscopy completion. The number of colonoscopies required to achieve CIR ≥90% was calculated by the moving average method and learning curve cumulative summation (LC-Cusum) analysis. To determine factors which determine colonoscopy completion, a mixed effect logistic regression model was developed which allowed for nesting of patients within trainees and nesting of patients within hospitals, with various patient, trainee and training factors entered as fixed effects. 297 trainees undertook 36 730 colonoscopies. By moving average analysis, the cohort of trainees reached a CIR of 90% at 233 procedures. By LC-Cusum analysis, 41% of trainees were competent after 200 procedures. Of the trainee factors, the number of colonoscopies, intensity of training and previous flexible sigmoidoscopy experience were significant factors associated with colonoscopy completion. This is the largest study to date investigating the number of procedures required to achieve competency in colonoscopy. The current training certification benchmark in the UK of 200 procedures does not appear to be an inappropriate minimum requirement. The LC-Cusum chart provides real time feedback on individual learning curves for trainees. The association of training intensity and flexible sigmoidoscopy experience with colonoscopy completion could be exploited in training programmes.
Article
Full-text available
Introduction Colorectal cancer is the second most common cause of cancer related death in the UK causing around 16 000 deaths each year. Colorectal adenomas are slow growing precursor lesions which progress to cancer. The lesion of most interest in this context is advanced adenoma (size 10+ mm/with 20%–25% villous histology/high grade dysplasia) as they are of higher risk of progression (2). This study analysed adenomatous lesions detected in NHS BCSP programme. Methods Data on each patient entering the NHS BCSP programme is prospectively recorded on the national BCSP database. The database was interrogated for all polyps/adenomas found during the period September 2006 to September 2011. The data were analysed with particular focus on detection of advanced adenoma and polyp cancers. Results A total of 65 535 polyps were found, of which 43 954 (67.06%) were confirmed histologically as adenomas. 15 261 advanced adenomas were detected. These accounts for 34.7% of lesions removed and 23.9% of all lesions detected during screening. 842 polyp cancers were found and removed. 1.9% of the adenomatous lesions removed were polyp cancer. The incidence of villous morphology, HGD and polyp cancer, categorised by adenoma size, are shown in the Abstract OC-156 table 1. The presence of villous histology and high grade dysplasia increases with increasing size of adenoma, whereas villous histology begins to plateau for adenomas over 15 mm in size, the incidence of HGD appears linear up to and beyond adenomas of 45mm in size. Conclusion 67.06% of all lesions found were histologically confirmed colorectal adenomas. One third of adenomas were advanced adenomas. There is a trend of increase of incidence of cancer and features of advanced neoplasia in adenomas with increasing size. The incidence of AA feature present in lesions below 10mm in size was 10.07%. Competing interests None declared. References 1. Office of National Statistics. UK, 2010. 2. Atkin W, Marson B, Cuzick J. Long term risk of colorectal cancer after excision of ectosigmoid adenomas. N Engl J Med 1992;326:658–62.
Article
Full-text available
The JAG Endoscopy Training System (JETS) e-portfolio was designed to provide an electronic log of endoscopic experience, improve the effectiveness of training, streamline the JAG certification process and support the quality assurance of trainers, units and regional training programmes. It was piloted in 2008 with an 82.6% uptake in trainees offered the system. The system was released in the UK in September 2009. Steady adoption across the UK demonstrates the service finds it a valuable tool. In time it will be the only vehicle through which a trainee can achieve certification through JAG to practise independently.
Article
Full-text available
Context: Many quality improvement education programmes have been introduced over the last decade with the purpose of enhancing patient safety. The importance of non-technical skills training is becoming increasingly prominent, but the extent to which educational interventions have been used and the theoretical underpinnings of such interventions remain unclear. These issues were investigated through a systematic review of the literature. Methods: Any studies involving an educational intervention to improve non-technical skills amongst undergraduate or postgraduate staff in an acute health care environment were considered. A standardised search of online databases was carried out independently by two authors and consensus reached on the inclusion of studies. Data extraction and multimodal quality assessment were completed independently, followed by a content analysis of interventions and the extraction of key themes. Results: A total of 22 studies met the inclusion criteria. Measured outcomes were variable, as was the strength of conclusions. Theoretical underpinning of interventions was not described in any studies. Content analysis revealed reasonable consistency with the emergence of five key themes: error; communication; teamwork and leadership; systems, and situational awareness. Teaching was often multidisciplinary and methods used included simulation and role-play exercises, and observation. Conclusions: The methodological quality of published studies is reasonable, although the reporting of specific interventions is poor. Although a recognised model to support the design of patient safety education is lacking, a number of theories have been applied to guide educators in future instructional design. Further published work should clearly describe interventions and their theoretical underpinnings, and should aim to further explore which specific aspects of interventions are effective and why. Such research should also try to assess whether such interventions can impact patient outcomes.
Article
Full-text available
Objective: To perform a comprehensive audit of all colonoscopy undertaken in the UK over a 2-week period. Design: Multi-centre survey. All adult (≥16 years of age) colonoscopies that took place in participating National Health Service hospitals between 28 February 2011 and 11 March 2011 were included. Results: Data on 20,085 colonoscopies and 2681 colonoscopists were collected from 302 units. A validation exercise indicated that data were collected on over 94% of all procedures performed nationally. The unadjusted caecal intubation rate (CIR) was 92.3%. When adjusted for impassable strictures and poor bowel preparation the CIR was 95.8%. The polyp detection rate was 32.1%. The polyp detection rate for larger polyps (≥10 mm diameter) was 11.7%. 92.3% of resected polyps were retrieved. 90.2% of procedures achieved acceptable levels of patient comfort. A total of eight perforations and 52 significant haemorrhages were reported. Eight patients underwent surgery as a consequence of a complication. Conclusions: This is the first national audit of colonoscopy that has successfully captured the majority of adult colonoscopies performed across an entire nation during a defined time period. The data confirm that there has been a significant improvement in the performance of colonoscopy in the UK since the last study reported seven years ago (CIR 76.9%) and that performance is above the required national standards.
Article
Objective To investigate the literature for evidence that workplace based assessment affects doctors’ education and performance. Design Systematic review. Data sources The primary data sources were the databases Journals@Ovid, Medline, Embase, CINAHL, PsycINFO, and ERIC. Evidence based reviews (Bandolier, Cochrane Library, DARE, HTA Database, and NHS EED) were accessed and searched via the Health Information Resources website. Reference lists of relevant studies and bibliographies of review articles were also searched. Review methods Studies of any design that attempted to evaluate either the educational impact of workplace based assessment, or the effect of workplace based assessment on doctors’ performance, were included. Studies were excluded if the sampled population was non-medical or the study was performed with medical students. Review articles, commentaries, and letters were also excluded. The final exclusion criterion was the use of simulated patients or models rather than real life clinical encounters. Results Sixteen studies were included. Fifteen of these were non-comparative descriptive or observational studies; the other was a randomised controlled trial. Study quality was mixed. Eight studies examined multisource feedback with mixed results; most doctors felt that multisource feedback had educational value, although the evidence for practice change was conflicting. Some junior doctors and surgeons displayed little willingness to change in response to multisource feedback, whereas family physicians might be more prepared to initiate change. Performance changes were more likely to occur when feedback was credible and accurate or when coaching was provided to help subjects identify their strengths and weaknesses. Four studies examined the mini-clinical evaluation exercise, one looked at direct observation of procedural skills, and three were concerned with multiple assessment methods: all these studies reported positive results for the educational impact of workplace based assessment tools. However, there was no objective evidence of improved performance with these tools. Conclusions Considering the emphasis placed on workplace based assessment as a method of formative performance assessment, there are few published articles exploring its impact on doctors’ education and performance. This review shows that multisource feedback can lead to performance improvement, although individual factors, the context of the feedback, and the presence of facilitation have a profound effect on the response. There is no evidence that alternative workplace based assessment tools (mini-clinical evaluation exercise, direct observation of procedural skills, and case based discussion) lead to improvement in performance, although subjective reports on their educational impact are positive.
Article
Background and study aims: The English National Health Service Bowel Cancer Screening Programme (NHSBCSP) is one of the world's largest organized screening programs. Minimizing adverse events is essential for any screening program. Study aims were to determine rates and to examine risk factors for adverse events. Patients and methods: Bleeding and perforations in NHSBCSP colonoscopies between August 2006 and January 2012 were examined. Logistic regression was used to examine risk factors for adverse events, including age, gender, polyp size, morphology, and location. For accurate attribution of adverse events, procedures with resection of only one polyp ("single-polypectomy") were analyzed in detail. Results: 130 831 colonoscopies (167 208 polypectomies) were analyzed, including 30 881 single-polypectomies. Overall bleeding rate was 0.65 %, rate of bleeding requiring transfusion was 0.04 % and perforation rate was 0.06 %. Polypectomy increased bleeding risk 11.14-fold and perforation risk 2.97-fold. Cecal location (but not elsewhere in the proximal colon) and increasing polyp size were the two most important risk factors for bleeding and perforation. After adjustment for polyp size, the odds ratio (OR) relative to the distal colon for bleeding requiring transfusion after cecal snare polypectomy was 13.5 (95 %CI 3.9 - 46.4) and for perforation after cecal nonpedunculated polypectomy it was 12.2 (95 %CI 1.2 - 119.5). Conclusion: This is the largest study focusing on polyp-specific risk factors. We have confirmed that the greatest risk factor for both post-polypectomy bleeding and perforation is polyp size. This is the first demonstration of substantial and significantly increased risk for both noteworthy bleeding (requiring transfusion) and perforation from cecal polypectomy for a given polyp size, compared with elsewhere in the colon.
Article
Background and objective: Serious GI adverse events in the outpatient setting were examined by polypectomy technique, endoscopist volume, and facility type (ambulatory surgery center and hospital outpatient department). Design: Retrospective follow-up study. Setting: Ambulatory surgery and hospital discharge datasets from Florida (1997-2004) were used. Patients: A total of 2,315,126 outpatient colonoscopies performed in patients of all ages and payers were examined. Main outcome: Thirty-day hospitalizations because of colonic perforations and GI bleeding, measured as cumulative and specific outcomes, were investigated. Results: Compared with simple colonoscopy, the adjusted risks of cumulative adverse events were greater with the use of cold forceps (1.21 [95% CI, 1.01-1.44]), ablation (3.75 [95% CI, 2.97-4.72]), hot forceps (5.63 [95% CI, 4.97-6.39]), snares (7.75 [95% CI, 6.95-8.64]), or complex colonoscopy (8.83 [95% CI, 7.70-10.12]). Low-volume endoscopists had higher risks of adverse events (1.18 [95% CI, 1.07-1.30]). A higher risk of adverse events was associated with procedures performed in ambulatory surgery centers (1.27 [95% CI, 1.16-1.40]). Important findings were also reported for the analyses stratified by specific outcomes and procedures. Limitation: The study was constrained by limitations inherent in administrative data pertaining to a single state. Conclusions: As the complexity of polypectomy increases, a higher risk of adverse events is reported. Using lower risk procedures when clinically appropriate or referring patients to high-volume endoscopists can reduce the rates of perforations and GI bleeding. Given the large number of colonoscopies performed in the United States, it is critical that the rates of adverse events be considered when choosing procedures.
Article
This is one of a series of documents prepared by the American Society for Gastrointestinal Endoscopy (ASGE) Training Committee. This curriculum document contains recommendations for training, intended for use by endoscopy training directors, endoscopists involved in teaching endoscopy, and for trainees in endoscopy. It was developed as an overview of techniques currently favored for the performance and training of colonoscopy and to serve as a guide to published references, videotapes, and other resources available to the trainer. By providing information to endoscopy trainers about the common practices used by experts in performing the technical aspects of the procedure, the ASGE hopes to improve the teaching and performance of colonoscopy.
Article
BACKGROUND: Colonic polypectomy reduces the subsequent rate of development of colonic cancer but is not without its risks. We aimed to examine our complication rates in relation to the characteristics of polyps and techniques employed. METHODS: A database for all colonic polypectomies performed over a 3½-year period between 2006 and 2009 was matched against all patients readmitted after an endoscopy. Serious complications post-polypectomy were defined as events leading to readmission within 14 days. RESULTS: We performed 2106 polypectomies on 1252 patients in this period. Fourteen patients or 24 (1.1%) polypectomies experienced complications. Two patients (0.09%) experienced perforation, 10 (0.47%) had bleeding and 3 (0.14%) had post-polypectomy syndromes. Our bleeding rate was 1:211, lower than the national standard of 1:100. No deaths were reported. Complication rates rose from 1% in the smallest group (1-10 mm) to 4.9% in the largest (>31 mm) but the difference was not statistically significant (p=0.067). Right-colon polypectomies had a higher tendency of developing post-polypectomy syndrome and bleeding (p=0.002). Complication rates in snare polypectomies were not significantly different from that of hot biopsies (p=0.64). However, endoscopic mucosal resections (EMR) had significantly more complications compared to snares (p=0.045) and hot biopsies (p=0.026). CONCLUSION: We achieved lower bleeding rates than that published nationally. Hot biopsies did not carry a higher risk unlike EMRs. Although polyp size may be an important risk factor, statistical significance was not met. Ascending and transverse colon polypectomies carried the highest risks of complications.