ArticlePDF Available

The reliability and validity of using the urine dipstick test by patient self-assessment for urinary tract infection screening in spinal cord injury patients: Methodological and statistical issues on reliability and validity

Authors:
© 2018 Journal of Family Medicine and Primary Care | Published by Wolters Kluwer - Medknow 1148
The reliability and validity of
using the urine dipstick test
by patient self‑assessment
for urinary tract infection
screening in spinal cord injury
patients: Methodological and
statistical issues on reliability
and validity
Dear Editor,
We were interested to read the recent paper by Krit Duanngai
and colleagues published in September 2017 issue of the J Family
Med Prim Care.[1]
The authors aimed to evaluate the reliability of the urine
dipstick test by patients’ self‑assessment for urinary tract
infection (UTI) screening and to determine the validity of urine
dipstick test. The inter‑rater reliability was measured in the sense
of Kappa and validity of urine dipstick test was reported in
terms of sensitivity, specicity, positive and negative likelihood
ratio (+LR, −LR), positive predictive value (PPV), and negative
predictive value (NPV). The Kappa of urine dipstick test for
leukocyte esterase, nitrite, and combined leukocyte esterase and
nitrite were 0.09, 0.21, and 0.52, respectively. The combined
leukocyte esterase and nitrite urine dipstick test gave the highest
specicity (87%), PPV (60%), and NPV (93%). According to the
validity of urine dipstick test +LR for leukocyte esterase was 1.33
with 95% condence interval (CI) (0.40–4.42) and −LR was 0.94
with 95% CI (0.74–1.21).
However, these results are not the most appropriate estimates
to evaluate validity and reliability. Kappa has two crucial
disadvantages; first, it depends on the prevalence in each
category and the second weaknesses of the Kappa value is the
fact that it depends on the number of categories.[2‑4] To assess
reliability (agreement), appropriate methods are the intraclass
correlation coefficient (ICCC) or Bland–Altman plot for
quantitative variables and weighted Kappa for the qualitative
variable with more than two categories.[2‑4]
Moreover, we surprised when we looked at the range of LR+ and
LR−. To the best of our knowledge, LR+ can be changed from 1
to ∞ (the higher the LR+, the more accurate the test) and LR− can
be changed from 0 to 1 (the closer the LR− to 0, the more accurate
the test). Theoretically, when the value of LR+ is <1 and LR− is >1,
the diagnostic accuracy of the test is worse than ipping a coin![4,5]
We are facing such a situation in this study when looking at the
95% CI of the LR+. It means the accuracy of the mentioned tests
is not acceptable and should not be suggested for clinical purposes.
Financial support and sponsorship
Nil.
Conflicts of interest
There are no conicts of interest.
Sajjad Rahimi Pordanjani1,2,
Sohrab Iranpour3,4, Siamak Sabour2,5
1Department of Public Health, School of Health, Semnan
University of Medical Sciences, Semnan, 2Department of
Clinical Epidemiology, School of Public Health, Shahid
Beheshti University of Medical Sciences, 5Safety Promotion
and Injury Prevention Research Center, Shahid Beheshti
University of Medical Sciences, Tehran, 3Department
of Community Medicine, School of Medicine, Ardabil
University of Medical Sciences, 4Social Determinants of
Health Research Center, Ardabil University of Medical
Sciences, Ardabil, Iran
Address for correspondence: Dr. Siamak Sabour,
Department of Clinical Epidemiology, Safety Promotion and Injury
Prevention Research Center, School of Health, Shahid Beheshti
University of Medical Sciences, Tehran, Iran.
E-mail: s.sabour@sbmu.ac.ir
References
1. Duanngai K, Sirasaporn P, Ngaosinchai SS. The reliability
and validity of using the urine dipstick test by patient
self-assessment for urinary tract infection screening
in spinal cord injury patients. J Family Med Prim Care
2017;6:578-82.
2. Szklo M, Nieto FJ. Epidemiology beyond the Basics. 3rd ed.
Burlington, MA: Jones and Bartlett; 2014.
3. Sabour S. Reliability of automatic vibratory equipment
for ultrasonic strain measurement of the median nerve:
Common mistake. Ultrasound Med Biol 2015;41:1119-20.
4. Sabour S. Adherence to guidelines strongly improves
reproducibility of brachial artery flow-mediated
dilation. Common mistakes and methodological issue.
Atherosclerosis 2016;251:490-1.
Letter to Editor
Letter to Editor
Journal of Family Medicine and Primary Care 1149 Volume 7 : Issue 5 : September-October 2018
5. Robert M. Centor. Estimating confidence intervals of
likelihood ratios. Med Decis Making 1992;12:229-33.
Access this article online
Quick Response Code:
Website:
www.jfmpc.com
DOI:
10.4103/jfmpc.jfmpc_224_18
How to cite this article: Pordanjani SR, Iranpour S, Sabour S.
The reliability and validity of using the urine dipstick test by patient
self-assessment for urinary tract infection screening in spinal cord injury
patients: Methodological and statistical issues on reliability and validity.
J Family Med Prim Care 2018;7:1148-9.
© 2018 Journal of Family Medicine and Primary Care | Published by Wolters Kluwer - Medknow
This is an open access journal, and articles are distributed under the terms of the Creative
Commons Attribution‑NonCommercial‑ShareAlike 4.0 License, which allows others to
remix, tweak, and build upon the work non‑commercially, as long as appropriate credit is
given and the new creations are licensed under the identical terms.
Article
Objectives To explore the association between dipstick results and urinary symptoms. Method This was a prospective 12-month observational study of real-time self-administered urine dipstick results and symptoms in a community setting that included 52 spinal cord injury/disease (SCI/D) participants with neurogenic lower urinary tract dysfunction (NLUTD) who use an indwelling catheter. Symptoms were collected using the Urinary Symptom Questionnaire for Neurogenic Bladder–Indwelling Catheter (USQNB-IDC). The USQNB-IDC includes actionable (A), bladder (B1), urine quality (B2), and other (C) symptoms; analyses focused on A, B1, and B2 symptoms. Dipstick results include nitrite (NIT +/−), and leukocyte esterase (LE; negative, trace, small, moderate, or large). Dipstick outcomes were defined as strong positive (LE = moderate/large and NIT+), inflammation positive (LE = moderate/large and NIT−), negative (LE = negative/trace and NIT−), and indeterminate (all others). Results Nitrite positive dipsticks and moderate or large LE positive dipsticks were each observed in over 50% of the sample in every week. Strong positive dipstick results were observed in 35% to 60% of participants in every week. A, B1, or B2 symptoms co-occurred less than 50% of the time with strong positive dipsticks, but they also co-occurred with negative dipsticks. Participants were asymptomatic with a strong positive dipstick an average of 30.2% of the weeks. On average, 73% of the time a person had a negative dipstick, they also had no key symptoms (95% CI, .597-.865). Conclusion No association was observed between A, B1, and B2 symptoms and positive dipstick. A negative dipstick with the absence of key symptoms may better support clinical decision-making.
Article
Full-text available
Aims The aim of this is to evaluate the reliability of the urine dipstick test by patients’ self-assessment for urinary tract infection (UTI) screening and to determine the validity of urine dipstick test. Settings Rehabilitation Department, Srinagarind Hospital, Thailand. Study Design A diagnostic study. Subjects and Methods This study compared the urine dipstick test (index test) with the National Institute on Disability and Rehabilitation Research (NIDRR) criteria (gold standard test) in spinal cord injury (SCI) patients. The urine dipstick test informed positive and negative results. Besides the NIDRR criteria classified as UTI and no UTI. The interrater reliability was measured in the sense of Kappa whereas the validity of urine dipstick test was reported in terms of sensitivity, specificity, positive likelihood ratio (LR) (+LR), negative LR (−LR), positive predictive value (PPV), and negative predictive value (NPV). Results Out of the 56 participants, the kappa of urine dipstick test for leukocyte esterase, nitrite, and combined leukocyte esterase and nitrite were 0.09, 0.21, and 0.52, respectively. The nitrite urine dipstick test showed the highest sensitivity (90%). The combined leukocyte esterase and nitrite urine dipstick test gave the highest specificity (87%), PPV (60%), NPV (93%), and +LR (5.63). Conclusions The interrater reliability of combined leukocyte esterase and nitrite urine dipstick test was moderate agreement. The combined leukocyte esterase and nitrite urine dipstick test showed high level of both sensitivity and specificity. The combined leukocyte esterase and nitrite urine dipstick test should be promoted for patients’ self-assessment for UTI screening in SCI patients.
Epidemiology beyond the
  • M Szklo
  • F J Nieto
Szklo M, Nieto FJ. Epidemiology beyond the Basics. 3 rd ed. Burlington, MA: Jones and Bartlett; 2014.