Interobserver Agreement in the Assessment of Clinical Findings in Children With First Unprovoked Seizures

Columbia University College of Physicians and Surgeons, Morgan Stanley Children's Hospital of New York, 622 W 168th St, PH 137, New York, NY 10032, USA.
PEDIATRICS (Impact Factor: 5.3). 05/2011; 127(5):e1266-71. DOI: 10.1542/peds.2010-1752
Source: PubMed

ABSTRACT Variables used in prediction rules and clinical guidelines should show acceptable agreement when assessed by different observers. Our objective was to determine the interobserver agreement of patient history and physical examination variables used to assess children undergoing emergency department (ED) evaluation for a first seizure not provoked by a known precipitant such as fever or trauma (ie, an unprovoked seizure).
We conducted a prospective cohort study of children aged 28 days to 18 years evaluated for unprovoked seizures at 6 tertiary care EDs. We excluded patients if previously evaluated for a similar event. Two clinicians independently completed a clinical assessment before neuroimaging. We determined agreement for each clinical variable by using the unweighted κ statistic.
A total of 217 paired observations were analyzed; median patient age was 53.5 months, and 38% were younger than 2 years. Agreement beyond chance was at least moderate (κ ≥ 0.41) for 21 of 31 (68%) variables for which κ could be calculated. κ was ≥0.41 for 7 of 11 (64%) general history variables, all 8 seizure-specific history variables (including seizure focality), and 6 of 12 (50%) physical examination variables. Agreement beyond chance was substantial or better (κ ≥ 0.61) for 2 of 11 (18%) general history variables, for 5 of 8 (63%) seizure-specific history variables, and for 2 of 12 (17%) physical examination variables.
For children with first unprovoked seizures evaluated in the ED, clinicians frequently assess findings from seizure-specific history with substantial agreement beyond chance. Those clinical variables that have been associated with the presence of intracranial abnormalities and show reliability between assessors, such as seizure focality and the presence of any focal neurological finding, may be more useful in the ED assessment of children with first unprovoked seizures.

  • [Show abstract] [Hide abstract]
    ABSTRACT: The objective of this study was to compare the first afebrile seizure management with internationally recognized standards in an Irish tertiary pediatric setting. Twenty-one management standards were derived from a combination of British (NICE 2004) and North American (AAN 2003) guidelines. Cases of first afebrile seizure presenting to a pediatric emergency department between July 2007 and June 2010 were assessed against the standards. On completion, the standards developed were presented to the relevant stakeholders, a nurse-developed parental advice sheet was introduced, and a re-audit was performed from July 2010 to June 2011. Forty children were identified in the initial audit period (A1) and 41 over the re-audit (A2). No case achieved full compliance with the devised standards in the audit period. A median compliance score of 15 (range 5-20) was achieved in A1 and 17 (range 11-21) in A2 [mean rank 31.93 versus 49.85; p(1,1) < 0.0001]. Optimal compliance (total score of ≥17) with devised standards was achieved in 6/40 patients in A1 and in 21/41 patients in A2 [χ (2) = 11.95; p(1,1) = 0.001]. Conclusion: We demonstrated an initial lack of compliance with international guidelines on management of a common medical presentation, first afebrile seizure, and demonstrated that improvements can be achieved by identification of appropriate standards and critical appraisal of the compliance with these standards through both formal and informal education.
    European Journal of Pediatrics 11/2013; DOI:10.1007/s00431-013-2180-7 · 1.98 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: OBJECTIVE:The Pediatric Emergency Care Applied Research Network (PECARN) traumatic brain injury (TBI) clinical prediction rules identify children with minor blunt head trauma who are at low risk for clinically important traumatic brain injuries. We measured the agreement between the registered nurse (RN) and physician (MD) assessments.METHODS:We performed a cross-sectional study of all children <18 years of age with minor blunt head trauma who presented to a single emergency department. RNs and MDs independently assessed each child and recorded age-based PECARN predictors. As symptoms can change over time, we included cases only when both evaluations were completed within 60 minutes. We used the κ statistic to measure RN-MD agreement, with the main analysis focusing on the overall PECARN rule agreement.RESULTS:Of the 1624 eligible children, 1191 (73%) had evaluations completed by both RN and ED providers, of which 437 (37%) were in children <2 years of age. The median time between completions of the provider forms was 12 minutes (interquartile range 4-25 minutes). The overall agreement between the RN and MD was higher for the older children (κ 0.55, 95% confidence interval 0.49-0.61 for children 2-18 years versus κ 0.32, 95% confidence interval 0.23-0.41 for children <2 years).CONCLUSIONS:The overall agreement between RN and MD for the PECARN TBI prediction rules was moderate for older children and fair for younger children. Initial RN assessments should be verified by the MD before clinical application, especially for the youngest children.
    PEDIATRICS 08/2013; 132(3). DOI:10.1542/peds.2013-0909 · 5.30 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Purpose: To assess the prevalence of clinically urgent intra-cranial pathology among children who had imaging for a first episode of non-febrile seizure with focal manifestations. Methods: We performed a cross sectional study of all children age 1 month to 18 years evaluated for first episode of non-febrile seizure with focal manifestations and having neuroimaging performed within 24 h of presentation at a single pediatric ED between 1995 and 2012. We excluded intubated patients, those with known structural brain abnormality and trauma. A single neuro-radiologist reviewed all cranial computed tomography and/or magnetic resonance imaging performed. We defined clinically urgent intracranial pathology as any finding resulting in a change of initial patient management. We performed univariate analysis using chi(2) analysis for categorical data and Mann-Whitney U test for continuous data. Results: We identified 319 patients having a median age of 4.6 years [IQR 1.8-9.4] of which 45% were female. Two hundred sixty-two children had a CT scan, 15 had an MR and 42 had both. Clinically urgent intra-cranial pathology was identified on imaging of 13 patients (4.1%; 95% CI: 2.2, 7.0). Infarction, hemorrhage and thrombosis were most common (9/13). Twelve of 13 were evident on CT scan. Persistent Todd's paresis and age <= 18 months were predictors of clinically urgent intracranial pathology. Absence of secondary generalization and multiple seizures on presentation were not predictive. Conclusions: Four percent of children imaged with first time, afebrile focal seizures have findings important to initial management. Children younger than <= 18 months are at increased risk. (c) 2014 British Epilepsy Association. Published by Elsevier Ltd. All rights reserved.
    Seizure 06/2014; 23(9). DOI:10.1016/j.seizure.2014.06.003 · 2.06 Impact Factor