Julianne Gee’s research while affiliated with Centers for Disease Control and Prevention and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (95)


A Texting- and Internet-Based Self-Reporting System for Enhanced Vaccine Safety Surveillance With Insights From a Large Integrated Health Care System in the United States: Prospective Cohort Study
  • Article

October 2024

·

8 Reads

JMIR mhealth and uhealth

·

Julianne Gee

·

Sungching Glenn

·

[...]

·

Background SMS text messaging- and internet-based self-reporting systems can supplement existing vaccine safety surveillance systems, but real-world participation patterns have not been assessed at scale. Objective This study aimed to describe the participation rates of a new SMS text messaging- and internet-based self-reporting system called the Kaiser Permanente Side Effect Monitor (KPSEM) within a large integrated health care system. Methods We conducted a prospective cohort study of Kaiser Permanente Southern California (KPSC) patients receiving a COVID-19 vaccination from April 23, 2021, to July 31, 2023. Patients received invitations through flyers, SMS text messages, emails, or patient health care portals. After consenting, patients received regular surveys to assess adverse events up to 5 weeks after each dose. Linkage with medical records provided demographic and clinical data. In this study, we describe KPSEM participation rates, defined as providing consent and completing at least 1 survey within 35 days of COVID-19 vaccination. Results Approximately, 8% (164,636/2,091,975) of all vaccinated patients provided consent and completed at least 1 survey within 35 days. The lowest participation rates were observed for parents of children aged 12-17 years (1349/152,928, 0.9% participation rate), and the highest participation was observed among older adults aged 61-70 years (39,844/329,487, 12.1%). Persons of non-Hispanic White race were more likely to participate compared with other races and ethnicities (13.1% vs 3.9%-7.5%, respectively; P<.001). In addition, patients residing in areas with a higher neighborhood deprivation index were less likely to participate (5.1%, 16,503/323,122 vs 10.8%, 38,084/352,939 in the highest vs lowest deprivation quintiles, respectively; P<.001). Invitations through the individual's Kaiser Permanente health care portal account and by SMS text message were associated with the highest participation rate (19.2%, 70,248/366,377 and 10.5%, 96,169/914,793, respectively), followed by email (19,464/396,912, 4.9%) and then QR codes on flyers (25,882/2,091,975, 1.2%). SMS text messaging–based surveys demonstrated the highest sustained daily response rates compared with internet-based surveys. Conclusions This real-world prospective study demonstrated that a novel digital vaccine safety self-reporting system implemented through an integrated health care system can achieve high participation rates. Linkage with participants’ electronic health records is another unique benefit of this surveillance system. We also identified lower participation among selected vulnerable populations, which may have implications when interpreting data collected from similar digital systems.


Identification and confirmation of ME/CFS cases from electronic medical records of Kaiser Permanente Northwest health care system members 9–39 years of age between 2006 and 2017. Analysis of annual coding rate was based on a subset of presumptive cases. ICD = International Classification of Diseases; MF/CFS = myalgic encephalomyelitis/chronic fatigue syndrome.
Annual coding rates for prespecified ME/CFS ICD-9 diagnosis code 780.71 and ICD-10 diagnosis code R53.82, per 100,000 person-years; age at first entry of ME/CFS code. ICD = International Classification of Diseases; ME/CFS = myalgic encephalomyelitis/chronic fatigue syndrome.
Annual coding rates for prespecified ME/CFS ICD-9 diagnosis code 780.71 and ICD-10 diagnosis code R53.82, per 100,000 person-years; age at first entry of ME/CFS code. ICD = International Classification of Diseases; ME/CFS = myalgic encephalomyelitis/chronic fatigue syndrome.
Classification Accuracy and Description of Myalgic Encephalomyelitis/Chronic Fatigue Syndrome in an Integrated Health Care System, 2006–2017
  • Article
  • Full-text available

June 2024

·

13 Reads

Introduction Myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS) is a chronic illness characterized by marked functional limitations and fatigue. Electronic health records can be used to estimate incidence of ME/CFS but may have limitations. Methods The authors used International Classification of Diseases (ICD) diagnosis codes to identify all presumptive cases of ME/CFS among 9- to 39-year-olds from 2006 to 2017. The authors randomly selected 200 cases for medical record review to classify cases as confirmed, probable, or possible, based on which and how many current clinical criteria they met, and to further characterize their illness. The authors calculated crude annual rates of ME/CFS coding stratified by age and sex using only those ICD codes that had identified confirmed, probable, or possible ME/CFS cases in the medical record review. Results The authors identified 522 individuals with presumptive ME/CFS based on having ≥ 1 ICD codes for ME/CFS in their electronic medical record. Of the 200 cases selected, records were available and reviewed for 188. Thirty (15%) were confirmed or probable ME/CFS cases, 39 (19%) were possible cases, 119 (60%) were not cases, and 12 (6%) had no medical record available. Confirmed/probable cases commonly had chronic pain (80%) or anxiety/depression (70%), and only 13 (43%) had completed a sleep study. Overall, 37 per 100,000 had ICD codes that identified confirmed, probable, or possible ME/CFS. Rates increased between 2006 and 2017, with the largest absolute increase among those 30–39 years old. Conclusions Using ICD diagnosis codes alone inaccurately estimates ME/CFS incidence.

Download

Postmenopausal Bleeding After Coronavirus Disease 2019 (COVID-19) Vaccination: Vaccine Adverse Event Reporting System

May 2024

·

15 Reads

·

1 Citation

Obstetrics and Gynecology

We identified U.S. reports of postmenopausal bleeding in the VAERS (Vaccine Adverse Event Reporting System) between December 13, 2020, and December 13, 2021. Among 711,224 VAERS reports after coronavirus disease 2019 (COVID-19) vaccination, during our study period, we identified 554 presumptive postmenopausal bleeding reports; 434 were further classified as verified based on data abstracted from reports and medical records, when available. In the United States, by December 14, 2021, 58.8 million women aged 50 years or older had received at least one dose of a COVID-19 vaccine, corresponding to approximately seven verified VAERS postmenopausal bleeding reports per 1 million women aged 50 years or older who received a COVID-19 vaccine. Reports of postmenopausal bleeding after COVID-19 vaccination in VAERS were rare, and causes of postmenopausal bleeding based on medical record review were consistent with known causes of postmenopausal bleeding.



A Texting- and Internet-Based Self-Reporting System for Enhanced Vaccine Safety Surveillance With Insights From a Large Integrated Health Care System in the United States: Prospective Cohort Study (Preprint)

March 2024

·

3 Reads

BACKGROUND SMS text messaging- and internet-based self-reporting systems can supplement existing vaccine safety surveillance systems, but real-world participation patterns have not been assessed at scale. OBJECTIVE This study aimed to describe the participation rates of a new SMS text messaging- and internet-based self-reporting system called the Kaiser Permanente Side Effect Monitor (KPSEM) within a large integrated health care system. METHODS We conducted a prospective cohort study of Kaiser Permanente Southern California (KPSC) patients receiving a COVID-19 vaccination from April 23, 2021, to July 31, 2023. Patients received invitations through flyers, SMS text messages, emails, or patient health care portals. After consenting, patients received regular surveys to assess adverse events up to 5 weeks after each dose. Linkage with medical records provided demographic and clinical data. In this study, we describe KPSEM participation rates, defined as providing consent and completing at least 1 survey within 35 days of COVID-19 vaccination. RESULTS Approximately, 8% (164,636/2,091,975) of all vaccinated patients provided consent and completed at least 1 survey within 35 days. The lowest participation rates were observed for parents of children aged 12-17 years (1349/152,928, 0.9% participation rate), and the highest participation was observed among older adults aged 61-70 years (39,844/329,487, 12.1%). Persons of non-Hispanic White race were more likely to participate compared with other races and ethnicities (13.1% vs 3.9%-7.5%, respectively; P <.001). In addition, patients residing in areas with a higher neighborhood deprivation index were less likely to participate (5.1%, 16,503/323,122 vs 10.8%, 38,084/352,939 in the highest vs lowest deprivation quintiles, respectively; P <.001). Invitations through the individual's Kaiser Permanente health care portal account and by SMS text message were associated with the highest participation rate (19.2%, 70,248/366,377 and 10.5%, 96,169/914,793, respectively), followed by email (19,464/396,912, 4.9%) and then QR codes on flyers (25,882/2,091,975, 1.2%). SMS text messaging–based surveys demonstrated the highest sustained daily response rates compared with internet-based surveys. CONCLUSIONS This real-world prospective study demonstrated that a novel digital vaccine safety self-reporting system implemented through an integrated health care system can achieve high participation rates. Linkage with participants’ electronic health records is another unique benefit of this surveillance system. We also identified lower participation among selected vulnerable populations, which may have implications when interpreting data collected from similar digital systems.



COVID-19 Vaccine Safety Technical (VaST) Work Group: Enhancing vaccine safety monitoring during the pandemic

February 2024

·

40 Reads

·

11 Citations

Vaccine

During the COVID-19 pandemic, candidate COVID-19 vaccines were being developed for potential use in the United States on an unprecedented, accelerated schedule. It was anticipated that once available, under U.S. Food and Drug Administration (FDA) Emergency Use Authorization (EUA) or FDA approval, COVID-19 vaccines would be broadly used and potentially administered to millions of individuals in a short period of time. Intensive monitoring in the post-EUA/licensure period would be necessary for timely detection and assessment of potential safety concerns. To address this, the Centers for Disease Control and Prevention (CDC) convened an Advisory Committee on Immunization Practices (ACIP) work group focused solely on COVID-19 vaccine safety, consisting of independent vaccine safety experts and representatives from federal agencies – the ACIP COVID-19 Vaccine Safety Technical Work Group (VaST). This report provides an overview of the organization and activities of VaST, summarizes data reviewed as part of the comprehensive effort to monitor vaccine safety during the COVID-19 pandemic, and highlights selected actions taken by CDC, ACIP, and FDA in response to accumulating post-authorization safety data. VaST convened regular meetings over the course of 29 months, from November 2020 through April 2023; through March 2023 FDA issued EUAs for six COVID-19 vaccines from four different manufacturers and subsequently licensed two of these COVID-19 vaccines. The independent vaccine safety experts collaborated with federal agencies to ensure timely assessment of vaccine safety data during this time. VaST worked closely with the ACIP COVID-19 Vaccines Work Group; that work group used safety data and VaST’s assessments for benefit-risk assessments and guidance for COVID-19 vaccination policy. Safety topics reviewed by VaST included those identified in safety monitoring systems and other topics of scientific or public interest. VaST provided guidance to CDC’s COVID-19 vaccine safety monitoring efforts, provided a forum for review of data from several U.S. government vaccine safety systems, and assured that a diverse group of scientists and clinicians, external to the federal government, promptly reviewed vaccine safety data. In the event of a future pandemic or other biological public health emergency, the VaST model could be used to strengthen vaccine safety monitoring, enhance public confidence, and increase transparency through incorporation of independent, non-government safety experts into the monitoring process, and through strong collaboration among federal and other partners.


Post-authorization safety surveillance of Ad.26.COV2.S vaccine: Reports to the Vaccine Adverse Event Reporting System and v-safe, February 2021–February 2022

June 2023

·

18 Reads

·

11 Citations

Vaccine

Background: On 2/27/2021, FDA authorized Janssen COVID-19 Vaccine (Ad.26.COV2.S) for use in individuals 18 years of age and older. Vaccine safety was monitored using the Vaccine Adverse Event Reporting System (VAERS), a national passive surveillance system, and v-safe, a smartphone-based surveillance system. Methods: VAERS and v-safe data from 2/27/2021 to 2/28/2022 were analyzed. Descriptive analyses included sex, age, race/ethnicity, seriousness, AEs of special interest (AESIs), and cause of death. For prespecified AESIs, reporting rates were calculated using the total number of doses of Ad26.COV2.S administered. For myopericarditis, observed-to-expected (O/E) analysis was performed based on the number verified cases, vaccine administration data, and published background rates. Proportions of v-safe participants reporting local and systemic reactions, as well as health impacts, were calculated. Results: During the analytic period, 17,018,042 doses of Ad26.COV2.S were administered in the United States, and VAERS received 67,995 reports of AEs after Ad26.COV2.S vaccination. Most AEs (59,750; 87.9 %) were non-serious and were similar to those observed during clinical trials. Serious AEs included COVID-19 disease, coagulopathy (including thrombosis with thrombocytopenia syndrome; TTS), myocardial infarction, Bell's Palsy, and Guillain-Barré syndrome (GBS). Among AESIs, reporting rates per million doses of Ad26.COV2.S administered ranged from 0.06 for multisystem inflammatory syndrome in children to 263.43 for COVID-19 disease. O/E analysis revealed elevated reporting rate ratios (RRs) for myopericarditis; among adults ages 18-64 years, the RR was 3.19 (95 % CI 2.00, 4.83) within 7 days and 1.79 (95 % CI 1.26, 2.46) within 21 days of vaccination. Of 416,384 Ad26.COV2.S recipients enrolled into v-safe, 60.9 % reported local symptoms (e.g. injection site pain) and 75.9 % reported systemic symptoms (e.g., fatigue, headache). One-third of participants (141,334; 33.9 %) reported a health impact, but only 1.4 % sought medical care. Conclusion: Our review confirmed previously established safety risks for TTS and GBS and identified a potential safety concern for myocarditis.


Budapest Criteria for the diagnosis of complex regional pain syndrome. Figure based on information from reference 26.
Ascertainment and verification of upper limb CRPS cases in patients ages 9–30 years, Kaiser Permanente Northwest, 2002–2017. a Upper limb or site unspecified CRPS, reflex sympathetic dystrophy, or causalgia diagnoses (ICD-9 codes 337.20, 337.21, 337.29, 354.4; ICD-10 codes G90.50, G90.511, G90.512, G90.513, G90.519, G90.59, G56.40, G56.41, G56.42, G56.43; and Kaiser Permanente Northwest–specific text diagnoses). CRPS = complex regional pain syndrome; ICD-9 = International Classification of Diseases, 9th Revision; ICD-10 = International Classification of Diseases, 10th Revision.
Epidemiology of Upper Limb Complex Regional Pain Syndrome in a Retrospective Cohort of Persons Aged 9–30 Years, 2002–2017

May 2023

·

57 Reads

·

2 Citations

Introduction This paper describes the epidemiology and clinical presentation of complex regional pain syndrome (CRPS) in a large, integrated health care delivery system; and CRPS incidence rates (IRs) over a time period spanning human papillomavirus (HPV) vaccine licensure and published case reports of CRPS following HPV vaccination. Methods The authors examined CRPS diagnoses in patients aged 9–30 years between January 2002 and December 2017 using electronic medical records, excluding patients with lower limb diagnoses only. Medical record abstraction and adjudication were conducted to verify diagnoses and describe clinical characteristics. CRPS IRs were calculated for 3 periods: Period 1 (2002–2006: before HPV vaccine licensure), Period 2 (2007–2012: after licensure but before published case reports), and Period 3 (2013–2017: after published case reports). Results A total of 231 individuals received an upper limb or unspecified CRPS diagnosis code during the study period; 113 cases were verified through abstraction and adjudication. Most verified cases (73%) were associated with a clear precipitating event (eg, non–vaccine-related injury, surgical procedure). The authors identified only 1 case in which a practitioner attributed CRPS onset to HPV vaccination. Twenty-five incident cases occurred in Period 1 (IR = 4.35/100,000 person-years (PY), 95% confidence interval (CI) = 2.94-6.44), 42 in Period 2 (IR = 5.94/100,000 PY, 95% CI = 4.39-8.04), and 29 in Period 3 (IR = 4.53/100,000 PY, 95% CI = 3.15-6.52); differences between periods were not statistically significant. Conclusion These data provide a comprehensive assessment of the epidemiology and characteristics of CRPS in children and young adults and provide further reassurance about the safety of HPV vaccination.


COVID-19 Vaccine Safety Inquiries to the Centers for Disease Control and Prevention Immunization Safety Office

May 2023

·

27 Reads

·

1 Citation

Vaccine

Background: Following the authorization and recommendations for use of the U.S. COVID-19 vaccines, the Centers for Disease Control and Prevention (CDC)'s Immunization Safety Office (ISO) responded to inquiries and questions from public health officials, healthcare providers, and the general public on COVID-19 vaccine safety. Methods: We describe COVID-19 vaccine safety inquiries, by topic, received and addressed by ISO from December 1, 2020-August 31, 2022. Results: Of the 1978 COVID-19 vaccine-related inquiries received, 1655 specifically involved vaccine safety topics. The most frequently asked-about topics included deaths following vaccination, myocarditis, pregnancy, and reproductive health outcomes, understanding or interpreting data from the Vaccine Adverse Event Reporting System (VAERS), and thrombosis with thrombocytopenia syndrome. Conclusions: Inquiries about vaccine safety generally reflect issues that receive media attention. ISO will continue to monitor vaccine safety inquiries and provide accurate and timely information to healthcare providers, public health officials, and the general public.


Citations (84)


... Nevertheless, there have been numerous reports of menstrual disturbances following the COVID-19 modmRNA injections, potentially impacting preventable morbidity and mortality. Of considerable concern, given the well-established underreporting factor in passive surveillance systems, were the 554 postmenopausal bleeding reports filed in the Vaccine Adverse Event Reporting System between December 13, 2020, and December 13, 2021 (Strid et al., 2024). A relatively high prevalence of menstrual cycle irregularities was recorded among Saudi women who had received the gene-based injections (AlRawi et al., 2024). ...

Reference:

COVID-19 Modified mRNA “Vaccines”: Lessons Learned from Clinical Trials, Mass Vaccination, and the Bio-Pharmaceutical Complex, Part 2
Postmenopausal Bleeding After Coronavirus Disease 2019 (COVID-19) Vaccination: Vaccine Adverse Event Reporting System
  • Citing Article
  • May 2024

Obstetrics and Gynecology

... Reports can be submitted by anybody, allowing VAERS to serve as an early warning system which can quickly detect potential safety signals. VAERS has several limitations, including both underreporting and stimulated reporting [90,91]. The latter refers to elevations in reporting due to media attention and public awareness, and may increase the rates of poorly documented, incorrect or fraudulent reports, the lattermost being rare due to database monitoring by the US Centers for Disease Control (CDC) [92]. ...

Overview of U.S. COVID-19 vaccine safety surveillance systems
  • Citing Article
  • April 2024

Vaccine

... Challenges in assessing vaccine safety and efficacy arise from the ethical dilemmas associated with conducting clinical trials during pregnancy, including concerns about potential risks to the fetus and the need for informed consent [7,33,42]. Post-marketing surveillance in vaccinated pregnant women is crucial for monitoring long-term safety and efficacy outcomes [7,33,43]. ...

Planning for the future of maternal immunization: Building on lessons learned from the COVID-19 pandemic
  • Citing Article
  • February 2024

Vaccine

... While the expedited development of COVID-19 vaccines was necessary, continuous post-vaccination surveillance is imperative to detect any rare or delayed adverse events, especially in vulnerable populations such as individuals with pre-existing conditions or those who are immunocompromised. Long-term monitoring is important for assessing vaccine safety and identifying potential risks, which plays a key role in maintaining public trust and guiding healthcare strategies [39][40][41][42][43]. ...

COVID-19 Vaccine Safety Technical (VaST) Work Group: Enhancing vaccine safety monitoring during the pandemic

Vaccine

... There could be several reasons for the high participation rate of 30% observed in this study when compared with other digital vaccine safety self-reporting systems such as V-safe (CDC), which enrolled approximately 1-2% of all vaccinees in the United States during the national COVID-19 vaccination program [26]. First, owing to the integrated health care system setting (rather than a federal entity), our system may have had enhanced trust among participants [27,28]. ...

Post-authorization safety surveillance of Ad.26.COV2.S vaccine: Reports to the Vaccine Adverse Event Reporting System and v-safe, February 2021–February 2022
  • Citing Article
  • June 2023

Vaccine

... Based on literature and preliminary experiment results, the expected incidence of CRPS was estimated to be around 20% [18,19]. To ensure the detection of significant risk factors associated with the occurrence of CRPS, an effect size (HR) of 2.0, a significance level (α) of 0.05, and a power of 0.75 were set. ...

Epidemiology of Upper Limb Complex Regional Pain Syndrome in a Retrospective Cohort of Persons Aged 9–30 Years, 2002–2017

... 3 The safety and efficacy of mRNA COVID-19 vaccines in these populations were assessed in clinical trials and post-marketing studies. [4][5][6][7] However, evidence is limited from post-marketing studies that have examined mRNA-COVID-19 vaccine safety in both older and younger children including infants. A systematic review and meta-analysis of COVID-19 vaccine safety among individuals aged 3-17 years emphasized the urgent need for multicenter, large-sample studies, particularly in younger children and infants, with long-term followup data. ...

COVID-19 Vaccine Safety First Year Findings in Adolescents
  • Citing Article
  • April 2023

... In addition, reported GBS cases following Ad26.COV2.S vaccinations were 2-3 times higher than predicted based on background rates at 21-and 42-days post-vaccination, respectively. GBS occurred more frequently after adenovirus immunization than after mRNA (messenger ribonucleic acid) vaccination [32]. ...

Reports of Guillain-Barré Syndrome After COVID-19 Vaccination in the United States

JAMA Network Open

... VAERS, acting as an early warning system, can identify AEFIs requiring further investigation, which can be accomplished through active monitoring systems including V-Safe, VSD, the biologics effectiveness and safety system (BEST) and the center for Medicare and Medicaid services (CMS) [93]. V-safe is a smartphone based platform which prompts users to complete health surveys after vaccination. ...

The v-safe after vaccination health checker: Active vaccine safety monitoring during CDC’s COVID-19 pandemic response
  • Citing Article
  • January 2023

Vaccine

... Analyzing the relationship between vaccines and deaths requires considerable time and effort; therefore, a comparative analysis with existing death statistics should be conducted before interpreting these findings. The results of the TMS were consistent with those previously reported from the Pfizer and Moderna vaccine clinical trials [18][19][20][21][22]. Most cases were mild or moderate and temporary, with pain at the injection site being the most common local AE. ...

Safety Monitoring of Bivalent COVID-19 mRNA Vaccine Booster Doses Among Children Aged 5-11 Years - United States, October 12-January 1, 2023

MMWR. Morbidity and mortality weekly report