Article

Informatics for the Modern Intensive Care Unit

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract

Advanced informatics systems can help improve health care delivery and the environment of care for critically ill patients. However, identifying, testing, and deploying advanced informatics systems can be quite challenging. These processes often require involvement from a collaborative group of health care professionals of varied disciplines with knowledge of the complexities related to designing the modern and "smart" intensive care unit (ICU). In this article, we explore the connectivity environment within the ICU, middleware technologies to address a host of patient care initiatives, and the core informatics concepts necessary for both the design and implementation of advanced informatics systems.

No full-text available

Request Full-text Paper PDF

To read the full-text of this research,
you can request a copy directly from the authors.

... Digital failures in healthcare settings, especially in an Intensive Care Unit (ICU), can have severe repercussions, potentially jeopardizing the treatment of critical clinical cases. With the escalating integration of digital technologies into ICUs, these units transform into 'smart ICUs', enabling the automatic patient treatment, remote expert consultation, and even robot-assisted surgeries directly in the ICU [Anderson et al.(2018)]. To achieve the desired flexibility and mobility of devices, these intelligent ICUs increasingly rely on modern mobile communication networks, particularly 5G [Peralta-Ochoa et al.(2023)]. ...
... The unique requirements and specialized treatment methods necessitate specific equipment and IoT devices, making a smart ICU a distinct entity within the smart hospital. Anderson et al. have constructed a prototype of such a smart ICU network [Anderson et al.(2018)]. ...
... Our threat modeling builds upon the smart ICU network approach proposed by Anderson et al. [Anderson et al.(2018)]. The ICU network is conceptualized as an internal envelope encapsulating all hardware used for patient care. ...
Conference Paper
Full-text available
Healthcare digitization has significantly enhanced patient care and alleviated the workload of hospital staff. This trend towards automation has also optimized the intensive care units (ICUs) of hospitals, leading to the emergence of smart ICUs equipped with modern wireless communication networks like 5G. However, this increased digitization presents new attack vectors and opportunities, especially regarding cybersecurity attacks. These attacks could compromise the resilience of smart ICU networks. Given the critical role of ICUs in healthcare, it is imperative to analyze and categorize digital threats in terms of the risks they pose to patients. This paper explores cybersecurity threats for smart ICU networks and offers a risk assessment of the potential worst-case impacts these threats could have on the network.
... Each medical device has the capability to export data and critically ill patients generate data from stationary or mobile bedside devices (monitors, ventilators, infusion pumps, and vital organ support systems), image diagnostics, biological samples, and responses to environmental changes that linked the patient to hospital servers. 96,97 Therefore, data from any medical device must have agnostic connectivity with any information system. A platform to support AI systems should enable centralized and interoperable connectivity of biomedical data generated by the patient at any point along the care pathway, not only in critical care facilities, but from home before hospital admission to home after hospital discharge. ...
Article
Full-text available
Mechanical ventilation (MV) has played a crucial role in the medical field, particularly in anesthesia and in critical care medicine (CCM) settings. MV has evolved significantly since its inception over 70 years ago and the future promises even more advanced technology. In the past, ventilation was provided manually, intermittently, and it was primarily used for resuscitation or as a last resort for patients with severe respiratory or cardiovascular failure. The earliest MV machines for prolonged ventilatory support and oxygenation were large and cumbersome. They required a significant amount of skills and expertise to operate. These early devices had limited capabilities, battery, power, safety features, alarms, and therefore these often caused harm to patients. Moreover, the physiology of MV was modified when mechanical ventilators moved from negative pressure to positive pressure mechanisms. Monitoring systems were also very limited and therefore the risks related to MV support were difficult to quantify, predict and timely detect for individual patients who were necessarily young with few comorbidities. Technology and devices designed to use tracheostomies versus endotracheal intubation evolved in the last century too and these are currently much more reliable. In the present, positive pressure MV is more sophisticated and widely used for extensive period of time. Modern ventilators use mostly positive pressure systems and are much smaller, more portable than their predecessors, and they are much easier to operate. They can also be programmed to provide different levels of support based on evolving physiological concepts allowing lung-protective ventilation. Monitoring systems are more sophisticated and knowledge related to the physiology of MV is improved. Patients are also more complex and elderly compared to the past. MV experts are informed about risks related to prolonged or aggressive ventilation modalities and settings. One of the most significant advances in MV has been protective lung ventilation, diaphragm protective ventilation including noninvasive ventilation (NIV). Health care professionals are familiar with the use of MV and in many countries, respiratory therapists have been trained for the exclusive purpose of providing safe and professional respiratory support to critically ill patients. Analgo-sedation drugs and techniques are improved, and more sedative drugs are available and this has an impact on recovery, weaning, and overall patients’ outcome. Looking toward the future, MV is likely to continue to evolve and improve alongside monitoring techniques and sedatives. There is increasing precision in monitoring global “patient-ventilator” interactions: structure and analysis (asynchrony, desynchrony, etc). One area of development is the use of artificial intelligence (AI) in ventilator technology. AI can be used to monitor patients in real-time, and it can predict when a patient is likely to experience respiratory distress. This allows medical professionals to intervene before a crisis occurs, improving patient outcomes and reducing the need for emergency intervention. This specific area of development is intended as “personalized ventilation.” It involves tailoring the ventilator settings to the individual patient, based on their physiology and the specific condition they are being treated for. This approach has the potential to improve patient outcomes by optimizing ventilation and reducing the risk of harm. In conclusion, MV has come a long way since its inception, and it continues to play a critical role in anesthesia and in CCM settings. Advances in technology have made MV safer, more effective, affordable, and more widely available. As technology continues to improve, more advanced and personalized MV will become available, leading to better patients’ outcomes and quality of life for those in need.
... Thus, for example, we had to shift to new infusion pumps (2007), physiological monitors (2010), mechanical ventilators (ongoing), and beds (2008)(2009)(2010)(2011)(2012)(2013)(2014)(2015)(2016)(2017)(2018). Concomitantly, we purchased third-party middleware to add enterprise-wide functionalities not included within individual primary devices (Anderson et al., 2018). These new applications include remote monitoring, alarm management and device and staff association, data and personnel management, and interoperability with hospital bed management systems and electronic medical records. ...
Article
In a complex medical center environment, the occupants of newly built or renovated spaces expect everything to “function almost perfectly” immediately upon occupancy and for years to come. However, the reality is usually quite different. The need to remediate initial design deficiencies or problems not noted with simulated workflows may occur. In our intensive care unit (ICU), we were very committed to both short-term and long-term enhancements to improve the built and technological environments in order to correct design flaws and modernize the space to extend its operational life way beyond a decade. In this case study, we present all the improvements and their background in our 20-bed, adult medical–surgical ICU. This ICU was the recipient of the Society of Critical Care Medicine’s 2009 ICU Design Award Citation. Our discussion addresses redesign and repurposing of ICU and support spaces to accommodate expanding clinical or entirely new programs, new regulations and mandates; upgrading of new technologies and informatics platforms; introducing new design initiatives; and addressing wear and tear and gaps in security and disaster management. These initiatives were all implemented while our ICU remained fully operational. Proposals that could not be implemented are also discussed. We believe this case study describing our experiences and real-life approaches to analyzing and solving challenges in a dynamic environment may offer great value to architects, designers, critical care providers, and hospital administrators whether they are involved in initial ICU design or participate in long-term ICU redesign or modernization.
Chapter
Healthcare digitization has significantly enhanced patient care and alleviated the workload of hospital staff. This trend towards automation has also optimized the intensive care units (ICUs) of hospitals, leading to the emergence of smart ICUs equipped with modern wireless communication networks like 5G. However, this increased digitization presents new attack vectors and opportunities, especially regarding cybersecurity attacks. These attacks could compromise the resilience of smart ICU networks. Given the critical role of ICUs in healthcare, it is imperative to analyze and categorize digital threats in terms of the risks they pose to patients. This paper explores cybersecurity threats for smart ICU networks and offers a risk assessment of the potential worst-case impacts these threats could have on the network.
Article
The role of informatics in public health has increased over the past few decades, and the coronavirus disease 2019 (COVID-19) pandemic has underscored the critical importance of aggregated, multicenter, high-quality, near-real-time data to inform decision-making by physicians, hospital systems, and governments. Given the impact of the pandemic on perioperative and critical care services (eg, elective procedure delays; information sharing related to interventions in critically ill patients; regional bed-management under crisis conditions), anesthesiologists must recognize and advocate for improved informatic frameworks in their local environments. Most anesthesiologists receive little formal training in public health informatics (PHI) during clinical residency or through continuing medical education. The COVID-19 pandemic demonstrated that this knowledge gap represents a missed opportunity for our specialty to participate in informatics-related, public health-oriented clinical care and policy decision-making. This article briefly outlines the background of PHI, its relevance to perioperative care, and conceives intersections with PHI that could evolve over the next quarter century.
Article
Intensive care unit (ICU) design has changed since the mid-1980s. Targeting timing and incorporation of the dynamic and evolutionary processes inherent in ICU design is not possible nationally. ICU design will continue evolving to incorporate new concepts of best design evidence and practice, better understandings of the needs of patients, visitors and staff, unremitting advances in diagnostic and therapeutic approaches, ICU technologies and informatics, and the ongoing search to best fit ICUs within greater hospital complexes. As the ideal ICU remains a moving target; the design process should include the ability for an ICU to evolve into the future.
Article
Full-text available
Prediction of major adverse kidney events in critically ill patients may help target therapy, allow risk adjustment, and facilitate the conduct of clinical trials. In a cohort comprised of all critically ill adults admitted to five intensive care units at a single tertiary care center over one year, we developed a logistic regression model for the outcome of Major Adverse Kidney Events within 30 days (MAKE30), the composite of persistent renal dysfunction, new renal replacement therapy (RRT), and in-hospital mortality. Proposed risk factors for the MAKE30 outcome were selected a priori and included age, race, gender, University Health System Consortium (UHC) expected mortality, baseline creatinine, volume of isotonic crystalloid fluid received in the prior 24 h, admission service, intensive care unit (ICU), source of admission, mechanical ventilation or receipt of vasopressors within 24 h of ICU admission, renal replacement therapy prior to ICU admission, acute kidney injury, chronic kidney disease as defined by baseline creatinine value, and renal failure as defined by the Elixhauser index. Among 10,983 patients in the study population, 1489 patients (13.6%) met the MAKE30 endpoint. The strongest independent predictors of MAKE30 were UHC expected mortality (OR 2.32 [95%CI 2.06–2.61]) and presence of acute kidney injury at ICU admission (OR 4.98 [95%CI 4.12–6.03]). The model had strong predictive properties including excellent discrimination with a bootstrap-corrected area-under-the-curve (AUC) of 0.903, and high precision of calibration with a mean absolute error prediction of 1.7%. The MAKE30 composite outcome can be reliably predicted from factors present within 24 h of ICU admission using data derived from the electronic health record.
Article
Full-text available
Background: Electronic health (eHealth) interventions may improve the quality of care by providing timely, accessible information about one patient or an entire population. Electronic patient care information forms the nucleus of computerized health information systems. However, interoperability among systems depends on the adoption of information standards. Additionally, investing in technology systems requires cost-effectiveness studies to ensure the sustainability of processes for stakeholders. Objective: The objective of this study was to assess cost-effectiveness of the use of electronically available inpatient data systems, health information exchange, or standards to support interoperability among systems. Methods: An overview of systematic reviews was conducted, assessing the MEDLINE, Cochrane Library, LILACS, and IEEE Library databases to identify relevant studies published through February 2016. The search was supplemented by citations from the selected papers. The primary outcome sought the cost-effectiveness, and the secondary outcome was the impact on quality of care. Independent reviewers selected studies, and disagreement was resolved by consensus. The quality of the included studies was evaluated using a measurement tool to assess systematic reviews (AMSTAR). Results: The primary search identified 286 papers, and two papers were manually included. A total of 211 were systematic reviews. From the 20 studies that were selected after screening the title and abstract, 14 were deemed ineligible, and six met the inclusion criteria. The interventions did not show a measurable effect on cost-effectiveness. Despite the limited number of studies, the heterogeneity of electronic systems reported, and the types of intervention in hospital routines, it was possible to identify some preliminary benefits in quality of care. Hospital information systems, along with information sharing, had the potential to improve clinical practice by reducing staff errors or incidents, improving automated harm detection, monitoring infections more effectively, and enhancing the continuity of care during physician handoffs. Conclusions: This review identified some benefits in the quality of care but did not provide evidence that the implementation of eHealth interventions had a measurable impact on cost-effectiveness in hospital settings. However, further evidence is needed to infer the impact of standards adoption or interoperability in cost benefits of health care; this in turn requires further research.
Article
Full-text available
Abstract Background Blood glucose control in the intensive care unit (ICU) has the potential to save lives. However, maintaining blood glucose concentrations within a chosen target range is difficult in clinical practice and holds risk of potentially harmful hypoglycemia. Clinically validated computer algorithms to guide insulin dosing by nurses have been advocated for better and safer blood glucose control. Methods We conducted an international, multicenter, randomized controlled trial involving 1550 adult, medical and surgical critically ill patients, requiring blood glucose control. Patients were randomly assigned to algorithm-guided blood glucose control (LOGIC-C, n = 777) or blood glucose control by trained nurses (Nurse-C, n = 773) during ICU stay, according to the local target range (80–110 mg/dL or 90–145 mg/dL). The primary outcome measure was the quality of blood glucose control, assessed by the glycemic penalty index (GPI), a measure that penalizes hypoglycemic and hyperglycemic deviations from the chosen target range. Incidence of severe hypoglycemia (
Article
Full-text available
Background Studies on nurse competence on alarm management are a few and tend to be focused on limited skills. In response to Phase II of implementing the National Patient Safety Goal on clinical alarm systems safety, this study assessed nurses’ perceived competence on physiologic monitors use in intensive care units (ICUs) and developed and validated a tool for this purpose. Methods This descriptive study took place in a Magnet hospital in a Southwestern state of the U.S. A Nurse Competence on Philips Physiologic Monitors Use Survey was created and went through validation by 13 expert ICU nurses. The survey included 5 subscales with 59 rated items and two open-ended questions. Items on the first 4 subscales reflect most common tasks nurses perform using physiologic monitors. Items on the fifth subscale (advanced functions) reflect rarely used skills and were included to understand the scope of utilizing advanced physiologic monitors’ features. Thirty nurses from 4 adult ICUs were invited to respond to the survey. Results Thirty nurses (100%) responded to the survey. The majority of nurses were from Neuro (47%) and Surgical Trauma (37%) ICUs. The data supported the high reliability and construct validity of the survey. At least one (3%) to 8 nurses (27%) reported lack of confidence on each item on the survey. On the first four subscales, 3% - 40% of the nurses reported they had never heard of or used 27 features/functions on the monitors. No relationships were found between subscales’ scores and demographic characteristics (p > .05). Nurses asked for training on navigating the central-station monitor and troubleshooting alarms, and the use of unit-specific super users to tailor training to users’ needs. Conclusion This is the first study to create and test a list of competencies for physiologic monitors use. Rigorous, periodic and individualized training is essential for safe and appropriate use of physiologic monitors and to decrease alarm fatigue. Training should be comprehensive to include all necessary skills and should not assume proficiency on basic skills. Special attention should be focused on managing technical alarms. Increasing the number of super users is a recommended strategy for individualized and unit-specific training. There is a need for a usability testing of complex IT-equipped medical devices, such as physiologic monitors, for effective, efficient and safe navigation of the monitors.
Article
Full-text available
Blood pressure management is a central concern in critical care patients. For a variety of reasons, titration of vasopressor infusions may be an ideal use-case for computer assistance. Using our previous experience gained in the bench-to-bedside development of a computer-assisted fluid management system, we have developed a novel controller for this purpose. The aim of this preliminary study was to assess the feasibility of using this controller in simulated patients to maintain a target blood pressure in both stable and variable blood-pressure scenarios. We tested the controller in two sets of simulation scenarios: one with stable underlying blood pressure and a second with variable underlying blood pressure. In addition, in the variable phase of the study, we tested infusion-line delays of 8–60 s. The primary outcome for both testing conditions (stable and variable) was % case time in target range. We determined a priori that acceptable performance on the first phase of the protocol would require greater than 95% case-time in-target given the simple nature of the protocol, and for the second phase of the study 80% or greater given the erratic nature of the blood pressure changes taking place. 250 distinct cases for each simulation condition, both managed and unmanaged, were run over 4 days. In the stable hemodynamic conditions, the unmanaged group had an MAP of 57.5 ± 4.6 mmHg and spent only 5.6% of case time in-target. The managed group had an MAP of 70.3 ± 2.6 and spent a total of 99.5% of case time in-target (p < 0.00001 for both comparisons between groups). In the variable hemodynamic conditions, the unmanaged group had an MAP of 53.1 ± 5.0 mmHg and spent 0% of case time in-target. The managed group had an MAP of 70.5 ± 3.2 mmHg (p < 0.00001 compared to unmanaged group) and spent 88.6% of case time in-target (p < 0.00001 compared to unmanaged group), with 6.4% of case time over and 5.1% of case time under target. Increasing infusion lag increased coefficient of variation by about 10% per 15 s of lag (p = 0.001). This study demonstrated that this novel controller for vasopressor administration is able to main a target mean arterial pressure in a simulated physiologic model in the face of random disturbances and infusion-line lag.
Article
Full-text available
Background: The adoption of healthcare technology is arduous, and it requires planning and implementation time. Healthcare organizations are vulnerable to modern trends and threats because it has not kept up with threats. Objective: The objective of this systematic review is to identify cybersecurity trends, including ransomware, and identify possible solutions by querying academic literature. Methods: The reviewers conducted three separate searches through the CINAHL and PubMed (MEDLINE) and the Nursing and Allied Health Source via ProQuest databases. Using key words with Boolean operators, database filters, and hand screening, we identified 31 articles that met the objective of the review. Results: The analysis of 31 articles showed the healthcare industry lags behind in security. Like other industries, healthcare should clearly define cybersecurity duties, establish clear procedures for upgrading software and handling a data breach, use VLANs and deauthentication and cloud-based computing, and to train their users not to open suspicious code. Conclusions: The healthcare industry is a prime target for medical information theft as it lags behind other leading industries in securing vital data. It is imperative that time and funding is invested in maintaining and ensuring the protection of healthcare technology and the confidentially of patient information from unauthorized access.
Article
Full-text available
Medical device and health information technology systems are increasingly interdependent with users demanding increased interoperability. Related safety standards must be developed taking into account these systems' perspective. In this article, we describe the current development of medical device standards and the need for these standards to address medical device informatics. Medical device information should be gathered from a broad range of clinical scenarios to lay the foundation for safe medical device interoperability. Five clinical examples show how medical device informatics principles, if applied in the development of medical device standards, could help facilitate the development of safe interoperable medical device systems. These examples illustrate the clinical implications of the failure to capture important signals and device attributes. We provide recommendations relating to the coordination between historically separate standards development groups, some of which focus on safety and effectiveness and others focus on health informatics. We identify the need for a shared understanding among stakeholders and describe organizational structures to promote cooperation such that device-to-device interactions and related safety information are considered during standards development.
Article
Full-text available
Background: Clinical alarm systems safety is a national concern, specifically in intensive care units (ICUs) where alarm rates are known to be the highest. Interventional projects that examined the effect of changing default alarm settings on overall alarm rate and on clinicians' attitudes and practices toward clinical alarms and alarm fatigue are scarce. Objective: To examine if (1) a change in default alarm settings of the cardiac monitors and (2) in-service nursing education on cardiac monitor use in an ICU would result in reducing alarm rate and in improving nurses' attitudes and practices toward clinical alarms. Methods: This quality improvement project took place in a 20-bed transplant/cardiac ICU with a total of 39 nurses. We implemented a unit-wide change of default alarm settings involving 17 parameters of the cardiac monitors. All nurses received an in-service education on monitor use. Alarm data were collected from the audit log of the cardiac monitors 10 weeks before and 10 weeks after the change in monitors' parameters. Nurses' attitudes and practices toward clinical alarms were measured using the Healthcare Technology Foundation National Clinical Alarms Survey, pre- and postintervention. Results: Alarm rate was 87.86 alarms/patient day (a total of 64,500 alarms) at the preintervention period compared to 59.18 alarms/patient day (49,319 alarms) postintervention (P=.01). At baseline, Arterial Blood Pressure (ABP), Pair Premature Ventricular Contractions (PVCs), and Peripheral Capillary Oxygen Saturation (SpO2) alarms were the highest. ABP and SpO2 alarms remained among the top three at the postproject period. Out of the 39 ICU nurses, 24 (62%) provided complete pre- and postproject survey questionnaires. Compared to the preintervention survey, no remarkable changes in the postproject period were reported in nurses' attitudes. Themes in the narrative data were related to poor usability of cardiac monitors and the frequent alarms. The data showed great variation among nurses in terms of changing alarm parameters and frequency of replacing patients' electrodes. Despite the in-service, 50% (12/24) of the nurses specified their need for more training on cardiac monitors in the postproject period. Conclusions: Changing default alarm settings and standard in-service education on cardiac monitor use are insufficient to improve alarm systems safety. Alarm management in ICUs is very complex, involving alarm management practices by clinicians, availability of unit policies and procedures, unit layout, complexity and usability of monitoring devices, and adequacy of training on system use. The complexity of the newer monitoring systems requires urgent usability testing and multidimensional interventions to improve alarm systems safety and to attain the Joint Commission National Patient Safety Goal on alarm systems safety in critical care units.
Article
Full-text available
Patients in an intensive care unit (ICU) may risk disruption of their circadian rhythm. In an intervention research project a cycled lighting system was set up in an ICU room to support patients' circadian rhythm. Part I aimed to compare experiences of the lighting environment in two rooms with different lighting environments by lighting experiences questionnaire. The results indicated differences in advantage for the patients in the intervention room (n=48), in perception of daytime brightness (p=0.004). In nighttime, greater lighting variation (p=0.005) was found in the ordinary room (n=52). Part II aimed to describe experiences of lighting in the room equipped with the cycled lighting environment. Patients (n=19) were interviewed and the results were presented in categories: "A dynamic lighting environment", "Impact of lighting on patients' sleep", "The impact of lighting/lights on circadian rhythm" and "The lighting calms". Most had experiences from sleep disorders and half had nightmares/sights and circadian rhythm disruption. Nearly all were pleased with the cycled lighting environment, which together with daylight supported their circadian rhythm. In night's actual lighting levels helped patients and staff to connect which engendered feelings of calm. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.
Article
Full-text available
Closed-loop (CL) systems modulate insulin delivery according to glucose levels without nurse input. In a prospective randomized controlled trial, we evaluated the feasibility of an automated closed-loop approach based on subcutaneous glucose measurements in comparison to a local sliding scale insulin therapy protocol. 24 critically ill adults (predominantly trauma and neuroscience patients) with hyperglycaemia (glucose [greater than or equal to] 10 mmol/l) or already receiving insulin therapy were randomized to receive either fully automated closed-loop therapy (model predictive control algorithm directing insulin and 20% dextrose infusion based on FreeStyle Navigator continuous subcutaneous glucose values, N = 12) or a local protocol (N = 12) with intravenous sliding scale insulin, over 48 hours. The primary endpoint was percentage time when arterial blood glucose was between 6.0 and 8.0 mmol/l. Time when glucose was in target was significantly increased during closed-loop therapy (54.3% [44.1-72.8] vs. 18.5% [0.1-39.9], P=0.001; median [interquartile range]) and so was time in wider targets 5.6-10.0 mmol/l and 4.0-10.0 mmol/l (P[less than or equal to]0.002) reflecting a reduced glucose exposure above 8 and 10 mmol/l (P[less than or equal to]0.002). Mean glucose was significantly lower during CL (7.8 [7.4-8.2] vs. 9.1 [8.3-13.0] mmol/l, P=0.001) without hypoglycaemia (<4 mmol/l) during either therapy. Fully automated closed loop control based on subcutaneous glucose measurements is feasible and may provide efficacious and hypoglycaemia-free glucose control in critically ill adults. Trial Registration: ClinicalTrials.gov Identifier - NCT01440842.
Article
Full-text available
Real-time locating systems (RTLS, also known as real-time location systems) have become an important component of many existing ubiquitous location aware systems. While GPS (global positioning system) has been quite successful as an outdoor real-time locating solution, it fails to repeat this success indoors. A number of RTLS technologies have been used to solve indoor tracking problems. The ability to accurately track the location of assets and individuals indoors has many applications in healthcare. This paper provides a condensed primer of RTLS in healthcare, briefly covering the many options and technologies that are involved, as well as the various possible applications of RTLS in healthcare facilities and their potential benefits, including capital expenditure reduction and workflow and patient throughput improvements. The key to a successful RTLS deployment lies in picking the right RTLS option(s) and solution(s) for the application(s) or problem(s) at hand. Where this application-technology match has not been carefully thought of, any technology will be doomed to failure or to achieving less than optimal results.
Article
Full-text available
Inadequate hand hygiene (HH) by healthcare staff results in increased rates of hospital acquired infections in healthcare institutions, considerable waste of resources, and negative economic impact for the healthcare system. Toronto Rehabilitation Institute has developed an automated HH monitoring system that detects HH opportunities, generates HH reminding signals when it is necessary and enables hospital management to monitor individual and aggregated HH performance on ongoing basis. To demonstrate that HH improvement is feasible with the proposed technical solution and that technology is acceptable by potential users. The technology was installed in four rooms on a nursing unit of a larger complex continuous care hospital. The rooms were selected to make it possible to automatically follow the same nurses for the duration of their entire shift. Eleven nurses were provided with the wearable electronic HH monitors as well as with the instrumented personal wearable alcohol gel dispensers. Stationary gel dispensers installed in the unit were also instrumented with technology. Over 145 h of testing the system automatically recorded a total of 1438 events of entering and leaving monitored rooms and indicated an average of 6.42 HH actions per hour. The baseline observational study indicated 4.2 HH actions per hour. Approximately half of the HH actions recorded by the system were performed using personal wearable alcohol gel dispensers. The results obtained when testing the embedded HH monitoring system demonstrated the feasibility of HH improvement and proved that proposed solution merits a larger and longer clinical trial to measure the degree of improvement and the sustainability of that improvement.
Article
Full-text available
Computerized ICUs rely on software services to convey the medical condition of their patients as well as assisting the staff in taking treatment decisions. Such services are useful for following clinical guidelines quickly and accurately. However, the development of services is often time-consuming and error-prone. Consequently, many care-related activities are still conducted based on manually constructed guidelines. These are often ambiguous, which leads to unnecessary variations in treatments and costs.The goal of this paper is to present a semi-automatic verification and translation framework capable of turning manually constructed diagrams into ready-to-use programs. This framework combines the strengths of the manual and service-oriented approaches while decreasing their disadvantages. The aim is to close the gap in communication between the IT and the medical domain. This leads to a less time-consuming and error-prone development phase and a shorter clinical evaluation phase. A framework is proposed that semi-automatically translates a clinical guideline, expressed as an XML-based flow chart, into a Drools Rule Flow by employing semantic technologies such as ontologies and SWRL. An overview of the architecture is given and all the technology choices are thoroughly motivated. Finally, it is shown how this framework can be integrated into a service-oriented architecture (SOA). The applicability of the Drools Rule language to express clinical guidelines is evaluated by translating an example guideline, namely the sedation protocol used for the anaesthetization of patients, to a Drools Rule Flow and executing and deploying this Rule-based application as a part of a SOA. The results show that the performance of Drools is comparable to other technologies such as Web Services and increases with the number of decision nodes present in the Rule Flow. Most delays are introduced by loading the Rule Flows. The framework is an effective solution for computerizing clinical guidelines as it allows for quick development, evaluation and human-readable visualization of the Rules and has a good performance. By monitoring the parameters of the patient to automatically detect exceptional situations and problems and by notifying the medical staff of tasks that need to be performed, the computerized sedation guideline improves the execution of the guideline.
Article
Objectives: The aim of the study was to investigate the efficacy of intravenous (IV) smart pumps with drug libraries and dose error reduction system (DERS) to intercept programming errors entailing high risk for patients in an adult intensive care unit (ICU). Methods: A 2-year retrospective study was conducted in the adult ICU of the Hospital Juárez de México in Mexico City to evaluate the impact of IV smart pump/DERS (Hospira MedNet) technology implementation. We conducted a descriptive analysis of the reports generated by the system's software from April 2014 through May 2016. Our study focused on the upper hard limit alerts and used the systems' variance reports and IV Medication Harm Index methodology to determine the severity of the averted overdoses for medications with the highest number of edits. Results: The system monitored 124,229 infusion programs and averted on 36,942 deviations of the preset safe limits. Upper hard limit alerts accounted for 26.4% of pump reprogramming events. One hundred sixty-six significant administration errors were intercepted and prevented, and IV Medication Harm Index analysis identified 83 of them as highest-risk averted overdoses with insulin accounting for 51.8% of those. The rate of compliance with the safety software during the study period was 69.8%. Conclusions: Our study contributes additional evidence of the impact of IV smart pump/DERS technology. These pumps effectively intercepted severe infusion errors and significantly prevented adverse drug events related to dosing. Our results support the implementation of this technology in ICUs as a minimum safety standard and could help drive an IV infusion safety initiative in Mexico.
Article
Purpose: To determine the feasibility of continuous recording of sound and light in the intensive care unit (ICU). Materials and methods: Four 1-hour baseline scenarios in an empty ICU patient room by day and night (doors open or closed and maximal or minimal lighting) and two daytime scenarios simulating a stable and unstable patient (quiet or loud devices and staff) were conducted. Sound and light levels were continuously recorded using a commercially available multisensor monitor and transmitted via the hospital's network to a cloud-based data storage and management system. Results: The empty ICU room was loud with similar mean sound levels of 45 to 46 dBA for the day and night simulations. Mean levels for maximal lighting during day and night ranged from 1306 to 1812 lux and mean levels for minimum lighting were 1 to 3 lux. The mean sound levels for the stable and unstable patient simulations were 61 and 81 dBA, respectively. The mean light levels were 349 lux for the stable patient and 1947 lux for the unstable patient. Conclusions: Combined sound and light can be continuously and easily monitored in the ICU setting. Incorporating sound and light monitors in ICU rooms may promote an enhanced patient- and staff-centered healing environment.
Article
Outcomes: The time difference when SpO2/FiO2 <250 and RscVent initiation was 4.7 ± 0.6 hr and 0.2 ± 0.1 hr, SOC and SOS, respectively (p<0.001). Oxygen responsiveness after RscVent, defined as: SpO2/FiO2 > 250 occurred in 4/7, SOS and 0/7, SOC. At 48 hr the SpO2/FiO2 ratio was 104 ± 5 SOC versus 228 ± 59 SOS, p = 0.036. Ventilatory compliance and peak airway pressures were significantly improved with SOS vs SOC (p < 0.001). Data suggests that SOS software e.g., SpO2/CLC-FiO2 ratio after experimental ARDS can provide a novel continuous index of pulmonary function that is apparent before other clinical symptoms. Earlier initiation of RscVent translates into improved oxygenation (reduces ARDS severity) and ventilation.
Article
Robotic telerounding is effective from the standpoint of patients’ satisfaction and patients’ care in teaching and community hospitals. However, the impact of robotic telerounding by the intensivist rounding remotely in the surgical intensive care unit (SICU), on patients’ outcome and on the education of medical students physician assistants and surgical residents, as well as on nurses’ satisfaction has not been studied. Prospective evaluation of robotic telerounding (RT) using a Likert Scale measuring tool to assess whether it can replace conventional rounding (CR) from the standpoint of patients’ care and outcome, nursing satisfaction, and educational effectiveness. RT did not have a negative impact on patients’ outcome during the study interval: mortality 5/42 (12 %) versus 6/37 (16 %), RT versus CR, respectively, p = 0.747. The intensivists rounding in the SICU were satisfied with their ability to deliver the same patients’ care remotely (Likert score 4.4 ± 0.2). The educational experience of medical students, physicia assistants, and surgical residents was not affected by RT (average Likert score 4.5 ± 0.2, 3.9 ± 0.4, and 4.4 ± 0.4 for surgical residents, medical students and PAs, respectively, p > 0.05). However, as shown by a Likert score of 3.5 ± 1.0, RT did not meet nurses’ expectations from several standpoints. Intensivists regard robotic telerounding as an effective alternative to conventional rounding from the standpoint of patients’ care and teaching. Medical students, physician assistants (PA’s), and surgical residents do not believe that RT compromises their education. Despite similar patients’ outcome, nurses have a less favorable opinion of RT; they believe that the physical presence of the intensivist is favorable at all times.
Article
This third and final installment of this series on innovative designs for the smart ICU addresses the steps involved in conceptualizing, actualizing, using, and maintaining the advanced ICU informatics infrastructure and systems. The smart ICU comprehensively and electronically integrates the patient in the ICU with all aspects of care, displays data in a variety of formats, converts data to actionable information, uses data proactively to enhance patient safety, and monitors the ICU environment to facilitate patient care and ICU management. The keys to success in this complex informatics design process include an understanding of advanced informatics concepts, sophisticated planning, installation of a robust infrastructure capable of both connectivity and interoperability, and implementation of middleware solutions that provide value. Although new technologies commonly appear compelling, they are also complicated and challenging to incorporate within existing or evolving hospital informatics systems. Therefore, careful analysis, deliberate testing, and a phased approach to the implementation of innovative technologies are necessary to achieve the multilevel solutions of the smart ICU.
Article
Designing a smart ICU is a time-consuming, complex, multiphased, political, and costly exercise. This process begins with two notions: First, all hospital parties agree that a new or renovated ICU is required, and second, the hospital has agreed to allocate space, personnel, and fiscal resources for the project. In this first of a three-part series on innovative designs for the smart ICU, we will explore the roles of the ICU design team in managing the design process. The team must be administratively empowered, knowledgeable, and forward thinking. The first charge of the design team is to develop a clear vision for the goals, look and feel, and functionality of the new ICU. This vision must be guided by the imperative to positively impact patients, staff, and visitors. The team must concentrate on innovative but practical ideas that are in compliance with building codes and design guidelines and address issues related to renovation vs new construction. Mock-ups, both physical and computer generated, and a simulation laboratory for advanced technologies should be used to test design assumptions and reveal problems well in advance of actual ICU construction and technology implementation. Technology platforms need to be standardized within the ICU and equipment purchases protected against early obsolescence. The ramifications and expectations of the new ICU must be thoughtfully considered and dealt with during the design process. Last, it is essential that the design group continue its involvement in the new ICU during construction, occupancy, and post occupancy.
Article
The changing economic environment in health care is pushing the health care construction industry to produce facilities which support improvements in patient care, patient experience, patient safety, staff satisfaction, and financial outcomes. The successful design, construction, and operation of a new or renovated intensive care unit (ICU) requires the participation of intensive care nurses to achieve success. A partnership between the architect and nurse, definition of the desired operational processes, and knowledge of evidence-based design are the foundations of good design. Hospital executives who support the participation of nurses in ICU facility projects will gain an efficient and safe intensive care facility.
Article
Including end users in evidence-based design is vital to outcomes. The physical environment impacts caregiver efficiencies, safety, satisfaction, and quality of patient outcomes. End users are more than members of the organization: patients should have representation as well. Patients bring value by offering insight from a different perspective. Timing is key; therefore, it is critical in obtaining desired outcomes, to include end users as early as possible, gaining the most insight into the design of the build. Consideration should also be given to best practice standards, regulatory compliance, progressive sciences, and technologies. Another vital factor is education of the end users on their role and expectations for participation in a design team. When end users are educated and understand the significance of input, the design team will be able to conceive a critical care unit that will meet needs for today and be able to adapt to needs for the future.
Article
Background: The management of critically ill hyperglycemic patients in the intensive care unit (ICU) has been fraught with recent controversy. Only one randomized trial has demonstrated a mortality benefit to intensive glycemic control, with all subsequent studies failing to confirm this benefit and revealing a markedly increased risk of severe hypoglycemia (SH) in intensively treated patients. In most of these trials, adherence to the protocols were neither tracked nor reported. Methods: A retrospective analysis of all patients admitted to an ICU who were treated with an insulin infusion directed by the GlucoCare™ IGC System, an FDA-cleared insulin-dosing calculator (Yale 100-140 mg/dL protocol). Mean blood glucose (BG) levels, time to target range and incidence of SH (<40 mg/dL) and moderate hypoglycemia (MH) (40-69 mg/dL) were determined, and potential causes of hypoglycemic episodes were assessed. Results: Mean post-target BG was approximately 123 mg/dL. Of >55,000 readings in 1,657 patients, overall incidence of SH was 0.01% of readings and 0.3% of patients. MH occurred in 1.1% of readings and 17.6% of patients. The top potential causes of MH were: (1) Protocol-directed recommendations including continuation of insulin with BG <100 mg/dL and decreases in the frequency of BG checks (63.7%), and (2) Staff non-adherence to protocol directives (15.3%). Conclusions: The results of the GlucoCare-directed Yale 100-140 mg/dL protocol experience revealed an extremely low incidence of SH and an incidence of MH of 1.1%. The incidence of SH in this study was lower than the control group of the NICE-SUGAR study and are supportive of the new Society of Critical Care guidelines to target BG levels of 100-150 mg/dL in critically ill patients. Further refinements to the original protocol and emphasis on staff adherence to protocol directives could potentially further reduce these very low hypoglycemia rates.
Article
Increasing noise in hospital environments, especially in intensive care units (ICUs) and operating rooms (ORs), has created a formidable challenge for both patients and hospital staff. A major contributing factor for the increasing noise levels in these environments is the number of false alarms generated by medical devices. This study focuses on discovering best practices for reducing the number of false clinical alarms in order to increase patient safety and provide a quiet environment for both work and healing. The researchers reviewed Pub Med, Web of Knowledge and Google Scholar sources to obtain original journal research and review articles published through January 2012. This review includes 27 critically important journal articles that address different aspects of medical device alarms management, including the audibility, identification, urgency mapping, and response time of nursing staff and different solutions to such problems. With current technology, the easiest and most direct method for reducing false alarms is to individualize alarm settings for each patient's condition. Promoting an institutional culture change that emphasizes the importance of individualization of alarms is therefore an important goal. Future research should also focus on the development of smart alarms.
Article
Technology always changes, yet change or evolution within the tele-ICU has been slow. In developing a modern telemedicine system to manage acute illness, there are several concepts the developer/administrator should consider to include "scalability," centralized/decentralized systems, open/closed architecture, inclusivity of the medical community, mobile technology, price set, and governmental regulation. The intent of this manuscript is to apply these concepts to current tele-ICU technology, explain the concepts in some depth, and finally, to speculate as to how the future tele-ICU might look.
Article
Objective: To describe remote presence robotic utilization and examine perceived physician impact upon care in the intensive care unit (ICU). Study design: Data were obtained from academic, university, community, and rural medical facilities in North America with remote presence robots used in ICUs. Objective utilization data were extracted from a continuous monitoring system. Physician data were obtained via an Internet-based survey. Results: As of 2010, 56 remote presence robots were deployed in 25 North American ICUs. Of 10,872 robot activations recorded, 10,065 were evaluated. Three distinct utilization patterns were discovered. Combining all programs revealed a pattern that closely reflects diurnal ICU activity. The physician survey revealed staff are senior (75% >40 years old, 60% with >16 years of clinical practice), trained in and dedicated to critical care. Programs are mature (70% >3 years old) and operate in a decentralized system, originating from cities with >50,000 population and provided to cities >50,000 (80%). Of the robots, 46.6% are in academic facilities. Most physicians (80%) provide on-site and remote ICU care, with 60% and 73% providing routine or scheduled rounds, respectively. All respondents (100%) believed patient care and patient/family satisfaction were improved. Sixty-six percent perceived the technology was a "blessing," while 100% intend to continue using the technology. Conclusions: Remote presence robotic technology is deployed in ICUs with various patterns of utilization that, in toto, simulate normal ICU work flow. There is a high rate of deployment in academic ICUs, suggesting the intensivists shortage also affects large facilities. Physicians using the technology are generally senior, experienced, and dedicated to critical care and highly support the technology.
Article
In the past two far-view displays, which showed vital signs, trends, alarms, infusion pump status, and therapy support indicators, were developed and assessed by critical care nurses (Görges et al. in Dimens Crit Care Nurs. 30(4):206-17, 2011). The aim of the current study is to assess the generalizability of these findings to physicians. The first aim is to test whether an integrated far-view display, designed to be readable from 3 to 5 m, enables critical care physicians to more rapidly and accurately (1) recognize a change in patient condition; (2) identify alarms; and (3) identify near-empty infusion pumps, than a traditional patient monitor and infusion pump. A second aim is to test if the new displays reduce the mental workload required for this decision making. Fifteen critical care fellow physicians (median age of 34 years, with 2-8 years of ICU experience) were asked to use the three displays to compare the data from two patients and decide which patient required their attention first. Each physician made 60 decisions: 20 with each of the two far-view displays and 20 decisions with a standard patient monitor next to an infusion pump. A 41 and 26 % improvement in decision accuracy was observed with the bar and clock far-view displays, respectively. Specifically, the identification of near empty infusion pumps, a task normally performed by nurses, and patients with a single alarm were better with the new displays. Using the bar display physicians made their decision 12 % faster than when using the control display, a median improvement of 2.1 s. No significant differences were observed in measured workload. Displays that present patient data in a redesigned format enables critical care clinicians to more rapidly identify changes in patient conditions and to more accurately decide which patient needs their attention. In a clinical setting, this could improve patient safety. In future work, an evaluation of the display using live patient data from an ICU should be performed.
Article
Published literature has successfully demonstrated the impact of intravenous (IV) infusion pump safety software on improving the quality of health care delivery. Much of this literature has focused solely on the ability of these devices to prevent potential medication errors, while overlooking the devices' additional valuable advantages. One non-reported benefit is the ability of IV infusion pump safety software to consistently administer doses of IV medication, which are based on evidence. This article describes the process undertaken to implement and evaluate the impact of IV infusion pump safety software on driving care toward evidence-based standards. An advisory group of expert users was convened for a 2-day session to develop consensus recommendations of best practices for IV infusion pump safety software. Using these recommendations, administrative data were collected from a community hospital to assess the endpoints identified by the advisory panel. Data analysis of rescue agents (ie, flumazenil, glucagon, and protamine sulfate) showed reductions in utilization in the post-implementation period of the safety software. The decreased requirement for blood transfusions in patients receiving heparin infusions suggests that heparin infusions were more safely administered in the post-implementation period. The decreased length of stay and mortality rate observed in patients with complex respiratory infections during the post-implementation period suggests that by correctly infusing antibiotics consistently, patient outcomes may be improved. Additionally, alert and edit data from the pumps demonstrated that the IV infusion pump safety software alerted to and influenced edits on many critical dose rate errors for benzodiazepines, heparin, and several antibiotics. Intravenous infusion pump safety software improves clinical outcomes through consistent application of evidence-based standards of dose rates for IV drugs.
Article
Intelligent medical displays have the potential to improve patient outcomes by integrating multiple physiologic signals, exhibiting high sensitivity and specificity, and reducing information overload for physicians. Research findings have suggested that information overload and distractions caused by patient care activities and alarms generated by multiple monitors in acute care situations, such as the operating room and the intensive care unit, may produce situations that negatively impact the outcomes of patients under anesthesia. This can be attributed to shortcomings of human-in-the-loop monitoring and the poor specificity of existing physiologic alarms. Modern artificial intelligence techniques (ie, intelligent software agents) are demonstrating the potential to meet the challenges of next-generation patient monitoring and alerting.
Article
To develop and validate an informatics infrastructure for syndrome surveillance, decision support, reporting, and modeling of critical illness. Using open-schema data feeds imported from electronic medical records (EMRs), we developed a near-real-time relational database (Multidisciplinary Epidemiology and Translational Research in Intensive Care Data Mart). Imported data domains included physiologic monitoring, medication orders, laboratory and radiologic investigations, and physician and nursing notes. Open database connectivity supported the use of Boolean combinations of data that allowed authorized users to develop syndrome surveillance, decision support, and reporting (data "sniffers") routines. Random samples of database entries in each category were validated against corresponding independent manual reviews. The Multidisciplinary Epidemiology and Translational Research in Intensive Care Data Mart accommodates, on average, 15,000 admissions to the intensive care unit (ICU) per year and 200,000 vital records per day. Agreement between database entries and manual EMR audits was high for sex, mortality, and use of mechanical ventilation (kappa, 1.0 for all) and for age and laboratory and monitored data (Bland-Altman mean difference +/- SD, 1(0) for all). Agreement was lower for interpreted or calculated variables, such as specific syndrome diagnoses (kappa, 0.5 for acute lung injury), duration of ICU stay (mean difference +/- SD, 0.43+/-0.2), or duration of mechanical ventilation (mean difference +/- SD, 0.2+/-0.9). Extraction of essential ICU data from a hospital EMR into an open, integrative database facilitates process control, reporting, syndrome surveillance, decision support, and outcome research in the ICU.
Article
Increased technological complexity of medical devices and systems coupled with increased workloads and reduced staffing, have created difficulties and discontinuities in the management of patient information. These issues have directly impacted and contributed to a rise in equipment-related errors, patient dissatisfaction, a potential for patient injury and resulting overall increased concern for patient safety. In response these concerns a variety of new devices, systems and applications have been developed to share information, provide cross checks along with verified delivery of critical information to the point of care. These applications include biomedical information systems, medication administration, sample collection, and electronic medical records. The deployment of these new integrated and networked devices, systems and applications are dependent on an accurate and consistent patient identification and association methodology which dynamically manages the relationship between patients, staff and equipment. Since the association information is common to many applications and utilizes a variety of technologies, (i.e. active and passive radio frequency identification (RFID), barcodes, etc.) an institutional approach is necessary to mange these processes in a consistent manor utilizing a common set of identification hardware. Implementation of a "Patient Centric Identification and Association Platform" represents a significant advance in the management of clinical patient information. The implementation of a Biomedical Device Information Network at Memorial Sloan-Kettering Cancer Center (MSKCC) integrates the identification and association of patients with devices and care providers and provides the methodologies to manage alarms, providing the ability to filter low priority or nuisance alarms. This implementation enables critical information to be distributed directly to care providers utilizing dedicated communications devices. Patient Centric Identification and Association is the enabling technology providing precise identification and association establishing an enhanced environment of care, increased patient safety, and a clear proactive response to the regulatory requirements of the Joint Commission (JCAHO) national patient safety initiatives.
Article
An overview of different methodologies used in various intelligent decision support systems (IDSSs) for mechanical ventilation is provided. The applications of the techniques are compared in view of today's intensive care unit (ICU) requirements. Information available in the literature is utilized to provide a methodological review of different systems. Comparisons are made of different systems developed for specific ventilation modes as well as those intended for use in wider applications. The inputs and the optimized parameters of different systems are discussed and rule-based systems are compared to model-based techniques. The knowledge-based systems used for closed-loop control of weaning from mechanical ventilation are also described. Finally, in view of increasing trend towards automation of mechanical ventilation, the potential utility of intelligent advisory systems for this purpose is discussed. IDSSs for mechanical ventilation can be quite helpful to clinicians in today's ICU settings. To be useful, such systems should be designed to be effective, safe, and easy to use at patient's bedside. In particular, these systems must be capable of noise removal, artifact detection and effective validation of data. Systems that can also be adapted for closed-loop control/weaning of patients at the discretion of the clinician, may have a higher potential for use in the future.
Article
Radio Frequency Identification (RFID) is an evolving technology that can utilize its capabilities within a healthcare environment to locate and track staff, equipment, and patients. RFID has the potential to significantly improve operations by actively monitoring asset flow through an organization and enabling this data to be analyzed for process improvement. It can also help to provide validation to existing process improvement initiatives set forth by an institution. Furthermore, RFID can be integrated into other operations including patient safety, clinical operations, billing, and theft prevention.
Article
Closed-loop algorithms and resuscitation systems are being developed to control IV infusion rate during early resuscitation of hypovolemia. Although several different physiologic variables have been suggested as an endpoint to guide fluid therapy, blood pressure remains the most used variable for the initial assessment of hemorrhagic shock and the treatment response to volume loading. Closed-loop algorithms use a controller function to alter infusion rate inversely to blood pressure. Studies in hemorrhaged conscious sheep suggest that: (1) a small reduction in target blood pressure can result in a significant reduction in volume requirement; (2) nonlinear algorithms may reduce the risk of increased internal bleeding during resuscitation; (3) algorithm control functions based on proportional-integral, fuzzy logic, or nonlinear decision tables were found to restore and maintain blood pressure equally well. Proportional-integral and fuzzy logic algorithms reduced mean fluid volume requirements compared with the nonlinear decision table; and (4) several algorithms have been constructed to the specific mechanism of injury and the volume expansion properties of different fluids. Closed-loop systems are undergoing translation from animal to patient studies. Future smart resuscitation systems will benefit from new noninvasive technologies for monitoring blood pressure and the development of computer controlled high flow intravenous pumps.
US Food and Drug Administration
  • Human Department Of Health
  • Services
Department of Health and Human Services, US Food and Drug Administration. Medical Device Data Systems. https://www.fda.gov/medicaldevices/ productsandmedicalprocedures/generalhospital devicesandsupplies/medicaldevicedatasystems/ default.htm. Accessed September 4, 2017.
Integrating the Healthcare Enterprise
  • Ihe International
International IHE. Integrating the Healthcare Enterprise. http://www.ihe.net/ Last accessed 9-5-2017.