Clinical Trials Logo

Clinical Trial Summary

The escalation of care for patients in a hospitalized setting between nurse practitioner managed services, teaching services, step-down units, and intensive care units is critical for appropriate care for any patient. Often such "triggers" for escalation are initiated based on the nursing evaluation of the patient, followed by physician history and physical exam, then augmented based on laboratory values. These "triggers" can enhance the care of patients without increasing the workload of responder teams. One of the goals in hospital medicine is the earlier identification of patients that require an escalation of care. The study team developed a model through a retrospective analysis of the historical data from the Mount Sinai Data Warehouse (MSDW), which can provide machine learning based triggers for escalation of care (Approved by: IRB-18-00581). This model is called "Medical Early Warning Score ++" (MEWS ++). This IRB seeks to prospectively validate the developed model through a pragmatic clinical trial of using these alerts to trigger an evaluation for appropriateness of escalation of care on two general inpatients wards, one medical and one surgical. These alerts will not change the standard of care. They will simply suggest to the care team that the patient should be further evaluated without specifying a subsequent specific course of action. In other words, these alerts in themselves does not designate any change to the care provider's clinical standard of care. The study team estimates that this study would require the evaluation of ~ 18380 bed movements and approximately 30 months to complete, based on the rate of escalation of care and rate of bed movements in the selected units.


Clinical Trial Description

Objectives:

Mount Sinai Hospital has developed a Rapid Response Team (RRT) system designed to give general floor care providers additional support for patients who may be requiring a higher level of care. This system enables both nurses and physicians to notify the RRT and have a critical care team evaluate the patients. During the period of 03/01/2018 to 09/17/2018, Mount Sinai Hospital floor units on 10W and 10E units made 357 rapid response team (RRT) calls with only 58 leading to an actual increase in the level of care (true positive rate ~ 16%). Similarly, the Electronic Health Record (EHR) generated 839 sepsis Best Practice Alerts (BPAs) yet only five led to escalations in care (true positive rate ~ 0.5%). The results above would imply that over 168 evaluations need to be made to identify a single case where the patient required an escalation in care. The goal of ReSCUE-ME is to evaluate prospective model performance and identify the best spot which the study team can incorporate MEWS++ into RRT and Primary providers workflow. The primary endpoint is rate of escalation of care on 10W and 10E during the study period.

Background:

In a prior study, the group has demonstrated that a machine learning model (MEWS++) significantly outperformed a standard, manually calculated MEWS score on a large retrospective cohort of hospitalized patients. To develop this model, the study team used a data set (Approved by: IRB-18-00581) of 96,645 patients with 157,984 hospital encounters and 244,343 bed movements. The study team found that MEWS++ was superior to the standard MEWS model with a sensitivity of 81.6% vs. 44.6%, specificity of 75.5% vs. 64.5%, and area under the receiver operating curve of 0.85 vs. 0.71.

Encouraged by this prior result, the study team is seeking to evaluate the model in a prospective study.

A silent pilot of the ReSCUE-ME alerts has been running on 10E and 10W since Feb 2019. The study team has continuously monitoring the alert performance via a real-time web-based dashboard. The results are summarized below:

- Median # of alerts to primary team, per floor, per day: 8

- Median # of alerts to RRT, per floor, per day: 4

- Sensitivity 0.76, Specificity 0.68, AUC 0.77

- Accuracy 0.69, Precision 0.3, F1 Score 0.43 This performance compares very favorably to the performance seen in the retrospective historical cohort used to develop the MEWS++ model:

- Sensitivity 0.82, Specificity 0.76, AUC 0.85

- Accuracy 0.76, Precision 0.12, F1 Score 0.19" ;


Study Design


Related Conditions & MeSH terms


NCT number NCT04026555
Study type Interventional
Source Icahn School of Medicine at Mount Sinai
Contact
Status Completed
Phase N/A
Start date June 18, 2019
Completion date March 19, 2020

See also
  Status Clinical Trial Phase
Recruiting NCT06077851 - Continuous Monitoring of Vital Signs at Home (WARD HOME II)
Terminated NCT04724681 - Continuous Wireless Monitoring of Vital Signs and Automated Alerts of Patient Deterioration in Patients Admitted With COVID-19 Infection N/A
Recruiting NCT06238180 - Personalised Real-time Interoperable Sepsis Monitoring (PRISM)
Completed NCT04220359 - Early Identification of Clinical Deterioration Using a Wearable Monitoring Device
Completed NCT05575531 - Evaluation of the Modified Early Warning Scoring System N/A
Active, not recruiting NCT04359641 - Predictive Monitoring - IMPact in Acute Care Cardiology Trial N/A
Not yet recruiting NCT06099327 - Image-based Remote Monitoring in Cardiac Surgery Patients
Recruiting NCT05181111 - Continuous Monitoring of Patients in and After the Acute Admission Ward to Optimize Clinical Pathways N/A
Recruiting NCT05893420 - A Rapid Diagnostic of Risk in Hospitalized Patients Using Machine Learning N/A
Completed NCT05536206 - Continuous and Wireless Vital Sign Monitoring in Patients at Home After Acute Medical Admission
Completed NCT05223504 - WARD-Home - Continuous Monitoring of Vital Parameters After Discharge
Completed NCT04189653 - Clinical Outcomes After Implementation of COntinuous Vital Sign Monitoring On the General Ward.