Clinical Trial Details
— Status: Not yet recruiting
Administrative data
| NCT number |
NCT03960099 |
| Other study ID # |
AAAR0800 |
| Secondary ID |
|
| Status |
Not yet recruiting |
| Phase |
N/A
|
| First received |
|
| Last updated |
|
| Start date |
January 2022 |
| Est. completion date |
June 30, 2022 |
Study information
| Verified date |
December 2021 |
| Source |
Columbia University |
| Contact |
Jason Adelman, MD, MS |
| Phone |
646-317-4803 |
| Email |
jsa2163[@]cumc.columbia.edu |
| Is FDA regulated |
No |
| Health authority |
|
| Study type |
Interventional
|
Clinical Trial Summary
Newborns in the neonatal intensive care unit (NICU) are at high risk for wrong-patient
errors. Effective 2019, The Joint Commission requires that health systems adopt distinct
methods of newborn identification as part of its National Patient Safety Goals. Displaying
patient photographs in the electronic health record (EHR) is a promising strategy to improve
identification of children and adults, but is unlikely to be effective for identifying
newborns. This study assesses the use of Pictographs as a "photo equivalent" for improving
identification of newborns in the NICU.
This multi-site, two-arm, parallel group, cluster randomized controlled trial will test the
effectiveness of Pictographs for preventing wrong-patient order errors in the NICU.
Pictographs consist of three elements: 1) pictorial symbols of easy-to-remember objects
(e.g., rainbow, lion); 2) the infant's given name (when available); and 3) a color-coded
border indicating the infant's sex. The study will be conducted at three academic medical
centers that utilize Epic EHR. All parents or guardians will be asked to select a unique
Pictograph for each infant admitted to the NICU to be displayed on the isolette and in the
EHR for the duration of the infant's hospital stay. All clinicians with the authority to
place electronic orders in the study NICUs will be randomly assigned to either the
intervention arm (Pictographs displayed in the EHR) or the control arm (no Pictographs
displayed in the EHR). The main hypothesis is that clinicians assigned to view Pictographs in
the EHR will have a significantly lower rate of wrong-patient order errors in the NICU versus
clinicians assigned to no Pictographs.
The primary outcome is wrong-patient order sessions, defined as a series of orders placed for
a single patient by a single clinician that contains at least one wrong-patient order. The
Wrong-Patient Retract-and-Reorder (RAR) measure, a validated, reliable, and automated method
for identifying wrong-patient orders, will be used as the primary outcome measure. The
Wrong-Patient RAR measure identifies one or more orders placed for a patient that are
retracted within 10 minutes, and then reordered by the same clinician for a different patient
within the next 10 minutes. In the validation study conducted at a large academic medical
center, real-time telephone interviews with clinicians confirmed that 76.2% of RAR events
were correctly identified by the measure as wrong-patient orders.
Description:
BACKGROUND
Newborns in the neonatal intensive care unit (NICU) are at high risk for wrong-patient
errors. Effective 2019, The Joint Commission requires that health systems adopt distinct
methods of newborn identification to prevent this type of error as part of its National
Patient Safety Goals. Displaying patient photographs in the electronic health record (EHR) is
a promising strategy to improve identification of children and adults, but photographs are
not likely to be effective for identifying newborns. Therefore, this study assesses the use
of Pictographs as a "photo equivalent" for improving identification of newborns in the NICU.
METHODS
The primary hypothesis of this study is that clinicians randomly assigned to view Pictographs
in the EHR (intervention arm) will have a significantly lower rate of wrong-patient order
errors in the neonatal intensive care unit (NICU) compared to clinicians assigned to view no
Pictographs in the EHR (control arm). The secondary hypothesis is that the rate of
wrong-patient orders for siblings of multiple births in the NICU will be significantly lower
for clinicians randomized to the intervention versus control arm.
The study will pursue the following specific aims:
Aim 1: Test the effectiveness of displaying Pictographs in EHR systems for reducing
wrong-patient orders among infants in the NICU, using the Wrong-Patient Retract-and-Reorder
measure to identify the outcome.
Aim 2: Conduct subgroup analyses of the effectiveness of Pictographs for reducing the rates
of wrong-patient orders among siblings of multiple-birth infants in the NICU.
Design. This multi-site, two-arm, parallel-group, cluster randomized controlled trial will
test the effectiveness of Pictographs for preventing wrong-patient order errors in the NICUs
of three health systems. Pictographs consist of three elements: 1) pictorial symbols of
easy-to-remember objects (e.g., rainbow, lion); 2) the infant's given name (when available);
and 3) a color-coded border indicating the infant's sex. For each infant admitted to the
study NICUs, parents or guardians will be asked to select a unique Pictograph to be displayed
on the isolette and in the EHR for the duration of each infant's hospital stay. Clinicians
randomized to the intervention arm will see a Pictograph displayed in the banner and
verification alert in the EHR. Clinicians randomized to the control arm will not see
Pictographs in the EHR.
Study Sites. The study includes NICUs at the following participating study institutions
representing diverse patient populations: NewYork-Presbyterian Hospital, New York, NY;
Montefiore Medical Center, Bronx, NY; and Johns Hopkins Medicine, Baltimore, MD. All sites
will conduct the study in EpicCare (Epic Systems Corporation, Verona, WI).
Patient Inclusion Criteria. All infants admitted to the study NICUs will be eligible to be
included.
Clinician Inclusion Criteria. All clinicians who place electronic orders in the NICU at the
study sites during the study period will be included.
Randomization. The clinician is the unit of randomization. Each ordering clinician will be
randomly assigned to a study arm in a 1:1 random allocation scheme using a computer random
number generator program at all study sites. Then, clinicians will be assigned, as
randomized, to groupers built into Epic to apply configuration rules that dictate whether
Pictographs are displayed according to study arm.
Primary Outcome. The primary outcome is wrong-patient order sessions, defined as a series of
orders placed for a single patient by a single clinician that contains at least one
wrong-patient order. The Wrong-Patient Retract-and-Reorder (RAR) measure--a validated,
reliable, and automated method endorsed by the National Quality Forum (NQF #2723)--will be
used to identify wrong-patient orders. The Wrong-Patient RAR measure identifies RAR events,
defined as one or more orders placed for a patient that are retracted within 10 minutes, and
then reordered by the same clinician for a different patient within the next 10 minutes.
These are near-miss errors, caught by the clinician before they reach the patient. In the
validation study, real-time telephone interviews with clinicians demonstrated that 76.2% of
RAR events identified by the measure were confirmed to be wrong-patient orders. In a study
conducted at a large academic medical center, the RAR measure identified more than 5,000
wrong-patient orders in 1 year. Thus, the RAR measure provides robust outcome data to test
safety interventions.
Unit of Analysis. If a clinician begins placing orders in the wrong patient's record, several
such orders may be placed consecutively and then retracted together. Therefore, individual
orders do not represent independent opportunities for RAR events to occur, rather the order
session represents an independent opportunity for an RAR event to occur. Thus, the unit of
analysis is the order session, defined as a series of orders placed by a clinician for a
single patient that begins with opening that patient's order file and terminates when an
order is placed for another patient or after 60 minutes, whichever occurs first. The presence
of Pictographs will be tracked as an order-session level characteristic.
Higher Level Units of Analysis. Order sessions are nested within both patient admission and
clinician, and both patients and clinicians are nested within NICU. In the analysis, NICU
will be treated as a fixed covariate, and clinicians are treated as an important source of
variance and "cluster" unit of analysis because clinician is the unit of randomization.
Data Extraction and Management. Data will be extracted retrospectively for all orders (e.g.,
medications, laboratory tests, imaging studies, and other types) placed by randomized
clinicians for patients receiving care in the study NICUs during the study period. Data for
each order, including order, patient, and clinician characteristics, will be extracted from
the health system data warehouse at each study site at the end of the study period. All
patient and clinician identifiers will be replaced by pseudo-identifiers by research
personnel at study sites to create de-identified analytic data sets, and data will be
transferred electronically to the study biostatistician using a secure file transfer
protocol.
Missing Data. Due to the automatic functioning of the EHR, no missing data concerning orders,
RAR events, study group assignment, or provider-level covariates is expected. There may be
missing information regarding patient-level covariates. If any variables are missing for more
than 1 record per 1,000, analyses will be extended to address this. Data will be presumed to
be missing at random and multiple imputation with chained equations will be applied.
Statistical Analysis Plan. Because order sessions are nested within clinicians, Aim 1 will be
tested by estimating a multilevel mixed Poisson regression model predicting RAR event status
(yes, no) with Group (Pictograph, coded 1, vs no Pictograph, coded 0) as the primary
predictor and Multiple Status and NICU included as categorical covariates ("class" variables
in SAS); the intercept will be treated as a random effect, assumed to vary among clinicians
within each group. Because RAR events are rare (approximately 5 per 10,000 order sessions),
the mixed Poisson regression model and the mixed logistic regression model yield nearly
identical results with parameter estimates differing in the 3rd significant digit. The
hypothesis will be confirmed if the RR for Group is significantly different from 1.0
(expected to be <1.0), based on the Wald chi-square test of BGroup; i.e., ln(RR).
To test Aim 2, a variant of the same multilevel Poisson regression model will be estimated in
which the main effect of Group is replaced with the Multiple Status*Group interaction; this
specification will yield two coefficients for Group, one for Singletons (Multiple Status=0)
and one for Multiples (Multiple Status=1). The Wald chi-square test will be used to evaluate
the statistical significance of each coefficient, i.e., the effect of Pictographs on RAR risk
for singletons and for multiples. The SAS GLIMMIX procedure will be used to perform these
analyses, and a 2-tailed, alpha=0.05 criterion will be used to evaluate statistical
significance.
Secondary analyses will examine whether the effect of the Pictograph intervention varies
across hospitals, by EHR vendor, by clinician type and other clinician characteristics, by
patient characteristics, and/or by order session characteristics.
Statistical Power/Sample Size. The power was calculated using the O'Brien and Muller
approach, an exemplary data set constructed by assumed population parameters to detect the
hypothesized effect. It is estimated approximately 17,000 patients, infants admitted to the
NICU at each site will be recruited, and verbal consent will be obtained from parents or
legal guardians. The number of clinicians is a fixed attribute of the study sites and is not
subject to investigator control. Based on preliminary data, it is assumed that data will be
obtained on 6,250 clinicians, with half randomized to each study arm. With respect to Aim 1,
if the effect sizes are reductions of 30% for singletons and 50% for multiples, as
hypothesized, the study will have 98% power to detect a significant benefit of Pictographs on
RAR event rate. By changing the weights described above to 0.75 and 0.25 for both singletons
and multiples, it is estimated that the study will have 81% power to detect an overall
reduction, across singletons and multiples, of 25% in RAR event rate. Using the mean standard
error, the calculated power for Aim 2 of the proposed study: for singletons, the power to
detect the hypothesized 30% reduction in RAR rate is 89%; for multiples, the power to detect
a 50% reduction is 95%. Minimum effect sizes detectable with 80% power are reductions of 27%
for singletons and 42% for multiples.
Interim Analysis. At the midpoint of the study, the Lan-Demets algorithm will be applied for
early termination with an O'Brien-Fleming boundary function to preserve overall Type I error
rate. At the interim review, the corresponding stopping points correspond to a z-statistic
for the primary hypothesis test of ±2.9626. To avoid bias in these judgments, the data sets
will contain interim results for the two arms but will not identify which arm is the
intervention. A test of futility will be conducted, by treating the expected result of 25%
reduction as a null hypothesis. If that hypothesis test is rejected at the 1-tailed 0.001
level, continuation will be considered futile and will conclude the study.
Recruitment/Enrollment. A nurse involved in patient care will inform parents or guardians of
infants admitted to the NICU about the study. The nurse will obtain verbal consent to display
the Pictograph on the infant's isolette and in the infant's medical record in the EHR for the
duration of the infant's hospital stay. Parents who provide verbal consent will select a
unique Pictograph for each infant using the Pictograph Application on an electronic tablet.
The Pictograph Application is a HIPAA-compliant, secure web-based application that enables
Pictograph selection, customization, printing, and uploading to the EHR. Parents with
multiple infants in the NICU will select a different Pictograph for each infant. Selected
Pictographs become unavailable such that no two infants will have the same Pictograph at the
same time in the NICU. The selected Pictograph will be printed and attached to the isolette,
and uploaded into the EHR using the same functionality used to upload and display patient
photographs. When the infant is discharged, the Pictograph will be removed from the isolette
and from the EHR; that image will remain unavailable for use for 2 weeks after the infant is
discharged.
