Human Algorithm Interactions for Acute Respiratory Failure Diagnosis

Status Completed

Clinical Trial Summary

Artificial intelligence (AI) shows promising in identifying abnormalities in clinical images. However, systematically biased AI models, where a model makes inaccurate predictions for entire subpopulations, can lead to errors and potential harms. When shown incorrect predictions from an AI model, clinician diagnostic accuracy can be harmed. This study aims to study the effectiveness of providing clinicians with image-based AI model explanations when provided AI model predictions to help clinicians better understand the logic of an AI model's prediction. It will evaluate whether providing clinicians with AI model explanations can improve diagnostic accuracy and help clinicians catch when models are making incorrect decisions. As a test case, the study will focus on the diagnosis of acute respiratory failure because determining the underlying causes of acute respiratory failure is critically important for guiding treatment decisions but can be clinically challenging. To determine if providing AI explanations can improve clinician diagnostic accuracy and alleviate the potential impact of showing clinicians a systematically biased AI model, a randomized clinical vignette survey study will be conducted. During the survey, study participants will be shown clinical vignettes of patients hospitalized with acute respiratory failure, including the patient's presenting symptoms, physical exam, laboratory results, and chest X-ray. Study participants will then be asked to assess the likelihood that heart failure, pneumonia and/or Chronic Obstructive Pulmonary Disease (COPD) is the underlying diagnosis. During specific vignettes in the survey, participants will also be shown standard or systematically biased AI models that provide an estimate the likelihood that heart failure, pneumonia and/or COPD is the underlying diagnosis. Clinicians will be randomized see AI predictions alone or AI predictions with explanations when shown AI models. This survey design will allow for testing the hypothesis that systematically biased models would harm clinician diagnostic accuracy, but commonly used image-based explanations would help clinicians partially recover their performance.

Clinical Trial Description

n/a

Study Design

Related Conditions & MeSH terms

Clinical Trial Details

NCT number	NCT06098950
Study type	Interventional
Source	University of Michigan
Contact
Status	Completed
Phase	N/A
Start date	April 1, 2022
Completion date	January 31, 2023

View Details

See also
Status	Clinical Trial	Phase
Recruiting	`NCT05144633` - Blue Protocol and Eko Artificial Intelligence Are Best (BEA-BEST)
Completed	`NCT04534569` - Expert Panel Statement for the Respiratory Management of COVID-19 Related Acute Respiratory Failure (C-ARF)
Recruiting	`NCT03021902` - Nutrition and Exercise in Critical Illness	Phase 2
Completed	`NCT02902146` - Bougie Use in Emergency Airway Management	N/A
Completed	`NCT02901158` - Esophageal Manometry in Mechanically Ventilated Patients
Completed	`NCT02236559` - High Flow Therapy for the Treatment of Respiratory Failure in the ED	N/A
Recruiting	`NCT02056093` - Comparison of Proportional Assist Ventilation And Neurally Adjusted Ventilator Assist	N/A
Not yet recruiting	`NCT01668368` - Goal Directed Mechanical Ventilation Aimed at Optimal Lung Compliance	N/A
Terminated	`NCT01083277` - Variable Ventilation During Acute Respiratory Failure	N/A
Completed	`NCT01462279` - Effect of Thiamine on Oxygen Utilization (VO2) in Critical Illness	N/A
Completed	`NCT01114022` - Prevention Inhalation of Bacterial by Using Endotracheal Tube Balloon Polyvinyl Chloride or Polyurethane	N/A
Active, not recruiting	`NCT01058421` - Treatment of Critical Illness Polyneuromyopathy	Phase 2
Completed	`NCT00252616` - Timing of Target Enteral Feeding in the Mechanically Ventilated Patient	Phase 2/Phase 3
Recruiting	`NCT04098094` - Outcomes of RV Dysfunction in Acute Exacerbation of Chronic Respiratory Diseases
Recruiting	`NCT06051292` - Decremental Esophageal Catheter Filling Volume Titration For Transpulmonary Pressure Measurement	N/A
Completed	`NCT04601090` - Survival Rates and Longterm Outcomes After COVID-19
Recruiting	`NCT05423301` - Global Physiotherapy in ICU Patients With High Risk Extubation Failure	N/A
Completed	`NCT02447692` - Proportional Assist Ventilation for Minimizing the Duration of Mechanical Ventilation: The PROMIZING Study	N/A
Completed	`NCT04016480` - HFNC During Bronchoscopy for Bronchoalveolar Lavage	N/A
Completed	`NCT04507425` - High Flow Nasal Cannula With Noninvasive Ventilation	N/A

Clinical trials are conducted in a series of steps, called phases - each phase is designed to answer a separate research question.

Phase 1: Researchers test a new drug or treatment in a small group of people for the first time to evaluate its safety, determine a safe dosage range, and identify side effects.
Phase 2: The drug or treatment is given to a larger group of people to see if it is effective and to further evaluate its safety.
Phase 3: The drug or treatment is given to large groups of people to confirm its effectiveness, monitor side effects, compare it to commonly used treatments, and collect information that will allow the drug or treatment to be used safely.
Phase 4: Studies are done after the drug or treatment has been marketed to gather information on the drug's effect in various populations and any side effects associated with long-term use.