Clinical Trial Details
— Status: Completed
Administrative data
NCT number |
NCT06157944 |
Other study ID # |
71319 |
Secondary ID |
|
Status |
Completed |
Phase |
N/A
|
First received |
|
Last updated |
|
Start date |
November 29, 2023 |
Est. completion date |
December 30, 2023 |
Study information
Verified date |
February 2024 |
Source |
Stanford University |
Contact |
n/a |
Is FDA regulated |
No |
Health authority |
|
Study type |
Interventional
|
Clinical Trial Summary
This study will evaluate the effect of providing access to GPT-4, a large language model,
compared to traditional diagnostic decision support tools on performance on case-based
diagnostic reasoning tasks.
Description:
Artificial intelligence (AI) technologies, specifically advanced large language models like
OpenAI's ChatGPT, have the potential to improve medical decision-making. Although ChatGPT-4
was not developed for its use in medical-specific applications, it has demonstrated promise
in various healthcare contexts, including medical note-writing, addressing patient inquiries,
and facilitating medical consultation. However, little is known about how ChatGPT augments
the clinical reasoning abilities of clinicians.
Clinical reasoning is a complex process involving pattern recognition, knowledge application,
and probabilistic reasoning. Integrating AI tools like ChatGPT-4 into physician workflows
could potentially help reduce clinician workload and decrease the likelihood of missed
diagnoses. However, ChatGPT-4 was not developed for the purpose of clinical reasoning nor has
it been validated for this purpose. Further, it may be subject to disinformation, including
convincing confabulations that may mislead clinicians. If clinicians misuse this tool, it may
not improve diagnostic reasoning and could even cause harm. Therefore, it is important to
study how clinicians use large language models to augment clinical reasoning prior to routine
incorporation into patient care.
In this study, we will randomize participants to answer diagnostic cases with or without
access to ChatGPT-4. The participants will be asked to give three differential diagnoses for
each case, with supporting and opposing findings for each diagnosis. Additionally they will
be asked to provide their top diagnosis along with next diagnostic steps. Answers will be
graded by independent reviewers blinded to treatment assignment.