DHL Survey on Generative AI for MyChart Messaging

Communication Clinical Trial

Official title:

Duke Health Listens Survey on Generative Artificial Intelligence (AI) for MyChart Messaging

Clinical Trial Details — Status: Completed

Administrative data

• NCT number: NCT06108037
• Other study ID #: Pro00113587
• Status: Completed
• Phase: N/A
• Start date: October 31, 2023
• Est. completion date: December 11, 2023

Study information

• Verified date: October 2023
• Source: Duke University
• Contact: n/a
• Is FDA regulated: No
• Study type: Interventional

Clinical Trial Summary

The purpose of this study is to understand how patients feel about the use of computer programs to create responses when they send electronic messages to their doctors.

Description:

• The investigators will create short surveys online to ask patients how they feel about using computer programs that create messages in their medical records.

• The surveys will show fictional situations where patients ask questions and get answers from either real people or computer programs, with or without a disclosure about how the response was written.

• The investigators will ask the people taking the survey to share what they think about these situations using tools like rating scales, comparison scales, or written responses.

• If patients want to, they can provide their contact information to be part of future discussion groups. Participants do not have to give any personal information to complete the survey.

Recruitment information / eligibility

• Status: Completed
• Enrollment: 1454
• Est. completion date: December 11, 2023
• Est. primary completion date: December 11, 2023
• Accepts healthy volunteers: Accepts Healthy Volunteers
• Gender: All
• Age group: 18 Years and older

Eligibility

Inclusion Criteria:

• Member of the Duke Health Listens patient advocacy community

Exclusion Criteria:

• Age < 18

Related Conditions & MeSH terms

• Communication

Intervention

Behavioral:
• Generative AI for electronic communication and disclosure
We will use a large language model such as GPT 3.5 to automatically generate responses to fictional messages to a physician. We will disclose whether the message was generated using this technology or not. There are 3 clinical scenarios and 6 pairs of human/AI response and human disclosure/AI disclosure/not disclosed that will test patient attitudes toward this technology.

Locations

Country	Name	City	State
United States	Duke University Health System	Durham	North Carolina

Sponsors (1)

Lead Sponsor	Collaborator
Duke University

Country where clinical trial is conducted

United States, 

References & Publications (1)

Ayers JW, Poliak A, Dredze M, Leas EC, Zhu Z, Kelley JB, Faix DJ, Goodman AM, Longhurst CA, Hogarth M, Smith DM. Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media Forum. JAMA Intern Med. 2023 Jun 1;183(6):589-596. doi: 10.1001/jamainternmed.2023.1838. — View Citation

Outcome

Type	Measure	Description	Time frame	Safety issue
Primary	Patient satisfaction, as measured by survey	Likert-scale responses to satisfaction question: "I am satisfied with this interaction", on a scale from 1-5 with answer options of Strongly Disagree (1), Disagree (2), Neither agree nor disagree (3), Agree (4), and Strongly agree (5).	Up to 2 weeks
Primary	Patient attitudes towards utility, as measured by survey	Likert-scale responses to utility question: "The information is useful", on a scale from 1-5 with answer options of Strongly Disagree (1), Disagree (2), Neither agree nor disagree (3), Agree (4), and Strongly agree (5).	Up to 2 weeks
Primary	Patient empathy, as measured by survey	Likert-scale responses to empathy question: "I feel cared for during this interaction", on a scale from 1-5 with answer options of Strongly Disagree (1), Disagree (2), Neither agree nor disagree (3), Agree (4), and Strongly agree (5).	Up to 2 weeks