Utility of ChatGPT in Pre-vasectomy Counselling in an Office-based Setting

Contraception Clinical Trial

Official title:

Real World Utility of ChatGPT in Pre-vasectomy Counselling in an Office-based Setting

Clinical Trial Details — Status: Recruiting

Administrative data

• NCT number: NCT06009783
• Other study ID #: HS25978 (H2023:136)
• Status: Recruiting
• Phase: N/A
• Start date: August 30, 2023
• Est. completion date: October 5, 2023

Study information

• Verified date: August 2023
• Source: University of Manitoba
• Contact: Premal Patel, MD
• Phone: 204-221-4476
• Email: ppatel5[@]hsc.mb.ca
• Is FDA regulated: No
• Study type: Interventional

Clinical Trial Summary

The investigators wish to perform a pilot study at the Manitoba Men's Health Clinic to assess if pre-vasectomy counseling with ChatGPT can safely streamline the consultation process by reducing visit times, while increasing patient satisfaction with the consultation process.

Description:

The release of ChatGPT, a natural language AI chat bot, has recently captured the attention of the general public and medical professionals world-wide. ChatGPT is a conversational AI language model designed by OpenAI that utilizes deep learning techniques to generate human like responses to questions. There has been increasing interest among the medical community on developing new ways to harness this technology to aid medical professionals. New applications have included writing scientific manuscripts, drafting correspondents, as well as testing its ability on standardized medical licensing examinations. ChatGPT was able to perform at or near passing threshold on the United States Medical Licensing Exam (USMLE). Despite ChatGPT demonstrating good medical knowledge, it is still unclear if this translates to real world clinical practice.

Physician burnout is becoming an increasing problem. Per a recent Canadian Urologic Association (CUA) census, burnout was identified in 39% of urologists, with high number of patient visits/week to be cited as a predictor predictive of burnout. That begs the question, can ChatGPT be used for patient counseling and to improve patient flow in one's practice? ChatGPT has been shown to provide effective and safe responses to medical questions and even "curbside" consultations. However its ability to counsel patients in real time has not yet been studied.

As such, the investigators wish to perform a pilot study at the Manitoba Men's Health Clinic to assess if pre-vasectomy counseling with ChatGPT can safely streamline the consultation process by reducing visit times, while increasing patient satisfaction with the consultation process. If the hypothesis provides true, further implementation of ChatGPT in a healthcare practice may work to reduce the burden on health care providers.

There are no predicted adverse events of this study. There are no identified potential harms of this study.

Recruitment information / eligibility

• Status: Recruiting
• Enrollment: 40
• Est. completion date: October 5, 2023
• Est. primary completion date: September 30, 2023
• Accepts healthy volunteers: Accepts Healthy Volunteers
• Gender: Male
• Age group: 18 Years to 65 Years

Eligibility

Inclusion Criteria:

• Patients undergoing vasectomies interested in participating

• Adult (>18 years old)

• Consenting

Exclusion Criteria:

• Do not consent, uninterested in participating

Related Conditions & MeSH terms

• Contraception
• Vasectomy

Intervention

Other:
• ChatGPT Language Model
ChatGPT Language Model - ability to converse with the model and ask questions regarding vasectomies

Locations

Country	Name	City	State
Canada	Men's Health Clinic Manitoba	Winnipeg	Manitoba

Sponsors (1)

Lead Sponsor	Collaborator
University of Manitoba

Country where clinical trial is conducted

Canada, 

Outcome

Type	Measure	Description	Time frame	Safety issue
Primary	Length of Consultation	Length of pre-vasectomy consultation as measured from beginning to end of telephone call	Through study completion, estimated to be 2 months measured for each phone call
Primary	Number of questions asked	Number of questions asked during pre-vasectomy consultation	Through study completion, estimated to be 2 months measured for each phone call
Primary	Satisfaction of patients assessed by Likert scale	Satisfaction of patients as measured by questionnaire with 10-point Likert Scale ([0-10] higher score correlates with higher satisfaction)	Through study completion, estimated to be 2 months measured for each patient
Secondary	Commonly asked questions	Chat logs will be reviewed to examine common themes or questions and reported using descriptive statistics.	Through study completion period, estimated to be 2 months
Secondary	Incidence of inaccurate ChatGPT responses	ChatGPT responses will be reviewed by two licensed clinicians experienced in vasectomies to determine rates of inaccurate responses by the language models responses to patient questions. Incidence of inaccurate ChatGPT responses will be reported and through descriptive analysis this will be described and inaccurate responses will be conveyed.	Through study completion period, estimated to be 2 months