Conversational AI Study

Medical Education Clinical Trial

Official title:

Conversational Artificial Intelligence Simulations to Improve Non-Technical Skills Among Anesthesiology Trainees: A Prospective, Mixed-Methods Study

Clinical Trial Details — Status: Not yet recruiting

Administrative data

• NCT number: NCT06459479
• Other study ID #: 75964
• Status: Not yet recruiting
• Phase: N/A
• Start date: August 1, 2024
• Est. completion date: July 31, 2025

Study information

• Verified date: June 2024
• Source: Stanford University
• Contact: Thomas Caruso, MD, PhD
• Phone: 6282750341
• Email: tjcaruso[@]stanford.edu
• Is FDA regulated: No
• Study type: Interventional

Clinical Trial Summary

This is a prospective, collaborative, mixed-methods study which includes anesthesiology trainees receiving one active intervention - a conversational artificial intelligence (CAI) simulation. The goal is to explore the capability of AI to provide high-fidelity simulations that can ultimately improve how healthcare professionals handle difficult conversations such as disclosing medical errors or mistakes.

Recruitment information / eligibility

• Status: Not yet recruiting
• Enrollment: 20
• Est. completion date: July 31, 2025
• Est. primary completion date: July 31, 2025
• Accepts healthy volunteers: No
• Gender: All
• Age group: 18 Years to 18 Years

Eligibility

Inclusion Criteria:

• Hospital providers, including nurses, physician assistants, physicians, physician trainees, and other healthcare workers at Lucile Packard Children's Hospital (LPCH) and affiliated facilities who communicate with patients daily will be included

Exclusion Criteria:

• Participants with reported severe motion sickness

• Nausea

• Seizure disorder

• Currently using chronotropic heart medications, such as ß blockers

Related Conditions & MeSH terms

• Medical Education

Intervention

Other:
• Conversational Artificial Intelligence Simulations
Use of Conversational Artificial Intelligence Simulations generate medical scenario.

Locations

Country	Name	City	State
n/a

Sponsors (1)

Lead Sponsor	Collaborator
Stanford University

Outcome

Type	Measure	Description	Time frame	Safety issue
Primary	Evaluate acceptance of Conversational Artificial Intelligence Simulations using Guided Discussion Interview Question Guide	Guided Discussion Interview Question Guide contains 6 questions focusing 3 areas including Attitudes and Opinions, Perceptions and Summation question. All the questions are open-ended questions	Before simulation
Secondary	Evaluation of Conversational Artificial Intelligence Simulations usability via the System Usability Scale (SUS)	Measured with the System Usability Scale (SUS). The scale has 10 items. Scores ranges from 1-5 (1 = strongly disagree and 5 = strongly agree)	Immediately after simulation
Secondary	Evaluation of Conversational Artificial Intelligence Simulations usability via the User Experience Questionnaire (UEQ-S).	UEQ-S, includes eight items (four from the pragmatic scales Efficiency, Perspicuity, Dependability, and four from the hedonic scales Stimulation and Novelty). Scores range from -3 (min) to 3 (max)	Immediately after simulation
Secondary	Evaluation of the reliability of AI quantitative assessment of non-technical performance compared to expert human assessors	The Anaesthetist Non-Technical Skills (ANTS) tool previously published by Fletcher et al. translated in French. The ANTS scoring system uses four categories assessing task management, teamworking, situation awareness and decision-making (1 to 4 points by categories). The minimum score is 4 and the maximum 16	immediately after simulation