Train the Trainer Curriculum to Scale up AI Supported Echo for RHD Screening in a Public Health System

Rheumatic Heart Disease Clinical Trial

— ADD-RHD 2B  

Official title:

Design and Evaluation of a Train the Trainer Curriculum to Scale Up Automated Intelligence Supported Echocardiography for Rheumatic Heart Disease Screening in a Public Health Care System

Clinical Trial Details — Status: Completed

Administrative data

• NCT number: NCT05668611
• Other study ID #: 2022-0312
• Status: Completed
• Phase: N/A
• Start date: January 3, 2023
• Est. completion date: December 20, 2023

Study information

• Verified date: February 2024
• Source: Children's Hospital Medical Center, Cincinnati
• Contact: n/a
• Is FDA regulated: No
• Study type: Interventional

Clinical Trial Summary

The first primary objective of this study is to determine the diagnostic performance (sensitivity and specificity) of primary MOH nurses who have completed certification in focused echocardiography acquisition and interpretation by expert trainers to accurately identify patients who are screen positive and screen negative for rheumatic heart disease. The second primary objective is to determine the diagnostic performance (sensitivity and specificity) of secondary MOH nurses who have completed certification in focused echocardiography acquisition and interpretation by MOH nurse trainers to accurately identify patients who are screen positive and screen negative for rheumatic heart disease.

Description:

Objective 1:

4 ultrasound naïve nurses (Primary) employed at the HCIII/IVs participating in ADD-RHD Part 1 (SOMREC REF 2021-61) in Lira, will be trained and certified by experts in echocardiography for RHD on focused RHD echocardiographic screening examination and interpretation using a novel AI guided software.

Focused RHD screening echocardiograms by the 4 nurses will be integrated into routine clinical practice at their assigned HCIII/IVs for 1 month.

Screen positive patients will be referred to LRRH for confirmatory echocardiogram using a Standard echocardiographic machine under the National RHD registry (SOMREC REF 2014-137).

All echocardiograms will be uploaded to a secure cloud-based server and over-read by a cardiologist with in one - two (1 - 2) weeks to ensure patient safety and to determine trainee performance.

Diagnostic accuracy, sensitivity, specificity, positive and negative predictive values will be calculated.

4 MOH trainees will use pre-recorded PowerPoint presentations to conduct hands-on training for phase 2 (secondary) nurses.

Objective 2:

Similar to Phase 1 with just a few exceptions. 12 MOH nurses will be trained and certified by MOH nurse trainers from phase 1 to acquire and interpret RHD focused screening echocardiograms using a novel AI guided software.

Screening will be integrated into routine care for 2 months and diagnostic performance assessed.

Recruitment information / eligibility

• Status: Completed
• Enrollment: 1628
• Est. completion date: December 20, 2023
• Est. primary completion date: December 20, 2023
• Accepts healthy volunteers: Accepts Healthy Volunteers
• Gender: All
• Age group: 5 Years to 40 Years

Eligibility

Inclusion Criteria:

• Attend same HCIII/IV sites that the MOH nurses work at

• Agree to participate via the study's informed consent

Exclusion Criteria:

• Very sick participants requiring transfer to higher level facility or inpatient care

Related Conditions & MeSH terms

• Heart Diseases
• Rheumatic Diseases
• Rheumatic Heart Disease

Intervention

Other:
• Primary Training Phase
A four-day training program taken over the course of two weekends will include materials on RHD and RHD echocardiographic screening using focused artificial intelligence navigational guided echocardiographic acquisition to identify patients who are screen positive or screen negative for RHD. The echo protocol will be limited to the parasternal long axis-view (2D and color Doppler) focusing on mitral and aortic valve morphology and function and a single 2D apical 4 chamber view for auto EF. The curriculum package will include online modules, instructor delivered PowerPoint presentations, and hands on practice on volunteers with and without RHD.
• Primary Assessment Phase
A pre- and post-training test on RHD knowledge and diagnosis will be administered. A rapid competency assessment, including obtaining imaging on volunteers with or without RHD and an online test with pre-recorded cases of RHD, LV dysfunction and Pericardial effusions, will be utilized at the end of the 4-day training sessions. Trainees will be monitored by trained study personnel and at the end of the practicum training, the expert users will blindly review and assess the quality of each study using the standardized scale and competency scorecard provided below. Additionally, they will be asked to pass the knowledge quiz (80% or better). If competency is not achieved, an additional weekend of training can be added.
• Primary Screening Phase
Following certification, the certified MOH nurses will integrate echocardiographic screening into the routine workflow at the 4 HCIII/IV clinics with each nurse carrying out screening at the assigned HC on patients (aged 5-40) presenting to the health center for routine care. Screening will be done daily over a period of one month. A minimum total of 400 participants will be screened during this period; each nurse will screen as many patients as they can, with a minimum of 100 participants (at least 5 participants per day). At the end of each screen, the trainees will interpret the screen as screen negative or screen positive. They will go ahead to refer participants identified as screen positives to the district hospital (LRRH) for a confirmatory echo. At the end of each screening day, all images will be uploaded to a cloud server for a confirmatory review by a cardiology fellow or cardiology attending physician, within in 1 - 2 weeks.
• Secondary Training Phase
Each Primary Trained MOH Nurse will train 3 other nurses from their Health Center using pre-recorded PowerPoints.
• Secondary Assessment Phase
The secondarily trained nurses will be assessed and certified by the nurse trainer.
• Secondary Screening Phase
Following certification, the certified MOH nurses will integrate echocardiographic screening into the routine workflow at the 4 HCIII/IV clinics with each nurse carrying out screening at the assigned HC on patients (aged 5-40) presenting to the health center for routine care. Screening will be done daily over a period of two months. A minimum total of 1200 participants will be screened during this period; each nurse will screen as many patients as they can, with a minimum of 100 participants. At the end of each screen, the trainees will interpret the study as screen negative or screen positive. They will go ahead to refer participants identified as screen positives to the district hospital (LRRH) for a confirmatory echo. At the end of each screening day, all images will be uploaded to a cloud server for a confirmatory review by a cardiology fellow or cardiology attending physician, within in 1 - 2 weeks.

Locations

Country	Name	City	State
Uganda	Uganda Heart Institute	Kampala

Sponsors (2)

Lead Sponsor	Collaborator
Children's Hospital Medical Center, Cincinnati	Uganda Heart Institute

Country where clinical trial is conducted

Uganda, 

Outcome

Type	Measure	Description	Time frame	Safety issue
Primary	RHD Echocardiographic Diagnostic accuracy, sensitivity, specificity of MOH nurses	Diagnostic performance of MOH nurses who have completed certification in focused echocardiography acquisition and interpretation by expert trainers will be assessed. Diagnostic accuracy, sensitivity, specificity, positive and negative predictive values will be calculated to determine diagnostic performance of MOH nurses who have completed certification on focused echocardiography acquisition and interpretation. The ability of trainees to correctly identify screen positive and negative patients for RHD using known expert diagnosis as the reference. Correct determination of RHD screen positive/negative in at least 80% of cases is the benchmark	2 months after completion of training
Secondary	Knowledge Assessment	Questionnaire to test compare pre and post training knowledge about Rheumatic Heart Disease administered to nurse trainees.	Immediately before the training session and immediately after completion of training
Secondary	Computer Based Testing	Computer based testing designed to determine positive and negative screening referrals of patients with RHD and other cardiac diseases	Immediately following training
Secondary	Rapid Competency assessment	This assessment will be administered post training to nurse trainees. It is an observation- based assessment designed to assess correct use of the technology, basic image acquisition proficiency, diagnostic accuracy and image quality.	Immediately following training
Secondary	Provider satisfaction	Surveys questions on training and screening experience along with guided discussions on the training and screening experiences will be administered to nurse trainees	Immediately post training
Secondary	Longitudinal Image Quality	Expert Echocardiographers will access each image acquired by nurses using the ACEP scale. A scale of 1-5 (1) being no recognizable structure and (5) being excellent image quality of all structures. A score of 3 and above will be considered diagnostic.	Daily assessment for 1 month
Secondary	Provider confidence	Nurses will subjectively report their level of confidence regarding image quality. The levels of confidence will be assessed. (1) Very confident, image quality is good and adequate for diagnosis. (2) Fairly confident, image is good but confirmation of diagnosis by expert trainer needed, (3) Not confident, image quality not adequate.	Daily assessment for 1 month
Secondary	Diagnostic performance for other common categories of cardiac diseases	Assess nurse's ability to accurately identify left ventricular dysfunction and pericardial effusion as compared to the same standard applied by an expert.	Through completion of screening phase, average of 1 month
Secondary	Time to certification	Determine the time from the first day of training to certification for participants including remediation time.	Trough first day of training to study completion, average of 1 year