Accuracy of an Artificial Intelligence-assisted Diagnostic System for Caries Diagnosis: a Prospective Multicenter Clinical Study

Dental Caries Clinical Trial

Official title:

Accuracy of an Artificial Intelligence-assisted Diagnostic System for Caries Diagnosis: a Prospective Multicenter Clinical Study

Clinical Trial Details — Status: Not yet recruiting

Administrative data

• NCT number: NCT06428344
• Other study ID #: KY2024060
• Status: Not yet recruiting
• Start date: June 1, 2024
• Est. completion date: June 1, 2027

Study information

• Verified date: May 2024
• Source: Zhejiang Provincial People's Hospital
• Contact: n/a
• Is FDA regulated: No
• Study type: Observational

Clinical Trial Summary

This clinical trial was designed as a prospective, multicenter, multi-reader multi-case (MRMC), superiority, parallel-controlled study. Participants who met the trial criteria and signed the informed consent form were enrolled. The trial group involved diagnoses of caries on panoramic radiographs using an artificial intelligence-assisted diagnostic system, while the control group involved diagnoses made by dental practitioners specializing in operative dentistry and endodontics with five years of experience, who interpreted oral panoramic radiographs to determine the presence and severity of caries.

Recruitment information / eligibility

• Status: Not yet recruiting
• Enrollment: 220
• Est. completion date: June 1, 2027
• Est. primary completion date: December 1, 2026
• Accepts healthy volunteers: No
• Gender: All
• Age group: 18 Years to 70 Years

Eligibility

Inclusion Criteria:

-

Inclusion Criteria:

1. Patients presenting with clinical manifestations of caries as their chief complaint;

2. Age =18 and =70 years, irrespective of gender;

3. Oral panoramic radiographs showing a complete dentition, specifically with the second molars and all premolars intact in each quadrant;

4. On the oral panoramic radiographs, the number of teeth with restorations or fillings does not exceed one in any quadrant;

5. Oral panoramic radiographs that are clear, easy to interpret, and free from significant artifacts;

6. Participants who voluntarily agree to partake, can comprehend the purpose of the study, and are capable of signing an informed consent form.

Exclusion Criteria:

1. Oral panoramic radiographs that are unclear, with overlapping, blurring, or artifacts present;

2. Insufficient number of teeth available for study;

3. Severe tooth wear or erosion leading to significant alteration in tooth morphology;

4. Presence of supernumerary teeth, microdontia, or missing teeth;

5. Conditions not suitable for oral radiography, such as pregnancy or undergoing radiation therapy for tumors;

6. Limited mouth opening that precludes clinical examination;

7. Neurological disorders, psychiatric illnesses, or psychological impairments;

8. Participation in another clinical trial within the last three months;

9. Any other condition deemed by the researchers as unsuitable for inclusion in the study.

Related Conditions & MeSH terms

• Artificial Intellegence
• Dental Caries
• Diagnosis
• Disease
• Machine Learning

Locations

Country	Name	City	State
n/a

Sponsors (1)

Lead Sponsor	Collaborator
Zhejiang Provincial People's Hospital

Outcome

Type	Measure	Description	Time frame	Safety issue
Primary	Sensitivity, specificity, and accuracy of caries diagnosis	Sensitivity: Sensitivity assesses the diagnostic method's ability to identify the disease, that is, how many true cases of caries can be correctly identified among all actual cases of caries.; Specificity: Specificity evaluates the diagnostic tool's ability to recognize the absence of disease, meaning how many true non-caries cases can be correctly identified among all actual non-caries cases.; Accuracy: Accuracy evaluates the overall correctness of the diagnostic tool in diagnosing the disease.	Immediately after the completion of all participant information collection.
Secondary	Miss rate and false positive rate of caries diagnosis	Miss rate (False Negative Rate): The miss rate refers to the proportion of true caries cases that the diagnostic method fails to correctly identify among all actual cases of caries. In this study, the effectiveness of the artificial intelligence-assisted diagnostic system is evaluated by comparing the miss rate of caries diagnosis between the artificial intelligence-assisted diagnostic system and dentists with five years of experience.; False positive rate: The false positive rate refers to the proportion of cases that are incorrectly identified as having caries among all actual non-caries cases. In this study, the effectiveness of the artificial intelligence-assisted diagnostic system is evaluated by comparing the false positive rate of caries diagnosis between the artificial intelligence-assisted diagnostic system and dentists with five years of experience.	Immediately after the completion of all participant information collection.
Secondary	Accuracy of Caries Severity Level Diagnosis	This study utilizes the International Caries Detection and Assessment System (ICDAS) to evaluate the grading of caries severity, categorizing caries severity into five levels: E0, E1, E2, D1, and D2. Wherein: E0 indicates no apparent signs of caries; E1 represents early caries, primarily initial enamel lesions; E2 designates enamel caries without involvement of the dentin; D1 denotes superficial dentin caries, not reaching half of the dentin thickness; D2 signifies deep dentin caries, reaching or exceeding half of the dentin thickness. This study will assess and compare the diagnostic accuracy at each grading level between the trial group and the control group.	Immediately after the completion of all participant information collection.