Assess the Clinical Effectiveness in AI Prioritising CT Heads

Stroke, Ischemic Clinical Trial

— ACCEPT  

Official title:

A Mixed Methods Study to Assess the Clinical Effectiveness and Acceptability of qER Artificial Intelligence Software to Prioritise CT Head Interpretation.

Clinical Trial Details — Status: Recruiting

Administrative data

• NCT number: NCT06027411
• Other study ID #: 313507
• Status: Recruiting
• Start date: March 27, 2024
• Est. completion date: August 2024

Study information

• Verified date: March 2024
• Source: Guy's and St Thomas' NHS Foundation Trust
• Contact: Haris Shuaib, MSc
• Phone: 020 7188 7188
• Email: haris.shuaib[@]gstt.nhs.uk
• Is FDA regulated: No
• Study type: Observational [Patient Registry]

Clinical Trial Summary

Non-Contrast Computed Tomography (NCCT) of the head is the most common imaging method used to assess patients attending the Emergency Department (ED) with a wide range of significant neurological presentations including trauma, stroke, seizure and reduced consciousness. Rapid review of the images supports clinical decision-making including treatment and onward referral.

Radiologists, those reporting scans, often have significant backlogs and are unable to prioritise abnormal images of patients with time critical abnormalities. Similarly, identification of normal scans would support patient turnover in ED with significant waits and pressure on resources.

To address this problem, Qure.AI has worked to develop the market approved qER algorithm, which is a software program that can analyse CT head to identify presence of abnormalities supporting workflow prioritisation.

This study will trial the software in 4 NHS hospitals across the UK to evaluate the ability of the software to reduce the turnaround time of reporting scans with abnormalities that need to be prioritised.

Description:

Study background:

Emergency Departments (ED) across the UK are overburdened with increasing patient demand, radiology staff shortages and rising patient wait times. Head injuries are a frequent cause of emergency attendance in the UK with computed tomography(CT) scans usually the first imaging tests to diagnose head injuries and strokes.

A report issued by National Institute of Health and Care Excellence (NICE), confirms that each year 1.4 million people attend emergency departments in England and Wales with head injury. Among the 200,000 patients admitted annually, one-fifth of them suffer from a Traumatic Brain Injury with skull fracture or evidence of brain damage. Head injury is the most common cause of death and disability in people up to the age of 40. Early detection and prompt treatment is vital to save lives and minimise risk of disability, according to the NICE guidelines of Head injury: assessment and early management. Head CT scans are the gold standard for diagnosing these and it is critical that these are performed and reported by Radiologists in line with NICE guidelines.

The potential applications of AI in radiology go well beyond image analysis for diagnostic and prognostic opportunities. It is becoming increasingly clear that AI algorithms have the potential to improve productivity, operational efficiency, and accuracy in diagnostic radiology. AI tools are being developed to aide diagnosis and enhance processes at multiple point in the radiology workflow including:

(a) protocolling the prioritised scan,(b) clinical decision support systems for detection of critical findings, (c) worklist priority adjustment via AI results, and (d) reducing turnaround time through worklist prioritisation and semiautomated structures reporting. The adoption of AI tools is dependent on the demonstration of a tangible effect on patient care and improvement in radiologist workflow.

Thus, in this study, we aim to assess whether real-world implementation of an AI tool which augments (b), (c) and (d) of the imaging life cycle would affect turnaround times.

qER medical device:

qER, a CE Class II approved medical software device, detects, and localizes the presence of six target abnormalities - intracranial haemorrhage, cranial fracture, midline shift, mass effect, atrophy and hypodensities suggestive of infarcts in non-contrast Head-CT scans. A priority status is assigned if any one of the target abnormalities (intracranial haemorrhage, cranial fracture, midline shift or mass effect) is detected by the software, and the user will be able to view a single summary slice listing all the target abnormalities found by qER on the CT scan followed by all slices in scan with the overlay of above abnormalities localization. Alternately, if none of the target abnormalities are detected, the output will indicate that the software has analysed the image and identified no critical findings. qER reports are intended to support certified radiologists and/or licensed medical practitioners for clinical decision making. It is a support tool and, when used with original scans, can assist the clinician to improve efficiency, accuracy, and turnaround time in reading head CTs. It is not to be used to provide medical advice, determine treatment plan, or recommend a course of action to the patient.

Study design:

A multi-centre stepped wedged cluster randomised study will be conducted in 4 NHS hospitals over a 13-month period. Hospitals will be identified and initiated into the qER solution with a 30-day implementation period. The order in which sites will receive the qER intervention will be determined by computer-based randomisation. The stepped wedge design allows delivery of the intervention at an organisational level with evaluation of outcome measures at a patient level. Structuring the implementation through a staged activation in a random order provides important methodological advantages for both qualitative and quantitative elements of the study. The design allows control of adoption bias and adjust for time-based changes in the background patient characteristics at a patient level.

All patients under this pathway would receive an AI reading, and no additional or different tests will be performed as a result of the AI findings. The turnaround time will be the interval between the time the scan was taken to the time when the final scan report becomes available and will be measured in minutes. When qER assistance is used for reporting Head-CT scans and if there is a difference between the output of the qER and the radiologist, the latter will be considered as final for further patient management.

Primary objective:

The primary objective is to assess if qER based reporting and triage significantly reduce turnaround time (TAT) of critical NCCT head reporting for patients attending the emergency department.

Secondary objective(s):

• To assess utility of qER to support emergency department pathways for patients requiring NCCT head and radiology reporting workflow.

• To assess the safety of qER at identifying patients with critical findings on NCCT heads.

• To evaluate the technical performance of qER.

• To conduct a Heath Economic, cost utility analysis of qER.

Recruitment information / eligibility

• Status: Recruiting
• Enrollment: 16800
• Est. completion date: August 2024
• Est. primary completion date: August 2024
• Gender: All
• Age group: 18 Years and older

Eligibility

Inclusion Criteria:

• Individuals undergoing Head CT scan at the ED / A&E (Accident and Emergency Services).

• Non-contrast axial CT scan series with consistently spaced axial slices.

• Soft reconstruction kernel covering the complete Brain.

• Maximum slice thickness of 6mm.

Exclusion Criteria:

There are no explicit exclusion criteria for qER as all scans in inclusion criteria will be processed by qER. Exclusion criteria are implicit within the inclusion criteria listed above.

Related Conditions & MeSH terms

• Brain Injuries, Traumatic
• Encephalomalacia
• Hemorrhage
• Hemorrhage, Intracranial
• Intracranial Hemorrhages
• Ischemic Stroke
• Mass Lesion
• Skull Fractures
• Stroke, Ischemic
• Trauma, Brain

Intervention

Device:
• qER (qER EU 2.0)
Qure.ai's emergency room software solution qER (qER EU 2.0) is an AI medical device, developed by training a deep-learning algorithm using over 300,000 scans labelled by expert radiologists. qER has been shown to be accurate in identifying a range of abnormalities in NCCT head scans as well as prioritising them for urgent review and radiologist reporting. It is designated as a clinical support tool and, when used with original scans, can assist the clinician to improve efficiency, accuracy, and turnaround time in reading head CTs.

Locations

Country	Name	City	State
United Kingdom	NHS Greater Glasgow and Clyde	Glasgow
United Kingdom	Guy's and St.Thomas Trusts	London
United Kingdom	Northumbria Healthcare NHS Foundation Trust	Northumberland
United Kingdom	Oxford University Hospitals	Oxford

Sponsors (5)

Lead Sponsor	Collaborator
Guy's and St Thomas' NHS Foundation Trust	NHS Greater Glasgow and Clyde, Northumbria Healthcare NHS Foundation Trust, Oxford University Hospitals NHS Trust, Qure.ai

Country where clinical trial is conducted

United Kingdom, 

Outcome

Type	Measure	Description	Time frame	Safety issue
Primary	Reporting turnaround time with qER prioritisation	Time taken to report NCCT head from acquisition for patients with prioritised findings in Emergency Department compared to standard of care.; Measured as time in minutes from the scan acquisition to the final radiology report of prioritised scans.	1 year
Secondary	Reporting turnaround time with qER prioritisation for scans without prioritised findings in Emergency Department compared to standard of care.	Measured as time in minutes from the scan acquisition to the final radiology report of scans without prioritised findings.	1 year
Secondary	Reporting turnaround time with qER prioritisation for scans with an absence of findings in Emergency Department compared to standard of care.	Measured as time in minutes from the scan acquisition to the final radiology report of scans with an absence of findings.	1 year
Secondary	Assess the impact of qER on radiology reporting workflow on other requests for CT scans.	To assess how this impacts the types of CT scans requested from the Emergency Department.	1 year
Secondary	Impact of qER supported reporting on teleradiology.	Time taken to report NCCT head from acquisition for patients in Emergency Department compared to standard of care where teleradiology is used.	1 year
Secondary	Assess utility of qER to support clinical decision making of the patients from the emergency department requiring an NCCT.	Time to diagnosis from NCCT acquisition.; Measured as time in hours for the electronic record of diagnosis assigned in the emergency department.	1 year
Secondary	Assess utility of qER to support referral or discharge of the patients from the emergency department requiring an NCCT.	Time to referral or discharge designation from NCCT acquisition.; Measured as time in hours to the electronic record of referral or discharge after diagnosis in the emergency department.	1 year
Secondary	Time to initiation of treatment from NCCT acquisition for prioritised scans.	Time to initiation of treatment from NCCT acquisition.; Measured as time in hours to the electronic record of the initiation of treatment in the emergency department.	1 year
Secondary	Death within 28 days of NCCT head acquisition.	Number of patients presenting via the emergency department who then had a NCCT and died 28 days after their scan.	1 year
Secondary	Percentage of NCCT heads that qER classifies as prioritised, non-prioritised and absence of findings.	Number of scans that qER identifies as prioritised, non-prioritised and absence of findings in accordance with the target abnormality definitions.	1 year
Secondary	Percentage of qER non-prioritised scans but identified by the radiologist as prioritised.	Accuracy of qER in classifying non-prioritised scans in comparison to a radiologist.; Rate of accurate classification of non-prioritised scans compared with the final radiology report.	1 year
Secondary	Percentage of qER non-prioritised scans but identified by the radiologist as absence of finding.	Accuracy of qER in classifying scans with an absence of findings. Rate of accurate classification of scans with an absence of findings compared with the final radiology report.	1 year
Secondary	Technical evaluation of product performance.	Sensitivity, specificity, positive and negative predictive values of qER in detecting scans with prioritised findings overall and stratified by all six target abnormalities.; Percentage of CT scans that could not be processed by qER due to technical factors.	1 year
Secondary	Assess the safety of qER	Mortality within 30 days of Emergency Department discharge.; Measured by the number of study participants who upon discharge from the impatient setting are dead within 30 days.	1 year
Secondary	Health Economic Assessment	To compare costs and health benefits between pre- and post-implementation of qER, including cost evaluation of fully automatic diagnosis of high confidence normal triage.	1 year