SEOUL, South Korea, July 3, 2023 /PRNewswire/ -- Findings from a recent study demonstrate that medical AI solutions with only high diagnostic accuracy can significantly improve the reading performance of radiologists.
Lunit (KRX:328130.KQ), a global provider of AI-powered cancer diagnostics solutions, today announced the publication of a study exploring the impact of medical AI solutions' accuracy on radiologists' diagnostic determination. The study, conducted by Seoul National University Hospital from December 2015 to February 2021, was recently published in 'Radiology,' a renowned peer-reviewed journal in medical imaging.
The study involved a cohort of 30 doctors, including 20 board-certified radiologists with 5 to 18 years of expertise and 10 radiology residents with 2 to 3 years of training. A total of 120 retrospectively collected chest radiographs were assessed, with 60 obtained from patients with lung cancer and the remaining 60 showing no abnormalities.
Ad Statistics
Times Displayed: 7262
Times Visited: 23 Brand-New FDA-cleared Advanced Ultrasound Medical Device available for sale or lease to Wound Care Centers or any other Medical Facilities.The Arobella 1000D is designed for non-contact or debridement ultrasound wound healing therapy, or any other wounds
During the first session, the 30 readers were divided into two groups and analyzed 120 chest X-rays each without the assistance of AI. In the subsequent session, each group reinterpreted the images with the aid of either a high-accuracy or low-accuracy AI model.
The high-accuracy AI model utilized in the study was Lunit INSIGHT CXR, Lunit's commercially available AI solution for chest X-ray analysis. In contrast, the low-accuracy model was trained using only 10% of the data available to Lunit INSIGHT CXR. The AUROC (area under the receiver operating characteristic curve), a commonly used metric for diagnostic accuracy, of Lunit INSIGHT CXR was 0.88, while the low-accuracy AI model only reached 0.77.
The study revealed that using the higher-accuracy AI model, Lunit INSIGHT CXR, significantly improved radiologists' performance. The AUROC was remarkably advanced from 0.77 to 0.82 when assisted by the high-accuracy AI model.
Conversely, the radiologists from the other group did not experience any performance improvement when utilizing the low-accuracy AI model, as the AUROC remained at 0.75. Moreover, the group that employed the high-accuracy AI model demonstrated a higher susceptibility to AI suggestions. The radiologists accepted 67% of AI recommendations that contradicted the initial reading results, compared to 59% acceptance of the group that utilized the low-accuracy AI model.
Moreover, the study findings highlighted that factors such as radiologists' individual expertise, experience with AI, or attitudes toward AI had negligible impact on their reading performance in the second session. Instead, the accuracy of the AI model and the radiologists' initial diagnostic accuracy emerged as the primary determinant shaping the final diagnostic determination.
