The algorithm is trained on EHR data
and mammogram images to predict
malignant breast cancer
AI model predicts malignant breast cancer as well as humans: IBM
June 27, 2019
by John R. Fischer
, Staff Reporter
A new AI model is just as good as human radiologists at predicting the development of malignant breast cancer in patients within the course of a year.
That’s the conclusion reached by a group of researchers at IBM Research – Haifa, who are responsible for developing an algorithm they say is the first to incorporate both mammogram and comprehensive electronic health record data. They hope to make the solution a “second reader” to aid radiologists in their analyses.
“Our algorithm takes into account many personal health factors, such as a family history of disease, breast density, and other elements that have been correlated with a higher risk of developing breast cancer,” Michal Rosen-Zvi, director of IBM Research, told HCB News. “It generates a per person risk prediction that is based on the unique combinations of many personal factors. Our hope is that this algorithm lays the groundwork for technology that could one day more accurately take into account all of these factors, and better assess a woman's risk from all of these predictive elements analyzed in conjunction with each other.”
Potential types of findings that can be found in mammograms vary in shape, size, color and texture among other factors, making assessments challenging. While a second reading by another radiologist can increase sensitivity and specificity, the lack of trained radiologists and limited time often prevent providers in many countries from including second readers in standard screening procedures.
The aim of the system is to predict biopsy malignancy and differentiate normal from abnormal screening examinations, which it can do using both bilateral craniocaudal (CC) and mediolateral oblique (MLO) views, the typical processes used by radiologists.
The team developed and trained an algorithm with 9,611 clinically-collected, de-identified mammography images from 13,234 women who underwent at least one mammogram between 2013 and 2017 and had healthy records at least one year prior to their mammograms. The images were linked to holistic clinical data and biomarkers of each patient, such as thyroid function and reproduction history. Also incorporated were detailed records of each individual’s clinical data, including cancer history, pregnancy history, status of menopause, follow-up from biopsies, cancer registry data, lab results, and codes for various other procedures and diagnoses.
Utilizing deep learning and machine learning, the model maps connections between these and other additional clinical risk features to decrease the risk for breast cancer misdiagnosis and achieve accuracy comparable to radiologists, as defined by the American benchmark for screening digital mammography.
When tested, the algorithm predicted the development of breast cancer in 87 percent of cases it analyzed and correctly interpreted 77 percent of non-cancerous cases. It then was used to analyze 71 different cases that were initially determined to be non-malignant by radiologists but ended up being diagnosed as breast cancer within the year. It correctly identified breast cancer in 48 percent of individuals out of the 71 cases, whom IBM says would not be diagnosed otherwise, and obtained an area under the receiver operating characteristic curve (AUC) of 0.91, and specificity of 77.3 percent at a sensitivity of 87 percent.
“In terms of expanding our research, we do know that cancer detection and differential diagnosis of cancer (i.e., detecting not only the presence of cancer but which type of cancer is present, and its likelihood to becoming metastatic and aggressive) is a challenging, open question. We would like to ultimately extend our algorithms to combine not only clinical history and medical images but also digital pathology images and potentially genomic data. This could test the promise of AI techniques to not only detect cancer early, but also to shed some light on the specific prognosis of the disease. If accurate, this type of technology could lay the foundation for systems that could assist in saving more lives, while also reducing the issue of over-treatment.”
Images were collected from IBM research partners, Maccabi Health Services and Assuta Medical Center.
The findings were published in the journal, Radiology.