Breast screening and artificial intelligence: an independent evaluation of two different software carried out at Valenciennes hospital

Adrien Le Vourch; Poncelet Edouard; Nicolas Laurent

doi:10.1117/12.2564129

22 May 2020 Breast screening and artificial intelligence: an independent evaluation of two different software carried out at Valenciennes hospital

Adrien Le Vourch, Poncelet Edouard, Nicolas Laurent

Author Affiliations +

Proceedings Volume 11513, 15th International Workshop on Breast Imaging (IWBI2020); 1151321 (2020) https://doi.org/10.1117/12.2564129
Event: Fifteenth International Workshop on Breast Imaging, 2020, Leuven, Belgium

Abstract

We aimed to test two different software based on the deep learning technology versus two senior and one junior radiologist on a recall-based model for mammography. We performed a retrospective, monocentric, multi-reader study in the Centre Hospitalier de Valenciennes in the north of France. A set of examinations from a daily practice, with both screening and diagnostic studies, has been interpreted by 3 radiologists and the two AI based algorithms. The dataset has been enriched with BIRADS 4 and 5 cases in order to have a number of cancer cases sufficient to have statistically significant results. In total, 140 examinations have been included in the final dataset. Sensitivity (true positive rate - TPR), False positive rate (FPR), and recall rate per BI-RADS category were considered as endpoints for each of the radiologists. To compute these metrics all the included cases were considered as positive if the initial BI-RADS was equal or higher than 3 and as negative if the initial BI-RADS was 1 or 2. Additional analysis have been carried out taking into account the biopsy report (if any) as ground truth. While both the algorithms and radiologist have a good and comparative rate of sensitivity and FPR, the test based on BI-RADS categories (i.e. the number of cancer per BI-RADS category), showed heterogeneous results, with bad performances for one of the tested software on the extremes score of BI-RADS. We concluded that one of the analysed software cannot be used in the current clinical practice without further improvements, the second one shows promising results, but other studies are needed to have a robust external validation before being used in a daily practice.

Citation Download Citation

Adrien Le Vourch, Poncelet Edouard, and Nicolas Laurent "Breast screening and artificial intelligence: an independent evaluation of two different software carried out at Valenciennes hospital", Proc. SPIE 11513, 15th International Workshop on Breast Imaging (IWBI2020), 1151321 (22 May 2020); https://doi.org/10.1117/12.2564129

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Evolutionary algorithms

Biopsy

Breast

Artificial intelligence

Mammography

Cancer

Diagnostics

Show All Keywords

Keywords/Phrases

Search In:

Publication Years