Towards improved breast cancer detection on digital mammograms using local self-attention-based transformer

Han Chen; Anne L. Martel

doi:10.1117/12.3025375

29 May 2024 Towards improved breast cancer detection on digital mammograms using local self-attention-based transformer

Han Chen, Anne L. Martel

Proceedings Volume 13174, 17th International Workshop on Breast Imaging (IWBI 2024); 131741T (2024) https://doi.org/10.1117/12.3025375
Event: 17th International Workshop on Breast Imaging (IWBI 2024), 2024, Chicago, IL, United States

Abstract

Deep-learning-based models have been proposed as an automated second reader for mammograms that might help reduce radiologists’ workload and improve screening accuracy. However, the inherent traits of mammograms, characterized by significantly higher resolutions and smaller regions of interest (ROIs) in comparison to natural images, impose constraints on the adaptability of deep neural networks that are well-suited for natural image analysis to the domain of mammogram analysis. In this work, we propose a novel neural network to effectively detect breast cancer on screening mammograms and address the above issues. First, we use a local self-attention-based Swin Transformer as the backbone to select the most informative patch regions from the whole mammogram. We then utilize a second CNN based network to further extract the fine-grained features of the selected patches. Finally, we employ a fusion module that aggregates global and local information to make a prediction. The final loss function is the combination of the prediction from both the transformer and CNN modules. With local self-attention and a hierarchical structure, our backbone can effectively model the relationships between ROIs (e.g., masses or micro-calcifications) of different sizes and their surrounding tissues. Thus introduces meaningful contextual information for robust feature extraction. The experimental results show that our model can achieve state-of-the-art performance, in terms of classification AUC of 0.856 on a public mammogram dataset.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Han Chen and Anne L. Martel "Towards improved breast cancer detection on digital mammograms using local self-attention-based transformer", Proc. SPIE 13174, 17th International Workshop on Breast Imaging (IWBI 2024), 131741T (29 May 2024); https://doi.org/10.1117/12.3025375

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available