Breast mass image retrieval based on multimodality similarity estimation

Chisako Muramatsu; Mikinao Oiwa; Tomonori Kawasaki; Hiroshi Fujita

doi:10.1117/12.2564048

22 May 2020 Breast mass image retrieval based on multimodality similarity estimation

Chisako Muramatsu, Mikinao Oiwa, Tomonori Kawasaki, Hiroshi Fujita

Proceedings Volume 11513, 15th International Workshop on Breast Imaging (IWBI2020); 1151326 (2020) https://doi.org/10.1117/12.2564048
Event: Fifteenth International Workshop on Breast Imaging, 2020, Leuven, Belgium

Abstract

Retrieval of similar cases can help radiologists in efficient diagnosis, treatment planning, and preparation of reports for new cases. In this study, similarities of pairs of lesions were estimated using convolutional neural networks with subjective similarity data. The network was trained with pairs of mammograms (MG), pairs of ultrasound images (US), and both as input data and the corresponding similarity ratings by expert radiologists as teacher data. Based on the estimated similarity, the cases with the highest similarities were retrieved for a test case. The precisions of selecting pathology-matched relevant cases were compared for the networks using different input data. In this study, rather a simple network architecture, which takes a pair or pairs of input images and has one regression output layer corresponding to the similarity, provided higher precisions. The precisions using mammograms, ultrasound images, and both modalities were 0.72, 0.68, and 0.80, respectively. The highest precision was obtained by the use of one network with multimodality image inputs than combining the outputs by two separate networks for MG and US data. Relatively high precision indicates that the presentation of reference images can be useful for assisting breast cancer diagnosis.

Citation Download Citation

Chisako Muramatsu, Mikinao Oiwa, Tomonori Kawasaki, and Hiroshi Fujita "Breast mass image retrieval based on multimodality similarity estimation", Proc. SPIE 11513, 15th International Workshop on Breast Imaging (IWBI2020), 1151326 (22 May 2020); https://doi.org/10.1117/12.2564048

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available