Efficient segmentation of multi-modal optoacoustic and ultrasound images using convolutional neural networks

Berkan Lafci; Elena Merćep; Stefan Morscher; Xosé Luís Deán-Ben; Daniel Razansky

doi:10.1117/12.2543970

17 February 2020 Efficient segmentation of multi-modal optoacoustic and ultrasound images using convolutional neural networks

Berkan Lafci, Elena Merćep, Stefan Morscher, Xosé Luís Deán-Ben, Daniel Razansky

Author Affiliations +

Proceedings Volume 11240, Photons Plus Ultrasound: Imaging and Sensing 2020; 112402N (2020) https://doi.org/10.1117/12.2543970
Event: SPIE BiOS, 2020, San Francisco, California, United States

Abstract

Multispectral optoacoustic tomography (MSOT) offers the unique capability to map the distribution of spectrally distinctive endogenous and exogenous substances in heterogeneous biological tissues by exciting the sample at various wavelengths and detecting the optoacoustically-induced ultrasound waves. This powerful functional and molecular imaging capability can greatly benefit from hybridization with pulse-echo ultrasound (US), which provides additional information on tissue anatomy and blood flow. However, speed of sound variations and acoustic mismatches in the imaged object generally lead to errors in the coregistration of compounded images and loss of spatial resolution in both imaging modalities. The spatially- and wavelength-dependent light fluence attenuation further limits the quantitative capabilities of MSOT. Proper segmentation of different regions and assignment of corresponding acoustic and optical properties turns then essential for maximizing the performance of hybrid optoacoustic and ultrasound (OPUS) imaging. Particularly, accurate segmentation of the boundary of the sample can significantly improve the images rendered. Herein, we propose an automatic segmentation method based on a convolutional neural network (CNN) for segmenting the mouse boundary in a pre-clinical OPUS system. The experimental performance of the method, as characterized with the Dice coefficient metric between the network output and the ground truth (manually segmented) images, is shown to be superior than that of a state-of-the-art active contour segmentation method in a series of two-dimensional (cross-sectional) OPUS images of the mouse brain, liver and kidney regions.

Citation Download Citation

Berkan Lafci, Elena Merćep, Stefan Morscher, Xosé Luís Deán-Ben, and Daniel Razansky "Efficient segmentation of multi-modal optoacoustic and ultrasound images using convolutional neural networks", Proc. SPIE 11240, Photons Plus Ultrasound: Imaging and Sensing 2020, 112402N (17 February 2020); https://doi.org/10.1117/12.2543970

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available