Deformable MRI-CT liver image registration using convolutional neural network with modality independent neighborhood descriptors

Yabo Fu; Yang Lei; Tonghe Wang; Jun Zhou; Walter J. Curran; Pretesh Patel; Tian Liu; Xiaofeng Yang

doi:10.1117/12.2581082

15 February 2021 Deformable MRI-CT liver image registration using convolutional neural network with modality independent neighborhood descriptors

Yabo Fu, Yang Lei, Tonghe Wang, Jun Zhou, Walter J. Curran, Pretesh Patel, Tian Liu, Xiaofeng Yang

Author Affiliations +

Proceedings Volume 11597, Medical Imaging 2021: Computer-Aided Diagnosis; 115970G (2021) https://doi.org/10.1117/12.2581082
Event: SPIE Medical Imaging, 2021, Online Only

Abstract

In radiotherapy, liver CT images are routinely acquired for treatment planning since CT images can provide important electron density information for dose calculation in treatment planning system. Besides the CT images, MRI is often acquired for diagnosis since it has superior soft tissue contrast. Therefore, for accurate contouring of the target, liver CT and MRI image registration plays an important role. It is very challenging to register the CT and MRI liver images due to the distinct image intensities and liver motion. In this study, a deep learning-based network was proposed to directly predict the DVF for MRI-CT liver image registration. To overcome the challenge of multimodal registration, we propose to incorporate a modality independent descriptor into the deep learning network to explore the correlations between the MRI and CT images. Our results show that the proposed network could accurately align MRI to CT liver images. The average Dice increased from 0.89±0.04 before registration to 0.93±0.02 after registration.

Conference Presentation

Citation Download Citation

Yabo Fu, Yang Lei, Tonghe Wang, Jun Zhou, Walter J. Curran, Pretesh Patel, Tian Liu, and Xiaofeng Yang "Deformable MRI-CT liver image registration using convolutional neural network with modality independent neighborhood descriptors", Proc. SPIE 11597, Medical Imaging 2021: Computer-Aided Diagnosis, 115970G (15 February 2021); https://doi.org/10.1117/12.2581082

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available