Patch-wise 3D segmentation quality assessment combining reconstruction and regression networks

Fahim Ahmed Zaman; Tarun Kanti Roy; Milan Sonka; Xiaodong Wu

doi:10.1117/1.JMI.10.5.054002

8 September 2023 Patch-wise 3D segmentation quality assessment combining reconstruction and regression networks

Fahim Ahmed Zaman, Tarun Kanti Roy, Milan Sonka, Xiaodong Wu

Author Affiliations +

Funded by: National Institutes of Health (NIH), US National Institutes of Health (NIH)

Journal of Medical Imaging, Vol. 10, Issue 5, 054002 (September 2023). https://doi.org/10.1117/1.JMI.10.5.054002

Abstract

Purpose

General deep-learning (DL)-based semantic segmentation methods with expert level accuracy may fail in 3D medical image segmentation due to complex tissue structures, lack of large datasets with ground truth, etc. For expeditious diagnosis, there is a compelling need to predict segmentation quality without ground truth. In some medical imaging applications, maintaining the quality of segmentation is crucial to the localized regions where disease is prevalent rather than just globally maintaining high-average segmentation quality. We propose a DL framework to identify regions of segmentation inaccuracies by combining a 3D generative adversarial network (GAN) and a convolutional regression network.

Approach

Our approach is methodologically based on the learned ability to reconstruct the original images identifying the regions of location-specific segmentation failures, in which the reconstruction does not match the underlying original image. We use conditional GAN to reconstruct input images masked by the segmentation results. The regression network is trained to predict the patch-wise Dice similarity coefficient (DSC), conditioned on the segmentation results. The method relies directly on the extracted segmentation related features and does not need to use ground truth during the inference phase to identify erroneous regions in the computed segmentation.

Results

We evaluated the proposed method on two public datasets: osteoarthritis initiative 4D (3D + time) knee MRI (knee-MR) and 3D non-small cell lung cancer CT (lung-CT). For the patch-wise DSC prediction, we observed the mean absolute errors of 0.01 and 0.04 with the independent standard for the knee-MR and lung-CT data, respectively.

Conclusions

This method shows promising results in localizing the erroneous segmentation regions that may aid the downstream analysis of disease diagnosis and prognosis prediction.

Citation Download Citation

Fahim Ahmed Zaman, Tarun Kanti Roy, Milan Sonka, and Xiaodong Wu "Patch-wise 3D segmentation quality assessment combining reconstruction and regression networks," Journal of Medical Imaging 10(5), 054002 (8 September 2023). https://doi.org/10.1117/1.JMI.10.5.054002

Received: 24 December 2022; Accepted: 28 August 2023; Published: 8 September 2023

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $24.00

Non-members: $28.00 ADD TO CART

JOURNAL ARTICLE
13 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image segmentation

Image restoration

Education and training

Convolution

Cartilage

Network architectures

Voxels

Purpose

Approach

Results

Conclusions

Show All Keywords

Keywords/Phrases

Search In:

Publication Years