Challenges and solutions of echocardiography generalization for deep learning: a study in patients with constrictive pericarditis

Jiwoong Jeong; Chieh-Ju Chao; Reza Arsanjani; Kihong Kim; Melissa N. Pelkey; Yi-Chieh Chen; Raheel N. Ramzan; Mohammad Elbahnasawy; Mohamed Sleem; Chadi Ayoub; Juan Maria M. Farina; Martha Grogan; Garvan C. Kane; Bhavik N. Patel; Jae K. Oh; Imon Banerjee

doi:10.1117/1.JMI.10.5.054502

12 October 2023 Challenges and solutions of echocardiography generalization for deep learning: a study in patients with constrictive pericarditis

Jiwoong Jeong, Chieh-Ju Chao, Reza Arsanjani, Kihong Kim, Melissa N. Pelkey, Yi-Chieh Chen, Raheel N. Ramzan, Mohammad Elbahnasawy, Mohamed Sleem, Chadi Ayoub, Juan Maria M. Farina, Martha Grogan, Garvan C. Kane, Bhavik N. Patel, Jae K. Oh, Imon Banerjee

Author Affiliations +

Journal of Medical Imaging, Vol. 10, Issue 5, 054502 (October 2023). https://doi.org/10.1117/1.JMI.10.5.054502

Abstract

Purpose

The inherent characteristics of transthoracic echocardiography (TTE) images such as low signal-to-noise ratio and acquisition variations can limit the direct use of TTE images in the development and generalization of deep learning models. As such, we propose an innovative automated framework to address the common challenges in the process of echocardiography deep learning model generalization on the challenging task of constrictive pericarditis (CP) and cardiac amyloidosis (CA) differentiation.

Approach

Patients with a confirmed diagnosis of CP or CA and normal cases from Mayo Clinic Rochester and Arizona were identified to extract baseline demographics and the apical 4 chamber view from TTE studies. We proposed an innovative preprocessing and image generalization framework to process the images for training the ResNet50, ResNeXt101, and EfficientNetB2 models. Ablation studies were conducted to justify the effect of each proposed processing step in the final classification performance.

Results

The models were initially trained and validated on 720 unique TTE studies from Mayo Rochester and further validated on 225 studies from Mayo Arizona. With our proposed generalization framework, EfficientNetB2 generalized the best with an average area under the curve (AUC) of 0.96 (±0.01) and 0.83 (±0.03) on the Rochester and Arizona test sets, respectively.

Conclusions

Leveraging the proposed generalization techniques, we successfully developed an echocardiography-based deep learning model that can accurately differentiate CP from CA and normal cases and applied the model to images from two sites. The proposed framework can be further extended for the development of echocardiography-based deep learning models.

Citation Download Citation

Jiwoong Jeong, Chieh-Ju Chao, Reza Arsanjani, Kihong Kim, Melissa N. Pelkey, Yi-Chieh Chen, Raheel N. Ramzan, Mohammad Elbahnasawy, Mohamed Sleem, Chadi Ayoub, Juan Maria M. Farina, Martha Grogan, Garvan C. Kane, Bhavik N. Patel, Jae K. Oh, and Imon Banerjee "Challenges and solutions of echocardiography generalization for deep learning: a study in patients with constrictive pericarditis," Journal of Medical Imaging 10(5), 054502 (12 October 2023). https://doi.org/10.1117/1.JMI.10.5.054502

Received: 28 February 2023; Accepted: 19 September 2023; Published: 12 October 2023

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $24.00

Non-members: $28.00 ADD TO CART

JOURNAL ARTICLE
16 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data modeling

Education and training

RGB color model

Echocardiography

Performance modeling

Deep learning

Motion models

Purpose

Approach

Results

Conclusions

Show All Keywords

Keywords/Phrases

Search In:

Publication Years