Deep learning technologies have been successfully applied to automatic diagnostics of ex-vivo lung cancer with fluorescence lifetime imaging endomicroscopy (FLIM). Recent advance in convolutional neural networks (CNNs) by splitting input features for multi-scale feature extraction as a feature-level aggregation, has achieved further improvement in visual recognition. However, due to the splitting, correlations among input features are no longer retained. To exploit the advantages of hierarchical multi-scale architectures, while maintaining the correlations as global information, we propose a novel architecture, namely multi-scale concatenated-dilation (MSCD) at a layer level. The MSCD performs multi-scale feature extraction on input features without the splitting. In addition, we substitute the Addition aggregation in the original hierarchical architecture with the Concatenation to retrieve more features. At the same time, we also introduce dilated convolutions to replace the linear convolutions to further enlarge the receptive field. We evaluate the performance of MSCD by integrating it into ResNet, on over 60,000 FLIM images collected from 14 patients, using a custom fiber-based FLIM system, with various user-specified configurations. Accuracy, precision, recall, and the area under the receiver operating characteristic curve are used as the metrics. We first demonstrate the superiority of our MSCD model over the backbone ResNet and other state-of-the-art CNNs in terms of higher scores with lower complexity over the metrics. Moreover, we empirically demonstrate the superiority of the Concatenation aggregation over the Addition on convolution and scale efficiency. Furthermore, we compare the MSCD with Res2Net to illustrate the advantages and disadvantages of feature-/layer-level multi-scale aggregation.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.