Open Access
27 March 2019 Label-free in vivo pathology of human epithelia with a high-speed handheld dual-axis confocal microscope
Chengbo Yin, Linpeng Wei, Sanjee Abeytunge, Gary Peterson, Milind Rajadhyaksha, Jonathan T. C. Liu
Author Affiliations +
Abstract
There would be clinical value in a miniature optical-sectioning microscope to enable in vivo interrogation of tissues as a real-time and noninvasive alternative to gold-standard histopathology for early disease detection and surgical guidance. To address this need, a reflectance-based handheld line-scanned dual-axis confocal microscope was developed and fully packaged for label-free imaging of human skin and oral mucosa. This device can collect images at >15  frames  /  s with an optical-sectioning thickness and lateral resolution of 1.7 and 1.1  μm, respectively. Incorporation of a sterile lens cap design enables pressure-sensitive adjustment of the imaging depth by the user during clinical use. In vivo human images and videos are obtained to demonstrate the capabilities of this high-speed optical-sectioning microscopy device.

The visualization of glandular, cellular, and subcellular features from thinly sectioned tissues mounted on glass slides, known as histopathology, provides a clinical gold standard by which diseases are diagnosed. Since this process is destructive of tissues, time-consuming, and costly, a limited number of sections are typically prepared from each tissue specimen, which leads to severe sampling errors. For rapid intraoperative consultations, frozen sections can be prepared, but this still requires the selective invasive removal of tissues, which is risky, and has the same sampling limitations as histology of formalin-fixed paraffin-embedded tissues.

Portable in vivo optical-sectioning microscopes have the potential to enable real-time noninvasive pathology that can circumvent many of the limitations of conventional histology methods.110 Confocal microscopy has traditionally been the most-popular optical-sectioning technique for imaging tissues, in which a pinhole is typically used as a spatial filter to reject out-of-focus and multiply scattered background light. While the first confocal microscopes were developed in the 1950s and 1960s, originally by Minsky,11 early systems that relied upon analog detection through an eyepiece were bulky and slow. In the past few decades, rapid advances in lasers, fibers, scanners, detectors, and computers have enabled the development of portable, handheld, and even endoscopic systems for various clinical applications.110 Although conventional single-axis confocal (SAC) microscopes have become standard equipment in life-science and clinical laboratories, a dual-axis confocal (DAC) architecture is utilized in this study.12 Unlike the SAC architecture, which utilizes a single objective and common beam path for illumination and collection, the DAC architecture utilizes off-axis low-numerical-aperture (NA) illumination and collection beams that intersect at their foci. This configuration has been shown, through diffraction-theory analysis and Monte-Carlo scattering simulations, to provide more effective optical sectioning, which in turn enables higher-contrast imaging [improved signal-to-background ratios (SBRs)] and imaging depth within biological tissues (compared with SAC microscopy).1215 In addition, the use of low-NA beams provides a long working distance, which can be an advantage for miniaturization.12

Handheld devices for the early detection of skin and oral malignancies, and/or surgical guidance of a variety of anatomical sites, should ideally acquire images at a high frame rate in order to minimize motion artifacts during clinical use on patients. While most previous DAC microscopes have utilized point scanning, in which an image is constructed by scanning a localized focal volume in two dimensions for two-dimensional (2-D) imaging, the DAC microscope described in this letter utilizes line scanning in order to achieve a high frame rate. In a line-scanned confocal microscope, the illumination beam is focused to a line within the specimen, and a detection slit is used in front of a linear detector array, instead of a pinhole, to reject out-of-focus light. While a line-scanned system sacrifices one dimension of confocality (along the focal line), simulations and experiments have demonstrated that an line-scanned dual-axis confocal (LS-DAC) microscope is capable of achieving adequate contrast (SBR) when imaging near tissue surfaces (100-μm depth) in comparison to a point-scanned dual-axis confocal (PS-DAC) microscope.13,15,16

In comparison to an earlier proof-of-concept prototype that was not fully packaged for clinical use,17 a number of technical improvements are reported here: (1) an optimized illumination module has been fabricated to improve the imaging resolution and contrast. (2) A portable detector has been incorporated into a fully packaged handheld device to enable portable clinical use. (3) A sterile lens cap has been designed to enable pressure-sensitive adjustment of the optical-sectioning depth by the user during imaging. Collectively, these technical advances have allowed us to obtain first-in-human reflectance images of skin and oral mucosa.

The handheld LS-DAC microscope developed in this study consists of three major modules [Fig. 1(a)]: (1) a main body that houses the optics for the illumination (blue) and collection (green) beams, a MEMS scanning mirror, and two alignment mirrors; (2) a custom relay objective lens with a lens cap that provides 3× magnification; and (3) a portable linear detector array. A single-mode optical fiber (SM670) is used to couple laser radiation at a wavelength of 660 nm into the illumination path of the main body (Gaussian beams are assumed throughout this work). A newly optimized illumination fiber module, assembled by GRINTECH GmbH (Jena, Germany), consists of two doublet achromat lenses packaged within a stainless steel cylindrical tube with an inner diameter of 3.0 mm and an outer diameter of 3.2 mm. Lens L1 is a spherical achromat from Edmund Optics (Barrington, New Jersey, catalog number 45262) that has been reduced in diameter (3.0-mm diameter) by BMV Optical (Ottawa, Ontario, Canada). Lens C is a custom cylindrical lens, fabricated by BMV Optical, that is based on the lens prescription of a spherical achromat from Edmund Optics (catalog number 45090). Compared to the fiber module utilized in a previous prototype,17 which utilized three lenses, the new two-lens fiber module is simpler to assemble and exhibits reduced diffraction sidelobes in the profile of the illumination focal line due to reduced clipping of the Gaussian beam (see Fig. 3 and associated text). The MEMS scanning mirror utilized in our device is from Mirrorcle Technologies, Richmond, California [shown in Fig. 1(c)]. The MEMS chip is packaged into an LCC18 package (measuring 8.89×7.24  mm) and soldered on to a custom-designed printed circuit board chip (measuring 10.16×8.64  mm) manufactured by Advanced Circuits Inc. The detector in Fig. 1(c) is a 2-D detector array (Basler ace acA2000-340 km) with 2048×1088  pixels, in which the size of each pixel measures 5.5×5.5  μm. To utilize this detector as a linear array, a region of interest of 4  rows×2048  pixels was binned to generate a 1×2048 output. A lens cap was designed to provide a means for adjusting the imaging depth [shown in Fig. 1(d)]. The distal face of the lens cap provides a flat surface that comes into contact with the tissue during imaging. A 3.5-mm-diameter hole at the center of the distal face of the lens cap provides optical access and is covered with a sterile plastic film that wraps around the entire device to maintain sterility. As the user adjusts the pressure of the device against the tissue, the tissue deflects slightly into the hole of the lens cap, which in turn allows the microscope to image more deeply.

Fig. 1

(a) Optical circuit of the handheld LS-DAC microscope. The illumination and collection beams are depicted in blue and green, respectively. The mirrors (M1 and M2) are used to align the dual-axis beams such that they intersect at the back focal plane of the custom objective, which relays the beams from the back focal plane (at the left side of the objective) to the front focal plane in tissue (right side) with 3× magnification. The focusing angle of the beams in tissue, α, and crossing angle, θ, enable high-contrast optical sectioning with micron-scale resolution (see text). The lower right inset shows a cross-sectional view of the lens cap. (b) Illumination and collection optics within the main body. (c) A design rendering of the precision-machined main body, within which the MEMS scanner, alignment mirrors (M1 and M2), and other optical components are mounted. (d) A cross-sectional view of the distal end of the objective with a lens cap installed. When the pressure of the lens cap against the tissue is adjusted, the tissue curves slightly into the hole at the tip of the lens cap, which changes the depth of the focal plane with respect to the tissue surface. A sterile but flexible plastic sheath forms a seal around the lens cap. (e) A 3-D rendering of the fully packaged device.

JBO_24_3_030501_f001.png

The imaging system is controlled by a LabVIEW program that runs on a standard PC [shown in Fig. 2(a)]. The MEMS controller amplifies voltage signals from a USB port on the PC to scan the MEMS mirror (triangular waveform). An field-programmable gate array (FPGA) based frame grabber (NI PCIe-1473R) collects video data from the Basler detector and stitches the lines to form 2-D images. When the LabVIEW program is started, the initial data acquisition is triggered by the next available horizontal synchronization (HSYNC) signal from the detector, and the scanning of the MEMS mirror is triggered through software. Since these two tasks are triggered by two unsynchronized trigger sources, a MATLAB script is embedded in the LabVIEW program to provide software-based synchronization to prevent image drifting.

The image of a reflective 1951 USAF resolution test chart, shown in Fig. 3(a), shows the ability of the microscope to resolve features at the micron scale. Figures 3(b) and 3(c) show the plots of the axial response to a flat mirror on a linear and log scale, respectively. The FWHM optical-sectioning thickness at the center of the field of view (FOV) is measured to be 1.72  μm. Figure 3(c) shows that the background signal in the axial-response plot, as the mirror is translated away from the focal plane, is 0.01% of the maximum signal from a mirror located at the focal plane. This is a significant improvement from our initial miniature device,17 which leads to improved contrast and imaging depth in tissues. Note that there is vignetting at the edges of the FOV due to slight field curvature introduced by the scanning MEMS mirror.

Fig. 2

(a) Diagram of electronic components and connections. A LabVIEW program controls the scanning of the MEMS mirror and acquires video signals from the detector for real-time display and data storage. A MEMS controller connected to the PC via a USB cable outputs amplified voltage signals to actuate the MEMS scanner. A FPGA-based frame grabber board in the PC collects video signals from the detector. (b) Timing diagram of the system.

JBO_24_3_030501_f002.png

Fig. 3

(a) Image of a reflective USAF target. The scale bar represents 50  μm. (b) Axial response to a flat mirror, plotted on a linear scale, showing an FWHM optical-sectioning thickness of 1.72  μm. (c) The same axial response, plotted on a log scale, shows >40  dB of dynamic range (10,000-fold attenuation in signal) as the mirror is translated away from the focal plane.

JBO_24_3_030501_f003.png

To demonstrate the ability of our device to acquire label-free reflectance images in vivo, we imaged human facial skin and oral mucosa from healthy volunteers at the Memorial Sloan-Kettering Cancer Center under IRB approval and patient consent. All images were acquired in real time at a frame rate of 15 frames/s. For direct comparison to imaging with point scanning, we also imaged with a handheld point-scanned single-axis confocal (PS-SAC) microscope, the VivaScope 3000 (Caliber I.D. Inc., Andover, Massachusetts), which has a frame rate of 7 frames/s. Figures 4(a) and 4(e) show photographs of the two devices as a size comparison. Figures 4(b) and 4(c) show the distinct morphological features in the facial skin, such as the stratum spinosum (red arrow) around a hair follicle (green arrow) in Fig. 4(b) and the epidermis (red arrow) and dermal papillae (green arrow) at the dermal–epidermal junction in Fig. 4(c). Supplemental videos demonstrate the ability to manually adjust the lateral position and imaging depth of the handheld device smoothly in real time (see Videos 1 and 2). Figure 4(d) shows distinct hyperreflective nuclei (red arrow) in the squamous cells of the labial mucosa (see Video 3). Figures 4(f)4(h) show reflectance images of similar features obtained at the same skin and oral mucosa sites with the PS-SAC microscope. Visual comparison shows that optical sectioning and resolution are preserved for the LS-DAC approach and are comparable to that of PS-SAC approach down to the basal cell layer (50- to 150-μm depth), which confirms our earlier modeling and experimental measurements.12,13,16

Fig. 4

(a) Photograph of the handheld LS-DAC microscope. (b) Human facial skin image (stratum spinosum around a hair follicle). Scale bar: 100  μm [Video 1, mov, 14.3 MB (URL: https://doi.org/10.1117/1.JBO.24.3.030501.1)]. (c) Human facial skin image (stratum basalis and dermal–epidermal junction). Scale bar: 100  μm [Video 2, mov, 11.7 MB (URL: https://doi.org/10.1117/1.JBO.24.3.030501.2)]. (d) Image of human oral mucosa (oral epithelial nuclei). Scale bar: 100  μm [Video 3, mov, 4.8 MB (URL: https://doi.org/10.1117/1.JBO.24.3.030501.3)]. (e) Photograph of a handheld PS-SAC microscope (VivaScope 3000). (f)–(h) Label-free images of corresponding tissues collected by the PS-SAC microscope.

JBO_24_3_030501_f004.png

Compared to the images collected by the PS-SAC (VivaScope 3000) device, speckle noise is more apparent in the images collected by the handheld LS-DAC microscope. This is, in part, due to a narrower confocal slit, which preserves resolution and thin sectioning, but at the trade-off of higher speckle contrast.18 Future devices can mitigate speckle noise, if desired, by increasing the physical slit width and/or altering the magnification of the collection optics, with the attendant trade-offs described in the literature.18 The utilization of an incoherent light source (if bright enough) can also suppress speckle noise, but with some trade-offs in resolution.19

As described in previous publications, the SBR of a point-scanned confocal architecture is superior to a line-scanned architecture due to loss of confocality along the focal line of a line-scanned device.12,13,15 However, the dual-axis configuration acts to mitigate this deterioration in SBR, somewhat, because of the fact that the illumination and collection beams are spatially separated, except where they intersect at their respective foci.12,13 This is seen in the image comparisons between the LS-DAC device and the PS-SAC VivaScope device, in which the PS-SAC device exhibits slightly improved contrast (SBR) at deeper depths, such as at the dermal–epidermal junction in Figs. 4(c) and 4(g). Since the LS-SAC device is smaller than the VivaScope device, diffraction noise (sidelobes) from lens apertures may be more severe and could be an additional source of minor degradations in contrast (SBR). This is a consequence of the fact that large beam diameters are desired to achieve relatively large NAs (high resolution) with a long working distance but are severely constrained in a miniature system, in which all optical components (including lens apertures) are necessarily small. However, at shallow depths, image quality is comparable between the LS-DAC and PS-SAC approaches, as expected and as previously shown with tabletop systems.16

In summary, we have developed a fully packaged handheld LS-DAC microscope, with pressure-sensitive depth control (via a lens cap design), which is the first device of its kind to be used for in vivo imaging of human skin and oral mucosa. Compared to previous miniature PS-DAC microscopes (4 frames/s), this handheld LS-DAC microscope has a much higher frame rate (15 frames/s), with reduced motion artifacts, and improved axial and lateral resolution (FWHM of 1.7 and 1.1  μm, respectively).20,21 As mentioned previously, maximizing the frame rate of a handheld device is critical for minimizing motion artifacts during handheld use and also for enabling effective video mosaicking.22 Note that for the reflectance-based LS-DAC device developed here, the imaging speed is limited not by signal-to-noise ratio (low photon counts) but rather by the limited readout rate of the detector used in the device. In the future, higher imaging speeds of >30  frames/s should be possible with higher-speed linear array detectors.

Ultimately, the LS-DAC design architecture has allowed us to develop a system with a miniature form factor that is conducive for clinical use to image skin and oral mucosa, and potentially other exposed tissues, such as during surgical resection procedures. The benefits in terms of imaging speed, while coming at the cost of a slight reduction in contrast, make the LS-DAC approach an attractive design choice. In the future, we plan to implement real-time mosaicking algorithms to provide users with instant feedback to comprehensively image a larger area of interest (e.g., a suspicious oral lesion) while avoiding redundant imaging of certain regions. Large clinical studies are also needed to assess the sensitivity and specificity of our device for detecting various malignancies.

Disclosures

Dr. Milind Rajadhyaksha is a former employee of and owns equity in Caliber ID (formerly, Lucid Inc.), the company that manufactures and sells the VivaScope confocal microscope.

Acknowledgments

The authors acknowledge funding support from the National Institutes of Health, including grants from the National Institute of Dental and Craniofacial Research (No. R01DE023497) and the National Cancer Institute (Nos. R01CA175391 and R01CA201399). Partial support was also provided by the Memorial Sloan-Kettering Cancer Center Core Grant (No. P30CA008748).

References

1. 

A. A. Tanbakuchi et al., “Clinical confocal microlaparoscope for real-time in vivo optical biopsies,” J. Biomed. Opt., 14 (4), 044030 (2009). https://doi.org/10.1117/1.3207139 JBOPFO 1083-3668 Google Scholar

2. 

K. Carlson et al., “In vivo fiber-optic confocal reflectance microscope with an injection-molded plastic miniature objective lens,” Appl. Opt., 44 (10), 1792 –1797 (2005). https://doi.org/10.1364/AO.44.001792 APOPAI 0003-6935 Google Scholar

3. 

R. Kiesslich et al., “Confocal laser endoscopy for diagnosing intraepithelial neoplasias and colorectal cancer in vivo,” Gastroenterology, 127 (3), 706 –713 (2004). https://doi.org/10.1053/j.gastro.2004.06.050 GASTAB 0016-5085 Google Scholar

4. 

T. D. Wang et al., “Functional imaging of colonic mucosa with a fibered confocal microscope for real-time in vivo pathology,” Clin. Gastroenterol. Hepatol., 5 (11), 1300 –1305 (2007). https://doi.org/10.1016/j.cgh.2007.07.013 Google Scholar

5. 

E. E. Freeman et al., “Smartphone confocal microscopy for imaging cellular structures in human skin in vivo,” Biomed. Opt. Express, 9 (4), 1906 –1915 (2018). https://doi.org/10.1364/BOE.9.001906 BOEICL 2156-7085 Google Scholar

6. 

X. Li et al., “Imaging needle for optical coherence tomography,” Opt. Lett., 25 (20), 1520 –1522 (2000). https://doi.org/10.1364/OL.25.001520 OPLEDP 0146-9592 Google Scholar

7. 

C. Olsovsky et al., “Handheld tunable focus confocal microscope utilizing a double-clad fiber coupler for in vivo imaging of oral epithelium,” J. Biomed. Opt., 22 (5), 056008 (2017). https://doi.org/10.1117/1.JBO.22.5.056008 JBOPFO 1083-3668 Google Scholar

8. 

K. Kumar et al., “Handheld histology-equivalent sectioning laser-scanning confocal optical microscope for interventional imaging,” Biomed. Microdevices, 12 (2), 223 –233 (2010). https://doi.org/10.1007/s10544-009-9377-6 Google Scholar

9. 

C. L. Hoy et al., “Miniaturized probe for femtosecond laser microsurgery and two-photon imaging,” Opt. Express, 16 (13), 9996 –10005 (2008). https://doi.org/10.1364/OE.16.009996 OPEXFF 1094-4087 Google Scholar

10. 

M. T. Myaing, D. J. MacDonald and X. Li, “Fiber-optic scanning two-photon fluorescence endoscope,” Opt. Lett., 31 (8), 1076 –1078 (2006). https://doi.org/10.1364/OL.31.001076 OPLEDP 0146-9592 Google Scholar

11. 

M. Minsky, “Memoir on inventing the confocal scanning microscope,” Scanning, 10 (4), 128 –138 (1988). https://doi.org/10.1002/sca.v10:4 SCNNDF 0161-0457 Google Scholar

12. 

L. Wei, C. Yin and J. T. Liu, “Dual-axis confocal microscopy for point-of-care pathology,” IEEE J. Sel. Top. Quantum Electron., 25 (1), 1 –10 (2019). https://doi.org/10.1109/JSTQE.2018.2854572 IJSQEN 1077-260X Google Scholar

13. 

Y. Chen, D. Wang and J. T. Liu, “Assessing the tissue-imaging performance of confocal microscope architectures via Monte Carlo simulations,” Opt. Lett., 37 (21), 4495 –4497 (2012). https://doi.org/10.1364/OL.37.004495 OPLEDP 0146-9592 Google Scholar

14. 

Y. Chen and J. T. Liu, “Optimizing the performance of dual-axis confocal microscopes via Monte-Carlo scattering simulations and diffraction theory,” J. Biomed. Opt., 18 (6), 066006 (2013). https://doi.org/10.1117/1.JBO.18.6.066006 JBOPFO 1083-3668 Google Scholar

15. 

A. K. Glaser, Y. Wang and J. T. Liu, “Assessing the imaging performance of light sheet microscopies in highly scattering tissues,” Biomed. Opt. Express, 7 454 –466 (2016). https://doi.org/10.1364/BOE.7.000454 Google Scholar

16. 

D. Wang et al., “Comparison of line-scanned and point-scanned dual-axis confocal microscope performance,” Opt. Lett., 38 (24), 5280 –5283 (2013). https://doi.org/10.1364/OL.38.005280 OPLEDP 0146-9592 Google Scholar

17. 

C. Yin et al., “Miniature in vivo MEMS-based line-scanned dual-axis confocal microscope for point-of-care pathology,” Biomed. Opt. Express, 7 (2), 251 –263 (2016). https://doi.org/10.1364/BOE.7.000251 BOEICL 2156-7085 Google Scholar

18. 

C. Glazowski and M. Rajadhyaksha, “Optimal detection pinhole for lowering speckle noise while maintaining adequate optical sectioning in confocal reflectance microscopes,” J. Biomed. Opt., 17 (8), 085001 (2012). https://doi.org/10.1117/1.JBO.17.8.085001 JBOPFO 1083-3668 Google Scholar

19. 

A. Vakili et al., “High brightness LED in confocal microscopy,” Proc. SPIE, 9330 933006 (2015). https://doi.org/10.1117/12.2078191 PSISDG 0277-786X Google Scholar

20. 

S. Y. Leigh and J. T. Liu, “Multi-color miniature dual-axis confocal microscope for point-of-care pathology,” Opt. Lett., 37 (12), 2430 –2432 (2012). https://doi.org/10.1364/OL.37.002430 OPLEDP 0146-9592 Google Scholar

21. 

W. Piyawattanametha et al., “In vivo near-infrared dual-axis confocal microendoscopy in the human lower gastrointestinal tract,” J. Biomed. Opt., 17 (2), 021102 (2012). https://doi.org/10.1117/1.JBO.17.2.021102 JBOPFO 1083-3668 Google Scholar

22. 

K. Kose et al., “Automated video-mosaicking approach for confocal microscopic imaging in vivo: an approach to address challenges in imaging living tissue and extend field of view,” Sci. Rep., 7 (1), 10759 (2017). https://doi.org/10.1038/s41598-017-11072-9 SRCEC3 2045-2322 Google Scholar
CC BY: © The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.
Chengbo Yin, Linpeng Wei, Sanjee Abeytunge, Gary Peterson, Milind Rajadhyaksha, and Jonathan T. C. Liu "Label-free in vivo pathology of human epithelia with a high-speed handheld dual-axis confocal microscope," Journal of Biomedical Optics 24(3), 030501 (27 March 2019). https://doi.org/10.1117/1.JBO.24.3.030501
Received: 21 November 2018; Accepted: 13 March 2019; Published: 27 March 2019
Lens.org Logo
CITATIONS
Cited by 8 scholarly publications.
Advertisement
Advertisement
KEYWORDS
Microscopes

Confocal microscopy

Tissues

Mirrors

Tissue optics

In vivo imaging

Microelectromechanical systems

Back to Top