Open Access
24 July 2023 Accelerated hyperspectral imaging via temporal compressive sensing
Author Affiliations +
Abstract

The article comments on a new approach to information acquisition in hyperspectral imaging.

Hyperspectral imaging (HSI), with the unique capability to discriminate various components by spatiospectral resolvability, is a powerful tool for observation and inspection, which has been applied in numerous fields, ranging from remote sensing,1 archaeology,2 food safety,3 and forensic medicine,4 to pharmaceutical research5 and clinical diagnosis.6 To acquire three-dimensional (3D) information I(x,y,λ) with two-dimensional spatial and spectral dimensions, various HSI strategies have been proposed,7 including point-scanning, wavelength-scanning, filtering-based, and snapshot methods. However, due to the lack of sensitive image sensors in the infrared region, the latter three strategies are difficult to work for HSI of infrared scenes with low signal-to-noise ratio. Moreover, for the detection of nonlinear signals, for example, with stimulated Raman scattering (SRS) and coherent anti-Stokes Raman scattering (CARS), high optical intensity is required to excite the sample, but wide-field strategies can barely provide uniform excitation and sufficient excitation power. Therefore, the point-scanning strategy is preferred for HSI of nonlinear scenes. Nevertheless, the imaging speed of point-scanning HSI is seriously limited, due to the large amounts of spatiospectral data and a single detector. The speed limitation hampers further applications of nonlinear HSI, especially for in vivo biomedical imaging.

As reported recently in Advanced Photonics Nexus, a group led by Kotaro Hiramatsu from University of Tokyo proposed a framework to improve the spectral image acquisition rate of HSI by integrating time-domain HSI and compressed sensing.8 Instead of measuring the spatiospectral information I(x,y,λ) directly, they choose to record the spatiotemporal information I(x,y,τ) with sparse sampling and then recover the corresponding spatiospectral information by solving an ill-posed inverse problem, as shown in Fig. 1. To verify the feasibility of the framework, a compressive sensing-based Fourier-transform CARS imaging system is designed to acquire the 3D information of the sample, where molecular vibrations are coherently excited by a pump pulse and interrogated by a time-delayed probe pulse.9 The pump–probe pulse pairs are generated by a Michaelson interferometer, where the optical path length of one of the arms is modulated by a resonant scanner. The incident beams are spatially scanned by the two galvanometric scanners for interrogating different spatial points of the sample. With all these designs, the time-domain interferograms are sampled sparsely by utilizing 3D Lissajous scanning with triangular and sinusoidal functions to boost the hyperspectral image acquisition rate, respectively.10 The hyperspectral images are then reconstructed by solving the inverse problem regularized with spatiospectral total variation. Hyperspectral image acquisition at a rate of 25 frames per second with a resolution of 100  pixels×100  pixels under experimentally feasible conditions was demonstrated, which is 10 times higher than that of the previous record.

Fig. 1

Schematic of hyperspectral imaging by compressive sensing in the temporal domain. Black arrow indicates the reconstruction from sparsely sampled spatiotemporal data to hyperspectral images.

AP_5_4_040502_f001.png

Exploiting the mapping between the temporal and spectral information by Fourier transform, sparse sampling in the temporal domain can be utilized to extract the corresponding spectral signal. By incorporating compressive sensing in temporal domain into hyperspectral imaging, an accelerated hyperspectral imaging framework is achieved. Hyperspectral images with high fidelity can be recovered by a posterior reconstruction algorithm with the spatiospectral total variation priors. This work provides a new perspective for information acquisition in hyperspectral imaging, and offers a feasible strategy to greatly accelerate 3D signal acquisition. The proposed method can also be further extended to other time-domain HSI methods, such as Fourier transform infrared and Fourier transform two-photon imaging. What’s more, 4D information acquisition I(x,y,λ,τ) energized by compressive sensing can be expected in the future, based on this work.

References

1. 

B. Lu et al., “Recent advances of hyperspectral imaging technology and applications in agriculture,” Remote Sens., 12 (16), 2659 https://doi.org/10.3390/rs12162659 (2020). Google Scholar

2. 

H. Liang, “Advances in multispectral and hyperspectral imaging for archaeology and art conservation,” Appl. Phys. A., 106 (2), 309 –323 https://doi.org/10.1007/s00339-011-6689-1 (2012). Google Scholar

3. 

Y. Feng and D. Sun, “Application of hyperspectral imaging in food safety inspection and control: a review,” Crit. Rev. Food Sci., 52 (11), 1039 –1058 https://doi.org/10.1080/10408398.2011.651542 CRFND6 0099-0248 (2012). Google Scholar

4. 

G. J. Edelman et al., “Hyperspectral imaging for non-contact analysis of forensic traces,” Forensic Sci. Int., 223 (1–3), 28 –39 https://doi.org/10.1016/j.forsciint.2012.09.012 FSINDR 0379-0738 (2012). Google Scholar

5. 

J. M. Amigo, “Practical issues of hyperspectral imaging analysis of solid dosage forms,” Anal. Bioanal. Chem., 398 (1), 93 –109 https://doi.org/10.1007/s00216-010-3828-z ABCNBP 1618-2642 (2010). Google Scholar

6. 

G. Lu and B. Fei, “Medical hyperspectral imaging: a review,” J. Biomed. Opt., 19 (1), 010901 https://doi.org/10.1117/1.JBO.19.1.010901 JBOPFO 1083-3668 (2014). Google Scholar

7. 

L. Gao and R. T. Smith, “Optical hyperspectral imaging in microscopy and spectroscopy–a review of data acquisition,” J. Biophotonics, 8 (6), 441 –456 https://doi.org/10.1002/jbio.201400051 (2015). Google Scholar

8. 

S. Takizawa et al., “High-speed hyperspectral imaging enabled by compressed sensing in time domain,” Adv. Photonics Nexus, 2 (2), 026008 https://doi.org/10.1117/1.APN.2.2.026008 (2023). Google Scholar

9. 

D. Fu et al., “Hyperspectral imaging with stimulated Raman scattering by chirped femtosecond lasers,” J. Phys. Chem. B, 117 (16), 4634 –4640 https://doi.org/10.1021/jp308938t JPCBFK 1520-6106 (2013). Google Scholar

10. 

H. Lin et al., “Spectroscopic stimulated Raman scattering imaging of highly dynamic specimens through matrix completion,” Light. Sci. Appl., 7 (5), 17179 https://doi.org/10.1038/lsa.2017.179 (2018). Google Scholar

Biography

Shian Zhang is an expert in ultrafast optical imaging. He is a professor and the deputy director of the State Key Laboratory of Precision Spectroscopy, East China Normal University (ECNU), China. He received his PhD in optics from ECNU in 2006. His current research interests focus on ultrafast optical imaging, multidimensional imaging, and high-speed super-resolution microscopy.

CC BY: © The Authors. Published by SPIE and CLP under a Creative Commons Attribution 4.0 International License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.
Shian Zhang "Accelerated hyperspectral imaging via temporal compressive sensing," Advanced Photonics 5(4), 040502 (24 July 2023). https://doi.org/10.1117/1.AP.5.4.040502
Published: 24 July 2023
Advertisement
Advertisement
KEYWORDS
Hyperspectral imaging

Compressed sensing

3D image processing

3D acquisition

Image acquisition

Signal detection

Infrared radiation

Back to Top