16 December 2024 Cross-modal pedestrian re-identification based on feature fusion and spatial information adaptation
Qian Zhao, Zhengzhe Qian
Author Affiliations +
Abstract

Visible-infrared person re-identification, which combines visible light and thermal imaging data, provides more comprehensive and accurate monitoring capabilities under various environmental conditions. However, the differences between image modalities pose significant challenges in this field. Existing methods often focus on learning and analyzing the differences and consistencies between the semantics of different modalities, without considering the variability of background information and the considerable impact of surrounding noise on learning effectiveness. In view of this, we propose a novel multimodal pedestrian re-identification model, namely the feature fusion and spatial information adaptive network (FSIANet). Specifically, we designed an enhanced multi-feature aggregation module, which comprehensively mines semantic features from multiple scales while fusing shallow and deep features to explore feature representations from different channels and spaces. Furthermore, we also designed a spatially informed adaptive module, which simulates people’s attention to regions of interest during filming and can adaptively identify and focus on areas with dense information distribution, effectively reducing the interference of surrounding noise and irrelevant information. The superiority of our proposed FSIANet has been demonstrated through extensive experimentation on the SYSU-MM01 and RegDB datasets, compared with several other state-of-the-art methods.

© 2024 SPIE and IS&T
Qian Zhao and Zhengzhe Qian "Cross-modal pedestrian re-identification based on feature fusion and spatial information adaptation," Journal of Electronic Imaging 33(6), 063048 (16 December 2024). https://doi.org/10.1117/1.JEI.33.6.063048
Received: 12 September 2024; Accepted: 3 December 2024; Published: 16 December 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Feature fusion

Visible radiation

Infrared imaging

Infrared radiation

Image fusion

Semantics

Feature extraction

Back to Top