Distributed Radar Imaging with Parallel Cross-Attention for Continuous Human Motion Recognition

Résumé fourni par la source

Radar imaging provides non-contact, privacy-preserving, and environmentally robust monitoring for continuous human motion recognition (HMR) by leveraging diverse information embedded in various radar signal domains. However, current research has not effectively integrated multi-radar and multi-domain imaging to fully exploit the benefits of distributed radar systems. To bridge this gap, we propose a multi-radar, multi-domain parallel cross-attention model with four key components: intra-domain cross-radar weight sharing encoders specific to each domain for consistent feature extraction and parameter reduction, domain-level parallel cross-attention (DLPCAN) modules to fuse domain-specific features and enhance feature representation robustness in each radar, a source-level attention fusion (SLAF) module to highlight significant features from multiple radar inputs, and two bi-directional gated recurrent unit (BiGRU) modules to capture temporal information. The model is trained using connectionist temporal classification (CTC) loss for effective sequence prediction. By integrating data from multiple radar nodes and domains, our approach significantly improves continuous HMR performance compared to single radar systems and single domain data. Comparative evaluations demonstrate that our model outperforms state-of-the-art radar imaging-based HMR solutions.

Ce résumé expose les affirmations des auteurs. BNTIC ne l’interprète pas comme une validation indépendante des résultats.