DEAF-Net: Dual-Domain Enhanced Adaptive Fusion Network for UAV Visible–Infrared Object Detection

Le résumé fourni par la source

In Unmanned Aerial Vehicle (UAV) object detection tasks, complex lighting conditions and variable weather render robust all-weather perception challenging when relying solely on the visible modality. Although infrared modalities can provide complementary information, the reliability of individual modalities is highly scene-dependent. Existing multimodal detection methods typically adopt static fusion strategies, which ignore spatial heterogeneity of modal reliability and under-explore spatial-frequency collaborative representation, thus limiting detection robustness in dynamic environments. To address these issues, this paper proposes a Dual-domain Enhanced Adaptive Fusion Network (DEAF-Net), with two core innovative modules to tackle the above challenges. First, the Dual Domain Progressive Refinement (DDPR) module mitigates feature degradation caused by poor imaging conditions via the joint design of frequency-domain learnable filtering and scale-aware contextual refinement in the spatial domain, effectively suppressing noise, enhancing textures, and yielding a purified feature basis for fusion. Second, the Consistency–Discrepancy Guided Fusion (CDGF) strategy leverages the selective scanning mechanism of VMamba to model consistent and differential patterns across modalities, dynamically generates local modal contribution maps for adaptive fusion, and integrates global scene prior via entropy weights for calibration. Extensive experiments on the DroneVehicle and VEDAI datasets show that DEAF-Net outperforms mainstream multimodal detection methods, achieving mAP@0.5 scores of 81.9% and 76.2%, respectively, while delivering improved robustness in low-light, dense fog, and sparse-category scenarios.

Ce résumé expose les affirmations des auteurs. BNTIC ne l’interprète pas comme une validation indépendante des résultats.