A Graph Convolutional Network for Action Recognition in Occluded Skeleton Data

Le résumé fourni par la source

Skeleton-based human action recognition has achieved significant progress, but local occlusions and missing joints in complex environments (e.g., occlusion and low-light conditions) still degrade recognition accuracy and stability. Existing GCN-based methods aggregate features uniformly across joints and lack mechanisms to suppress unreliable observations or recover structural semantics under large-area occlusion. To address this, we propose a Robust Occlusion-Compensated Graph Convolutional Network (ROC-GCN) with two complementary components: an adaptive dropout module that suppresses spatiotemporal noise via attention-guided Bernoulli sampling with dynamic spatial–temporal fusion, and an Occlusion Compensation Graph Convolution Module that compensates occluded features through Local–Global Body-Prior-Guided Attention together with feature-guided and multi-hop aggregation. To enable systematic evaluation, we further construct two complementary occlusion benchmarks on NTU RGB+D 60/120 covering spatial-random and spatiotemporal-continuous occlusion, and additionally validate the model on a real-world missing-joint subset. On standard NTU60/120 X-Sub, ROC-GCN improves Top-1 accuracy by +0.41% and +0.48% over the baseline, with the Top-1 standard deviation reduced from 0.61 → 0.17 and 0.47 → 0.10. On the occlusion benchmarks, Top-1 accuracy further improves by +0.98% and +0.73%, and consistent gains are also observed on the real-world missing-joint validation, confirming improved robustness and training stability.

Ce résumé expose les affirmations des auteurs. BNTIC ne l’interprète pas comme une validation indépendante des résultats.