Dendritic Wave Recurrent Neural Networks

Résumé fourni par la source

Abstract Wave recurrent neural networks (wRNNs) are biologically inspired recurrent architectures that use traveling-wave dynamics to support sequence learning and memory. However, their input-to-hidden pathway remains relatively simple compared with biological neurons, where dendrites perform nonlinear input integration. In this study, we introduce the Dendritic Wave Recurrent Neural Network (DW-RNN), which augments the input pathway of the wRNN with nonlinear basal dendritic branches while preserving the original recurrent wave dynamics. We evaluate DW-RNN on a simple copy task, sequential MNIST (sMNIST), permuted sequential MNIST (psMNIST), and noisy sequential CIFAR-10 (nsCIFAR-10). On the copy task, DW-RNN shows learning behavior comparable to the standard wRNN, suggesting that dendritic input integration does not disrupt the recurrent wave-based memory mechanism. On the three sequential image-classification benchmarks, DW-RNN outperforms the standard wRNN, improving accuracy from 97.27 ± 0.15% to 97.82 ± 0.12% on sMNIST, from 96.74 ± 0.17% to 96.92 ± 0.10% on psMNIST, and from 54.30 ± 0.79% to 55.65 ± 0.55% on nsCIFAR-10. In addition to improving mean accuracy, DW-RNN exhibits lower across-seed variability on all three classification benchmarks, suggesting that dendritic input integration may improve the stability of wRNN training. Hidden-activity visualizations further show that DW-RNN preserves the characteristic traveling-wave patterns of the original wRNN. These results suggest that dendritic computation and traveling-wave recurrent dynamics provide complementary mechanisms for biologically inspired sequence learning.

Ce résumé expose les affirmations des auteurs. BNTIC ne l’interprète pas comme une validation indépendante des résultats.