AlexNet Architecture Based Convolution Neural Network for Realtime Audio to Text Translator of Bisindo Hand Sign

Le résumé fourni par la source

Deafness is a condition that results in the loss of hearing function, hindering the reception of information such as oral communication that relies on auditory senses. Consequently, individuals with hearing impairment experience communication barriers and may have limited or no ability to respond. One solution is the use of sign language. In Indonesia, there are two known sign languages: Sibi and Bisindo. Both serve the same function but differ in their style of movement and expression. Bisindo is considered more flexible as it conveys meaning based on the Indonesian language. However, the universal understanding of this language solution is still limited among many people. Therefore, a program is needed to facilitate translation between deaf individuals who use sign language and their counterparts who do not communicate through sign language. CNN (Convolutional Neural Network) is a deep learning algorithm used for training visual input data recognition by computer systems. There are various CNN-based architectures, and one of them is AlexNet. Based on the author's testing, the AlexNet architecture proves to be suitable for real-time sign language translation. The evaluation of the system involved 7,800 datasets and 520 testing instances, with an average accuracy of 468 correct translations. When averaged, the system achieved a 90% accuracy rate, representing a 100% increase in accuracy compared to previous approaches.

Ce résumé expose les affirmations des auteurs. BNTIC ne l’interprète pas comme une validation indépendante des résultats.