Real-time sign language recognition using parallel multi-scale CNN to enhance inclusive education for deaf and hard of hearing students.
Saved in:
| Title: | Real-time sign language recognition using parallel multi-scale CNN to enhance inclusive education for deaf and hard of hearing students. |
|---|---|
| Authors: | El-Marzouki, Naoufal1 (AUTHOR) naoufal_elmarzouki@um5.ac.ma, Lasri, Imane1 (AUTHOR) imane_lasri@um5.ac.ma, Riadsolh, Anouar1 (AUTHOR) a.riadsolh@um5r.ac.ma, Elbelkacemi, Mourad1 (AUTHOR) mourad_prof@yahoo.fr |
| Source: | Multimedia Tools & Applications. Sep2025, Vol. 84 Issue 31, p38741-38760. 20p. |
| Subjects: | Sign language, Deaf students, Machine learning, Convolutional neural networks, Higher education, Inclusive education, Real-time computing |
| Abstract: | Inclusive education, a fundamental right for all individuals, presents unique challenges in higher education, particularly when it comes to students with disabilities. Our research focuses on rectifying the gaps in catering to the needs of deaf university students by introducing real-time sign language recognition through a parallel multi-scale CNN. We conducted model testing with five different optimizers, including Adam, Nadam, Adadelta, RMSprop, and Stochastic Gradient Descent (SGD). Notably, the best test accuracy of 99.70% was achieved using SGD on the Sign MNIST dataset, which comprises 7200 images categorized into 24 alphabet classes (excluding 'J' and 'Z'). The parallel multi-scale CNN outperformed the conventional CNN model, which achieved an accuracy of 96%. Our approach outperformed other state-of-the-art methods, demonstrating superior performance based on accuracy, precision, recall, and F1-score. The model was tested in real-time scenarios with Moroccan deaf students pursuing degrees in electronics, computer science, and robotics at Mohammed V University in Rabat. This testing underscores the model's adaptability and its potential to improve inclusivity in higher education. [ABSTRACT FROM AUTHOR] |
| Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 188021239 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Real-time sign language recognition using parallel multi-scale CNN to enhance inclusive education for deaf and hard of hearing students. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22El-Marzouki%2C+Naoufal%22">El-Marzouki, Naoufal</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> naoufal_elmarzouki@um5.ac.ma</i><br /><searchLink fieldCode="AR" term="%22Lasri%2C+Imane%22">Lasri, Imane</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> imane_lasri@um5.ac.ma</i><br /><searchLink fieldCode="AR" term="%22Riadsolh%2C+Anouar%22">Riadsolh, Anouar</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> a.riadsolh@um5r.ac.ma</i><br /><searchLink fieldCode="AR" term="%22Elbelkacemi%2C+Mourad%22">Elbelkacemi, Mourad</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> mourad_prof@yahoo.fr</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Multimedia+Tools+%26+Applications%22">Multimedia Tools & Applications</searchLink>. Sep2025, Vol. 84 Issue 31, p38741-38760. 20p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Sign+language%22">Sign language</searchLink><br /><searchLink fieldCode="DE" term="%22Deaf+students%22">Deaf students</searchLink><br /><searchLink fieldCode="DE" term="%22Machine+learning%22">Machine learning</searchLink><br /><searchLink fieldCode="DE" term="%22Convolutional+neural+networks%22">Convolutional neural networks</searchLink><br /><searchLink fieldCode="DE" term="%22Higher+education%22">Higher education</searchLink><br /><searchLink fieldCode="DE" term="%22Inclusive+education%22">Inclusive education</searchLink><br /><searchLink fieldCode="DE" term="%22Real-time+computing%22">Real-time computing</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Inclusive education, a fundamental right for all individuals, presents unique challenges in higher education, particularly when it comes to students with disabilities. Our research focuses on rectifying the gaps in catering to the needs of deaf university students by introducing real-time sign language recognition through a parallel multi-scale CNN. We conducted model testing with five different optimizers, including Adam, Nadam, Adadelta, RMSprop, and Stochastic Gradient Descent (SGD). Notably, the best test accuracy of 99.70% was achieved using SGD on the Sign MNIST dataset, which comprises 7200 images categorized into 24 alphabet classes (excluding 'J' and 'Z'). The parallel multi-scale CNN outperformed the conventional CNN model, which achieved an accuracy of 96%. Our approach outperformed other state-of-the-art methods, demonstrating superior performance based on accuracy, precision, recall, and F1-score. The model was tested in real-time scenarios with Moroccan deaf students pursuing degrees in electronics, computer science, and robotics at Mohammed V University in Rabat. This testing underscores the model's adaptability and its potential to improve inclusivity in higher education. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=188021239 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/s11042-025-20692-7 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 20 StartPage: 38741 Subjects: – SubjectFull: Sign language Type: general – SubjectFull: Deaf students Type: general – SubjectFull: Machine learning Type: general – SubjectFull: Convolutional neural networks Type: general – SubjectFull: Higher education Type: general – SubjectFull: Inclusive education Type: general – SubjectFull: Real-time computing Type: general Titles: – TitleFull: Real-time sign language recognition using parallel multi-scale CNN to enhance inclusive education for deaf and hard of hearing students. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: El-Marzouki, Naoufal – PersonEntity: Name: NameFull: Lasri, Imane – PersonEntity: Name: NameFull: Riadsolh, Anouar – PersonEntity: Name: NameFull: Elbelkacemi, Mourad IsPartOfRelationships: – BibEntity: Dates: – D: 25 M: 09 Text: Sep2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 13807501 Numbering: – Type: volume Value: 84 – Type: issue Value: 31 Titles: – TitleFull: Multimedia Tools & Applications Type: main |
| ResultId | 1 |
