Enhancing Pitch Perception and Melodic Reproduction of Hard-of-Hearing Individuals Using a Vibrotactile Glove.
Saved in:
| Title: | Enhancing Pitch Perception and Melodic Reproduction of Hard-of-Hearing Individuals Using a Vibrotactile Glove. |
|---|---|
| Authors: | Shin, Sungyong1,2 (AUTHOR), Baek, Sunwoo2 (AUTHOR), Park, Sohyun2 (AUTHOR), Yi, Hyeonbeom1 (AUTHOR), Shin, Hyungcheol1 (AUTHOR), Lee, Woohun2 (AUTHOR) woohun.lee@kaist.ac.kr |
| Source: | International Journal of Human-Computer Interaction. Oct2025, Vol. 41 Issue 19, p12032-12049. 18p. |
| Subjects: | Hard of hearing people, Vibrotactile stimulation, User experience, Audio frequency, Absolute pitch, Hearing disorders, Singing, Treatment programs |
| Abstract: | The perception of pitch and engagement in melodic singing significantly contribute to the appreciation and comprehension of music. Notably, for hard-of-hearing individuals, perceiving pitch and singing play crucial roles as effective aids in auditory rehabilitation. However, the limited perception of pitch, stemming from the constraints of hearing devices, poses challenges in the learning process of recognizing and vocalizing melodies. In this study, we developed a wearable vibrotactile glove, TTS+, designed to convert musical tones into the corresponding vibrotactile patterns, complemented by an associated training application. After ten training sessions with our system, the participants exhibited notable improvements in pitch perception and the capacity to reproduce melodies through singing compared with their pre-test baseline without vibrotactile feedback. Beyond quantitative outcomes, findings from user experiences obtained through user feedback during training and post-test interviews offer valuable perspectives and constraints for our study, which may be further investigated in future studies. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | The perception of pitch and engagement in melodic singing significantly contribute to the appreciation and comprehension of music. Notably, for hard-of-hearing individuals, perceiving pitch and singing play crucial roles as effective aids in auditory rehabilitation. However, the limited perception of pitch, stemming from the constraints of hearing devices, poses challenges in the learning process of recognizing and vocalizing melodies. In this study, we developed a wearable vibrotactile glove, TTS+, designed to convert musical tones into the corresponding vibrotactile patterns, complemented by an associated training application. After ten training sessions with our system, the participants exhibited notable improvements in pitch perception and the capacity to reproduce melodies through singing compared with their pre-test baseline without vibrotactile feedback. Beyond quantitative outcomes, findings from user experiences obtained through user feedback during training and post-test interviews offer valuable perspectives and constraints for our study, which may be further investigated in future studies. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 10447318 |
| DOI: | 10.1080/10447318.2025.2452192 |
