Enhancing Pitch Perception and Melodic Reproduction of Hard-of-Hearing Individuals Using a Vibrotactile Glove.
Saved in:
| Title: | Enhancing Pitch Perception and Melodic Reproduction of Hard-of-Hearing Individuals Using a Vibrotactile Glove. |
|---|---|
| Authors: | Shin, Sungyong1,2 (AUTHOR), Baek, Sunwoo2 (AUTHOR), Park, Sohyun2 (AUTHOR), Yi, Hyeonbeom1 (AUTHOR), Shin, Hyungcheol1 (AUTHOR), Lee, Woohun2 (AUTHOR) woohun.lee@kaist.ac.kr |
| Source: | International Journal of Human-Computer Interaction. Oct2025, Vol. 41 Issue 19, p12032-12049. 18p. |
| Subjects: | Hard of hearing people, Vibrotactile stimulation, User experience, Audio frequency, Absolute pitch, Hearing disorders, Singing, Treatment programs |
| Abstract: | The perception of pitch and engagement in melodic singing significantly contribute to the appreciation and comprehension of music. Notably, for hard-of-hearing individuals, perceiving pitch and singing play crucial roles as effective aids in auditory rehabilitation. However, the limited perception of pitch, stemming from the constraints of hearing devices, poses challenges in the learning process of recognizing and vocalizing melodies. In this study, we developed a wearable vibrotactile glove, TTS+, designed to convert musical tones into the corresponding vibrotactile patterns, complemented by an associated training application. After ten training sessions with our system, the participants exhibited notable improvements in pitch perception and the capacity to reproduce melodies through singing compared with their pre-test baseline without vibrotactile feedback. Beyond quantitative outcomes, findings from user experiences obtained through user feedback during training and post-test interviews offer valuable perspectives and constraints for our study, which may be further investigated in future studies. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 188157064 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Enhancing Pitch Perception and Melodic Reproduction of Hard-of-Hearing Individuals Using a Vibrotactile Glove. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Shin%2C+Sungyong%22">Shin, Sungyong</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Baek%2C+Sunwoo%22">Baek, Sunwoo</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Park%2C+Sohyun%22">Park, Sohyun</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Yi%2C+Hyeonbeom%22">Yi, Hyeonbeom</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Shin%2C+Hyungcheol%22">Shin, Hyungcheol</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Lee%2C+Woohun%22">Lee, Woohun</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> woohun.lee@kaist.ac.kr</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Human-Computer+Interaction%22">International Journal of Human-Computer Interaction</searchLink>. Oct2025, Vol. 41 Issue 19, p12032-12049. 18p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Hard+of+hearing+people%22">Hard of hearing people</searchLink><br /><searchLink fieldCode="DE" term="%22Vibrotactile+stimulation%22">Vibrotactile stimulation</searchLink><br /><searchLink fieldCode="DE" term="%22User+experience%22">User experience</searchLink><br /><searchLink fieldCode="DE" term="%22Audio+frequency%22">Audio frequency</searchLink><br /><searchLink fieldCode="DE" term="%22Absolute+pitch%22">Absolute pitch</searchLink><br /><searchLink fieldCode="DE" term="%22Hearing+disorders%22">Hearing disorders</searchLink><br /><searchLink fieldCode="DE" term="%22Singing%22">Singing</searchLink><br /><searchLink fieldCode="DE" term="%22Treatment+programs%22">Treatment programs</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: The perception of pitch and engagement in melodic singing significantly contribute to the appreciation and comprehension of music. Notably, for hard-of-hearing individuals, perceiving pitch and singing play crucial roles as effective aids in auditory rehabilitation. However, the limited perception of pitch, stemming from the constraints of hearing devices, poses challenges in the learning process of recognizing and vocalizing melodies. In this study, we developed a wearable vibrotactile glove, TTS+, designed to convert musical tones into the corresponding vibrotactile patterns, complemented by an associated training application. After ten training sessions with our system, the participants exhibited notable improvements in pitch perception and the capacity to reproduce melodies through singing compared with their pre-test baseline without vibrotactile feedback. Beyond quantitative outcomes, findings from user experiences obtained through user feedback during training and post-test interviews offer valuable perspectives and constraints for our study, which may be further investigated in future studies. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=188157064 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1080/10447318.2025.2452192 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 18 StartPage: 12032 Subjects: – SubjectFull: Hard of hearing people Type: general – SubjectFull: Vibrotactile stimulation Type: general – SubjectFull: User experience Type: general – SubjectFull: Audio frequency Type: general – SubjectFull: Absolute pitch Type: general – SubjectFull: Hearing disorders Type: general – SubjectFull: Singing Type: general – SubjectFull: Treatment programs Type: general Titles: – TitleFull: Enhancing Pitch Perception and Melodic Reproduction of Hard-of-Hearing Individuals Using a Vibrotactile Glove. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Shin, Sungyong – PersonEntity: Name: NameFull: Baek, Sunwoo – PersonEntity: Name: NameFull: Park, Sohyun – PersonEntity: Name: NameFull: Yi, Hyeonbeom – PersonEntity: Name: NameFull: Shin, Hyungcheol – PersonEntity: Name: NameFull: Lee, Woohun IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 10 Text: Oct2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 10447318 Numbering: – Type: volume Value: 41 – Type: issue Value: 19 Titles: – TitleFull: International Journal of Human-Computer Interaction Type: main |
| ResultId | 1 |