Enhancing Pitch Perception and Melodic Reproduction of Hard-of-Hearing Individuals Using a Vibrotactile Glove.

Saved in:
Bibliographic Details
Title: Enhancing Pitch Perception and Melodic Reproduction of Hard-of-Hearing Individuals Using a Vibrotactile Glove.
Authors: Shin, Sungyong1,2 (AUTHOR), Baek, Sunwoo2 (AUTHOR), Park, Sohyun2 (AUTHOR), Yi, Hyeonbeom1 (AUTHOR), Shin, Hyungcheol1 (AUTHOR), Lee, Woohun2 (AUTHOR) woohun.lee@kaist.ac.kr
Source: International Journal of Human-Computer Interaction. Oct2025, Vol. 41 Issue 19, p12032-12049. 18p.
Subjects: Hard of hearing people, Vibrotactile stimulation, User experience, Audio frequency, Absolute pitch, Hearing disorders, Singing, Treatment programs
Abstract: The perception of pitch and engagement in melodic singing significantly contribute to the appreciation and comprehension of music. Notably, for hard-of-hearing individuals, perceiving pitch and singing play crucial roles as effective aids in auditory rehabilitation. However, the limited perception of pitch, stemming from the constraints of hearing devices, poses challenges in the learning process of recognizing and vocalizing melodies. In this study, we developed a wearable vibrotactile glove, TTS+, designed to convert musical tones into the corresponding vibrotactile patterns, complemented by an associated training application. After ten training sessions with our system, the participants exhibited notable improvements in pitch perception and the capacity to reproduce melodies through singing compared with their pre-test baseline without vibrotactile feedback. Beyond quantitative outcomes, findings from user experiences obtained through user feedback during training and post-test interviews offer valuable perspectives and constraints for our study, which may be further investigated in future studies. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 188157064
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Enhancing Pitch Perception and Melodic Reproduction of Hard-of-Hearing Individuals Using a Vibrotactile Glove.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Shin%2C+Sungyong%22">Shin, Sungyong</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Baek%2C+Sunwoo%22">Baek, Sunwoo</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Park%2C+Sohyun%22">Park, Sohyun</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Yi%2C+Hyeonbeom%22">Yi, Hyeonbeom</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Shin%2C+Hyungcheol%22">Shin, Hyungcheol</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Lee%2C+Woohun%22">Lee, Woohun</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> woohun.lee@kaist.ac.kr</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Human-Computer+Interaction%22">International Journal of Human-Computer Interaction</searchLink>. Oct2025, Vol. 41 Issue 19, p12032-12049. 18p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Hard+of+hearing+people%22">Hard of hearing people</searchLink><br /><searchLink fieldCode="DE" term="%22Vibrotactile+stimulation%22">Vibrotactile stimulation</searchLink><br /><searchLink fieldCode="DE" term="%22User+experience%22">User experience</searchLink><br /><searchLink fieldCode="DE" term="%22Audio+frequency%22">Audio frequency</searchLink><br /><searchLink fieldCode="DE" term="%22Absolute+pitch%22">Absolute pitch</searchLink><br /><searchLink fieldCode="DE" term="%22Hearing+disorders%22">Hearing disorders</searchLink><br /><searchLink fieldCode="DE" term="%22Singing%22">Singing</searchLink><br /><searchLink fieldCode="DE" term="%22Treatment+programs%22">Treatment programs</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The perception of pitch and engagement in melodic singing significantly contribute to the appreciation and comprehension of music. Notably, for hard-of-hearing individuals, perceiving pitch and singing play crucial roles as effective aids in auditory rehabilitation. However, the limited perception of pitch, stemming from the constraints of hearing devices, poses challenges in the learning process of recognizing and vocalizing melodies. In this study, we developed a wearable vibrotactile glove, TTS+, designed to convert musical tones into the corresponding vibrotactile patterns, complemented by an associated training application. After ten training sessions with our system, the participants exhibited notable improvements in pitch perception and the capacity to reproduce melodies through singing compared with their pre-test baseline without vibrotactile feedback. Beyond quantitative outcomes, findings from user experiences obtained through user feedback during training and post-test interviews offer valuable perspectives and constraints for our study, which may be further investigated in future studies. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=188157064
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/10447318.2025.2452192
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 12032
    Subjects:
      – SubjectFull: Hard of hearing people
        Type: general
      – SubjectFull: Vibrotactile stimulation
        Type: general
      – SubjectFull: User experience
        Type: general
      – SubjectFull: Audio frequency
        Type: general
      – SubjectFull: Absolute pitch
        Type: general
      – SubjectFull: Hearing disorders
        Type: general
      – SubjectFull: Singing
        Type: general
      – SubjectFull: Treatment programs
        Type: general
    Titles:
      – TitleFull: Enhancing Pitch Perception and Melodic Reproduction of Hard-of-Hearing Individuals Using a Vibrotactile Glove.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Shin, Sungyong
      – PersonEntity:
          Name:
            NameFull: Baek, Sunwoo
      – PersonEntity:
          Name:
            NameFull: Park, Sohyun
      – PersonEntity:
          Name:
            NameFull: Yi, Hyeonbeom
      – PersonEntity:
          Name:
            NameFull: Shin, Hyungcheol
      – PersonEntity:
          Name:
            NameFull: Lee, Woohun
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 10
              Text: Oct2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 10447318
          Numbering:
            – Type: volume
              Value: 41
            – Type: issue
              Value: 19
          Titles:
            – TitleFull: International Journal of Human-Computer Interaction
              Type: main
ResultId 1