Search

Cochlear implant (CI) users often report being unsatisfied by music listening through their hearing device. Vibrotactile stimulation could help alleviate those challenges. Previous research has shown that musical stimuli was given higher preference ratings by normal-hearing listeners when concurrent vibrotactile stimulation was congruent in intensity and timing with the corresponding auditory signal compared to incongruent. However, it is not known whether this is also the case for CI users. Therefore, in this experiment, we presented 18 CI users and 24 normal-hearing listeners with five melodies and five different audio-to-tactile maps. Each map varied the congruence between the audio and tactile signals related to intensity, fundamental frequency, and timing. Participants were asked to rate the maps from zero to 100, based on preference. It was shown that almost all normal-hearing listeners, as well as a subset of the CI users, preferred tactile stimulation, which was congruent with the audio in intensity and timing. However, many CI users had no difference in preference between timing aligned and timing unaligned stimuli. The results provide evidence that vibrotactile music enjoyment enhancement could be a solution for some CI users; however, more research is needed to understand which CI users can benefit from it most., (© 2024 Author(s). All article content, except where otherwise noted, is licensed under a Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).)

Using headphones may expose the listener to potentially harmful levels of sound. This study examines whether introducing tactile vibrations to the listening experience would encourage them to reduce their headphone volume. Fifteen participants adjusted their preferred listening levels for four diverse music tracks under audio-only and audiotactile conditions. Results indicated a significant decrease in preferred audio levels with added tactile stimulation. This effect was particularly significant in songs featuring a strong beat. In contrast, only a minimal effect was observed for genres such as classical music, which typically lack a pronounced beat, at higher vibration intensities. These findings suggest that integrating tactile feedback could be a viable strategy for lowering sound exposure risk., (© 2024 Author(s). All article content, except where otherwise noted, is licensed under a Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).)

Several studies have established that Cochlear implant (CI) listeners rely on the tempo of music to judge the emotional content of music. However, a re-analysis of a study in which CI listeners judged the emotion conveyed by piano pieces on a scale from happy to sad revealed a weak correlation between tempo and emotion. The present study explored which temporal cues in music influence emotion judgments among normal hearing (NH) listeners, which might provide insights into the cues utilized by CI listeners. Experiment 1 was a replication of the Vannson et al. study with NH listeners using rhythmic patterns of piano created with congas. The temporal cues were preserved while the tonal ones were removed. The results showed (i) tempo was weakly correlated with emotion judgments, (ii) NH listeners' judgments for congas were similar to CI listeners' judgments for piano. In Experiment 2, two tasks were administered with congas played at three different tempi: emotion judgment and a tapping task to record listeners' perceived tempo. Perceived tempo was a better predictor than the tempo, but its physical correlate, mean onset-to-onset difference (MOOD), a measure of the average time between notes, yielded higher correlations with NH listeners' emotion judgments. This result suggests that instead of the tempo, listeners rely on the average time between consecutive notes to judge the emotional content of music. CI listeners could utilize this cue to judge the emotional content of music.

The study tests the hypothesis that vibrotactile stimulation can affect timbre perception. A multidimensional scaling experiment was conducted. Twenty listeners with normal hearing and nine cochlear implant users were asked to judge the dissimilarity of a set of synthetic sounds that varied in attack time and amplitude modulation depth. The listeners were simultaneously presented with vibrotactile stimuli, which varied also in attack time and amplitude modulation depth. The results showed that alterations to the temporal waveform of the tactile stimuli affected the listeners' dissimilarity judgments of the audio. A three-dimensional analysis revealed evidence of crossmodal processing where the audio and tactile equivalents combined accounted for their dissimilarity judgments. For the normal-hearing listeners, 86% of the first dimension was explained by audio impulsiveness and 14% by tactile impulsiveness; 75% of the second dimension was explained by the audio roughness or fast amplitude modulation, while its tactile counterpart explained 25%. Interestingly, the third dimension revealed a combination of 43% of audio impulsiveness and 57% of tactile amplitude modulation. For the CI listeners, the first dimension was mostly accounted for by the tactile roughness and the second by the audio impulsiveness. This experiment shows that the perception of timbre can be affected by tactile input and could lead to the developing of new audio-tactile devices for people with hearing impairment.

Music listening experiences can be enhanced with tactile vibrations. However, it is not known which parameters of the tactile vibration must be congruent with the music to enhance it. Devices that aim to enhance music with tactile vibrations often require coding an acoustic signal into a congruent vibrotactile signal. Therefore, understanding which of these audio-tactile congruences are important is crucial. Participants were presented with a simple sine wave melody through supra-aural headphones and a haptic actuator held between the thumb and forefinger. Incongruent versions of the stimuli were made by randomizing physical parameters of the tactile stimulus independently of the auditory stimulus. Participants were instructed to rate the stimuli against the incongruent stimuli based on preference. It was found making the intensity of the tactile stimulus incongruent with the intensity of the auditory stimulus, as well as misaligning the two modalities in time, had the biggest negative effect on ratings for the melody used. Future vibrotactile music enhancement devices can use time alignment and intensity congruence as a baseline coding strategy, which improved strategies can be tested against.

Auditory stream segregation, or separating sounds into their respective sources and tracking them over time, is a fundamental auditory ability. Previous research has separately explored the impacts of aging and musicianship on the ability to separate and follow auditory streams. The current study evaluated the simultaneous effects of age and musicianship on auditory streaming induced by three physical features: intensity, spectral envelope and temporal envelope. In the first study, older and younger musicians and non-musicians with normal hearing identified deviants in a four-note melody interleaved with distractors that were more or less similar to the melody in terms of intensity, spectral envelope and temporal envelope. In the second study, older and younger musicians and non-musicians participated in a dissimilarity rating paradigm with pairs of melodies that differed along the same three features. Results suggested that auditory streaming skills are maintained in older adults but that older adults rely on intensity more than younger adults while musicianship is associated with increased sensitivity to spectral and temporal envelope, acoustic features that are typically less effective for stream segregation, particularly in older adults., Competing Interests: The authors have declared that no competing interests exist.

Musical enjoyment for cochlear implant (CI) recipients is often reported to be unsatisfactory. Our goal was to determine whether the musical experience of postlingually deafened adult CI recipients could be enriched by presenting the bass and treble clef parts of short polyphonic piano pieces separately to each ear (dichotic). Dichotic presentation should artificially enhance the lateralization cues of each part and help the listeners to better segregate them and thus provide greater clarity. We also hypothesized that perception of the intended emotion of the pieces and their overall enjoyment would be enhanced in the dichotic mode compared with the monophonic (both parts in the same ear) and the diotic mode (both parts in both ears). Twenty-eight piano pieces specifically composed to induce sad or happy emotions were selected. The tempo of the pieces, which ranged from lento to presto covaried with the intended emotion (from sad to happy). Thirty participants (11 normal-hearing listeners, 11 bimodal CI and hearing-aid users, and 8 bilaterally implanted CI users) participated in this study. Participants were asked to rate the perceived clarity, the intended emotion, and their preference of each piece in different listening modes. Results indicated that dichotic presentation produced small significant improvements in subjective ratings based on perceived clarity and preference. We also found that preference and clarity ratings were significantly higher for pieces with fast tempi compared with slow tempi. However, no significant differences between diotic and dichotic presentation were found for the participants' preference ratings, or their judgments of intended emotion., (© The Author(s) 2015.)

Background: Children with hearing impairments, especially those using hearing devices such as the cochlear implant (CI) or hearing aid (HA), are sometimes not encouraged to attend music classes, as they or their parents and teachers may be unsure whether the child can perform basic musical tasks., Purpose: The objective of the current study was to provide a baseline for the performance of children using CIs and HAs on standardized tests of rhythm and pitch perception as well as an instrument timbre identification task. An additional aim was to determine the effect of structured music training on these measures during the course of a school year., Research Design: The Intermediate Measures of Music Audiation (IMMA) Tonal and Rhythmic subtests were administered four times, with 6 wk between tests. All children in the study were also enrolled in "Music Club" teaching sessions. Measures were compared between groups and across the four testing sessions., Study Sample: Twenty children from a single school in Melbourne, Australia, were recruited. Eleven (four girls) had impaired hearing, including six with a unilateral CI or CI and HA together (two girls) and five with bilateral HAs (two girls). Nine were normally hearing, selected to match the age and gender of the hearing-impaired children. Ages ranged from 9-13 yr., Intervention: All children participated in a weekly Music Club--a 45 min session of musical activities based around vocal play and the integration of aural, visual, and kinesthetic modes of learning., Data Collection and Analysis: Audiological data were collected from clinical files. IMMA scores were converted to percentile ranks using published norms. Between-group differences were tested using repeated-measures analysis of variance, and between-session differences were tested using a linear mixed model. Linear regression was used to model the effect of hearing loss on the test scores., Results: In the first session, normally hearing children had a mean percentile rank of ∼50 in both the Tonal and Rhythmic subtests of the IMMA. Children using CIs showed trends toward lower scores in the Tonal, but not the Rhythmic, subtests. No significant improvements were found between sessions. In the timbre test, children generally made fewer errors within the set of percussive compared to nonpercussive instruments. The hearing loss level partially predicted performance in the Tonal, but not the Rhythmic, task, and predictions were more significant for nonpercussive compared to percussive instruments., Conclusions: The findings highlight the importance of temporal cues in the perception of music, and indicate that temporal cues may be used by children with CIs and HAs in the perception of not only rhythm, but also of some aspects of timbre. We were not able to link participation in the Music Club with increased scores on the Tonal, Rhythmic, and Timbre tests. However, anecdotal evidence from the children and their teachers suggested a wide range of benefits from participation in the Music Club that extended from increased engagement and interest in music classes into the children's social situations., (American Academy of Audiology.)

Unlabelled: Although the perception of music is generally poor in cochlear implant users, there are a few excellent performers., Objective: The aim of this study was the assessment of different aspects of music perception in one exceptional cochlear implant user., Design: The assessments included pitch direction discrimination, melody and timbre recognition, relative and absolute pitch judgment, and consonance rating of musical notes presented through the sound processor(s)., Study Sample: An adult cochlear implant user with musical background who lost her hearing postlingually, and five normally-hearing listeners with musical training participated in the study., Results: The CI user discriminated pitch direction for sounds differing by one semitone and recognized melody with nearly 100% accuracy. Her results in timbre recognition were better than average published data for cochlear implant users. Her consonance rating, and relative and absolute pitch perception were comparable to normally-hearing listeners with musical training., Conclusion: The results in this study showed that excellent performance is possible on musical perception tasks including pitch perception using present day cochlear implant technologies. Factors that may explain this user's exceptional performance are short duration of deafness, pre- and post-deafness musical training, and perfect pitch abilities before the onset of deafness.

Purpose: The purpose of this study was to investigate musical timbre perception in cochlear-implant (CI) listeners using a multidimensional scaling technique to derive a timbre space. Methods Sixteen stimuli that synthesized western musical instruments were used (McAdams, Winsberg, Donnadieu, De Soete, & Krimphoff, 1995). Eight CI listeners and 15 normal-hearing (NH) listeners participated. Each listener made judgments of dissimilarity between stimulus pairs. Acoustical analyses that characterized the temporal and spectral characteristics of each stimulus were performed to examine the psychophysical nature of each perceptual dimension., Results: For NH listeners, the timbre space was best represented in three dimensions, one correlated with the temporal envelope (log-attack time) of the stimuli, one correlated with the spectral envelope (spectral centroid), and one correlated with the spectral fine structure (spectral irregularity) of the stimuli. The timbre space from CI listeners, however, was best represented by two dimensions, one correlated with temporal envelope features and the other weakly correlated with spectral envelope features of the stimuli., Conclusions: Temporal envelope was a dominant cue for timbre perception in CI listeners. Compared to NH listeners, CI listeners showed reduced reliance on both spectral envelope and spectral fine structure cues for timbre perception.

Background: Enjoyment of music is an important part of life that may be degraded for people with hearing impairments, especially those using cochlear implants. The ability to follow separate lines of melody is an important factor in music appreciation. This ability relies on effective auditory streaming, which is much reduced in people with hearing impairment, contributing to difficulties in music appreciation. The aim of this study was to assess whether visual cues could reduce the subjective difficulty of segregating a melody from interleaved background notes in normally hearing listeners, those using hearing aids, and those using cochlear implants., Methodology/principal Findings: Normally hearing listeners (N = 20), hearing aid users (N = 10), and cochlear implant users (N = 11) were asked to rate the difficulty of segregating a repeating four-note melody from random interleaved distracter notes. The pitch of the background notes was gradually increased or decreased throughout blocks, providing a range of difficulty from easy (with a large pitch separation between melody and distracter) to impossible (with the melody and distracter completely overlapping). Visual cues were provided on half the blocks, and difficulty ratings for blocks with and without visual cues were compared between groups. Visual cues reduced the subjective difficulty of extracting the melody from the distracter notes for normally hearing listeners and cochlear implant users, but not hearing aid users., Conclusion/significance: Simple visual cues may improve the ability of cochlear implant users to segregate lines of music, thus potentially increasing their enjoyment of music. More research is needed to determine what type of acoustic cues to encode visually in order to optimise the benefits they may provide.

Purpose: To estimate real-environment iPod listening levels for listeners in 4 environments to gain insight into whether average listeners receive dosages exceeding occupational noise exposure guidelines as a result of their listening habits., Method: The earbud outputs of iPods were connected directly into the inputs of a digital recorder to make recordings of listening levels. These recordings were used to estimate listening levels using reference recordings made in a real ear. Recordings were made in 4 environments with a wide range of background noises: (a) a library, (b) a student center, (c) busy streets, and (d) the subway., Results: None of the 64 listeners were estimated to exceed allowable occupational dosages, with a maximum dose of 7.57% based on Occupational Safety and Health Administration (OSHA; 1998) methods and 10.83% based on National Institute for Occupational Safety and Health (NIOSH; 1998) methods., Conclusions: All of the listeners surveyed were exposed to dosages well below OSHA and NIOSH occupational regulations. Although this does not guarantee individual safety, the results do not support the widespread concern regarding the safety of common iPod usage. However, measurements made in this study agree with the finding that iPod output can exceed safe levels and further support recommendations to monitor and limit listening volume and listening duration.

Background: The ability to separate two interleaved melodies is an important factor in music appreciation. This ability is greatly reduced in people with hearing impairment, contributing to difficulties in music appreciation. The aim of this study was to assess whether visual cues, musical training or musical context could have an effect on this ability, and potentially improve music appreciation for the hearing impaired., Methods: Musicians (N = 18) and non-musicians (N = 19) were asked to rate the difficulty of segregating a four-note repeating melody from interleaved random distracter notes. Visual cues were provided on half the blocks, and two musical contexts were tested, with the overlap between melody and distracter notes either gradually increasing or decreasing., Conclusions: Visual cues, musical training, and musical context all affected the difficulty of extracting the melody from a background of interleaved random distracter notes. Visual cues were effective in reducing the difficulty of segregating the melody from distracter notes, even in individuals with no musical training. These results are consistent with theories that indicate an important role for central (top-down) processes in auditory streaming mechanisms, and suggest that visual cues may help the hearing-impaired enjoy music.

The dependency of the brightness dimension of timbre on fundamental frequency (FO) was examined experimentally. Subjects compared the timbres of 24 synthetic stimuli, produced by the combination of six values of spectral centroid to obtain different values of expected brightness, and four FO's, ranging over 18 semitones. Subjects were instructed to ignore pitch differences. Dissimilarity scores were analyzed by both ANOVA and multidimensional scaling (MDS). Results show that timbres can be compared between stimuli with different FO's over the range tested, and that differences in FO affect timbre dissimilarity in two ways. First, dissimilarity scores reveal a term proportional to FO difference that shows up in the MDS solution as a dimension correlated with FO and orthogonal to other timbre dimensions. Second, FO affects systematically the timbre dimension (brightness) correlated with spectral centroid. Interestingly, both terms covaried with differences in FO rather than chroma or consonance. The first term probably corresponds to pitch. The second can be eliminated if the formula for spectral centroid is modified by introducing a corrective factor dependent on FO.

Keywords: music; cochlear implants; cognition; sensory deprivation; hearing restoration EN music cochlear implants cognition sensory deprivation hearing restoration 1 3 3 08/14/21 20210812 NES 210812 Cochlear implants (CI) rank as the most successful neural prostheses. Although most CI patients achieve some level of speech perception, many experience very poor music perception, both in terms of self-reported music enjoyment and objective perceptual abilities, which are significantly lower than in normal hearing subjects (Marozeau et al., [5]). The music cognition literature makes an important distinction between music perception and music appraisal, the former being about the objectively measured capacity to process certain sound features. [Extracted from the article]

Difficulty perceiving music is often cited as one of the main problems facing hearing-impaired listeners. It has been suggested that musical enjoyment could be enhanced if sound information absent due to impairment is transmitted via other sensory modalities such as vision or touch. In this study, we test whether tactile cues can be used to segregate 2 interleaved melodies. Twelve musicians and 12 nonmusicians were asked to detect changes in a 4-note repeated melody interleaved with a random melody. In order to perform this task, the listener must be able to segregate the target melody from the random melody. Tactile cues were applied to the listener's fingers on half of the blocks. Results showed that tactile cues can significantly improve the melodic segregation ability in both musician and nonmusician groups in challenging listening conditions. Overall, the musician group performance was always better; however, the magnitude of improvement with the introduction of tactile cues was similar in both groups. This study suggests that hearing-impaired listeners could potentially benefit from a system transmitting such information via a tactile modality. [ABSTRACT FROM AUTHOR]

Although cochlear implant (CI) users enjoy good speech understanding, music perception is still difficult or unpleasant for many. This study aimed to assess cognitive, engagement, and auditory responses to new music composed specifically for CI users. From 407 concertgoers who completed a questionnaire, responses from groups of normally hearing listeners (n = 44) and CI users (n = 44), matched in age and musical ability, were compared to determine whether specially commissioned works would elicit similar responses from both groups. No significant group differences were found on measures of interest, enjoyment, and musicality, whereas ratings of understanding and instrument localization and recognition were significantly lower for CI users. Overall, ratings of the music were typically higher for percussion pieces. The concert successfully elicited similar responses from both groups in terms of interest, enjoyment, and musicality, although technical aspects, such as understanding, localization, and instrument identification, continue to be problematic for CI users. [ABSTRACT FROM AUTHOR]