Search

This study investigated whether seeing iconic gestures depicting verb referents promotes two types of generalization. We taught 3- to 4-year-olds novel locomotion verbs. Children who saw iconic manner gestures during training generalized more verbs to novel events (first-order generalization) than children who saw interactive gestures (Experiment 1, N = 48; Experiment 2, N = 48) and path-tracing gestures (Experiment 3, N = 48). Furthermore, immediately (Experiments 1 and 3) and after 1 week (Experiment 2), the iconic manner gesture group outperformed the control groups in subsequent generalization trials with different novel verbs (second-order generalization), although all groups saw interactive gestures. Thus, seeing iconic gestures that depict verb referents helps children (a) generalize individual verb meanings to novel events and (b) learn more verbs from the same subcategory., (© 2020 The Authors. Child Development published by Wiley Periodicals LLC on behalf of Society for Research in Child Development.)

A speech signal carries information about meaning and about the talker conveying that meaning. It is now known that these two dimensions are related. There is evidence that gaining experience with a particular talker in one modality not only facilitates better phonetic perception in that modality, but also transfers across modalities to allow better phonetic perception in the other. This finding suggests that experience with a talker provides familiarity with some amodal properties of their articulation such that the experience can be shared across modalities. The present study investigates if experience with talker-specific articulatory information can also support cross-modal talker learning. In Experiment 1 we show that participants can learn to identify ten novel talkers from point-light and sinewave speech, expanding on prior work. Point-light and sinewave speech also supported similar talker identification accuracies, and similar patterns of talker confusions were found across stimulus types. Experiment 2 showed these stimuli could also support cross-modal talker matching, further expanding on prior work. Finally, in Experiment 3 we show that learning to identify talkers in one modality (visual-only point-light speech) facilitates learning of those same talkers in another modality (auditory-only sinewave speech). These results suggest that some of the information for talker identity takes a modality-independent form.

Effort during listening is commonly measured using the task-evoked pupil response (TEPR); a pupillometric marker of physiological arousal. However, studies to date report no association between TEPR and perceived effort. One possible reason for this is the way in which self-report effort measures are typically administered, namely as a single data point collected at the end of a testing session. Another possible reason is that TEPR might relate more closely to the experience of tiredness from listening than to effort per se. To examine these possibilities, we conducted two preregistered experiments that recorded subjective ratings of effort and tiredness from listening at multiple time points and examined their covariance with TEPR over the course of listening tasks varying in levels of acoustic and attentional demand. In both experiments, we showed a within-subject association between TEPR and tiredness from listening, but no association between TEPR and effort. The data also suggest that the effect of task difficulty on the experience of tiredness from listening may go undetected using the traditional approach of collecting a single data point at the end of a listening block. Finally, this study demonstrates the utility of a novel correlation analysis technique ("rmcorr"), which can be used to overcome statistical power constraints commonly found in the literature. Teasing apart the subjective and physiological mechanisms that underpin effortful listening is a crucial step toward addressing these difficulties in older and/or hearing-impaired individuals., (© 2020 The Authors. Psychophysiology published by Wiley Periodicals LLC on behalf of Society for Psychophysiological Research.)

Objectives: The present study investigated how children with cochlear implants (CIs), with optimal exposure to oral language, perform on sonority-related novel word learning tasks. By optimal oral language exposure, we refer to bilateral cochlear implantation below the age of 2 years. Sonority is the relative perceptual prominence/loudness of speech sounds of the same length, stress, and pitch. The present study is guided by a previous study that investigated the sonority-related novel word learning ability of a group of children with CIs, in the Greek language, of which the majority were implanted beyond the age of 2 unilaterally., Design: A case-control study with 15 Dutch-speaking participants in each of the three groups, i.e., children with CIs, normal-hearing children (NHC), and normal-hearing adults, was conducted using a sonority-related novel "CVC" word learning task. All children with CIs are implanted before the age of 2 years with preimplant hearing aids. Thirteen out of the 15 children had bilateral CIs. The CVC words were constructed according to four sonority conditions, where N is nonsonorous and S is a sonorous phoneme: NSN, NSS, SSN, and SSS. Outcome measures were accuracy and reaction times (RTs). In addition, the Peabody picture vocabulary test and the digit span forward test were administered to the children., Results: There were no statistical differences in accuracy or RTs between the children groups on the overall score and across the different conditions. However, children with CIs, unlike NHC, scored statistically less accurately and with longer RTs relative to normal-hearing adults, on the overall task. Within-group comparisons showed that none of the groups performed statistically differently on any of the conditions. The NHC showed higher receptive vocabulary scores relative to children with CIs. In addition, the group of children with CIs entailed a statistically significantly higher number of children with "weak" short-term memory., Conclusions: Children with CIs who have optimal oral language exposure showed age-appropriate sonority-related novel word learning abilities and strategies relative to their NH peers. However, children with CIs continue to show lower receptive vocabulary scores than NHC, despite the equivalent novel word learning ability. This suggests that children with CIs may have difficulties in retaining newly learned words. Future work should look into possible causes of the gap in performance. This would eventually aid in rehabilitation tailored to the needs of the individual.

Objectives: Speech recognition (SR)-tests have been developed for children without considering the linguistic complexity of the sentences used. However, linguistic complexity is hypothesized to influence correct sentence repetition. The aim of this study is to identify lexical and grammatical parameters influencing verbal repetition accuracy of sentences derived from a Dutch SR-test when performed by 6-year-old typically developing children., Design: For this observational, cross-sectional study, 40 typically developing children aged 6 were recruited at four primary schools in the Netherlands. All children performed a sentence repetition task derived from an SR-test for adults. The sentence complexity was described beforehand with one lexical parameter, age of acquisition, and four grammatical parameters, specifically sentence length, prepositions, sentence structure, and verb inflection. A multiple logistic regression analysis was performed., Results: Sentences with a higher age of acquisition (odds ratio [OR] = 1.59) or greater sentence length (OR = 1.28) had a higher risk of repetition inaccuracy. Sentences including a spatial (OR = 1.25) or other preposition (OR = 1.25) were at increased risk for incorrect repetition, as were complex sentences (OR = 1.69) and sentences in the present perfect (OR = 1.44) or future tense (OR = 2.32)., Conclusions: The variation in verbal repetition accuracy in 6-year-old children is significantly influenced by both lexical and grammatical parameters. Linguistic complexity is an important factor to take into account when assessing speech intelligibility in children.

During their second year of life, infants develop a rudimentary understanding of grammatical categories based on their knowledge and use of frequent function words. The current study inquired whether, at only 14 months of age, infants can track co-occurrence patterns between function words and content words (e.g., determiners can precede nouns, and pronouns can precede verbs), and use these previously encountered syntactic contexts to build expectations about which function words can co-occur with novel words. Using a habituation paradigm, French-learning 14-month-olds were presented with utterances containing two novel words preceded by function words (either two determiners in the Novel Nouns condition or two pronouns in the Novel Verbs conditions). We found that at test, infants looked longer during trials in which the novel words occurred in an unexpected syntactic context (following a pronoun for infants in the Novel Nouns condition and following a determiner for infants in the pooled analysis of the three Novel Verbs conditions). Hence, our results confirm previous findings on infants' sensitivity to noun contexts and most importantly demonstrate that their sensitivity to the co-occurrence of verbs with pronouns begins much earlier than previously understood., (© 2020 International Congress of Infant Studies (ICIS).)

Seminal work by Werker and colleagues (Stager & Werker [1997] Nature, 388, 381-382) has found that 14-month-old infants do not show evidence for learning minimal pairs in the habituation-switch paradigm. However, when multiple speakers produce the minimal pair in acoustically variable ways, infants' performance improves in comparison to a single speaker condition (Rost & McMurray [2009] Developmental Science, 12, 339-349). The current study further extends these results and assesses how different kinds of input variability affect 14-month-olds' minimal pair learning in the habituation-switch paradigm testing German learning infants. The first two experiments investigated word learning when the labels were spoken by a single speaker versus when the labels were spoken by multiple speakers. In the third experiment we studied whether non-acoustic variability, implemented by visual variability of the objects presented together with the labels, would also affect minimal pair learning. We found enhanced learning in the multiple speakers compared to the single speaker condition, confirming previous findings with English-learning infants. In contrast, visual variability of the presented objects did not support learning. These findings both confirm and better delimit the beneficial role of speech-specific variability in minimal pair learning. Finally, we review different proposals on the mechanisms via which variability confers benefits to learning and outline what may be likely principles that underlie this benefit. We highlight among these the multiplicity of acoustic cues signalling phonemic contrasts and the presence of relations among these cues. It is in these relations where we trace part of the source for the apparent paradoxical benefit of variability in learning., (© 2020 The Authors. Developmental Science published by John Wiley & Sons Ltd.)

Objective: A comparison of three interventions for profound unilateral sensorineural hearing loss., Study Design: Prospective, crossover randomized clinical trial., Participants: Fifteen participants with profound unilateral sensorineural hearing loss., Interventions: Three potential technical interventions were compared: Bone Conduction Device on softband, Contralateral Routing of Signal (CROS), and Remote Microphone . Each intervention was randomly trialed for a period of 3 weeks, separated by a 1 week washout period., Outcome Measures: Speech in noise recognition test performed under four conditions (lateral noise poorer ear, lateral noise better ear, speech poorer ear, speech better ear). Standardized questionnaires (Abbreviated Profile of Hearing Aid Benefit, Bern Benefit in Single Sided Deafness Questionnaire, and Speech, Spatial, and Other Qualities 12) were used to evaluate amplification benefit at baseline and following each intervention., Results: The use of remote microphone provided the best results in the speech recognition in noise test. A benefit in some signal-to-noise ratios was presented of the CROS over bone conduction device on softband in the Speech Poor Ear condition. On questionnaires of benefit, participants did not rate a particular intervention as significantly better than any other. Following the study, CROS was the intervention preferred by the 8 of 15 participants (53%). The majority of participants (80%) chose to continue with an intervention rather than no treatment., Conclusion: The use of all interventions resulted in increased performance in speech recognition in noise and rated higher on subjective benefits in comparison with baseline. People with SSD are a heterogeneous population when considering perceived difficulties. Future research should focus on segmenting the population of SSD depending on factors such as etiology, high frequency loss in the better ear, and age of acquired loss for the poorer ear. This stratification may possibly increase the benefit for the patient in terms of more individual-based clinical routines.

Objective: To implement a unified testing framework into clinical routine that can be used by adults with single-sided deafness (SSD) to assess alternative treatment options before cochlear implantation., Study Design: Retrospective data analysis., Setting: Tertiary referral center with a large CI program., Subjects and Methods: Thirty four participants underwent the new implemented testing procedure, including a test trial with contralateral routing of the signal (CROS) hearing aids and bone conduction devices (BCD) on a headband, before deciding whether to proceed with cochlear implantation. A test battery was used to assess speech in noise, binaural effects (head shadow, squelch, summation, spatial release from masking), sound localization, and quality of life. For participants that chose a CI, the same test battery was repeated during the 6 and 12 months follow-up appointments., Results: Of the 34 participants involved in the study, 11 were implanted with a CI and finished their 12 month evaluation. Sixteen participants decided to stop after the CROS/BCD trial. In the CI-recipient group, a significant head shadow effect of 5.1 to 7.1 dB was achieved with the CI. Recipients in this group received only a limited benefit with either CROS or BCD before implantation. In the non-CI-recipient group, a significant difference between the CROS and BCD, in favor for the CROS device, was found calculating the head shadow and squelch effect. Localization abilities with the CI improved significantly in the CI-recipient group, even between the 6- and 12-month follow-up appointments. In the non-CI-recipient group, localization was significantly better with the BCD during the trial period. Higher scores were obtained from the speech and spatial categories of the Speech, Spatial, and Qualities of Hearing (SSQ) questionnaire with the CI. No subjective difference could be determined in the non-CI-recipient group., Conclusion: Implementing the unified testing framework into a clinical routine was challenging but provided helpful insight into the best treatment option for each individual.

Identifying emotions in speech is based on the interaction of lexical content and prosody. This may be disrupted in individuals with High-Functioning Autism Spectrum Disorder (HF-ASD). Undergraduates with HF-ASD (n = 20) and matched typically developed peers (n = 20) were tested using the (Hebrew) Test for Rating of Emotions in Speech. Participants rated the degree to which a target-emotion is present in spoken sentences, in which the emotional-lexical and -prosodic content appear in different combinations from trial to trial. No group differences were found in measures of emotion-identification, selective-attention (focusing on one target-channel) and integration. These preserved abilities can partially explain the high levels of independence and self-control characterizing students with HF-ASD. Support programs may rely on such skills to improve social interactions.

Limited data availability remains a significant challenge for Whisper's low-resource speech recognition performance, falling short of practical application requirements. While previous studies have successfully reduced the recognition error rates of target language speech through fine-tuning, a comprehensive exploration and analysis of Whisper's fine-tuning capabilities and the advantages and disadvantages of various fine-tuning strategies are still lacking. This paper aims to fill this gap by conducting comprehensive experimental exploration for Whisper's low-resource speech recognition performance using five fine-tuning strategies with limited supervised data from seven low-resource languages. The results and analysis demonstrate that all fine-tuning strategies explored in this paper significantly enhance Whisper's performance. However, different strategies vary in their suitability and practical effectiveness, highlighting the need for careful selection based on specific use cases and resources available. [ABSTRACT FROM AUTHOR]

English speech incorporates numerous features associated with the speaker's emotions, offering valuable cues for emotion recognition. This paper begins by briefly outlining preprocessing approaches for English speech signals. Subsequently, the Mel-frequency cepstral coefficient (MFCC), energy, and short-time zero-crossing rate were chosen as features, and their statistical properties were computed. The resulting 250-dimensional feature fusion was employed as input. A novel approach that combined gated recurrent unit (GRU) and a convolutional neural network (CNN) was designed for emotion recognition. The bidirectional GRU (BiGRU) method was enhanced through jump-joining to create a CNN-Skip-BiGRU model as an emotion recognition method for English speech. Experimental evaluations were conducted using the IEMOCAP dataset. The findings indicated that the fusion features exhibited superior performance in emotion recognition, achieving an unweighted accuracy rate of 70.31% and a weighted accuracy rate of 70.88%. In contrast to models like CNN-long short-term memory (LSTM), the CNN-Skip-BiGRU model demonstrated enhanced discriminative capabilities for different emotions. Moreover, it stood favorably against several existing emotion recognition methods. These results underscore the efficacy of the improved method in English speech emotion identification, suggesting its potential practical applications. [ABSTRACT FROM AUTHOR]

The article presents abstracts on audiology topics, which include "Identification and prioritising uncertainties in the treatment of tinnitus," "A guinea pig model of tinnitus" and "Evaluation of pitch perception tests for cochlear implant users."

Abstract: The field of automatic speech recognition (ASR) is discussed from the viewpoint of pattern recognition (PR). This tutorial examines the problem area, its methods, successes and failures, focusing on the nature of the speech signal and techniques to accomplish useful data reduction. Comparison is made with other areas of PR. Suggestions are given for areas of future progress. [Copyright &y& Elsevier]

In medicine, the count of different types of white blood cells can be used as the basis for diagnosing certain diseases or evaluating the treatment effects of diseases. The recognition and counting of white blood cells have important clinical significance. But the effect of recognition based on machine learning is affected by the size of the training set. At present, researchers mainly rely on image rotation and cropping to expand the dataset. These methods either add features to the white blood cell image or require manual intervention and are inefficient. In this paper, a method for expanding the training set of white blood cell images is proposed. After rotating the image at any angle, Canny is used to extract the edge of the black area caused by the rotation and then fill the black area to achieve the purpose of expanding the training set. The experimental results show that after using the method proposed in this paper to expand the training set to train the three models of ResNet, MobileNet, and ShuffleNet, and comparing the original dataset and the method trained by the simple rotated image expanded dataset, the recognition accuracy of the three models is obviously improved without manual intervention. [ABSTRACT FROM AUTHOR]

Muslims aim to recite and memorize the Holy Quran correctly. However, traditional recitation verification approaches depend on humans who may not be available. On the other hand, Artificial Intelligence (AI) capabilities assist in developing intelligent recitation verification tools based on speech recognition techniques. This study aims to overview the current state of the intelligent Quran recitation recognition and verification solutions and highlight the related open issues. A systematic literature review was performed on the published paper since 2006 up to date to answer six research questions. The research questions covered the speech recognition techniques and methods used to develop Quran recitation recognition and verification models, the database and tools used, and the existing mobile application supporting real-time intelligent Quran recitation verification services. Based on the review results, a taxonomy of the Quran recitation recognition and verification techniques was generated, including traditional and end-to-end speech recognition methods. Moreover, the limitations of the existing AI-based Quran recitation verification applications were reported. Additionally, the available Quran audio datasets and tools capable of dealing with Quranic speech were identified. In conclusion, several open issues can be addressed in future research, e.g., considering AI-based approaches to ensure sequence recitation and recognize diacritics-based errors. [ABSTRACT FROM AUTHOR]

Objectives: To investigate the correlations between hearing handicap, speech recognition, listening effort, and fatigue., Design: Eighty-four adults with hearing loss (65 to 85 years) completed three self-report questionnaires: the Fatigue Assessment Scale, the Effort Assessment Scale, and the Hearing Handicap Inventory for Elderly. Audiometric assessment included pure-tone audiometry and speech recognition in noise., Results: There was a significant positive correlation between handicap and fatigue (r = 0.39, p < 0.05) and handicap and effort (r = 0.73, p < 0.05). There were significant (but lower) correlations between speech recognition and fatigue (r = 0.22, p < 0.05) or effort (r = 0.32, p< 0.05). There was no significant correlation between hearing level and fatigue or effort., Conclusions: Hearing handicap and speech recognition both correlate with self-reported listening effort and fatigue, which is consistent with a model of listening effort and fatigue where perceived difficulty is related to sustained effort and fatigue for unrewarding tasks over which the listener has low control. A clinical implication is that encouraging clients to recognize and focus on the pleasure and positive experiences of listening may result in greater satisfaction and benefit from hearing aid use.

The papers in this special issue provide a critical look at some historical ideas that have had an influence on research and teaching in the field of speech communication. They also address widely used methodologies or address long-standing methodological challenges in the areas of speech perception and speech production. The goal is to reconsider and evaluate the need for caution or replacement of historical ideas with more modern results and methods. The contributions provide respectful historical context to the classic ideas, as well as new original research or discussion that clarifies the limitations of the original ideas. [ABSTRACT FROM AUTHOR]

Presents an overview of issues presented in the 2001 special issue on brain imaging and language processing of the "Journal of Psycholinguistic Research." Examinations of auditory language processing; Evidence on both auditory and visual modalities of language processing; Neural regions for speech perception and production.

Background: While hearing aids for a contralateral routing of signals (CROS-HA) and bone conduction devices have been the traditional treatment for single-sided deafness (SSD) and asymmetric hearing loss (AHL), in recent years, cochlear implants (CIs) have increasingly become a viable treatment choice, particularly in countries where regulatory approval and reimbursement schemes are in place. Part of the reason for this shift is that the CI is the only device capable of restoring bilateral input to the auditory system and hence of possibly reinstating binaural hearing. Although several studies have independently shown that the CI is a safe and effective treatment for SSD and AHL, clinical outcome measures in those studies and across CI centers vary greatly. Only with a consistent use of defined and agreed-upon outcome measures across centers can high-level evidence be generated to assess the safety and efficacy of CIs and alternative treatments in recipients with SSD and AHL.Methods: This paper presents a comparative study design and minimum outcome measures for the assessment of current treatment options in patients with SSD/AHL. The protocol was developed, discussed, and eventually agreed upon by expert panels that convened at the 2015 APSCI conference in Beijing, China, and at the CI 2016 conference in Toronto, Canada.Results: A longitudinal study design comparing CROS-HA, BCD, and CI treatments is proposed. The recommended outcome measures include (1) speech in noise testing, using the same set of 3 spatial configurations to compare binaural benefits such as summation, squelch, and head shadow across devices; (2) localization testing, using stimuli that rove in both level and spectral content; (3) questionnaires to collect quality of life measures and the frequency of device use; and (4) questionnaires for assessing the impact of tinnitus before and after treatment, if applicable.Conclusion: A protocol for the assessment of treatment options and outcomes in recipients with SSD and AHL is presented. The proposed set of minimum outcome measures aims at harmonizing assessment methods across centers and thus at generating a growing body of high-level evidence for those treatment options. [ABSTRACT FROM AUTHOR]

The traditional wheelchair focuses on the "human-chair" motor function interaction to ensure the elderly and people with disabilities' basic travel. For people with visual, hearing, physical disabilities, etc., the current wheelchairs show shortcomings in terms of accessibility and independent travel for this group. Therefore, this paper develops an intelligent wheelchair with multimodal human–computer interaction and autonomous navigation technology. Firstly, it researches the multimodal human–computer interaction technology of occupant gesture recognition, speech recognition, and head posture recognition and proposes a wheelchair control method of three-dimensional head posture mapping the two-dimensional plane. After testing, the average accuracy of the gesture, head posture and voice control modes of the motorized wheelchair proposed in this study reaches more than 95 percent. Secondly, the LiDAR-based smart wheelchair indoor autonomous navigation technology is investigated to realize the autonomous navigation of the wheelchair by constructing an environment map, using A* and DWA algorithms for global and local path planning, and adaptive Monte Carlo simulation algorithms for real-time localization. Experiments show that the position error of the wheelchair is within 10 cm, and the heading angle error is less than 5° during the autonomous navigation. The multimode human–computer interaction and assisted driving technology proposed in this study can partially compensate and replace the functional deficiencies of the disabled population and improve the quality of life of the elderly and disabled population. [ABSTRACT FROM AUTHOR]

This project will study a fast retrieval method for music humming speech recognition based on sentence features and deep learning. The method proposed in this paper can realize the fast extraction of songs. According to the characteristics of the natural pause mode of the song, the song database and the song fragments provided by the user are divided into different sentences. The deep learning algorithm of BDTW is used to calculate the similarity of the song's pitch, and users can set matching conditions according to their preferences. It can identify the most significant differences between music fragments and the order of queries in the database. Then, a retrieval method of a music database based on DIS is proposed. It can shorten the acquisition time. Experiments show that the algorithm can recognize humming songs quickly and efficiently. [ABSTRACT FROM AUTHOR]

This paper introduces an innovative technique for creating a cough detection system that relies on speech recognition algorithms. The strategy utilizes the Kaldi platform, which is open source and incorporates a hybrid system of Gaussian Mixture Model-based Hidden Markov Models (GMM-HMM) through a straightforward monophone training model. Additionally, the study examines the effectiveness of two different feature extraction approaches, Mel Frequency Cepstral Coefficient (MFCC) and Perceptual Linear Prediction (PLP). The proposed system can function as a collection tool for gathering natural and spontaneous cough data from conversations or continuous speech. The paper also compares the Kaldi and CMU Sphinx4 toolkits, concluding that Kaldi's use of GMM-HMM outperforms CMU Sphinx4. [ABSTRACT FROM AUTHOR]

Speech recognition systems have become a unique human-computer interaction (HCI) family. Speech is one of the most naturally developed human abilities; speech signal processing opens up a transparent and hand-free computation experience. This paper aims to present a retrospective yet modern approach to the world of speech recognition systems. The development journey of ASR (Automatic Speech Recognition) has seen quite a few milestones and breakthrough technologies that have been highlighted in this paper. A step-by-step rundown of the fundamental stages in developing speech recognition systems has been presented, along with a brief discussion of various modern-day developments and applications in this domain. This review paper aims to summarize and provide a beginning point for those starting in the vast field of speech signal processing. Since speech recognition has a vast potential in various industries like telecommunication, emotion recognition, healthcare, etc., this review would be helpful to researchers who aim at exploring more applications that society can quickly adopt in future years of evolution. [ABSTRACT FROM AUTHOR]

Understanding the correct intention of a speaker is critical for social interaction. Speech prosody is an important source for understanding speakers' intentions during verbal communication. However, the neural dynamics by which the human brain translates the prosodic cues into a mental representation of communicative intentions in real time remains unclear. Here, we recorded EEG (electroencephalograph) while participants listened to dialogues. The prosodic features of the critical words at the end of sentences were manipulated to signal either suggestion, warning, or neutral intentions. The results showed that suggestion and warning intentions evoked enhanced late positive event-related potentials (ERPs) compared to the neutral condition. Linear mixed-effects model (LMEM) regression and representational similarity analysis (RSA) analyses revealed that these ERP effects were distinctively correlated with prosodic acoustic analysis, emotional valence evaluation, and intention interpretation in different time windows; The onset latency significantly increased as the processing level of abstractness and communicative intentionality increased. Neural representations of intention and emotional information emerged and parallelly persisted over a long time window, guiding the correct identification of communicative intention. These results provide new insights into understanding the structural components of intention processing and their temporal neural dynamics underlying communicative intention comprehension from speech prosody in online social interactions., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

We investigated how neural oscillations code the hierarchical nature of stress rhythms in speech and how stress processing varies with language experience. By measuring phase synchrony of multilevel EEG-acoustic tracking and intra-brain cross-frequency coupling, we show the encoding of stress involves different neural signatures (delta rhythms = stress foot rate; theta rhythms = syllable rate), is stronger for amplitude vs. duration stress cues, and induces nested delta-theta coherence mirroring the stress-syllable hierarchy in speech. Only native English, but not Mandarin, speakers exhibited enhanced neural entrainment at central stress (2 Hz) and syllable (4 Hz) rates intrinsic to natural English. English individuals with superior cortical-stress tracking capabilities also displayed stronger neural hierarchical coherence, highlighting a nuanced interplay between internal nesting of brain rhythms and external entrainment rooted in language-specific speech rhythms. Our cross-language findings reveal brain-speech synchronization is not purely a "bottom-up" but benefits from "top-down" processing from listeners' language-specific experience., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier Inc. All rights reserved.)

Reporting discomfort when noise affects listening experience suggests that listeners may be aware, at least to some extent, of adverse environmental conditions and their impact on listening experience. This involves monitoring internal states (effort and confidence). Here we quantified continuous self-report indices that track one's own internal states and investigated age-related differences in this ability. We instructed two groups of young and older adults to continuously report their confidence and effort while listening to stories in fluctuating noise. Using cross-correlation analyses between the time series of fluctuating noise and those of perceived effort or confidence, we showed that (1) participants modified their assessment of effort and confidence based on variations in the noise, with a 4 s lag; (2) there were no differences between the groups. These findings imply extending this method to other areas, expanding the definition of metacognition, and highlighting the value of this ability for older adults., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

Objectives: This paper reports a noninvasive method for quantifying neural synchrony in the cochlear nerve (i.e., peripheral neural synchrony) in cochlear implant (CI) users, which allows for evaluating this physiological phenomenon in human CI users for the first time in the literature. In addition, this study assessed how peripheral neural synchrony was correlated with temporal resolution acuity and speech perception outcomes measured in quiet and in noise in postlingually deafened adult CI users. It tested the hypothesis that peripheral neural synchrony was an important factor for temporal resolution acuity and speech perception outcomes in noise in postlingually deafened adult CI users., Design: Study participants included 24 postlingually deafened adult CI users with a Cochlear™ Nucleus® device. Three study participants were implanted bilaterally, and each ear was tested separately. For each of the 27 implanted ears tested in this study, 400 sweeps of the electrically evoked compound action potential (eCAP) were measured at four electrode locations across the electrode array. Peripheral neural synchrony was quantified at each electrode location using the phase-locking value (PLV), which is a measure of trial-by-trial phase coherence among eCAP sweeps/trials. Temporal resolution acuity was evaluated by measuring the within-channel gap detection threshold (GDT) using a three-alternative, forced-choice procedure in a subgroup of 20 participants (23 implanted ears). For each ear tested in these participants, GDTs were measured at two electrode locations with a large difference in PLVs. For 26 implanted ears tested in 23 participants, speech perception performance was evaluated using consonant-nucleus-consonant (CNC) word lists presented in quiet and in noise at signal to noise ratios (SNRs) of +10 and +5 dB. Linear Mixed effect Models were used to evaluate the effect of electrode location on the PLV and the effect of the PLV on GDT after controlling for the stimulation level effects. Pearson product-moment correlation tests were used to assess the correlations between PLVs, CNC word scores measured in different conditions, and the degree of noise effect on CNC word scores., Results: There was a significant effect of electrode location on the PLV after controlling for the effect of stimulation level. There was a significant effect of the PLV on GDT after controlling for the effects of stimulation level, where higher PLVs (greater synchrony) led to lower GDTs (better temporal resolution acuity). PLVs were not significantly correlated with CNC word scores measured in any listening condition or the effect of competing background noise presented at an SNR of +10 dB on CNC word scores. In contrast, there was a significant negative correlation between the PLV and the degree of noise effect on CNC word scores for a competing background noise presented at an SNR of +5 dB, where higher PLVs (greater synchrony) correlated with smaller noise effects on CNC word scores., Conclusions: This newly developed method can be used to assess peripheral neural synchrony in CI users, a physiological phenomenon that has not been systematically evaluated in electrical hearing. Poorer peripheral neural synchrony leads to lower temporal resolution acuity and is correlated with a larger detrimental effect of competing background noise presented at an SNR of 5 dB on speech perception performance in postlingually deafened adult CI users., Competing Interests: The authors have no conflicts of interest to disclose., (Copyright © 2024 Wolters Kluwer Health, Inc. All rights reserved.)

Better communication with older people requires not only improving speech intelligibility but also understanding how well emotions can be conveyed and the effect of age and hearing loss (HL) on emotion perception. In this paper, emotion discrimination experiments were conducted using a vocal morphing method and an HL simulator in young normal hearing (YNH) and older participants. Speech sounds were morphed to represent intermediate emotions between all combinations of happiness, sadness, and anger. Discrimination performance was compared when the YNH listened to normal sounds, when the same YNH listened to HL simulated sounds, and when older people listened to the same normal sounds. The results showed that there was no significant difference between discrimination with and without HL simulation, suggesting that peripheral HL may not affect emotion perception. The discrimination performance of the older participants was significantly worse only for the anger-happiness pair than for the other emotion pairs and for the YNH. It was also found that the difficulty increases with age, not just with hearing level., (© 2024. The Author(s).)

Recognizing acoustically degraded speech relies on predictive processing whereby incomplete auditory cues are mapped to stored linguistic representations via pattern recognition processes. While listeners vary in their ability to recognize degraded speech, performance improves when a written transcription is presented, allowing completion of the partial sensory pattern to preexisting representations. Building on work characterizing predictive processing as pattern completion, we examined the relationship between domain-general pattern recognition and individual variation in degraded speech learning. Participants completed a visual pattern recognition task to measure individual-level tendency towards pattern completion. Participants were also trained to recognize noise-vocoded speech with written transcriptions and tested on speech recognition pre- and post-training using a retrieval-based transcription task. Listeners significantly improved in recognizing speech after training, and pattern completion on the visual task predicted improvement for novel items. The results implicate pattern completion as a domain-general learning mechanism that can facilitate speech adaptation in challenging contexts., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier Inc. All rights reserved.)

In language comprehension, we use perceptual cues to infer meanings. Some of these cues reside on perceptual dimensions. For example, the difference between bear and pear is cued by a difference in voice onset time (VOT), which is a continuous perceptual dimension. The present paper asks whether, and when, experience with a single value on a dimension behaving unexpectedly is used by the learner to reweight the whole dimension. We show that learners reweight the whole VOT dimension when exposed to a single VOT value (e.g., 45 ms) and provided with feedback indicating that the speaker intended to produce a /b/ 50% of the time and a /p/ the other 50% of the time. Importantly, dimensional reweighting occurs only if 1) the 50/50 feedback is unexpected for the VOT value, and 2) there is another dimension that is predictive of feedback. When no predictive dimension is available, listeners reassociate the experienced VOT value with the more surprising outcome but do not downweight the entire VOT dimension. These results provide support for perceptual representations of speech sounds that combine cues and dimensions, for viewing perceptual learning in speech as a combination of error-driven cue reassociation and dimensional reweighting, and for considering dimensional reweighting to be reallocation of attention that occurs only when there is evidence that reallocating attention would improve prediction accuracy (Harmon, Z., Idemaru, K., & Kapatsinski, V. 2019. Learning mechanisms in cue reweighting. Cognition, 189, 76-88.)., (Copyright © 2024 Elsevier B.V. All rights reserved.)

This paper investigates blind identification methods for linear scramblers under non‐cooperative conditions, which are essential for the inverse analysis of communication protocols using scramblers. In this paper, a blind identification scheme for feedback polynomials of synchronous scramblers is proposed. A variable Υ¯$\overline{\Upsilon }$ is first proposed that measures the correctness of the test polynomial by using the soft information of the received sequence, then the mean and variance of the variable Υ¯$\overline{\Upsilon }$ in different cases are obtained, and finally the optimal threshold value to determine whether the test primitive polynomial is correct or not is obtained. That is, the blind identification problem is transformed into a hypothesis testing problem. The simulations verify that the proposed scheme requires a much smaller scrambled sequence length than existing blind identification schemes. Furthermore, the proposed scheme is more fault tolerant than existing schemes and has a signal‐to‐noise ratio (SNR) gain of at least 3 dB when the intercepted scrambled sequences are of the same length and high identification accuracy is achieved. [ABSTRACT FROM AUTHOR]

Front-end speech enhancement methods based on microphone array are helpful to improve the front-end signal quality and speech recognition in cochlear implant. However, the size constraint will limit the available quantity of microphones. In this paper, we propose a dual-microphone signal acquisition method based on four acoustic tubes, and analyze the signal acquisition characteristics and beamforming feature. We research four types of beamforming mode to suit to the speech enhancement demand for cochlear implant, and further summarize the corresponding beamforming direction feature and the influence of different inter-microphone distances. The algorithm proposed in this paper has the characteristics of low computation, few microphones, and multiple sound tubes, and can meet the de-noising requirements of various specific application scenarios of cochlear implant. [ABSTRACT FROM AUTHOR]

Acoustic information in speech changes continuously, yet listeners form discrete perceptual categories to ease the demands of perception. Being a more continuous/gradient as opposed to a more discrete/categorical listener may be further advantageous for understanding speech in noise by increasing perceptual flexibility and resolving ambiguity. The degree to which a listener's responses to a continuum of speech sounds are categorical versus continuous can be quantified using visual analog scaling (VAS) during speech labeling tasks. Here, we recorded event-related brain potentials (ERPs) to vowels along an acoustic-phonetic continuum (/u/ to /a/) while listeners categorized phonemes in both clean and noise conditions. Behavior was assessed using standard two alternative forced choice (2AFC) and VAS paradigms to evaluate categorization under task structures that promote discrete vs. continuous hearing, respectively. Behaviorally, identification curves were steeper under 2AFC vs. VAS categorization but were relatively immune to noise, suggesting robust access to abstract, phonetic categories even under signal degradation. Behavioral slopes were correlated with listeners' QuickSIN scores; shallower slopes corresponded with better speech in noise performance, suggesting a perceptual advantage to noise degraded speech comprehension conferred by a more gradient listening strategy. At the neural level, P2 amplitudes and latencies of the ERPs were modulated by task and noise; VAS responses were larger and showed greater noise-related latency delays than 2AFC responses. More gradient responders had smaller shifts in ERP latency with noise, suggesting their neural encoding of speech was more resilient to noise degradation. Interestingly, source-resolved ERPs showed that more gradient listening was also correlated with stronger neural responses in left superior temporal gyrus. Our results demonstrate that listening strategy modulates the categorical organization of speech and behavioral success, with more continuous/gradient listening being advantageous to sentential speech in noise perception., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier B.V. All rights reserved.)

In an online class, students respond to queries initiated by the educator through voice, video, or chat. The educator receives these responses but cannot ascertain the emotion carried in these responses with confidence. This emotional limitation in online classes is a major drawback as emotions play a very important role in gauging student engagement and learning. This limitation in the detection of emotions or affective states in the responses of the student makes it difficult for the educator to decide if the student is on the right track or needs more help. On the other hand, if a negative affective state is detected, the educator could modify their teaching approach, speed, or content to the advantage of the student. This poses as an additional disadvantage to educators who suffer from any form of hearing impairment like late or acquired deafness, as they would have difficulty in hearing as well as gauging the emotion from student's feedback. Emotions being a key element in decision making and speech being one of the affective measurement channels, a useful solution would be to use an automatic speech emotion recognition system. In this paper, speech emotion recognition systems (SER) have been reviewed with the intention of identifying research gaps that need to be bridged before an effective SER application can be incorporated in any online education system for teaching. This would guarantee inclusivity as it would benefit all educators, especially the late deafened. This paper has been written with the intention of providing an in-depth understanding of SER components, spanning from emotional models to classifiers. The opportunities for possible improvements have also been touched upon. Special attention is given to deep learning approaches to understand their main contributions and challenges so far in this area. [ABSTRACT FROM AUTHOR]

This paper surveys human-inspired speech technologies developed for European Portuguese and the computational models they integrate and made them possible. In this regard, it covers systems for synthesis and recognition as well as information on the methods adopted for the speech production studies that were performed, in parallel, to support them. And, on doing so, it can also contribute to provide an entry point for those who work in the field but are not familiar with these particular areas, including: context, history, and comprehensive references. As the great majority of work in these areas for European Portuguese was done by the first author's research group, this paper can also be seen as a review of more than 25 years of research at University of Aveiro in these topics. [ABSTRACT FROM AUTHOR]

Human–computer interaction, Artificial Intelligence, and the multilingualism of digital culture open up unexpected scenarios in the contemporary design of cultural spaces with the creation of artifacts in which the analogic and digital dimensions come together to enhance the experience. Sensors and devices track user movement in the real world and translate the inputs into commands through hand gestures, speech recognition, head movements, tangible interfaces, or a combination of these elements. Through theorical models, concepts and tools, the paper reports the evolution of "User Experience" applied to personalized enjoyment and use of cultural places. The functional-performance survey of tools and technologies for perception, narrative and augmented interaction revealed models that highlight the diversity and richness of tangible and intangible cultural heritage through new forms of interaction and knowledge transfer. In this direction, new technological tools make it possible to detect, track and evaluate the personalized user experience by processing or producing large amounts of data. Therefore, on one hand the paper explores the limitations dictated by data management and user privacy in using such systems and, on the other, it prefigures new scenarios for amplifying and personalizing the user experience. [ABSTRACT FROM AUTHOR]

Children with single-sided deafness (SSD) may experience delays in language and speech development. Reduced speech discrimination and poor sound localization abilities in young SSD patients may result in greater cognitive efforts required to focus and process auditory information, as well as increased listening-related fatigue. Consequently, these children can have a higher risk of academic failure and are often in need of extra help at school. Recently, cochlear implants (CIs) have been introduced as a rehabilitative option for these children, but their effectiveness is still a topic of debate. A literature review was performed according to PRISMA guidelines, searching the Medline database from inception to October 2023. The research identified nine papers that met the inclusion criteria. Data extracted from the selected studies included 311 children affected by SSD and cochlear implants. The reported audiological outcomes were further analyzed. Overall, a high level of satisfaction was described by parents of children with SSD and CI, and those who received a CI under the age of 3 presented better results. However, a proportion of patients did not use the device daily. Our review highlights the possible, and still controversial, role of CI for the hearing rehabilitation of children with unilateral deafness, underlining the need for further research in this field. To date, careful and comprehensive counseling with the child and the family is necessary before considering this option. [ABSTRACT FROM AUTHOR]

The importance of automatic question generation (AQG) systems in education is recognized for automating tasks and providing adaptive assessments. Recent research focuses on improving quality with advanced neural networks and machine learning techniques. However, selecting the appropriate target sentences and concepts remains challenging in AQG systems. To address this problem, the authors created a novel system that combined sentence structure analysis, dependency parsing approach, and named entity recognition techniques to select the relevant target words from the given sentence. The main goal of this paper is to develop an AQG system using syntactic and semantic sentence structure analysis. Evaluation using manual and automatic metrics shows good performance on simple and short sentences, with an overall score of 3.67 out of 5.0. As the field of AQG continues to evolve rapidly, future research should focus on developing more advanced models that can generate a wider range of questions, especially for complex sentence structures. [ABSTRACT FROM AUTHOR]

Background: Cochlear implantation can be used when a patient's hearing cannot satisfactorily be improved after optimised hearing aid fitting. However, in patients with a cochlear nerve or brain disorder affecting hearing, the benefits of cochlear implants are not so straightforward. Methods: This paper describes a 58-year-old patient suffering from multiple sclerosis and profound sensorineural hearing loss, rehabilitated with a cochlear implant. Literature concerning cochlear implantation in demyelinating conditions was systematically reviewed using PubMed/Medline and Web of Science databases. Results: The patient's cochlear implantation was successful, with speech discrimination scores remaining above 90 per cent for eight years post-operatively. No previous cases of cochlear implantation with multiple sclerosis related hearing loss have been reported, despite the high incidence of hearing loss in multiple sclerosis patients. Conclusion: This paper demonstrates that multiple sclerosis lesions should not be an exclusion criterion in an otherwise suitable candidate for cochlear implantation. [ABSTRACT FROM AUTHOR]

Listening effort (LE) describes the cognitive resources needed to process an auditory message. Our understanding of this notion remains in its infancy, hindering our ability to appreciate how it impacts individuals with hearing impairment effectively. Despite the myriad of proposed measurement tools, a validated method remains elusive. This is complicated by the seeming lack of association between tools demonstrated via correlational analyses. This review aims to systematically review the literature relating to the correlational analyses between different measures of LE. Five databases were used-PubMed, Cochrane, EMBASE, PsychINFO, and CINAHL. The quality of the evidence was assessed using the GRADE criteria and risk of bias with ROBINS-I/GRADE tools. Each statistically significant analysis was classified using an approved system for medical correlations. The final analyses included 48 papers, equating to 274 correlational analyses, of which 99 reached statistical significance (36.1%). Within these results, the most prevalent classifications were poor or fair. Moreover, when moderate or very strong correlations were observed, they tended to be dependent on experimental conditions. The quality of evidence was graded as very low. These results show that measures of LE are poorly correlated and supports the multi-dimensional concept of LE. The lack of association may be explained by considering where each measure operates along the effort perception pathway. Moreover, the fragility of significant correlations to specific conditions further diminishes the hope of finding an all-encompassing tool. Therefore, it may be prudent to focus on capturing the consequences of LE rather than the notion itself. [ABSTRACT FROM AUTHOR]

The neural correlates of predictive processing in language, critical for efficient sentence comprehension, is well documented in adults. Specifically, adults exhibit alpha power (9-12 Hz) suppression when processing high versus low predictability sentences. This study explores whether young children exhibit similar neural mechanisms. We analyzed EEG data from 29 children aged 3-5 years listening to sentences of varying predictability. Our results revealed significant neural oscillation differences in the 5-12 Hz range between high and low predictability sentences, similar to adult patterns. Crucially, the degree of these differences correlated with children's language abilities. These findings are the first to demonstrate the neural basis of predictive processing in young children and its association with language development., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier Inc. All rights reserved.)

Considerable work has investigated similarities between the processing of music and language, but it remains unclear whether typical, genuine music can influence speech processing via cross-domain priming. To investigate this, we measured ERPs to musical phrases and to syntactically ambiguous Chinese phrases that could be disambiguated by early or late prosodic boundaries. Musical primes also had either early or late prosodic boundaries and we asked participants to judge whether the prime and target have the same structure. Within musical phrases, prosodic boundaries elicited reduced N1 and enhanced P2 components (relative to the no-boundary condition) and musical phrases with late boundaries exhibited a closure positive shift (CPS) component. More importantly, primed target phrases elicited a smaller CPS compared to non-primed phrases, regardless of the type of ambiguous phrase. These results suggest that prosodic priming can occur across domains, supporting the existence of common neural processes in music and language processing., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier Inc. All rights reserved.)

This paper provides a selective overview of some of the research that has followed from the publication of Werker and Tees (1984a) "Cross-language speech perception: Evidence for Perceptual Reorganization During the First Year of Life." Specifically, I briefly present the original finding, our interpretation of its meaning, and some key replications and extensions. I then review some of the work that has followed, including work with different kinds of populations, different kinds of speech sound contrasts, as well as attunement (perceptual reorganization) to additional properties of language beyond phonetic contrasts. Included is the body of work that queries whether perceptual attunement is a critical period phenomenon. Potential learning mechanisms for how experience functions to guide phonetic perceptual development are also presented, as is work on the relation between speech perception and word learning., Competing Interests: Declaration of Competing Interest None, (Crown Copyright © 2024. Published by Elsevier Inc. All rights reserved.)