Search

The vocal tract's motion during speech is a complex patterning of the movement of many different articulators according to many different time functions. Understanding this myriad of gestures is important to a number of different disciplines including automatic speech recognition, speech and language pathologies, speech motor control, and experimental phonetics. Central issues are the accurate description of the shape of the vocal tract and determining how each articulator contributes to this shape. A problem facing all of these research areas is how to cope with the multivariate data from speech production experiments. In this paper techniques are described that provide useful tools for describing multivariate functional data such as the measurement of speech movements. The choice of data analysis procedures has been motivated by the need to partition the articulator movement in various ways: end effects separated from shape effects, partitioning of syllable effects, and the splitting of variation within an articulator site from variation from between sites. The techniques of functional data analysis seem admirably suited to the analyses of phenomena such as these. Familiar multivariate procedures such as analysis of variance and principal components analysis have their functional counterparts, and these reveal in a way more suited to the data the important sources of variation in lip motion. Finally, it is found that the analyses of acceleration were especially helpful in suggesting possible control mechanisms. The focus is on using these speech production data to understand the basic principles of coordination. However, it is believed that the tools will have a more general use. © 1996 Acoustical Society of America. [ABSTRACT FROM AUTHOR]

The vocal tract's motion during speech is a complex patterning of the movement of many different articulators according to many different time functions. Central issues are the accurate description of the shape of the vocal tract and determining how each articulator contributes to this shape. Techniques are described that provide useful tools for describing multivariate functional data such as the measurement of speech movements. The choice of data analysis procedures has been motivated by the need to partition the articulator movement in various ways: movement start- and end-effects separated from shape effects, effects due to different syllables, and the splitting of within-sensor variation from between-sensor overall variation. The techniques of functional data analysis seem admirably suited to the analyses of phenomena such as these. Familiar multivariate procedures such as analysis of variance and principal components analysis have their functional counterparts, and these reveal in a way more suited to the data the important sources of variation in lip motion. Finally, it is found that the analyses of acceleration were especially revealing in considering the character of possible control mechanisms. [Work supported by NIH Grant DC-00594.] [ABSTRACT FROM AUTHOR]

This study examined the temporal phasing of tongue and lip movements in vowel-consonant-vowel sequences where the consonant is a bilabial stop consonant /p, b/ and the vowels one of /i, a, u/; only asymmetrical vowel contexts were included in the analysis. Four subjects participated. Articulatory movements were recorded using a magnetometer system. The onset of the tongue movement from the first to the second vowel almost always occurred before the oral closure. Most of the tongue movement trajectory from the first to the second vowel took place during the oral closure for the stop. For all subjects, the onset of the tongue movement occurred earlier with respect to the onset of the lip closing movement as the tongue movement trajectory increased. The influence of consonant voicing and vowel context on interarticulator timing and tongue movement kinematics varied across subjects. Overall, the results are compatible with the hypothesis that there is a temporal window before the oral closure for the stop during which the tongue movement can start. A very early onset of the tongue movement relative to the stop closure together with an extensive movement before the closure would most likely produce an extra vowel sound before the closure.

Vocal tract models are often used to study the problem of mapping from the acoustic transfer function to the vocal tract area function (inverse mapping). Unfortunately, results based on vocal tract models are strongly affected by the assumptions underlying the models. In this study, the mapping from acoustics (digitized speech samples) to articulation (measurements of the positions of receiver coils placed on the tongue, jaw, and lips) is examined using human data from a single speaker: Simultaneous acoustic and articulator measurements made for vowel-to-vowel transitions, /g/ closures, and transitions into and out of /g/ closures. Articulator positions were measured using an EMMA system to track coils placed on the lips, jaw, and tongue. Using these data, look-up tables were created that allow articulator positions to be estimated from acoustic signals. On a data set not used for making look-up tables, correlations between estimated and actual coil positions of around 94% and root-mean-squared errors around 2 mm are common for coils on the tongue. An error source evaluation shows that estimating articulator positions from quantized acoustics gives root-mean-squared errors that are typically less than 1 mm greater than the errors that would be obtained from quantizing the articulator positions themselves. This study agrees with and extends previous studies of human data by showing that for the data studied, speech acoustics can be used to accurately recover articulator positions.

It has been shown that articulator movements during speech are adjusted along a number of spatiotemporal dimensions. For example, variations in the extent of lip, jaw, or tongue motion are associated with proportional changes in the respective articulators' peak velocity. Modifications in the timing of lip and jaw actions are apparently constrained, exhibiting relative timing covariation. Syllable prominence systematically affects some combination of the articular motion parameters, i.e., extent, speed, and duration. The present investigation is an attempt to extend observations of the spatiotemporal properties of articulator movement to include the velum. Lip, jaw, and velar kinematics were recorded optoelectronically and simultaneously with the acoustic signal during productions of the utterance/mabnab/. The spatial and temporal relations between the lips, the jaw, and the velum were examined and compared across articulators. For movements associated with each syllable, the velum displayed scaling pattern qualitatively similar to those of the lips and jaw. Moreover, velocity-displacement relations were more robust for the lowering than for the raising movements of the velum. There was evidence of interarticulator coupling between the velum and the jaw, and between the velum and the upper lip, although this coupling was not as strong as that observed among the oral articulators. Articulator specific differences in velocity-displacement correlations and degree of interarticulator cohesion for the various movement phases may be related to a combination of aerodynamic and phonetic factors, such as the phonologically noncontrastive nature of nasalization in English.