Search

Using visual information to perform actions is a fundamental aspect of human behavior. Musicians commonly translate visual information into action using both concrete and abstract visual information. We exposed expert guitarists to four types of familiar visual depictions of action instruction including musical notation (very abstract), tablature (abstract), chord diagrams (more concrete), and actual pictures of guitars chords being formed (very concrete). These were shown during fMRI scanning as the guitarists formed the appropriate chords (as visually depicted) on a magnet safe guitar fret board with strings, or where they simply viewed the visual stimuli without an action. Whole brain contrasts revealed that the right precuneus was more active for abstract instruction while an occipito-insular circuit was more active for concrete instruction. The current findings highlight that the degree of over-learned visual abstraction is an important factor modulating visual-motor processing., (Copyright © 2021 Elsevier B.V. All rights reserved.)

Letter production through handwriting creates visual experiences that may be important for the development of visual letter perception. We sought to better understand the neural responses to different visual percepts created during handwriting at different levels of experience. Three groups of participants, younger children, older children, and adults, ranging in age from 4.5 to 22 years old, were presented with dynamic and static presentations of their own handwritten letters, static presentations of an age-matched control's handwritten letters, and typeface letters during fMRI. First, data from each group were analyzed through a series of contrasts designed to highlight neural systems that were most sensitive to each visual experience in each age group. We found that younger children recruited ventral-temporal cortex during perception and this response was associated with the variability present in handwritten forms. Older children and adults also recruited ventral-temporal cortex; this response, however, was significant for typed letter forms but not variability. The adult response to typed letters was more distributed than in the children, including ventral-temporal, parietal, and frontal motor cortices. The adult response was also significant for one's own handwritten letters in left parietal cortex. Second, we compared responses among age groups. Compared to older children, younger children demonstrated a greater fusiform response associated with handwritten form variability. When compared to adults, younger children demonstrated a greater response to this variability in left parietal cortex. Our results suggest that the visual perception of the variability present in handwritten forms that occurs during handwriting may contribute to developmental changes in the neural systems that support letter perception., (© 2020 John Wiley & Sons Ltd.)

Studies of symbol production using fMRI often use techniques that introduce an artificial pairing between motor production and visual perception. These techniques allow participants to see their own output by recording their pen trajectories using a touchscreen-only tablet and displaying these productions on a mirror placed above their head. We recently developed an MR-safe writing tablet with video display that allows participants to see their own hand and their own productions while producing symbols in real time on the surface where they are producing them-allowing for more ecologically valid fMRI studies of production. We conducted a study to determine whether the participation of posterior parietal cortex during symbol production was affected by the pairing of motor production and visual feedback associated with the two types of tablets. We performed ROI analyses in intraparietal sulcus while adult participants produced letters to dictation using either a touchscreen-only tablet (no visual guidance of the hand) (n = 14) or using a touchscreen-and-video-display tablet (visual guidance of the hand) (n = 14). We found that left posterior intraparietal sulcus was more active during production with the touchscreen-only tablet than during production with the touchscreen-and-video-display tablet. These results suggest that posterior parietal involvement during production tasks is associated with the somewhat artificial visual-motor pairing that is introduced by the techniques used in some studies of symbol production., Competing Interests: Declaration of Competing Interest This report makes use of an MRI-compatible device that is patent pending. If a patent issues it will be owned by the Trustees of Indiana University. The authors, therefore, believe there is no conflict of interest to report., (Copyright © 2020 Elsevier B.V. All rights reserved.)

Visuohaptic inputs offer redundant and complementary information regarding an object׳s geometrical structure. The integration of these inputs facilitates object recognition in adults. While the ability to recognize objects in the environment both visually and haptically develops early on, the development of the neural mechanisms for integrating visual and haptic object shape information remains unknown. In the present study, we used functional Magnetic Resonance Imaging (fMRI) in three groups of participants, 4 to 5.5 year olds, 7 to 8.5 year olds, and adults. Participants were tested in a block design involving visual exploration of two-dimensional images of common objects and real textures, and haptic exploration of their three-dimensional counterparts. As in previous studies, object preference was defined as a greater BOLD response for objects than textures. The analyses specifically target two sites of known visuohaptic convergence in adults: the lateral occipital tactile-visual region (LOtv) and intraparietal sulcus (IPS). Results indicated that the LOtv is involved in visuohaptic object recognition early on. More importantly, object preference in the LOtv became increasingly visually dominant with development. Despite previous reports that the lateral occipital complex (LOC) is adult-like by 8 years, these findings indicate that at least part of the LOC is not. Whole-brain maps showed overlap between adults and both groups of children in the LOC. However, the overlap did not build incrementally from the younger to the older group, suggesting that visuohaptic object preference does not develop in an additive manner. Taken together, the results show that the development of neural substrates for visuohaptic recognition is protracted compared to substrates that are primarily visual or haptic., (Copyright © 2014 Elsevier Ltd. All rights reserved.)

Our experience with the world commonly involves physical interaction with objects enabling us to learn associations between multisensory information perceived during an event and our actions that create an event. The interplay among active interactions during learning and multisensory integration of object properties is not well understood. To better understand how action might enhance multisensory associative recognition, we investigated the interplay among motor and perceptual systems after active learning. Fifteen participants were included in an fMRI study during which they learned visuo-auditory-motor associations between novel objects and the sounds they produce, either through self-generated actions on the objects (active learning) or by observing an experimenter produce the actions (passive learning). Immediately after learning, behavioral and BOLD fMRI measures were collected while perceiving the objects used during unisensory and multisensory training in associative perception and recognition tasks. Active learning was faster and led to more accurate recognition of audiovisual associations than passive learning. Functional ROI analyses showed that in motor, somatosensory, and cerebellar regions there was greater activation during both the perception and recognition of actively learned associations. Finally, functional connectivity between visual- and motor-related processing regions was enhanced during the presentation of actively learned audiovisual associations. Overall, the results of the current study clarify and extend our own previous work [Butler, A. J., James, T. W., & Harman James, K. Enhanced multisensory integration and motor reactivation after active motor learning of audiovisual associations. Journal of Cognitive Neuroscience, 23, 3515-3528, 2011] by providing several novel findings and highlighting the task-based nature of motor reactivation and retrieval after active learning.

Everyday experience affords us many opportunities to learn about objects through multiple senses using physical interaction. Previous work has shown that active motor learning of unisensory items enhances memory and leads to the involvement of motor systems during subsequent perception. However, the impact of active motor learning on subsequent perception and recognition of associations among multiple senses has not been investigated. Twenty participants were included in an fMRI study that explored the impact of active motor learning on subsequent processing of unisensory and multisensory stimuli. Participants were exposed to visuo-motor associations between novel objects and novel sounds either through self-generated actions on the objects or by observing an experimenter produce the actions. Immediately after exposure, accuracy, RT, and BOLD fMRI measures were collected with unisensory and multisensory stimuli in associative perception and recognition tasks. Response times during audiovisual associative and unisensory recognition were enhanced by active learning, as was accuracy during audiovisual associative recognition. The difference in motor cortex activation between old and new associations was greater for the active than the passive group. Furthermore, functional connectivity between visual and motor cortices was stronger after active learning than passive learning. Active learning also led to greater activation of the fusiform gyrus during subsequent unisensory visual perception. Finally, brain regions implicated in audiovisual integration (e.g., STS) showed greater multisensory gain after active learning than after passive learning. Overall, the results show that active motor learning modulates the processing of multisensory associations.

Previous research shows that sensory and motor systems interact during perception, but how these connections among systems are created during development is unknown. The current work exposes young children to novel 'verbs' and objects through either (a) actively exploring the objects or (b) by seeing an experimenter interact with the objects. Results demonstrate that the motor system is recruited during auditory perception only after learning involved self-generated interactions with objects. Action observation itself led to above-baseline activation in one motor region during visual perception, but was still significantly less active than after self-generated action. Therefore, in the developing brain, associations are built upon real-world interactions of body and environment, leading to sensori-motor representations of both objects and words., (© 2010 Blackwell Publishing Ltd.)

Environmental events produce many sensory cues for identifying the action that evoked the event, the agent that performed the action, and the object targeted by the action. The cues for identifying environmental events are usually distributed across multiple sensory systems. Thus, to understand how environmental events are recognized requires an understanding of the fundamental cognitive and neural processes involved in multisensory object and action recognition. Here, we investigated the neural substrates involved in auditory and visual recognition of object-directed actions. Consistent with previous work on visual recognition of isolated objects, visual recognition of actions, and recognition of environmental sounds, we found evidence for multisensory audiovisual event-selective activation bilaterally at the junction of the posterior middle temporal gyrus and the lateral occipital cortex, the left superior temporal sulcus, and bilaterally in the intraparietal sulcus. The results suggest that recognition of events through convergence of visual and auditory cues is accomplished through a network of brain regions that was previously implicated only in visual recognition of action., (Copyright © 2010 Elsevier Ltd. All rights reserved.)

Since Broca's studies on language processing, cortical functional specialization has been considered to be integral to efficient neural processing. A fundamental question in cognitive neuroscience concerns the type of learning that is required for functional specialization to develop. To address this issue with respect to the development of neural specialization for letters, we used functional magnetic resonance imaging (fMRI) to compare brain activation patterns in pre-school children before and after different letter-learning conditions: a sensori-motor group practised printing letters during the learning phase, while the control group practised visual recognition. Results demonstrated an overall left-hemisphere bias for processing letters in these pre-literate participants, but, more interestingly, showed enhanced blood oxygen-level-dependent activation in the visual association cortex during letter perception only after sensori-motor (printing) learning. It is concluded that sensori-motor experience augments processing in the visual system of pre-school children. The change of activation in these neural circuits provides important evidence that 'learning-by-doing' can lay the foundation for, and potentially strengthen, the neural systems used for visual letter recognition.

Letter production through handwriting creates visual experiences that may be important for the development of visual letter perception. We sought to better understand the neural responses to different visual percepts created during handwriting at different levels of experience. Three groups of participants, younger children, older children, and adults, ranging in age from 4.5 to 22 years old, were presented with dynamic and static presentations of their own handwritten letters, static presentations of an age-matched control's handwritten letters, and typeface letters during fMRI. First, data from each group were analyzed through a series of contrasts designed to highlight neural systems that were most sensitive to each visual experience in each age group. We found that younger children recruited ventral-temporal cortex during perception and this response was associated with the variability present in handwritten forms. Older children and adults also recruited ventral-temporal cortex; this response, however, was significant for typed letter forms but not variability. The adult response to typed letters was more distributed than in the children, including ventral-temporal, parietal, and frontal motor cortices. The adult response was also significant for one's own handwritten letters in left parietal cortex. Second, we compared responses among age groups. Compared to older children, younger children demonstrated a greater fusiform response associated with handwritten form variability. When compared to adults, younger children demonstrated a greater response to this variability in left parietal cortex. Our results suggest that the visual perception of the variability present in handwritten forms that occurs during handwriting may contribute to developmental changes in the neural systems that support letter perception.

Two important and related developments in children between 18 and 24 months of age are the rapid expansion of object name vocabularies and the emergence of an ability to recognize objects from sparse representations of their geometric shapes. In the same period, children also begin to show a preference for planar views (i.e., views of objects held perpendicular to the line of sight) of objects they manually explore. Are children's emerging view preferences somehow related to contemporary changes in object name vocabulary and object perception? Children aged 18 to 24 months old explored richly detailed toy objects while wearing a head camera that recorded their object views. Both children's vocabulary size and their success in recognizing sparse three-dimensional representations of the geometric shapes of objects were significantly related to their spontaneous choice of planar views of those objects during exploration. The results suggest important interdependencies among developmental changes in perception, action, word learning, and categorization in very young children.

Everyday experience affords us many opportunities to learn about objects through multiple senses using physical interaction. Previous work has shown that active motor learning of unisensory items enhances memory and leads to the involvement of motor systems during subsequent perception. However, the impact of active motor learning on subsequent perception and recognition of associations among multiple senses has not been investigated. Twenty participants were included in an fMRI study that explored the impact of active motor learning on subsequent processing of unisensory and multisensory stimuli. Participants were exposed to visuo-motor associations between novel objects and novel sounds either through self-generated actions on the objects or by observing an experimenter produce the actions. Immediately after exposure, accuracy, RT, and BOLD fMRI measures were collected with unisensory and multisensory stimuli in associative perception and recognition tasks. Response times during audiovisual associative and unisensory recognition were enhanced by active learning, as was accuracy during audiovisual associative recognition. The difference in motor cortex activation between old and new associations was greater for the active than the passive group. Furthermore, functional connectivity between visual and motor cortices was stronger after active learning than passive learning. Active learning also led to greater activation of the fusiform gyrus during subsequent unisensory visual perception. Finally, brain regions implicated in audiovisual integration (e.g., STS) showed greater multisensory gain after active learning than after passive learning. Overall, the results show that active motor learning modulates the processing of multisensory associations.

Previous research shows that sensory and motor systems interact during perception, but how these connections among systems are created during development is unknown. The current work exposes young children to novel "verbs" and objects through either (a) actively exploring the objects or (b) by seeing an experimenter interact with the objects. Results demonstrate that the motor system is recruited during auditory perception only after learning involved self-generated interactions with objects. Action observation itself led to above-baseline activation in one motor region during visual perception, but was still significantly less active than after self-generated action. Therefore, in the developing brain, associations are built upon real-world interactions of body and environment, leading to sensori-motor representations of both objects and words.

Since Broca's studies on language processing, cortical functional specialization has been considered to be integral to efficient neural processing. A fundamental question in cognitive neuroscience concerns the type of learning that is required for functional specialization to develop. To address this issue with respect to the development of neural specialization for letters, we used functional magnetic resonance imaging (fMRI) to compare brain activation patterns in pre-school children before and after different letter-learning conditions: a sensori-motor group practised printing letters during the learning phase, while the control group practised visual recognition. Results demonstrated an overall left-hemisphere bias for processing letters in these pre-literate participants, but, more interestingly, showed enhanced blood oxygen-level-dependent activation in the visual association cortex during letter perception "only" after sensori-motor (printing) learning. It is concluded that sensori-motor experience augments processing in the visual system of pre-school children. The change of activation in these neural circuits provides important evidence that "learning-by-doing" can lay the foundation for, and potentially strengthen, the neural systems used for visual letter recognition.

The effect of writing on the concurrent visual perception of letters was investigated in a series of studies using an interference paradigm. Participants drew shapes and letters while simultaneously visually identifying letters and shapes embedded in noise. Experiments 1-3 demonstrated that letter perception, but not the perception of shapes, was affected by motor interference. This suggests a strong link between the perception of letters and the neural substrates engaged during writing. The overlap both in category (letter vs. shape) and in the perceptual similarity of the features (straight vs. curvy) of the seen and drawn items determined the amount of interference. Experiment 4 demonstrated that intentional production of letters is not necessary for the interference to occur, because passive movement of the hand in the shape of letters also interfered with letter perception. When passive movements were used, however, only the category of the drawn items (letters vs. shapes), but not the perceptual similarity, had an influence, suggesting that motor representations for letters may selectively influence visual perception of letters through proprioceptive feedback, with an additional influence of perceptual similarity that depends on motor programs. (Contains 8 figures.)

Recent research has demonstrated that handwriting practice facilitates letter categorization in young children. The present experiments investigated why handwriting practice facilitates visual categorization by comparing 2 hypotheses: that handwriting exerts its facilitative effect because of the visual-motor production of forms, resulting in a direct link between motor and perceptual systems, or because handwriting produces variable visual instances of a named category in the environment that then changes neural systems. We addressed these issues by measuring performance of 5-year-old children on a categorization task involving novel, Greek symbols across 6 different types of learning conditions: 3 involving visual-motor practice (copying typed symbols independently, tracing typed symbols, tracing handwritten symbols) and 3 involving visual-auditory practice (seeing and saying typed symbols of a single typed font, of variable typed fonts, and of handwritten examples). We could therefore compare visual-motor production with visual perception both of variable and similar forms. Comparisons across the 6 conditions (N = 72) demonstrated that all conditions that involved studying highly variable instances of a symbol facilitated symbol categorization relative to conditions where similar instances of a symbol were learned, regardless of visual-motor production. Therefore, learning perceptually variable instances of a category enhanced performance, suggesting that handwriting facilitates symbol understanding by virtue of its environmental output: supporting the notion of developmental change though brain-body-environment interactions. [ABSTRACT FROM AUTHOR]

Gaze direction, a cue of both social and spatial attention, is known to modulate early neural responses tofaces e.g. N170. However, findings in the literature have been inconsistent, likely reflecting differences in stimulus characteristics and task requirements. Here, we investigated the effect of task on neural responses to dynamic gaze changes: away and toward transitions (resulting or not in eye contact). Subjects performed, in random order, social (away/toward them) and non-social (left/right) judgment tasks on these stimuli. Overall, in the non-social task, results showed a larger N170 to gaze aversion than gaze motion toward the observer. In the social task, however, this difference was no longer present in the right hemisphere, likely reflecting an enhanced N170 to gaze motion toward the observer. Our behavioral and event-related potential data indicate that performing social judgments enhances saliency of gaze motion toward the observer, even those that did not result in gaze contact. These data and that of previous studies suggest two modes of processing visual information: a 'default mode' that may focus on spatial information; a 'socially aware mode' that might be activated when subjects are required to make social judgments. The exact mechanism that allows switching from one mode to the other remains to be clarified. [ABSTRACT FROM AUTHOR]

Actions influence perceptions, but how this occurs may change across the lifespan. Studies have investigated how object-directed actions (e.g., learning about objects through manipulation) affect subsequent perception, but how abstract actions affect perception, and how this may change across development, have not been well studied. In the present study, we address this question, teaching children (4-7 year-olds) and adults sung melodies, with or without an abstract motor component, and using functional Magnetic Resonance Imaging (fMRI) to determine how these melodies are subsequently processed. Results demonstrated developmental change in the motor cortices and Middle Temporal Gyrus. Results have implications for understanding sensori-motor integration in the developing brain, and may provide insight into motor learning use in some music education techniques. [ABSTRACT FROM AUTHOR]

Previous research shows that sensory and motor systems interact during verb perception, and that these interactions are formed through self-generated actions that refer to verb labels during development. Here we expand on these findings by investigating whether self-generated actions lead to sensori-motor interaction during sound perception and visual perception. The current research exposes young children to novel sounds that are produced by object movement through either a) actively exploring the objects and producing the sounds or b) by seeing and hearing an experimenter interact with the objects. Results demonstrate that the motor system was recruited during auditory perception only after learning involved self-generated interactions with objects. Interestingly, visual association regions were also active during both sound perception and visual perception after active exploratory learning, but not after passive observation. Therefore, in the developing brain, associations are built upon real-world interactions of body and environment, leading to sensori-motor representations of both objects and sounds. [ABSTRACT FROM AUTHOR]

The effect of writing on the concurrent visual perception of letters was investigated in a series of studies using an interference paradigm. Participants drew shapes and letters while simultaneously visually identifying letters and shapes embedded in noise. Experiments 1-3 demonstrated that letter perception, but not the perception of shapes, was affected by motor interference. This suggests a strong link between the perception of letters and the neural substrates engaged during writing. The overlap both in category (letter vs. shape) and in the perceptual similarity of the features (straight vs. curvy) of the seen and drawn items determined the amount of interference. Experiment 4 demonstrated that intentional production of letters is not necessary for the interference to occur, because passive movement of the hand in the shape of letters also interfered with letter perception. When passive movements were used, however, only the category of the drawn items (letters vs. shapes), but not the perceptual similarity, had an influence, suggesting that motor representations for letters may selectively influence visual perception of letters through proprioceptive feedback, with an additional influence of perceptual similarity that depends on motor programs. [ABSTRACT FROM AUTHOR]