66 results on '"Gobbini MI"'
Search Results
2. Imbalanced between attentional and emotional system in social phobics processing social relevant stimulli
- Author
-
Gentili, Claudio, Gobbini, Mi, Ricciardi, Emiliano, Vanello, Nicola, Pietrini, Pietro, Haxby, Jv, and Guazzelli, Mario
- Published
- 2008
3. Supramodal, topographic and category-related organization in the ventral visual pathway
- Author
-
Ricciardi, Emiliano, Furey, Ml, Gobbini, Mi, Guazzelli, Mario, Haxby, Jv, and Pietrini, Pietro
- Published
- 2004
4. Neural Activity in Ventral Extrastriate Cortex during Tactile Discrimination of Faces and Other Objects in Congenitally Blind and Sighted Subjects. Presented at the 8th International Conference on Functional Mapping of Human Brain Mapping, June 2-6, 2002 Sendai, Japan. NeuroImage 658
- Author
-
Pietrini, Pietro, Furey, Ml, Ricciardi, Emiliano, Gobbini, Mi, Wc, Wu, Cohen, L, Guazzelli, Mario, and Haxby, Jv
- Published
- 2002
5. An fMRI functional connectivity study of face perception system in Social Phobic Patients and Healthy Controls
- Author
-
Danti, S, primary, Gentili, C, additional, Ricciardi, E, additional, Gobbini, MI, additional, Haxby, JV, additional, Guazzelli, M, additional, and Pietrini, P, additional
- Published
- 2009
- Full Text
- View/download PDF
6. Beyond Amygdala: Default mode network activity differs between patients with Social Phobia and healthy controls
- Author
-
Gentili, C, primary, Ricciardi, E, additional, Gobbini, MI, additional, Haxby, JV, additional, Pietrini, P, additional, and Guazzelli, M, additional
- Published
- 2009
- Full Text
- View/download PDF
7. Disentangling the representation of identity from head view along the human face processing pathway
- Author
-
Kelsey G. Wheeler, J. Swaroop Guntupalli, M. Ida Gobbini, Guntupalli, J, Wheeler, Kg, and Gobbini, Mi
- Subjects
Adult ,Male ,Right inferior ,Cognitive Neuroscience ,fusiform face area ,view-invariant face identity ,Face processing, Inferior Frontal Face Area, View-invariant Face identity, Fusiform Face Area, Occipital Face Area, Neural Decoding, fMRI ,Intermediate level ,Facial recognition system ,Brain mapping ,050105 experimental psychology ,03 medical and health sciences ,Cellular and Molecular Neuroscience ,0302 clinical medicine ,Face perception ,occipital face area ,Neural Pathways ,medicine ,Humans ,0501 psychology and cognitive sciences ,Visual Cortex ,Cognitive science ,Communication ,Brain Mapping ,medicine.diagnostic_test ,business.industry ,05 social sciences ,Recognition, Psychology ,Original Articles ,Fusiform face area ,neural decoding ,Frontal Lobe ,Visual cortex ,medicine.anatomical_structure ,Frontal lobe ,Pattern Recognition, Visual ,inferior frontal face area ,Female ,Nerve Net ,Functional magnetic resonance imaging ,Psychology ,business ,Facial Recognition ,030217 neurology & neurosurgery ,Neural decoding - Abstract
Neural models of a distributed system for face perception implicate a network of regions in the ventral visual stream for recognition of identity. Here, we report an fMRI neural decoding study in humans that shows that this pathway culminates in a right inferior frontal cortex face area (rIFFA) with a representation of individual identities that has been disentangled from variable visual features in different images of the same person. At earlier stages in the pathway, processing begins in early visual cortex and the occipital face area (OFA) with representations of head view that are invariant across identities, and proceeds to an intermediate level of representation in the fusiform face area (FFA) in which identity is emerging but still entangled with head view. Three-dimensional, view-invariant representation of identities in the rIFFA may be the critical link to the extended system for face perception, affording activation of person knowledge and emotional responses to familiar faces.Significance StatementIn this fMRI decoding experiment, we address how face images are processed in successive stages to disentangle the view-invariant representation of identity from variable visual features. Representations in early visual cortex and the occipital face area distinguish head views, invariant across identities. An intermediate level of representation in the fusiform face area distinguishes identities but still is entangled with head view. The face-processing pathway culminates in the right inferior frontal area with representation of view-independent identity. This paper clarifies the homologies between the human and macaque face processing systems. The findings show further, however, the importance of the inferior frontal cortex in decoding face identity, a result that has not yet been reported in the monkey literature.
- Published
- 2016
- Full Text
- View/download PDF
8. Idiosyncratic, Retinotopic Bias in Face Identification Modulated by Familiarity
- Author
-
M. Ida Gobbini, Morgan Taylor, Patrick Cavanagh, Matteo Visconti di Oleggio Castello, and Visconti di Oleggio Castello M, Taylor M, Cavanagh P, Gobbini MI
- Subjects
Adult ,Male ,vision ,media_common.quotation_subject ,Face (sociological concept) ,Identity (social science) ,Facial recognition system ,Young Adult ,Bias ,Perception ,Humans ,retinotopy ,Interpersonal Relations ,familiar face ,media_common ,familiarity ,face processing ,General Neuroscience ,Perspective (graphical) ,Recognition, Psychology ,social ,General Medicine ,New Research ,1.1 ,Visual field ,Identification (information) ,Pattern Recognition, Visual ,Cognition and Behavior ,Face identity ,Receptive field ,Face ,Retinotopy ,Face (geometry) ,familiar faces ,Female ,Psychology ,Facial Recognition ,Cognitive psychology - Abstract
The perception of gender and age of unfamiliar faces is reported to vary idiosyncratically across retinal locations such that, for example, the same androgynous face may appear to be male at one location but female at another. Here we test spatial heterogeneity for the recognition of the identity of personally familiar faces in human participants. We found idiosyncratic biases that were stable within participants and that varied more across locations for low as compared to high familiar faces. These data suggest that like face gender and age, face identity is processed, in part, by independent populations of neurons monitoring restricted spatial regions and that the recognition responses vary for the same face across these different locations. Moreover, repeated and varied social interactions appear to lead to adjustments of these independent face recognition neurons so that the same familiar face is eventually more likely to elicit the same recognition response across widely separated visual field locations. We provide a mechanistic account of this reduced retinotopic bias based on computational simulations.Significance statementIn this work we tested spatial heterogeneity for the recognition of personally familiar faces. We found retinotopic biases that varied more across locations for low as compared to highly familiar faces. The retinotopic biases were idiosyncratic and stable within participants. Our data suggest that, like face gender and age, face identity is processed by independent populations of neurons monitoring restricted spatial regions and that recognition may vary for the same face at these different locations. Unlike previous findings, our data and computational simulation address the effects of learning and show how increased familiarity modifies the representation of face identity in face-responsive cortical areas. This new perspective has broader implications for understanding how learning optimizes visual processes for socially salient stimuli.
- Published
- 2018
9. Familiar Face Detection in 180 ms
- Author
-
M. Ida Gobbini, Matteo Visconti di Oleggio Castello, Visconti di Oleggio Castello M, and Gobbini, Mi.
- Subjects
Eye Movements ,media_common.quotation_subject ,lcsh:Medicine ,Facial recognition system ,Reaction Time ,Saccades ,Contrast (vision) ,Humans ,Attention ,Face detection ,lcsh:Science ,Evoked Potentials ,Vision, Ocular ,media_common ,Multidisciplinary ,face processing ,lcsh:R ,Saccadic Reaction Time (SRT) ,Eye movement ,Recognition, Psychology ,Familiar face detection ,Visual appearance ,Pattern Recognition, Visual ,Face (geometry) ,Face ,Saccade ,Pattern recognition (psychology) ,lcsh:Q ,Psychology ,Cognitive psychology ,face recognition ,Research Article - Abstract
The visual system is tuned for rapid detection of faces, with the fastest choice saccade to a face at 100 ms. Familiar faces have a more robust representation than do unfamiliar faces, and are detected faster in the absence of awareness and with reduced attentional resources. Faces of family and close friends become familiar over a protracted period involving learning the unique visual appearance, including a view-invariant representation, as well as person knowledge. We investigated the effect of personal familiarity on the earliest stages of face processing by using a saccadic-choice task to measure how fast familiar face detection can happen. Subjects made correct and reliable saccades to familiar faces when unfamiliar faces were distractors at 180 ms--very rapid saccades that are 30 to 70 ms earlier than the earliest evoked potential modulated by familiarity. By contrast, accuracy of saccades to unfamiliar faces with familiar faces as distractors did not exceed chance. Saccades to faces with object distractors were even faster (110 to 120 ms) and equivalent for familiar and unfamiliar faces, indicating that familiarity does not affect ultra-rapid saccades. We propose that detectors of diagnostic facial features for familiar faces develop in visual cortices through learning and allow rapid detection that precedes explicit recognition of identity.
- Published
- 2015
10. Facilitated detection of social cues conveyed by familiar faces
- Author
-
M. Ida Gobbini, J. Swaroop Guntupalli, Matteo Visconti di Oleggio Castello, Hua Yang, Visconti di Oleggio Castello M, Guntupalli JS, Yang H, and Gobbini MI
- Subjects
social cognition ,lcsh:RC321-571 ,Behavioral Neuroscience ,Face perception ,Social cognition ,Orientation (mental) ,Original Research Article ,lcsh:Neurosciences. Biological psychiatry. Neuropsychiatry ,Biological Psychiatry ,Visual search ,familiar face recognition ,Communication ,visual search ,business.industry ,head angle ,Visibility (geometry) ,Social cue ,Gaze ,attention ,Psychiatry and Mental health ,Neuropsychology and Physiological Psychology ,Neurology ,face perception ,Eye tracking ,eye gaze ,Psychology ,business ,Neuroscience - Abstract
Recognition of the identity of familiar faces in conditions with poor visibility or over large changes in head angle, lighting and partial occlusion is far more accurate than recognition of unfamiliar faces in similar conditions. Here we used a visual search paradigm to test if one class of social cues transmitted by faces – direction of another’s attention as conveyed by gaze direction and head orientation – is perceived more rapidly in personally familiar faces than in unfamiliar faces. We found a strong effect of familiarity on the detection of these social cues, suggesting that the times to process these signals in familiar faces are markedly faster than the corresponding processing times for unfamiliar faces. In the light of these new data, hypotheses on the organization of the visual system for processing faces are formulated and discussed.
- Published
- 2014
11. Processing of invisible social cues
- Author
-
Yaroslav O. Halchenko, Carlo Cipolli, Jason Gors, M. Ida Gobbini, Howard C. Hughes, Gobbini MI, Gors JD, Halchenko YO, Hughes HC, and Cipolli C
- Subjects
Adult ,Male ,genetic structures ,Adolescent ,Face perception ,Binocular Rivalry ,Face (sociological concept) ,Experimental and Cognitive Psychology ,Fixation, Ocular ,Young Adult ,Arts and Humanities (miscellaneous) ,Social cognition ,Conscious awareness ,Developmental and Educational Psychology ,Reaction Time ,Humans ,Face detection ,Communication ,Unconscious, Psychology ,business.industry ,Recognition, Psychology ,Social cue ,Awareness ,Pattern Recognition, Visual ,Social Perception ,Face ,Female ,Interocular suppression ,Cues ,business ,Psychology ,Perceptual Masking ,Social relevance ,Photic Stimulation - Abstract
Successful interactions between people are dependent on rapid recognition of social cues. We investigated whether head direction – a powerful social signal – is processed in the absence of conscious awareness. We used continuous flash interocular suppression to render stimuli invisible and compared the reaction time for face detection when faces were turned towards the viewer and turned slightly away. We found that faces turned towards the viewer break through suppression faster than faces that are turned away, regardless of eye direction. Our results suggest that detection of a face with attention directed at the viewer occurs even in the absence of awareness of that face. While previous work has demonstrated that stimuli that signal threat are processed without awareness, our data suggest that the social relevance of a face, defined more broadly, is evaluated in the absence of awareness.
- Published
- 2012
12. Beyond amygdala: Default Mode Network activity differs between patients with social phobia and healthy controls
- Author
-
Pietro Pietrini, Claudio Gentili, Emiliano Ricciardi, James V. Haxby, Maria Ida Gobbini, Mario Guazzelli, Maria Filomena Santarelli, Gentili C, Ricciardi E, Gobbini MI, Santarelli MF, Haxby JV, Pietrini P, and Guazzelli M.
- Subjects
Adult ,Male ,Emotions ,Social cognition ,Theory of mind ,medicine ,Humans ,Default mode network ,Brain Mapping ,General Neuroscience ,Brain ,medicine.disease ,Magnetic Resonance Imaging ,Social relation ,Frontal Lobe ,Facial Expression ,Phobic Disorders ,Posterior cingulate ,Rumination ,Visual Perception ,Anxiety ,Female ,medicine.symptom ,Psychology ,human activities ,Anxiety disorder ,Photic Stimulation ,Cognitive psychology - Abstract
The Default Mode Network (DMN) is a constellation of brain areas that decrease their activity during a wide number of different goal-oriented tasks as compared to passive "rest" tasks. DMN can be modulated by different factors such as emotional states, cognitive load of the task and psychopathology, including anxiety. Moreover, DMN seems to play a pivotal role in social cognition. For example, the ability to predict another person's behaviour taking his or her perspective modulates the activity of the DMN. Recent data from autistic patients support a role of DMN in social cognition as well. Social Phobia (SP) is an anxiety disorder characterized by an abnormal distress in situations that require social interaction. To date, no study has assessed DMN in Social Phobia. To determine potential differences in DMN activity between Social Phobia patients (SPP) and healthy control (HC) subjects we examined functional magnetic resonance imaging (fMRI) data obtained during a face perception study with emotional and neutral stimuli. As compared to HC, SPP showed a lower deactivation in the precuneus and posterior cingulate regions (PCun/PCC) during task conditions. These regions are part of the so-called "Theory of Mind" circuit and in particular they are involved in the evaluation of one's own emotional state. Because of the role of the PCun/PCC in self-state perception and attribution and, more in general, the role of the DMN in social cognition, we suggest that its impairment in the DMN network in SPP might be relevant in the development of the feeling of wariness of others' judgment and may be related to the so-called self-focused attention. Self-focused attention is the awareness of self-referent information, and is present in many emotional disorders and may additionally prevent individuals from observing external information that could disconfirm their own fears. Moreover, the abnormal modulation of activity in the DMN may reflect persistent rumination or anxiety-related thoughts that are not modulated by the switch from rest to task.
- Published
- 2009
13. Differential modulation of neural activity throughout the distributed neural system for face perception in patients with Social Phobia and healthy subjects
- Author
-
James V. Haxby, Maria Ida Gobbini, Claudio Gentili, Mario Guazzelli, Nicola Vanello, Emiliano Ricciardi, Pietro Pietrini, Gentili C, Gobbini MI, Ricciardi E, Vanello N, Pietrini P, Haxby JV, and Guazzelli M
- Subjects
Adult ,Male ,genetic structures ,Brain activity and meditation ,Emotions ,Intraparietal sulcus ,behavioral disciplines and activities ,Face perception ,Humans ,Emotional expression ,Neurons ,Facial expression ,Brain Mapping ,Fusiform gyrus ,General Neuroscience ,Brain ,Superior temporal sulcus ,Middle Aged ,Magnetic Resonance Imaging ,Facial Expression ,Phobic Disorders ,Visual Perception ,Female ,Psychology ,Insula ,Cognitive psychology - Abstract
Social Phobia (SP) is a marked and persistent fear of social or performance situations in which the person is exposed to unfamiliar people or to possible scrutiny by others. Faces of others are perceived as threatening by social phobic patients (SPP). To investigate how face processing is altered in the distributed neural system for face perception in Social Phobia, we designed an event-related fMRI study in which Healthy Controls (HC) and SPP were presented with angry, fearful, disgusted, happy and neutral faces and scrambled pictures (visual baseline). As compared to HC, SPP showed increased neural activity not only in regions involved in emotional processing including left amygdala and insula, as expected from previous reports, but also in the bilateral superior temporal sulcus (STS), a part of the core system for face perception that is involved in the evaluation of expression and personal traits. In addition SPP showed a significantly weaker activation in the left fusiform gyrus, left dorsolateral prefrontal cortex, and bilateral intraparietal sulcus as compared to HC. These effects were found not only in response to emotional faces but also to neutral faces as compared to scrambled pictures. Thus, SPP showed enhanced activity in brain areas related to processing of information about emotional expression and personality traits. In contrast, brain activity was decreased in areas for attention and for processing other information from the face, perhaps as a result of a feeling of wariness. These results indicate a differential modulation of neural activity throughout the different parts of the distributed neural system for face perception in SPP as compared to HC.
- Published
- 2008
14. Spontaneous retrieval of affective person knowledge in face perception
- Author
-
Todorov A, Evans KK, Haxby J.V., GOBBINI, MARIA IDA, Todorov A, Gobbini MI, Evans KK, and Haxby JV.
- Abstract
In a functional magnetic resonance imaging experiment, we explored whether affective person knowledge based on memories formed from minimal information is spontaneously retrieved in face perception. In the first stage of the experiment, participants were presented with 120 unfamiliar faces. Each face was presented with a description of one of four types of behaviors: aggressive, disgusting, neutral, and nice. In the second stage, participants were scanned while engaged in a one-back recognition task in which they saw the faces that were associated with behaviors and 30 novel faces. Although this task is a simple perceptual task that neither demands person evaluation nor retrieval of person knowledge, neural responses to faces differed as a function of the behaviors. Faces associated with behaviors evoked stronger activity than did novel faces in regions implicated in social cognition-anterior paracingulate cortex and superior temporal sulcus. Explicit memory for the behaviors enhanced the neural response in these regions. Faces associated with disgusting behaviors evoked stronger activity in left anterior insula than did faces associated with aggressive behaviors. This effect was equally strong for faces associated with explicitly recalled behaviors and faces associated with non-recalled behaviors. The findings suggest that affective person knowledge acquired from minimal information is spontaneously retrieved in face perception, engaging neural systems for analysis of social cognition and emotions.
- Published
- 2007
15. Two takes on the social brain: a comparison of theory of mind tasks
- Author
-
GOBBINI, MARIA IDA, Koralek AC, Bryan RE, Montgomery KJ, Haxby JV, Gobbini MI, Koralek AC, Bryan RE, Montgomery KJ, and Haxby JV
- Published
- 2007
16. Neural systems for recognition of familiar faces
- Author
-
GOBBINI, MARIA IDA, Haxby J.V., Gobbini MI, and Haxby JV.
- Abstract
Immediate access to information about people that we encounter is an essential requirement for effective social interactions. In this manuscript we briefly review our work and work of others on familiar face recognition and propose a modified version of our model of neural systems for face perception with a special emphasis on processes associated with recognition of familiar faces. We argue that visual appearance is only one component of successful recognition of familiar individuals. Other fundamental aspects include the retrieval of "person knowledge" - the representation of the personal traits, intentions, and outlook of someone we know - and the emotional response we experience when seeing a familiar individual. Specifically, we hypothesize that the "theory of mind" areas, that have been implicated in social and cognitive functions other than face perception, play an essential role in the spontaneous activation of person knowledge associated with the recognition of familiar individuals. The amygdala and the insula, structures that are involved in the representation of emotion, also are part of the distributed network of areas that are modulated by familiarity, reflecting the role of emotion in face recognition.
- Published
- 2007
17. Spatial distribution of face and objects representation in the human brain
- Author
-
Haxby J, GOBBINI, MARIA IDA, WENYI ZHAO, RAMA CHELLAPPA, Haxby J, and Gobbini MI.
- Subjects
genetic structures - Abstract
Numerous imaging studies have reported a consistent activation in the fusiform gyrus (in a portion localized between the occipital and temporal lobes) when contrasting the response to faces to other categories of objects. This region has been called “Fusiform Face Area”, FFA (Kanwisher et al. 1997). Since this pivotal finding, further work has investigated the role of the fusiform gyrus in the perception of object categories other than faces. With this purpose, many experiments have contrasted the response to different types of objects and other areas have been identified by their maximal response to specific categories. For example, an area in the parahippocampal gyrus responds maximally to interior spaces, buildings or landscapes, the so-called parahippocampal place area (PPA) (Epstein and Kanwisher 1998), and an area localized in the inferior temporal gyrus responds maximally to body parts other than faces, the so-called extrastriate body part (EBA) (Downing et al. 2001). This preferential activation in specific regions in response to specific categories has contributed to a controversy about how the brain represents and differentiates among categories of objects. One line of thought proposes a modular theory according to which the brain is organized in ‘modules’ each dedicated to the representation of a specific type of information (Kanwisher J Neurosci 1997). Another line of thought proposes, in contrast to previous hypothesis, that the representation of different categories of objects in the brain is shaped by experience. According to this view, the “fusiform face area” is specialized for the representation of ‘visual expertise’ – which refers to the capacity for finer-grained discrimination among individuals within category – not just for face perception (Gauthier et al Nat Neurosci 2000). A third line of thought argues that the organization of object-responsive cortex can be explained by a coarse retinotopy that biases the representation of object categories according to how consistently those categories are perceived in central or peripheral vision (Malach et al. 2002). We have proposed that the representations of faces and objects in ventral temporal cortex are distributed and overlapping (Haxby et al. 2001). We showed that the distinctiveness of the response to a given category is not due simply to the regions that respond maximally to that category by demonstrating that the category been viewed can still be identified on the basis of the pattern of response when those regions were excluded from the analysis. Thus, representations of faces and objects are distributed locally within ventral temporal cortex. Faces and other categories of objects also evoke neural activity in cortical areas outside the ventral object vision pathway. These responses indicate the spontaneous activation of other types of information that are associated with objects, such as the emotion associated with a facial expression, the direction of attention indicated by eye gaze, or the motion associated with tool use. Thus, the representation of a visually-presented object appears to be distributed not only locally but also across multiple cortical areas. Finally, the temporal course for the development of face and object representations can be studied with electro- and magnetoencephalography (EEG and MEG). Although early neural responses (< 200 ms) can differentiate among some categories, only later responses show the effect of familiarity or reflect finer discriminations within a category (Bentin et al. 1998; Sugase et al. 1999; Eimer 2000). In this chapter, we review the functional neuroanatomy of face and object recognition with emphasis on explicating how representation are distributed in space and time.
- Published
- 2006
18. Beyond sensory images: Object-based representation in the human ventral pathway
- Author
-
Pietrini P, Furey ML, Ricciardi E, Wu WH, Cohen L, Guazzelli M, Haxby J.V., GOBBINI, MARIA IDA, Pietrini P, Furey ML, Ricciardi E, Gobbini MI, Wu WH, Cohen L, Guazzelli M, and Haxby JV.
- Subjects
genetic structures ,eye diseases - Abstract
We investigated whether the topographically organized, category-related patterns of neural response in the ventral visual pathway are a representation of sensory images or a more abstract representation of object form that is not dependent on sensory modality. We used functional MRI to measure patterns of response evoked during visual and tactile recognition of faces and manmade objects in sighted subjects and during tactile recognition in blind subjects. Results showed that visual and tactile recognition evoked category-related patterns of response in a ventral extrastriate visual area in the inferior temporal gyrus that were correlated across modality for manmade objects. Blind subjects also demonstrated category-related patterns of response in this "visual" area, and in more ventral cortical regions in the fusiform gyrus, indicating that these patterns are not due to visual imagery and, furthermore, that visual experience is not necessary for category-related representations to develop in these cortices. These results demonstrate that the representation of objects in the ventral visual pathway is not simply a representation of visual images but, rather, is a representation of more abstract features of object form.
- Published
- 2004
19. A cortical surface template for human neuroscience.
- Author
-
Feilong M, Jiahui G, Gobbini MI, and Haxby JV
- Subjects
- Humans, Neuroimaging methods, Magnetic Resonance Imaging methods, Image Processing, Computer-Assisted methods, Neurosciences methods, Brain Mapping methods, Male, Female, Cerebral Cortex diagnostic imaging, Cerebral Cortex anatomy & histology, Algorithms
- Abstract
Neuroimaging data analysis relies on normalization to standard anatomical templates to resolve macroanatomical differences across brains. Existing human cortical surface templates sample locations unevenly because of distortions introduced by inflation of the folded cortex into a standard shape. Here we present the onavg template, which affords uniform sampling of the cortex. We created the onavg template based on openly available high-quality structural scans of 1,031 brains-25 times more than existing cortical templates. We optimized the vertex locations based on cortical anatomy, achieving an even distribution. We observed consistently higher multivariate pattern classification accuracies and representational geometry inter-participant correlations based on onavg than on other templates, and onavg only needs three-quarters as much data to achieve the same performance compared with other templates. The optimized sampling also reduces CPU time across algorithms by 1.3-22.4% due to less variation in the number of vertices in each searchlight., (© 2024. The Author(s).)
- Published
- 2024
- Full Text
- View/download PDF
20. Cross-movie prediction of individualized functional topography.
- Author
-
Jiahui G, Feilong M, Nastase SA, Haxby JV, and Gobbini MI
- Subjects
- Humans, Brain, Cognition, Databases, Factual, Motion Pictures, Academies and Institutes
- Abstract
Participant-specific, functionally defined brain areas are usually mapped with functional localizers and estimated by making contrasts between responses to single categories of input. Naturalistic stimuli engage multiple brain systems in parallel, provide more ecologically plausible estimates of real-world statistics, and are friendly to special populations. The current study shows that cortical functional topographies in individual participants can be estimated with high fidelity from naturalistic stimuli. Importantly, we demonstrate that robust, individualized estimates can be obtained even when participants watched different movies, were scanned with different parameters/scanners, and were sampled from different institutes across the world. Our results create a foundation for future studies that allow researchers to estimate a broad range of functional topographies based on naturalistic movies and a normative database, making it possible to integrate high-level cognitive functions across datasets from laboratories worldwide., Competing Interests: GJ, MF, SN, JH, MG No competing interests declared, (© 2023, Jiahui et al.)
- Published
- 2023
- Full Text
- View/download PDF
21. Modeling naturalistic face processing in humans with deep convolutional neural networks.
- Author
-
Jiahui G, Feilong M, Visconti di Oleggio Castello M, Nastase SA, Haxby JV, and Gobbini MI
- Subjects
- Humans, Neural Networks, Computer, Image Processing, Computer-Assisted methods, Brain diagnostic imaging, Neuroimaging, Facial Recognition physiology
- Abstract
Deep convolutional neural networks (DCNNs) trained for face identification can rival and even exceed human-level performance. The ways in which the internal face representations in DCNNs relate to human cognitive representations and brain activity are not well understood. Nearly all previous studies focused on static face image processing with rapid display times and ignored the processing of naturalistic, dynamic information. To address this gap, we developed the largest naturalistic dynamic face stimulus set in human neuroimaging research (700+ naturalistic video clips of unfamiliar faces). We used this naturalistic dataset to compare representational geometries estimated from DCNNs, behavioral responses, and brain responses. We found that DCNN representational geometries were consistent across architectures, cognitive representational geometries were consistent across raters in a behavioral arrangement task, and neural representational geometries in face areas were consistent across brains. Representational geometries in late, fully connected DCNN layers, which are optimized for individuation, were much more weakly correlated with cognitive and neural geometries than were geometries in late-intermediate layers. The late-intermediate face-DCNN layers successfully matched cognitive representational geometries, as measured with a behavioral arrangement task that primarily reflected categorical attributes, and correlated with neural representational geometries in known face-selective topographies. Our study suggests that current DCNNs successfully capture neural cognitive processes for categorical attributes of faces but less accurately capture individuation and dynamic features.
- Published
- 2023
- Full Text
- View/download PDF
22. Familiarity Facilitates Detection of Angry Expressions.
- Author
-
Chauhan V, Visconti di Oleggio Castello M, Taylor M, and Gobbini MI
- Abstract
Personal familiarity facilitates rapid and optimized detection of faces. In this study, we investigated whether familiarity associated with faces can also facilitate the detection of facial expressions. Models of face processing propose that face identity and face expression detection are mediated by distinct pathways. We used a visual search paradigm to assess if facial expressions of emotion (anger and happiness) were detected more rapidly when produced by familiar as compared to unfamiliar faces. We found that participants detected an angry expression 11% more accurately and 135 ms faster when produced by familiar as compared to unfamiliar faces while happy expressions were detected with equivalent accuracies and at equivalent speeds for familiar and unfamiliar faces. These results suggest that detectors in the visual system dedicated to processing features of angry expressions are optimized for familiar faces.
- Published
- 2023
- Full Text
- View/download PDF
23. Shared neural codes for visual and semantic information about familiar faces in a common representational space.
- Author
-
Visconti di Oleggio Castello M, Haxby JV, and Gobbini MI
- Subjects
- Adult, Brain diagnostic imaging, Female, Humans, Magnetic Resonance Imaging, Male, Semantics, Brain physiology, Facial Recognition physiology, Recognition, Psychology physiology
- Abstract
Processes evoked by seeing a personally familiar face encompass recognition of visual appearance and activation of social and person knowledge. Whereas visual appearance is the same for all viewers, social and person knowledge may be more idiosyncratic. Using between-subject multivariate decoding of hyperaligned functional magnetic resonance imaging data, we investigated whether representations of personally familiar faces in different parts of the distributed neural system for face perception are shared across individuals who know the same people. We found that the identities of both personally familiar and merely visually familiar faces were decoded accurately across brains in the core system for visual processing, but only the identities of personally familiar faces could be decoded across brains in the extended system for processing nonvisual information associated with faces. Our results show that personal interactions with the same individuals lead to shared neural representations of both the seen and unseen features that distinguish their identities., Competing Interests: The authors declare no competing interest., (Copyright © 2021 the Author(s). Published by PNAS.)
- Published
- 2021
- Full Text
- View/download PDF
24. Hybrid hyperalignment: A single high-dimensional model of shared information embedded in cortical patterns of response and functional connectivity.
- Author
-
Busch EL, Slipski L, Feilong M, Guntupalli JS, Castello MVDO, Huckins JF, Nastase SA, Gobbini MI, Wager TD, and Haxby JV
- Subjects
- Adult, Cerebral Cortex physiology, Female, Humans, Male, Nerve Net physiology, Photic Stimulation methods, Brain Mapping methods, Cerebral Cortex diagnostic imaging, Image Processing, Computer-Assisted methods, Magnetic Resonance Imaging methods, Motion Pictures, Nerve Net diagnostic imaging
- Abstract
Shared information content is represented across brains in idiosyncratic functional topographies. Hyperalignment addresses these idiosyncrasies by using neural responses to project individuals' brain data into a common model space while maintaining the geometric relationships between distinct patterns of activity or connectivity. The dimensions of this common model capture functional profiles that are shared across individuals such as cortical response profiles collected during a common time-locked stimulus presentation (e.g. movie viewing) or functional connectivity profiles. Hyperalignment can use either response-based or connectivity-based input data to derive transformations that project individuals' neural data from anatomical space into the common model space. Previously, only response or connectivity profiles were used in the derivation of these transformations. In this study, we developed a new hyperalignment algorithm, hybrid hyperalignment, that derives transformations based on both response-based and connectivity-based information. We used three different movie-viewing fMRI datasets to test the performance of our new algorithm. Hybrid hyperalignment derives a single common model space that aligns response-based information as well as or better than response hyperalignment while simultaneously aligning connectivity-based information better than connectivity hyperalignment. These results suggest that a single common information space can encode both shared cortical response and functional connectivity profiles across individuals., (Copyright © 2021 The Author(s). Published by Elsevier Inc. All rights reserved.)
- Published
- 2021
- Full Text
- View/download PDF
25. An fMRI dataset in response to "The Grand Budapest Hotel", a socially-rich, naturalistic movie.
- Author
-
Visconti di Oleggio Castello M, Chauhan V, Jiahui G, and Gobbini MI
- Subjects
- Brain physiology, Facial Expression, Humans, Social Interaction, Brain diagnostic imaging, Brain Mapping, Magnetic Resonance Imaging, Motion Pictures
- Abstract
Naturalistic stimuli evoke strong, consistent, and information-rich patterns of brain activity, and engage large extents of the human brain. They allow researchers to compare highly similar brain responses across subjects, and to study how complex representations are encoded in brain activity. Here, we describe and share a dataset where 25 subjects watched part of the feature film "The Grand Budapest Hotel" by Wes Anderson. The movie has a large cast with many famous actors. Throughout the story, the camera shots highlight faces and expressions, which are fundamental to understand the complex narrative of the movie. This movie was chosen to sample brain activity specifically related to social interactions and face processing. This dataset provides researchers with fMRI data that can be used to explore social cognitive processes and face processing, adding to the existing neuroimaging datasets that sample brain activity with naturalistic movies.
- Published
- 2020
- Full Text
- View/download PDF
26. Predicting individual face-selective topography using naturalistic stimuli.
- Author
-
Jiahui G, Feilong M, Visconti di Oleggio Castello M, Guntupalli JS, Chauhan V, Haxby JV, and Gobbini MI
- Subjects
- Adult, Female, Forecasting, Humans, Male, Photic Stimulation methods, Young Adult, Brain diagnostic imaging, Brain physiology, Facial Recognition physiology, Magnetic Resonance Imaging methods, Motion Pictures
- Abstract
Subject-specific, functionally defined areas are conventionally estimated with functional localizers and a simple contrast analysis between responses to different stimulus categories. Compared with functional localizers, naturalistic stimuli provide several advantages such as stronger and widespread brain activation, greater engagement, and increased subject compliance. In this study we demonstrate that a subject's idiosyncratic functional topography can be estimated with high fidelity from that subject's fMRI data obtained while watching a naturalistic movie using hyperalignment to project other subjects' localizer data into that subject's idiosyncratic cortical anatomy. These findings lay the foundation for developing an efficient tool for mapping functional topographies for a wide range of perceptual and cognitive functions in new subjects based only on fMRI data collected while watching an engaging, naturalistic stimulus and other subjects' localizer data from a normative sample., (Copyright © 2019 The Authors. Published by Elsevier Inc. All rights reserved.)
- Published
- 2020
- Full Text
- View/download PDF
27. Naturalistic stimuli reveal a dominant role for agentic action in visual representation.
- Author
-
Haxby JV, Gobbini MI, and Nastase SA
- Subjects
- Animals, Humans, Biomedical Research methods, Biomedical Research standards, Biomedical Research trends, Brain Mapping, Cerebral Cortex physiology, Cognitive Neuroscience methods, Cognitive Neuroscience standards, Cognitive Neuroscience trends, Magnetic Resonance Imaging, Motion Pictures, Visual Perception physiology
- Abstract
Naturalistic, dynamic movies evoke strong, consistent, and information-rich patterns of activity over a broad expanse of cortex and engage multiple perceptual and cognitive systems in parallel. The use of naturalistic stimuli enables functional brain imaging research to explore cognitive domains that are poorly sampled in highly-controlled experiments. These domains include perception and understanding of agentic action, which plays a larger role in visual representation than was appreciated from experiments using static, controlled stimuli., (Copyright © 2020. Published by Elsevier Inc.)
- Published
- 2020
- Full Text
- View/download PDF
28. How familiarity warps representation in the face space.
- Author
-
Chauhan V, Kotlewska I, Tang S, and Gobbini MI
- Subjects
- Adult, Female, Humans, Male, Young Adult, Facial Recognition physiology, Pattern Recognition, Visual physiology, Recognition, Psychology physiology
- Abstract
Recognition of familiar as compared to unfamiliar faces is robust and resistant to marked image distortion or degradation. Here we tested the flexibility of familiar face recognition with a morphing paradigm where the appearance of a personally familiar face was mixed with the appearance of a stranger (Experiment 1) and the appearance of one's own face with the appearance of a familiar face and the appearance of a stranger (Experiment 2). The aim of the two experiments was to assess how categorical boundaries for recognition of identity are affected by familiarity. We found a narrower categorical boundary for the identity of personally familiar faces when they were mixed with unfamiliar identities as compared to the control condition, in which the appearance of two unfamiliar faces was mixed. Our results suggest that familiarity warps the representational geometry of face space, amplifying perceptual distances for small changes in the appearance of familiar faces that are inconsistent with the structural features that define their identities.
- Published
- 2020
- Full Text
- View/download PDF
29. Idiosyncratic, Retinotopic Bias in Face Identification Modulated by Familiarity.
- Author
-
Visconti di Oleggio Castello M, Taylor M, Cavanagh P, and Gobbini MI
- Subjects
- Adult, Face physiology, Female, Humans, Male, Young Adult, Bias, Facial Recognition physiology, Interpersonal Relations, Pattern Recognition, Visual physiology, Recognition, Psychology physiology
- Abstract
The perception of gender and age of unfamiliar faces is reported to vary idiosyncratically across retinal locations such that, for example, the same androgynous face may appear to be male at one location but female at another. Here, we test spatial heterogeneity for the recognition of the identity of personally familiar faces in human participants. We found idiosyncratic biases that were stable within participants and that varied more across locations for low as compared to high familiar faces. These data suggest that like face gender and age, face identity is processed, in part, by independent populations of neurons monitoring restricted spatial regions and that the recognition responses vary for the same face across these different locations. Moreover, repeated and varied social interactions appear to lead to adjustments of these independent face recognition neurons so that the same familiar face is eventually more likely to elicit the same recognition response across widely separated visual field locations. We provide a mechanistic account of this reduced retinotopic bias based on computational simulations.
- Published
- 2018
- Full Text
- View/download PDF
30. Modeling Semantic Encoding in a Common Neural Representational Space.
- Author
-
Van Uden CE, Nastase SA, Connolly AC, Feilong M, Hansen I, Gobbini MI, and Haxby JV
- Abstract
Encoding models for mapping voxelwise semantic tuning are typically estimated separately for each individual, limiting their generalizability. In the current report, we develop a method for estimating semantic encoding models that generalize across individuals. Functional MRI was used to measure brain responses while participants freely viewed a naturalistic audiovisual movie. Word embeddings capturing agent-, action-, object-, and scene-related semantic content were assigned to each imaging volume based on an annotation of the film. We constructed both conventional within-subject semantic encoding models and between-subject models where the model was trained on a subset of participants and validated on a left-out participant. Between-subject models were trained using cortical surface-based anatomical normalization or surface-based whole-cortex hyperalignment. We used hyperalignment to project group data into an individual's unique anatomical space via a common representational space, thus leveraging a larger volume of data for out-of-sample prediction while preserving the individual's fine-grained functional-anatomical idiosyncrasies. Our findings demonstrate that anatomical normalization degrades the spatial specificity of between-subject encoding models relative to within-subject models. Hyperalignment, on the other hand, recovers the spatial specificity of semantic tuning lost during anatomical normalization, and yields model performance exceeding that of within-subject models.
- Published
- 2018
- Full Text
- View/download PDF
31. Influence of learning strategy on response time during complex value-based learning and choice.
- Author
-
Farashahi S, Rowe K, Aslami Z, Gobbini MI, and Soltani A
- Subjects
- Anticipation, Psychological, Feedback, Psychological, Female, Humans, Male, Models, Psychological, Choice Behavior, Learning, Reaction Time, Reward
- Abstract
Measurements of response time (RT) have long been used to infer neural processes underlying various cognitive functions such as working memory, attention, and decision making. However, it is currently unknown if RT is also informative about various stages of value-based choice, particularly how reward values are constructed. To investigate these questions, we analyzed the pattern of RT during a set of multi-dimensional learning and decision-making tasks that can prompt subjects to adopt different learning strategies. In our experiments, subjects could use reward feedback to directly learn reward values associated with possible choice options (object-based learning). Alternatively, they could learn reward values of options' features (e.g. color, shape) and combine these values to estimate reward values for individual options (feature-based learning). We found that RT was slower when the difference between subjects' estimates of reward probabilities for the two alternative objects on a given trial was smaller. Moreover, RT was overall faster when the preceding trial was rewarded or when the previously selected object was present. These effects, however, were mediated by an interaction between these factors such that subjects were faster when the previously selected object was present rather than absent but only after unrewarded trials. Finally, RT reflected the learning strategy (i.e. object-based or feature-based approach) adopted by the subject on a trial-by-trial basis, indicating an overall faster construction of reward value and/or value comparison during object-based learning. Altogether, these results demonstrate that the pattern of RT can be informative about how reward values are learned and constructed during complex value-based learning and decision making., Competing Interests: The authors have declared that no competing interests exist.
- Published
- 2018
- Full Text
- View/download PDF
32. Neural Responses to Naturalistic Clips of Behaving Animals in Two Different Task Contexts.
- Author
-
Nastase SA, Halchenko YO, Connolly AC, Gobbini MI, and Haxby JV
- Published
- 2018
- Full Text
- View/download PDF
33. Reading Faces: From Features to Recognition.
- Author
-
Guntupalli JS and Gobbini MI
- Subjects
- Animals, Learning, Primates, Brain, Reading
- Abstract
Chang and Tsao recently reported that the monkey face patch system encodes facial identity in a space of facial features as opposed to exemplars. Here, we discuss how such coding might contribute to face recognition, emphasizing the critical role of learning and interactions with other brain areas for optimizing the recognition of familiar faces., (Copyright © 2017 Elsevier Ltd. All rights reserved.)
- Published
- 2017
- Full Text
- View/download PDF
34. The neural representation of personally familiar and unfamiliar faces in the distributed system for face perception.
- Author
-
Visconti di Oleggio Castello M, Halchenko YO, Guntupalli JS, Gors JD, and Gobbini MI
- Subjects
- Adult, Brain Mapping, Female, Humans, Magnetic Resonance Imaging, Male, Young Adult, Brain physiology, Facial Recognition, Recognition, Psychology
- Abstract
Personally familiar faces are processed more robustly and efficiently than unfamiliar faces. The human face processing system comprises a core system that analyzes the visual appearance of faces and an extended system for the retrieval of person-knowledge and other nonvisual information. We applied multivariate pattern analysis to fMRI data to investigate aspects of familiarity that are shared by all familiar identities and information that distinguishes specific face identities from each other. Both identity-independent familiarity information and face identity could be decoded in an overlapping set of areas in the core and extended systems. Representational similarity analysis revealed a clear distinction between the two systems and a subdivision of the core system into ventral, dorsal and anterior components. This study provides evidence that activity in the extended system carries information about both individual identities and personal familiarity, while clarifying and extending the organization of the core system for face perception.
- Published
- 2017
- Full Text
- View/download PDF
35. Plastic reorganization of neural systems for perception of others in the congenitally blind.
- Author
-
Fairhall SL, Porter KB, Bellucci C, Mazzetti M, Cipolli C, and Gobbini MI
- Subjects
- Acoustic Stimulation, Adult, Brain Mapping, Female, Humans, Magnetic Resonance Imaging, Male, Visual Perception physiology, Auditory Perception physiology, Blindness physiopathology, Neuronal Plasticity physiology, Temporal Lobe physiopathology
- Abstract
Recent evidence suggests that the function of the core system for face perception might extend beyond visual face-perception to a broader role in person perception. To critically test the broader role of core face-system in person perception, we examined the role of the core system during the perception of others in 7 congenitally blind individuals and 15 sighted subjects by measuring their neural responses using fMRI while they listened to voices and performed identity and emotion recognition tasks. We hypothesised that in people who have had no visual experience of faces, core face-system areas may assume a role in the perception of others via voices. Results showed that emotions conveyed by voices can be decoded in homologues of the core face system only in the blind. Moreover, there was a specific enhancement of response to verbal as compared to non-verbal stimuli in bilateral fusiform face areas and the right posterior superior temporal sulcus showing that the core system also assumes some language-related functions in the blind. These results indicate that, in individuals with no history of visual experience, areas of the core system for face perception may assume a role in aspects of voice perception that are relevant to social cognition and perception of others' emotions., (Copyright © 2017 The Author(s). Published by Elsevier Inc. All rights reserved.)
- Published
- 2017
- Full Text
- View/download PDF
36. Attention Selectively Reshapes the Geometry of Distributed Semantic Representation.
- Author
-
Nastase SA, Connolly AC, Oosterhof NN, Halchenko YO, Guntupalli JS, Visconti di Oleggio Castello M, Gors J, Gobbini MI, and Haxby JV
- Subjects
- Adult, Brain diagnostic imaging, Brain Mapping methods, Female, Humans, Magnetic Resonance Imaging, Male, Models, Statistical, Neural Pathways diagnostic imaging, Neural Pathways physiology, Neuropsychological Tests, Pattern Recognition, Visual physiology, Attention physiology, Brain physiology, Motion Perception physiology, Semantics
- Abstract
Humans prioritize different semantic qualities of a complex stimulus depending on their behavioral goals. These semantic features are encoded in distributed neural populations, yet it is unclear how attention might operate across these distributed representations. To address this, we presented participants with naturalistic video clips of animals behaving in their natural environments while the participants attended to either behavior or taxonomy. We used models of representational geometry to investigate how attentional allocation affects the distributed neural representation of animal behavior and taxonomy. Attending to animal behavior transiently increased the discriminability of distributed population codes for observed actions in anterior intraparietal, pericentral, and ventral temporal cortices. Attending to animal taxonomy while viewing the same stimuli increased the discriminability of distributed animal category representations in ventral temporal cortex. For both tasks, attention selectively enhanced the discriminability of response patterns along behaviorally relevant dimensions. These findings suggest that behavioral goals alter how the brain extracts semantic features from the visual world. Attention effectively disentangles population responses for downstream read-out by sculpting representational geometry in late-stage perceptual areas., (© The Author 2017. Published by Oxford University Press.)
- Published
- 2017
- Full Text
- View/download PDF
37. Concurrent development of facial identity and expression discrimination.
- Author
-
Dalrymple KA, Visconti di Oleggio Castello M, Elison JT, and Gobbini MI
- Subjects
- Age Factors, Child, Child, Preschool, Female, Humans, Male, Child Development physiology, Expressed Emotion physiology, Face physiology
- Abstract
Facial identity and facial expression processing both appear to follow a protracted developmental trajectory, yet these trajectories have been studied independently and have not been directly compared. Here we investigated whether these processes develop at the same or different rates using matched identity and expression discrimination tasks. The Identity task begins with a target face that is a morph between two identities (Identity A/Identity B). After a brief delay, the target face is replaced by two choice faces: 100% Identity A and 100% Identity B. Children 5-12-years-old were asked to pick the choice face that is most similar to the target identity. The Expression task is matched in format and difficulty to the Identity task, except the targets are morphs between two expressions (Angry/Happy, or Disgust/Surprise). The same children were asked to pick the choice face with the expression that is most similar to the target expression. There were significant effects of age, with performance improving (becoming more accurate and faster) on both tasks with increasing age. Accuracy and reaction times were not significantly different across tasks and there was no significant Age x Task interaction. Thus, facial identity and facial expression discrimination appear to develop at a similar rate, with comparable improvement on both tasks from age five to twelve. Because our tasks are so closely matched in format and difficulty, they may prove useful for testing face identity and face expression processing in special populations, such as autism or prosopagnosia, where one of these abilities might be impaired.
- Published
- 2017
- Full Text
- View/download PDF
38. Familiarity facilitates feature-based face processing.
- Author
-
Visconti di Oleggio Castello M, Wheeler KG, Cipolli C, and Gobbini MI
- Subjects
- Adult, Female, Humans, Male, Reaction Time, Task Performance and Analysis, Brain physiology, Face anatomy & histology, Pattern Recognition, Visual physiology, Recognition, Psychology physiology
- Abstract
Recognition of personally familiar faces is remarkably efficient, effortless and robust. We asked if feature-based face processing facilitates detection of familiar faces by testing the effect of face inversion on a visual search task for familiar and unfamiliar faces. Because face inversion disrupts configural and holistic face processing, we hypothesized that inversion would diminish the familiarity advantage to the extent that it is mediated by such processing. Subjects detected personally familiar and stranger target faces in arrays of two, four, or six face images. Subjects showed significant facilitation of personally familiar face detection for both upright and inverted faces. The effect of familiarity on target absent trials, which involved only rejection of unfamiliar face distractors, suggests that familiarity facilitates rejection of unfamiliar distractors as well as detection of familiar targets. The preserved familiarity effect for inverted faces suggests that facilitation of face detection afforded by familiarity reflects mostly feature-based processes.
- Published
- 2017
- Full Text
- View/download PDF
39. Social Saliency of the Cue Slows Attention Shifts.
- Author
-
Chauhan V, Visconti di Oleggio Castello M, Soltani A, and Gobbini MI
- Abstract
Eye gaze is a powerful cue that indicates where another person's attention is directed in the environment. Seeing another person's eye gaze shift spontaneously and reflexively elicits a shift of one's own attention to the same region in space. Here, we investigated whether reallocation of attention in the direction of eye gaze is modulated by personal familiarity with faces. On the one hand, the eye gaze of a close friend should be more effective in redirecting our attention as compared to the eye gaze of a stranger. On the other hand, the social relevance of a familiar face might itself hold attention and, thereby, slow lateral shifts of attention. To distinguish between these possibilities, we measured the efficacy of the eye gaze of personally familiar and unfamiliar faces as directional attention cues using adapted versions of the Posner paradigm with saccadic and manual responses. We found that attention shifts were slower when elicited by a perceived change in the eye gaze of a familiar individual as compared to attention shifts elicited by unfamiliar faces at short latencies (100 ms). We also measured simple detection of change in direction of gaze in personally familiar and unfamiliar faces to test whether slower attention shifts were due to slower detection. Participants detected changes in eye gaze faster for familiar faces than for unfamiliar faces. Our results suggest that personally familiar faces briefly hold attention due to their social relevance, thereby slowing shifts of attention, even though the direction of eye movements are detected faster in familiar faces.
- Published
- 2017
- Full Text
- View/download PDF
40. Disentangling the Representation of Identity from Head View Along the Human Face Processing Pathway.
- Author
-
Guntupalli JS, Wheeler KG, and Gobbini MI
- Subjects
- Adult, Brain Mapping, Female, Humans, Male, Neural Pathways physiology, Facial Recognition physiology, Frontal Lobe physiology, Nerve Net physiology, Pattern Recognition, Visual physiology, Recognition, Psychology physiology, Visual Cortex physiology
- Abstract
Neural models of a distributed system for face perception implicate a network of regions in the ventral visual stream for recognition of identity. Here, we report a functional magnetic resonance imaging (fMRI) neural decoding study in humans that shows that this pathway culminates in the right inferior frontal cortex face area (rIFFA) with a representation of individual identities that has been disentangled from variable visual features in different images of the same person. At earlier stages in the pathway, processing begins in early visual cortex and the occipital face area with representations of head view that are invariant across identities, and proceeds to an intermediate level of representation in the fusiform face area in which identity is emerging but still entangled with head view. Three-dimensional, view-invariant representation of identities in the rIFFA may be the critical link to the extended system for face perception, affording activation of person knowledge and emotional responses to familiar faces., (© The Author 2016. Published by Oxford University Press.)
- Published
- 2017
- Full Text
- View/download PDF
41. How the Human Brain Represents Perceived Dangerousness or "Predacity" of Animals.
- Author
-
Connolly AC, Sha L, Guntupalli JS, Oosterhof N, Halchenko YO, Nastase SA, di Oleggio Castello MV, Abdi H, Jobst BC, Gobbini MI, and Haxby JV
- Subjects
- Adult, Amphibians physiology, Animals, Arthropods physiology, Brain cytology, Cognition, Female, Humans, Magnetic Resonance Imaging, Male, Neurons physiology, Reptiles physiology, Brain physiology, Connectome, Predatory Behavior classification, Visual Perception
- Abstract
Unlabelled: Common or folk knowledge about animals is dominated by three dimensions: (1) level of cognitive complexity or "animacy;" (2) dangerousness or "predacity;" and (3) size. We investigated the neural basis of the perceived dangerousness or aggressiveness of animals, which we refer to more generally as "perception of threat." Using functional magnetic resonance imaging (fMRI), we analyzed neural activity evoked by viewing images of animal categories that spanned the dissociable semantic dimensions of threat and taxonomic class. The results reveal a distributed network for perception of threat extending along the right superior temporal sulcus. We compared neural representational spaces with target representational spaces based on behavioral judgments and a computational model of early vision and found a processing pathway in which perceived threat emerges as a dominant dimension: whereas visual features predominate in early visual cortex and taxonomy in lateral occipital and ventral temporal cortices, these dimensions fall away progressively from posterior to anterior temporal cortices, leaving threat as the dominant explanatory variable. Our results suggest that the perception of threat in the human brain is associated with neural structures that underlie perception and cognition of social actions and intentions, suggesting a broader role for these regions than has been thought previously, one that includes the perception of potential threat from agents independent of their biological class., Significance Statement: For centuries, philosophers have wondered how the human mind organizes the world into meaningful categories and concepts. Today this question is at the core of cognitive science, but our focus has shifted to understanding how knowledge manifests in dynamic activity of neural systems in the human brain. This study advances the young field of empirical neuroepistemology by characterizing the neural systems engaged by an important dimension in our cognitive representation of the animal kingdom ontological subdomain: how the brain represents the perceived threat, dangerousness, or "predacity" of animals. Our findings reveal how activity for domain-specific knowledge of animals overlaps the social perception networks of the brain, suggesting domain-general mechanisms underlying the representation of conspecifics and other animals., (Copyright © 2016 the authors 0270-6474/16/365373-12$15.00/0.)
- Published
- 2016
- Full Text
- View/download PDF
42. Familiar Face Detection in 180 ms.
- Author
-
Visconti di Oleggio Castello M and Gobbini MI
- Subjects
- Evoked Potentials physiology, Eye Movements physiology, Humans, Reaction Time, Recognition, Psychology, Saccades physiology, Attention physiology, Face, Pattern Recognition, Visual physiology, Vision, Ocular physiology
- Abstract
The visual system is tuned for rapid detection of faces, with the fastest choice saccade to a face at 100 ms. Familiar faces have a more robust representation than do unfamiliar faces, and are detected faster in the absence of awareness and with reduced attentional resources. Faces of family and close friends become familiar over a protracted period involving learning the unique visual appearance, including a view-invariant representation, as well as person knowledge. We investigated the effect of personal familiarity on the earliest stages of face processing by using a saccadic-choice task to measure how fast familiar face detection can happen. Subjects made correct and reliable saccades to familiar faces when unfamiliar faces were distractors at 180 ms--very rapid saccades that are 30 to 70 ms earlier than the earliest evoked potential modulated by familiarity. By contrast, accuracy of saccades to unfamiliar faces with familiar faces as distractors did not exceed chance. Saccades to faces with object distractors were even faster (110 to 120 ms) and equivalent for familiar and unfamiliar faces, indicating that familiarity does not affect ultra-rapid saccades. We propose that detectors of diagnostic facial features for familiar faces develop in visual cortices through learning and allow rapid detection that precedes explicit recognition of identity.
- Published
- 2015
- Full Text
- View/download PDF
43. Facilitated detection of social cues conveyed by familiar faces.
- Author
-
Visconti di Oleggio Castello M, Guntupalli JS, Yang H, and Gobbini MI
- Abstract
Recognition of the identity of familiar faces in conditions with poor visibility or over large changes in head angle, lighting and partial occlusion is far more accurate than recognition of unfamiliar faces in similar conditions. Here we used a visual search paradigm to test if one class of social cues transmitted by faces-direction of another's attention as conveyed by gaze direction and head orientation-is perceived more rapidly in personally familiar faces than in unfamiliar faces. We found a strong effect of familiarity on the detection of these social cues, suggesting that the times to process these signals in familiar faces are markedly faster than the corresponding processing times for unfamiliar faces. In the light of these new data, hypotheses on the organization of the visual system for processing faces are formulated and discussed.
- Published
- 2014
- Full Text
- View/download PDF
44. Processing of invisible social cues.
- Author
-
Gobbini MI, Gors JD, Halchenko YO, Hughes HC, and Cipolli C
- Subjects
- Adolescent, Adult, Awareness physiology, Face, Female, Fixation, Ocular, Humans, Male, Perceptual Masking physiology, Photic Stimulation methods, Reaction Time, Young Adult, Cues, Pattern Recognition, Visual physiology, Recognition, Psychology physiology, Social Perception, Unconscious, Psychology
- Abstract
Successful interactions between people are dependent on rapid recognition of social cues. We investigated whether head direction--a powerful social signal--is processed in the absence of conscious awareness. We used continuous flash interocular suppression to render stimuli invisible and compared the reaction time for face detection when faces were turned towards the viewer and turned slightly away. We found that faces turned towards the viewer break through suppression faster than faces that are turned away, regardless of eye direction. Our results suggest that detection of a face with attention directed at the viewer occurs even in the absence of awareness of that face. While previous work has demonstrated that stimuli that signal threat are processed without awareness, our data suggest that the social relevance of a face, defined more broadly, is evaluated in the absence of awareness., (Copyright © 2013 The Authors. Published by Elsevier Inc. All rights reserved.)
- Published
- 2013
- Full Text
- View/download PDF
45. Prioritized Detection of Personally Familiar Faces.
- Author
-
Gobbini MI, Gors JD, Halchenko YO, Rogers C, Guntupalli JS, Hughes H, and Cipolli C
- Subjects
- Adult, Female, Humans, Male, Time Factors, Attention physiology, Facial Recognition physiology
- Abstract
We investigated whether personally familiar faces are preferentially processed in conditions of reduced attentional resources and in the absence of conscious awareness. In the first experiment, we used Rapid Serial Visual Presentation (RSVP) to test the susceptibility of familiar faces and faces of strangers to the attentional blink. In the second experiment, we used continuous flash interocular suppression to render stimuli invisible and measured face detection time for personally familiar faces as compared to faces of strangers. In both experiments we found an advantage for detection of personally familiar faces as compared to faces of strangers. Our data suggest that the identity of faces is processed with reduced attentional resources and even in the absence of awareness. Our results show that this facilitated processing of familiar faces cannot be attributed to detection of low-level visual features and that a learned unique configuration of facial features can influence preconscious perceptual processing.
- Published
- 2013
- Full Text
- View/download PDF
46. Multiple Subject Barycentric Discriminant Analysis (MUSUBADA): how to assign scans to categories without using spatial normalization.
- Author
-
Abdi H, Williams LJ, Connolly AC, Gobbini MI, Dunlop JP, and Haxby JV
- Subjects
- Animals, Data Interpretation, Statistical, Discriminant Analysis, Dogs, Face, Female, Haplorhini, Humans, Male, Brain physiology, Magnetic Resonance Imaging psychology
- Abstract
We present a new discriminant analysis (DA) method called Multiple Subject Barycentric Discriminant Analysis (MUSUBADA) suited for analyzing fMRI data because it handles datasets with multiple participants that each provides different number of variables (i.e., voxels) that are themselves grouped into regions of interest (ROIs). Like DA, MUSUBADA (1) assigns observations to predefined categories, (2) gives factorial maps displaying observations and categories, and (3) optimally assigns observations to categories. MUSUBADA handles cases with more variables than observations and can project portions of the data table (e.g., subtables, which can represent participants or ROIs) on the factorial maps. Therefore MUSUBADA can analyze datasets with different voxel numbers per participant and, so does not require spatial normalization. MUSUBADA statistical inferences are implemented with cross-validation techniques (e.g., jackknife and bootstrap), its performance is evaluated with confusion matrices (for fixed and random models) and represented with prediction, tolerance, and confidence intervals. We present an example where we predict the image categories (houses, shoes, chairs, and human, monkey, dog, faces,) of images watched by participants whose brains were scanned. This example corresponds to a DA question in which the data table is made of subtables (one per subject) and with more variables than observations.
- Published
- 2012
- Full Text
- View/download PDF
47. A common, high-dimensional model of the representational space in human ventral temporal cortex.
- Author
-
Haxby JV, Guntupalli JS, Connolly AC, Halchenko YO, Conroy BR, Gobbini MI, Hanke M, and Ramadge PJ
- Subjects
- Adult, Functional Neuroimaging, Humans, Image Processing, Computer-Assisted, Models, Neurological, Photic Stimulation, Brain Mapping methods, Neurons physiology, Temporal Lobe physiology, Visual Cortex physiology, Visual Perception physiology
- Abstract
We present a high-dimensional model of the representational space in human ventral temporal (VT) cortex in which dimensions are response-tuning functions that are common across individuals and patterns of response are modeled as weighted sums of basis patterns associated with these response tunings. We map response-pattern vectors, measured with fMRI, from individual subjects' voxel spaces into this common model space using a new method, "hyperalignment." Hyperalignment parameters based on responses during one experiment--movie viewing--identified 35 common response-tuning functions that captured fine-grained distinctions among a wide range of stimuli in the movie and in two category perception experiments. Between-subject classification (BSC, multivariate pattern classification based on other subjects' data) of response-pattern vectors in common model space greatly exceeded BSC of anatomically aligned responses and matched within-subject classification. Results indicate that population codes for complex visual stimuli in VT cortex are based on response-tuning functions that are common across individuals., (Copyright © 2011 Elsevier Inc. All rights reserved.)
- Published
- 2011
- Full Text
- View/download PDF
48. Amygdala and dorsomedial prefrontal cortex responses to appearance-based and behavior-based person impressions.
- Author
-
Baron SG, Gobbini MI, Engell AD, and Todorov A
- Subjects
- Adult, Amygdala blood supply, Face, Female, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Neuropsychological Tests, Oxygen blood, Photic Stimulation methods, Prefrontal Cortex blood supply, Social Perception, Young Adult, Amygdala physiology, Brain Mapping, Facial Expression, Pattern Recognition, Visual physiology, Prefrontal Cortex physiology, Trust
- Abstract
We explored the neural correlates of learning about people when the affective value of both facial appearance and behavioral information is manipulated. Participants were presented with faces that were either rated as high or low on trustworthiness. Subsequently, we paired these faces with positive, negative, or no behavioral information. Prior to forming face-behavior associations, a cluster in the right amygdala responded more strongly to untrustworthy than to trustworthy faces. During learning, a cluster in the dorsomedial prefrontal cortex (dmPFC) responded more strongly to faces paired with behaviors than faces not paired with behaviors. We also observed that the activity in the dmPFC was correlated with behavioral learning performance assessed after scanning. Interestingly, individual differences in the initial amygdala response to face trustworthiness prior to learning modulated the relationship between dmPFC activity and learning. This finding suggests that the activity of the amygdala can affect the interaction between dmPFC activity and learning.
- Published
- 2011
- Full Text
- View/download PDF
49. Distinct neural systems involved in agency and animacy detection.
- Author
-
Gobbini MI, Gentili C, Ricciardi E, Bellucci C, Salvini P, Laschi C, Guazzelli M, and Pietrini P
- Subjects
- Adult, Analysis of Variance, Brain blood supply, Emotions physiology, Female, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Oxygen blood, Photic Stimulation, Reaction Time, Robotics, Young Adult, Brain physiology, Brain Mapping, Face, Pattern Recognition, Visual physiology, Theory of Mind
- Abstract
We designed an fMRI experiment comparing perception of human faces and robotic faces producing emotional expressions. The purpose of our experiment was to investigate engagement of different parts of the social brain by viewing these animate and inanimate agents. Both human and robotic face expressions evoked activity in face-responsive regions in the fusiform gyrus and STS and in the putative human mirror neuron system. These results suggest that these areas mediate perception of agency, independently of whether the agents are living or not. By contrast, the human faces evoked stronger activity than did robotic faces in the medial pFC and the anterior temporal cortex--areas associated with the representation of others' mental states (theory of mind), whereas robotic faces evoked stronger activity in areas associated with perception of objects and mechanical movements. Our data demonstrate that the representation of the distinction between animate and inanimate agents involves areas that participate in attribution of mental stance.
- Published
- 2011
- Full Text
- View/download PDF
50. Is Social Phobia a "Mis-Communication" Disorder? Brain Functional Connectivity during Face Perception Differs between Patients with Social Phobia and Healthy Control Subjects.
- Author
-
Danti S, Ricciardi E, Gentili C, Gobbini MI, Pietrini P, and Guazzelli M
- Abstract
Recently, a differential recruitment of brain areas throughout the distributed neural system for face perception has been found in social phobic patients as compared to healthy control subjects. These functional abnormalities in social phobic patients extend beyond emotion-related brain areas, such as the amygdala, to include cortical networks that modulate attention and process other facial features, and they are also associated with an alteration of the task-related activation/deactivation trade-off. Functional connectivity is becoming a powerful tool to examine how components of large-scale distributed neural systems are coupled together while performing a specific function. This study was designed to determine whether functional connectivity networks among brain regions within the distributed system for face perception also would differ between social phobic patients and healthy controls. Data were obtained from eight social phobic patients and seven healthy controls by using functional magnetic resonance imaging. Our findings indicated that social phobic patients and healthy controls have different patterns of functional connectivity across brain regions within both the core and the extended systems for face perception and the default mode network. To our knowledge, this is the first study that shows that functional connectivity during brain response to socially relevant stimuli differs between social phobic patients and healthy controls. These results expand our previous findings and indicate that brain functional changes in social phobic patients are not restricted to a single specific brain structure, but rather involve a mis-communication among different sensory and emotional processing brain areas.
- Published
- 2010
- Full Text
- View/download PDF
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.