Search

Binocular rivalry arises when two discrepant stimuli are simultaneously presented to different eyes, during which observers consciously experience vivid perceptual alternations without physical changes in visual inputs. Neural dynamics tracking such perceptual alternations have been identified at both early and late visual areas, leading to the fundamental debate concerning the primary neural substrate underlying binocular rivalry. One promising hypothesis that might reconcile these seemingly paradoxical findings is a gradual shift from interocular competition between monocular neurons to pattern competition among binocular neurons. Here, we examined this hypothesis by investigating how neural representations of rivalrous stimuli evolved along the visual pathway. We found that representations of the dominant and the suppressed stimuli initially co-existed in V1, which were enhanced and attenuated respectively in extrastriate visual areas. Notably, neural activity in V4 was dictated by the representation of the dominant stimulus, while the representation of the suppressed stimulus was only partially inhibited in dorsal areas V3A and MT+. Our findings revealed a progressive transition from the co-existing representations of the rivalrous inputs to the dictatorial representation of the dominant stimulus in the ventral pathway, and advocated different cortical evolutionary patterns of visual representations between the dorsal and the ventral pathways.

One of the most remarkable functional feats accomplished by visual system is the interpolation of missing retinal inputs based on surrounding information, a process known as perceptual completion. Perceptual completion enables the active construction of coherent, vivid percepts from spatially discontinuous visual information that is prevalent in real-life visual scenes. Despite mounting evidence linking sensory activity enhancement and perceptual completion, surprisingly little is known about whether and how attention, a fundamental modulator of sensory activities, affects perceptual completion. Using EEG-based time-resolved inverted encoding model (IEM), we reconstructed the moment-to-moment representation of the illusory grating that resulted from spatially interpolating the orientation of surrounding inducers. We found that, despite manipulation of observers' attentional focus, the illusory grating representation unfolded in time in a similar manner. Critically, attention to the surrounding inducers simultaneously attenuated the illusory grating representation and delayed its temporal development. Our findings disclosed, for the first time, the suppressive role of selective attention in perceptual completion and were suggestive of a fast, automatic neural machinery that implements the interpolation of missing visual information.

When a feature is attended, all locations containing this feature are enhanced throughout the visual field. However, how the brain concurrently attends to multiple features remains unknown and cannot be easily deduced from classical attention theories. Here, we recorded human magnetoencephalography signals when subjects concurrently attended to two spatially overlapping orientations. A time-resolved multivariate inverted encoding model was employed to track the ongoing temporal courses of the neural representations of the attended orientations. We show that the two orientation representations alternate with each other and undergo a theta-band (~4 Hz) rhythmic fluctuation over time. Similar temporal profiles are also revealed in the orientation discrimination performance. Computational modeling suggests a tuning competition process between the two neuronal populations that are selectively tuned to one of the attended orientations. Taken together, our findings reveal for the first time a rhythm-based, time-multiplexing neural machinery underlying concurrent multi-feature attention., The neural mechanisms for concurrently attending to multiple features in the visual stimuli are not well understood. Here, the authors show that the neural representations for two overlapping stimulus features alternate with each other at a ~4 Hz rhythm that was also observed in fluctuations in the task performance.

Humans beings decide to trust others selectively, often based on the appearance of a face. But how do observers deal with the wide variety of facial morphologies and, in particular, those outside their own familiar cultural group? Using reverse correlation, a data-driven approach to explore how individuals create internal representations without external biases, we studied the generation of trustworthy faces by French and Chinese participants (N = 160) within and outside their own cultural group. Participants selected the most trustworthy or attractive (control condition) face from two identical European or Asian descent faces that had been modified by different noise masks. A conjunction analysis to reveal facial features common to both cultures showed that Chinese and French participants unconsciously increased the contrast of the "pupil-iris area" to make the face appear more trustworthy. No significant effects common to both groups were found for the attraction condition suggesting that attraction judgements are dependent on cultural processes. These results suggest the presence of universal cross-cultural mechanisms for the construction of implicit first impressions of trust, and highlight the importance of the eyes area in this process.

Inhibition and shifting are two key components of domain-general cognitive control. Numerous studies have investigated the neural substrates of both components, but it is still unclear whether the relevant brain regions are specifically involved in one specific component or commonly engaged in both components. Here, we addressed this question by using functional magnetic resonance imaging and a modified saccade paradigm that was effective to disentangle inhibition and shifting in one experiment. The results showed that both the middle frontal gyrus and left parietal lobe were involved in both components but the middle frontal gyrus was more active for the inhibition while the inferior parietal lobe was more active for the shifting processing. The outcome suggests that, although both regions are engaged in inhibition and shifting, each plays a dominant role in one component. These findings provide a further insight into the neural dissociation in inhibition and shifting, as well as a better explanation on the framework of unity and diversity from a neuropsychological viewpoint.

A critical cognitive symptom that is commonly involved in social anxiety and depression is attentional deficit. However, the functional relationship between attentional deficit and these two disorders remains poorly understood. Here, we behaviorally disentangled the three key attentional components (alerting, orienting, and executive control) using the established attentional network task (ANT) to investigate how social anxiety and depression are related to deficits in these attention components. We identified a double dissociation between the symptoms of social anxiety and depression and the attentional component deficits when processing non-emotional stimuli. While individuals vulnerable to social anxiety exhibited deficits in the orienting component, individuals vulnerable to depression were impaired in the executive control component. Our findings showed that social anxiety and depression were associated with deficits in different attentional components, which are not specific to emotional information.

Attention priority maps are topographic representations that are used for attention selection and guidance of task-related behavior during visual processing. Previous studies have identified attention priority maps of simple artificial stimuli in multiple cortical and subcortical areas, but investigating neural correlates of priority maps of natural stimuli is complicated by the complexity of their spatial structure and the difficulty of behaviorally characterizing their priority map. To overcome these challenges, we reconstructed the topographic representations of upright/inverted face images from fMRI BOLD signals in human early visual areas primary visual cortex (V1) and the extrastriate cortex (V2 and V3) based on a voxelwise population receptive field model. We characterized the priority map behaviorally as the first saccadic eye movement pattern when subjects performed a face-matching task relative to the condition in which subjects performed a phase-scrambled face-matching task. We found that the differential first saccadic eye movement pattern between upright/inverted and scrambled faces could be predicted from the reconstructed topographic representations in V1–V3 in humans of either sex. The coupling between the reconstructed representation and the eye movement pattern increased from V1 to V2/3 for the upright faces, whereas no such effect was found for the inverted faces. Moreover, face inversion modulated the coupling in V2/3, but not in V1. Our findings provide new evidence for priority maps of natural stimuli in early visual areas and extend traditional attention priority map theories by revealing another critical factor that affects priority maps in extrastriate cortex in addition to physical salience and task goal relevance: image configuration.SIGNIFICANCE STATEMENTProminent theories of attention posit that attention sampling of visual information is mediated by a series of interacting topographic representations of visual space known as attention priority maps. Until now, neural evidence of attention priority maps has been limited to studies involving simple artificial stimuli and much remains unknown about the neural correlates of priority maps of natural stimuli. Here, we show that attention priority maps of face stimuli could be found in primary visual cortex (V1) and the extrastriate cortex (V2 and V3). Moreover, representations in extrastriate visual areas are strongly modulated by image configuration. These findings extend our understanding of attention priority maps significantly by showing that they are modulated, not only by physical salience and task–goal relevance, but also by the configuration of stimuli images.

Face perception is modulated by categorical information in faces, which is known as categorical perception (CP) of faces. However, it remains unknown whether CP of faces is humans’ inborn capability or the result of acquired categories. Here, we examined whether and when newly learned categories affect face perception. A short-term training method was employed in which participants learned new categories of face stimuli. Behaviorally, using an AB-X discrimination task, we found that the discrimination accuracy of face pairs from different learned categories was significantly higher than that of faces from the same category. Neurally, using a visual oddball task, we found that deviant stimuli whose category differed from standard stimuli evoked a larger N170. Importantly, the visual mismatch negativity (vMMN), starting from 140 ms after stimuli onset, was stronger with the between-category deviants than with the within-category deviants under the unattended condition. Altogether, our study provides empirical evidence indicating that CP of faces could be induced by newly learned categories, and this effect occurs automatically during an early stage of processing.

Perceptual processing of colors and shapes in the right visual field is modulated by the lexical category information of the stimuli, a phenomenon known as the lateralized Whorfian effect. For color stimuli, lateralized Whorfian effect is characterized by preattentive occurrence and dependency on acquired lexical information, but it remains unknown whether these key features are generalizable to other domains of perceptual processing. Here, we investigated whether lateralized Whorfian effect in the shape perception domain also depends on acquired lexical category and occurs preattentively using ERPs. Participants were trained to associate novel, irregular polygons with lexical category labels via short-term intensive training. Using the visual oddball paradigm, we found stronger visual mismatch negativity (vMMN) component elicited by the deviant stimuli whose lexical category differed from the standard stimuli when the deviant was presented in the right visual field, indicating higher perceptual conspicuity for between-category stimuli. These findings provide direct evidence of similar preattentive lexical category-contingent modulation on shape perception akin to color perception, suggesting that the lateralized Whorfian effect is not epiphenomenal but rather might reflect the interaction between higher-level lexical processing and the lower-level perceptual processing more broadly.

The core of visual processing is the identification and recognition of the objects relevant to cognitive behaviors. In natural environment, visual input is often comprised of highly complex 3-dimensional signals involving multiple visual objects. One critical determinant of object recognition is visual contour. Despite substantial insights on visual contour processing gained from previous findings, these studies have focused on limited aspects or particular stages of contour processing. So far, a systematic perspective of contour processing that comprehensively incorporates previous evidence is still missing. We therefore propose an integrated framework of the cognitive and neural mechanisms of contour processing, which involves three mutually interacting cognitive stages: contour detection, border ownership assignment and contour integration. For each stage, we provide an elaborated discussion of the neural properties, processing mechanism, and its functional interaction with the other stages by summarizing the relevant electrophysiological and human cognitive neuroscience evidence. Finally, we present the major challenges for further unraveling the mechanisms of visual contour processing.

The action-evaluation effect indicates that the processing of affective valence is affected by bodily actions. However, whether this effect is based on bodily simulation or situational priming is unknown. Moreover, P2 is a neural marker for this effect, suggesting the integration between valence and actions. Whether the P2 component is modulated by the situation is also unknown. In this study, we tested this effect in multiple situations to examine (1) whether this effect is dependent on the situation and (2) the amplitude of P2 is modulated by the situation. During the experiments, participants pushed/pulled computer mice to verify the valence of affective words in far-near (Experiment 1), front-back (Experiments 2a-2b), and up-down (Experiments 3a-3b) situations. Pulling (or pushing) mice responding to positive (or negative) words were treated as the congruent condition, while the opposite combination was the incongruent condition. In the far-near situation, participants’ response times were faster and the amplitude of the P2 component was smaller in the congruent condition than the incongruent one; however, these results were reversed in other situations. The results suggested that the congruency of action-evaluation effect was restructured by the situation. Therefore, the action-evaluation effect might be based on situational priming.

This study tested whether the presence of an attractive face would influence individuals' honesty. In 2 experiments, 225 participants were asked to predict the outcome of computerised coin-flips and to self-report the accuracy of their predictions. Self-reports were made in the presence of a facial photo of a female who had been rated before the experiment as high attractive, middle attractive or low attractive by other volunteers. Participants were rewarded based on their self-reported (not actual) accuracy. The results showed that subjects tended to give more dishonest self-reports when presented with middle or low attractive facial images than when presented with high attractive images, with self-reported accuracy being significantly higher than the random level. The results of this study show that presented with an attractive face, subjects tend to engage in behaviours that conform to moral codes.

Ponzo illusion is a well-known perceptual phenomenon in which the perceived sizes of visual objects are altered by visual depth cues created by converging lines at the horizon. One possible neural mechanism of the Ponzo illusion is the receptive field position shifts of V1 neurons, as supported by a recent monkey electrophysiological study (Ni et al. in Curr Biol 24(14):1653-1658, 2014). Here, we used fMRI-based population receptive field (pRF) mapping technique in combination of psychophysics to investigate this idea. We found that, relative to the close apparent depth in a 3D scene, the far apparent depth in the scene caused the pRF positions of voxels in V1-V3 to shift toward the fovea, in line with subjects' percept of the Ponzo illusion. Moreover, the pRF position shift in V1 significantly correlated with the magnitude of the Ponzo illusion across individual subjects. Our findings thus provide evidence for the close association between the perceived object size and the pRF position shift in human visual areas, especially in V1, lending further support for the receptive field position shift explanation for the Ponzo illusion.

Is moral beauty different from facial beauty? Two functional magnetic resonance imaging experiments were performed to answer this question. Experiment 1 investigated the network of moral aesthetic judgments and facial aesthetic judgments. Participants performed aesthetic judgments and gender judgments on both faces and scenes containing moral acts. The conjunction analysis of the contrasts ‘facial aesthetic judgment > facial gender judgment’ and ‘scene moral aesthetic judgment > scene gender judgment’ identified the common involvement of the orbitofrontal cortex (OFC), inferior temporal gyrus and medial superior frontal gyrus, suggesting that both types of aesthetic judgments are based on the orchestration of perceptual, emotional and cognitive components. Experiment 2 examined the network of facial beauty and moral beauty during implicit perception. Participants performed a non-aesthetic judgment task on both faces (beautiful vs common) and scenes (containing morally beautiful vs neutral information). We observed that facial beauty (beautiful faces > common faces) involved both the cortical reward region OFC and the subcortical reward region putamen, whereas moral beauty (moral beauty scenes > moral neutral scenes) only involved the OFC. Moreover, compared with facial beauty, moral beauty spanned a larger-scale cortical network, indicating more advanced and complex cerebral representations characterizing moral beauty.

Perceptual processing of colors and shapes in the right visual field is modulated by the lexical category information of the stimuli, a phenomenon known as the lateralized Whorfian effect. For color stimuli, lateralized Whorfian effect is characterized by preattentive occurrence and dependency on acquired lexical information, but it remains unknown whether these key features are generalizable to other domains of perceptual processing. Here, we investigated whether lateralized Whorfian effect in the shape perception domain also depends on acquired lexical category and occurs preattentively using ERPs. Participants were trained to associate novel, irregular polygons with lexical category labels via short-term intensive training. Using the visual oddball paradigm, we found stronger visual mismatch negativity (vMMN) component elicited by the deviant stimuli whose lexical category differed from the standard stimuli when the deviant was presented in the right visual field, indicating higher perceptual conspicuity for between-category stimuli. These findings provide direct evidence of similar preattentive lexical category-contingent modulation on shape perception akin to color perception, suggesting that the lateralized Whorfian effect is not epiphenomenal but rather might reflect the interaction between higher-level lexical processing and the lower-level perceptual processing more broadly.

Existing linguistic theories have converged on the fundamental role of syllable and phoneme as the phonological production units that drive articulation in most alphabetic languages, while much remains controversial concerning the logographic Chinese because there is no conclusive evidence of the neural correlates of syllabic and phonemic processing during Chinese speech production. Here, fMRI adaptation paradigm was used to explore the possibility of distinctive neural representations of phonemes and syllables when native Chinese speakers pronounced Chinese pseudowords. We found that bilateral basal ganglia (BG) exhibited evident neural adaptation effect for phonemic repetition, indicating independent neural representation of phonemes in the speech production network in Chinese speakers. Moreover, neural adaptation effect for syllabic repetition was found in bilateral superior temporal gyrus (STg). These findings thus suggest that, similar to alphabetic languages, both phonemes and syllables are phonological production units associated with distinctive neural representations in Mandarin Chinese and further implicate the universality of hierarchical phonological coding across different linguistic systems.

This study tested whether the presence of an attractive face would influence individuals' honesty. In 2 experiments, 225 participants were asked to predict the outcome of computerised coin-flips and to self-report the accuracy of their predictions. Self-reports were made in the presence of a facial photo of a female who had been rated before the experiment as high attractive, middle attractive or low attractive by other volunteers. Participants were rewarded based on their self-reported (not actual) accuracy. The results showed that subjects tended to give more dishonest self-reports when presented with middle or low attractive facial images than when presented with high attractive images, with self-reported accuracy being significantly higher than the random level. The results of this study show that presented with an attractive face, subjects tend to engage in behaviours that conform to moral codes.

Saccadic eye movements cause rapid and dramatic displacements of the retinal image of the visual world, yet our conscious perception of the world remains stable and continuous. A popular explanation for this remarkable ability of our visual system to compensate for the displacements is the predictive feature remapping theory. The theory proposes that, before saccades, the representation of a visual stimulus can be predictively transferred from neurons that initially encode the stimulus to neurons whose receptive fields will encompass the stimulus location after the saccade. Visual adaptation aftereffect experiments performed by Melcher (2007) provided psychophysical evidence for this theory. However, it was argued that the visual aftereffects were not measured at the "appropriate" remapped location (Rolfs, Jonikaitis, Deubel, & Cavanagh, 2011). Therefore, whether the remapped representation contains feature information (e.g., orientation, motion direction, or contrast) is still a subject of intense debate. Here, to explore the nature of the predictive transfer during trans-saccadic perception, we measured visual aftereffects (tilt aftereffect, motion aftereffect, and threshold elevation aftereffect) at the appropriate remapped location of adapting stimuli before saccades. We observed a significant tilt aftereffect and motion aftereffect, but little threshold elevation aftereffect. Furthermore, the tilt aftereffect and motion aftereffect exhibited spatial specificity. These findings provide strong evidence for the predictive feature remapping theory and suggest that intermediate visual processing stages (i.e., extrastriate visual cortex) might be critical for feature remapping. Finally, we propose that the feature remapping process might also contribute to the spatiotopic representation of visual features.

Established linguistic theoretical frameworks propose that alphabetic language speakers use phonemes as phonological encoding units during speech production whereas Mandarin Chinese speakers use syllables. This framework was challenged by recent neural evidence of facilitation induced by overlapping initial phonemes, raising the possibility that phonemes also contribute to the phonological encoding process in Chinese. However, there is no evidence of non-initial phoneme involvement in Chinese phonological encoding among representative Chinese speakers, rendering the functional role of phonemes in spoken Chinese controversial. Here, we addressed this issue by systematically investigating the word-initial and non-initial phoneme repetition effect on the electrophysiological signal using a picture-naming priming task in which native Chinese speakers produced disyllabic word pairs. We found that overlapping phonemes in both the initial and non-initial position evoked more positive ERPs in the 180- to 300-ms interval, indicating position-invariant repetition facilitation effect during phonological encoding. Our findings thus revealed the fundamental role of phonemes as independent phonological encoding units in Mandarin Chinese.

How are Chinese characters recognized and represented in the brain of skilled readers? Functional MRI fast adaptation technique was used to address this question. We found that neural adaptation effects were limited to identical characters in bilateral ventral visual system while no activation reduction was observed for partially overlapping characters regardless of the spatial location of the shared sub-character components, suggesting highly selective neuronal tuning to whole characters. The consistent neural profile across the entire ventral visual cortex indicates that Chinese characters are represented as mutually distinctive wholes rather than combinations of sub-character components, which presents a salient contrast to the left-lateralized, simple-to-complex neural representations of alphabetic words. Our findings thus revealed the cultural modulation effect on both local neuronal activity patterns and functional anatomical regions associated with written symbol recognition. Moreover, the cross-language discrepancy in written symbol recognition mechanism might stem from the language-specific early-stage learning experience.