Search

People often interact with groups (i.e., ensembles) during social interactions. Given that group-level information is important in navigating social environments, we expect perceptual sensitivity to aspects of groups that are relevant for personal threat as well as social belonging. Most ensemble perception research has focused on visual ensembles, with little research looking at auditory or vocal ensembles. Across four studies, we present evidence that (i) perceivers accurately extract the sex composition of a group from voices alone, (ii) judgments of threat increase concomitantly with the number of men, and (iii) listeners sense of belonging depends on the number of same-sex others in the group. This work advances our understanding of social cognition, interpersonal communication, and ensemble coding to include auditory information, and reveals peoples ability to extract relevant social information from brief exposures to vocalizing groups.

By observing dynamically changing facial expressions, humans can use a specialized capacity known as ensemble coding to effortlessly obtain a summary representation of an individual's emotional state. However, few studies have examined whether the missing expression informed by the statistical regularity in the changing facial expressions can be sampled and then influence the perceptual averaging process. In Experiment 1a and 1b, we manipulated the amount of prior information from local regularity by varying the position of the missing expression in the temporal sequence (1a: Neutral to Disgust and/or Disgust to Neutral,1b: Neutral to Happy and/or Happy to Neutral) within a trial. Results showed that ensemble estimates were towards the mean of expressions including both the presented and the missing faces, only when sufficient predictability (e.g. a missing expression in the late position) informed by local regularity. In Experiment 2, we added prior information from global regularities to help boost the predictability of an early missing expression by keeping the emotional direction consistent in a block. However, estimates were not towards the mean of expressions including both the presented and the missing expressions as expected. Although the generalizability may be limited, these findings suggest that prior information at different levels of hierarchical predictive coding may exert qualitatively different influences on the perceptual averaging of temporally ordered facial expressions with missing items. [ABSTRACT FROM AUTHOR]

BACKGROUND: The human brain can rapidly represent sets of similar stimuli by their ensemble summary statistics, like the average orientation or size. Classic models assume that ensemble statistics are computed by integrating all elements with equal weight. Challenging this view, here, we show that ensemble statistics are estimated by combining parafoveal and foveal statistics in proportion to their reliability. In a series of experiments, observers reproduced the average orientation of an ensemble of stimuli under varying levels of visual uncertainty. RESULTS: Ensemble statistics were affected by multiple spatial biases, in particular, a strong and persistent bias towards the center of the visual field. This bias, evident in the majority of subjects and in all experiments, scaled with uncertainty: the higher the uncertainty in the ensemble statistics, the larger the bias towards the element shown at the fovea. CONCLUSION: Our findings indicate that ensemble perception cannot be explained by simple uniform pooling. The visual system weights information anisotropically from both the parafovea and the fovea, taking the intrinsic spatial anisotropies of vision into account to compensate for visual uncertainty.

Cultural difference in ensemble emotion perception is an important research question, providing insights into the complexity of human cognition and social interaction. Here, we conducted two experiments to investigate how emotion perception would be affected by other ethnicity effects and ensemble coding. In Experiment 1, two groups of Asian and Caucasian participants were tasked with assessing the average emotion of faces from their ethnic group, other ethnic group, and mixed ethnicity groups. Results revealed that participants exhibited relatively accurate yet amplified emotion perception of their group faces, with a tendency to overestimate the weight of the faces from the other ethnic group. In Experiment 2, Asian participants were instructed to discern the emotion of a target face surrounded by faces from Caucasian and Asian faces. Results corroborated earlier findings, indicating that while participants accurately perceived emotions in faces of their ethnicity, their perception of Caucasian faces was noticeably influenced by the presence of surrounding Asian faces. These findings collectively support the notion that the other ethnicity effect stems from differential emotional amplification inherent in ensemble coding of emotion perception. [ABSTRACT FROM AUTHOR]

Copyright of Psychological Science is the property of Psychological Science Editorial Office and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Abstract People often interact with groups (i.e., ensembles) during social interactions. Given that group-level information is important in navigating social environments, we expect perceptual sensitivity to aspects of groups that are relevant for personal threat as well as social belonging. Most ensemble perception research has focused on visual ensembles, with little research looking at auditory or vocal ensembles. Across four studies, we present evidence that (i) perceivers accurately extract the sex composition of a group from voices alone, (ii) judgments of threat increase concomitantly with the number of men, and (iii) listeners’ sense of belonging depends on the number of same-sex others in the group. This work advances our understanding of social cognition, interpersonal communication, and ensemble coding to include auditory information, and reveals people’s ability to extract relevant social information from brief exposures to vocalizing groups.

Observers can rapidly extract the mean emotion from a set of faces with remarkable precision, known as ensemble coding. Previous studies have demonstrated that matched physical backgrounds improve the precision of ongoing ensemble tasks. However, it remains unknown whether this facilitation effect still occurs when matched social information is perceived from the backgrounds. In two experiments, participants decided whether the test face in the retrieving phase appeared more disgusted or neutral than the mean emotion of the face set in the encoding phase. Both phases were paired with task-irrelevant animated backgrounds, which included either the forward movement trajectory carrying the "cooperatively chasing" information, or the backward movement trajectory conveying no such chasing information. The backgrounds in the encoding and retrieving phases were either mismatched (i.e., forward and backward replays of the same trajectory), or matched (i.e., two identical forward movement trajectories in Experiment 1, or two different forward movement trajectories in Experiment 2). Participants in both experiments showed higher ensemble precisions and better discrimination sensitivities when backgrounds matched. The findings suggest that consistent social information perceived from memory-related context exerts a context-matching facilitation effect on ensemble coding and, more importantly, this effect is independent of consistent physical information. [ABSTRACT FROM AUTHOR]

Ensemble coding allows observers to form an average to represent a set of elements. However, it is unclear whether observers can extract an average from a cross-category set. Previous investigations on this issue using low-level stimuli yielded contradictory results. The current study addressed this issue by presenting high-level stimuli (i.e., a crowd of facial expressions) simultaneously (Experiment 1) or sequentially (Experiment 2), and asked participants to complete a member judgment task. The results showed that participants could extract average information from a group of cross-category facial expressions with a short perceptual distance. These findings demonstrate cross-category ensemble coding of high-level stimuli, contributing to the understanding of ensemble coding and providing inspiration for future research. [ABSTRACT FROM AUTHOR]

Previous findings on people perception show that perceivers are attuned to the social categories of group members, which subsequently influences social judgments. An outstanding question is whether perceivers are also attuned to visual cue variability (e.g., gender typicality). In two studies (n = 165), perceivers viewed 12-person ensembles (500 ms) of varying White men-to-women ratios. Importantly, faces of one gender/sex were morphed to appear either more masculine or more feminine. Consistent with prior work, results indicated that judgments varied by the actual gender/sex ratio. In addition, perceivers' judgments varied as a function of manipulated gender cues. Ensembles composed of masculine, compared to feminine White men, were judged to have more men, higher perceived masculinity, and to be more threatening. Complementary results were found for ensembles composed of feminine, compared to masculine White women. These findings highlight the impact of both social categories and visual phenotypic cue variability on people perception. [ABSTRACT FROM AUTHOR]

Ensemble coding (the brain's ability to rapidly extract summary statistics from groups of items) has been demonstrated across a range of low-level (e.g., average color) to high-level (e.g., average facial expression) visual features, and even on information that cannot be gleaned solely from retinal input (e.g., object lifelikeness). There is also evidence that ensemble coding can interact with other cognitive systems such as long-term memory (LTM), as observers are able to derive the average cost of items. We extended this line of research to examine if different sensory modalities can interact during ensemble coding. Participants made judgments about the average sweetness of groups of different visually presented foods. We found that, when viewed simultaneously, observers were limited in the number of items they could incorporate into their cross-modal ensemble percepts. We speculate that this capacity limit is caused by the crossmodal translation of visual percepts into taste representations stored in LTM. This was supported by findings that (a) participants could use similar stimuli to form capacity-unlimited ensemble representations of average screen size and (b) participants could extract the average sweetness of displays when items were viewed in sequence, with no capacity limitation (suggesting that spatial attention constrains the number of necessary visual cues an observer can integrate in a given moment to trigger cross-modal retrieval of taste). Together, the results of our study demonstrate that there are limits to the flexibility of ensemble coding, especially when multiple cognitive systems need to interact to compress sensory information into an ensemble representation. [ABSTRACT FROM AUTHOR]

Recognizing the emotions of faces in a crowd is crucial for understanding overall behavior and intention as well as for smooth and friendly social interactions. However, it is unclear whether the spatial frequency of faces affects the discrimination of crowd emotion. Although high- and low-spatial-frequency information for individual faces is processed by distinct neural channels, there is a lack of evidence on how this applies to crowd faces. Here, we used functional magnetic resonance imaging (fMRI) to investigate neural representations of crowd faces at different spatial frequencies. Thirty-three participants were asked to compare whether a test face was happy or more fearful than a crowd face that varied in high, low, and broad spatial frequencies. Our findings revealed that fearful faces with low spatial frequencies were easier to recognize in terms of accuracy (78.9%) and response time (927 ms). Brain regions, such as the fusiform gyrus, located in the ventral visual stream, were preferentially activated in high spatial frequency crowds, which, however, were the most difficult to recognize behaviorally (68.9%). Finally, the right inferior frontal gyrus was found to be better activated in the broad spatial frequency crowds. Our study suggests that people are more sensitive to fearful crowd faces with low spatial frequency and that high spatial frequency does not promote crowd face recognition. [ABSTRACT FROM AUTHOR]

The other-race effect (ORE) is the phenomenon by which own-race faces are better recognized than other-race faces, which is one of the best-replicated phenomena in facial recognition. However, it is still unknown whether this effect also exists in the emotional perception of group faces. In this study, we tried to clarify whether the ORE exists in a mixed group of Asian and Caucasian faces and whether this possible ORE is driven by attention modulation. Results suggested that the ORE did exist in the emotional process of a mixed group. Moreover, attention could modulate this emotional significance by increasing the weight of the different face (the different face represents the face whose ethnicity is different from the other 3), especially when the different face is of the participants' own ethnicity (Asian). However, Asian participants tended to discard the single Caucasian face but depended on the 3 Asian faces to form the ensemble representation of them regardless of attention to the Caucasian face. Therefore, for Asian participants, although there is an ORE for the emotional ensemble representation of faces from different ethnicities, this effect is not entirely driven by attentional modulation. Together with the error distribution analysis, results suggested that ORE is more likely to be affected by perceptual precision. These findings may help us better understand the emotional perception of faces from different ethnicities. [ABSTRACT FROM AUTHOR]

This study investigated the similarity-based clustering mechanism of multifeature stimuli, wherein items are separated or grouped based on their similarity in visual working memory (VWM). In particular, we investigated whether clustering occurred at an individual feature level or at an integrated object level when participants encoded objects with multiple features for VWM. To test this, we conducted two experiments in which participants remembered and reconstructed a randomly chosen feature (either color or orientation) from one of five presented stimuli. As a key manipulation, we kept the distributions of the two feature dimensions constant while controlling the conjunction between the two dimensions in two different conditions: congruent conjunction (CC) and incongruent conjunction (IC). With this manipulation, we expected to observe the same number of clusters regardless of the conjunction condition when clustering occurred at the feature level. However, we expected a different number of clusters for CC and IC conditions when clustering occurred at the object level. Across two experiments, we consistently observed evidence that favored feature-level clustering. Nevertheless, we found that the swap error rates increased in the IC condition only when two features had to be encoded in VWM. These results suggest that clustering occurs at the feature level in VWM and that feature-level clustering influences item-level feature binding. Therefore, our study demonstrated the flexibility of representational units in VWM. [ABSTRACT FROM AUTHOR]

The human visual system represents summary statistical information (e.g. average) along many visual dimensions efficiently. While studies have indicated that approximately the square root of the number of items in a set are effectively integrated through this ensemble coding, how those samples are determined is still unknown. Here, we report that salient items are preferentially weighted over the other less salient items, by demonstrating that the perceived means of spatial (i.e. size) and temporal (i.e. flickering temporal frequency (TF)) features of the group of items are positively biased as the number of items in the group increases. This illusory 'amplification effect' was not the product of decision bias but of perceptual bias. Moreover, our visual search experiments with similar stimuli suggested that this amplification effect was due to attraction of visual attention to the salient items (i.e. large or high TF items). These results support the idea that summary statistical information is extracted from sets with an implicit preferential weighting towards salient items. Our study suggests that this saliency-based weighting may reflect a more optimal and efficient integration strategy for the extraction of spatio-temporal statistical information from the environment, and may thus be a basic principle of ensemble coding.

Humans have developed the capacity to rapidly extract summary statistics from the facial expressions of a crowd, such as computing the average facial expression. Although dual-task paradigms involving memory and ensemble tasks have recently found that this ensemble coding ability is biased by visual working memory, few studies have examined whether the context-dependent nature of memory itself can influence the perceptual averaging process. In two experiments, participants made forced-choice judgments about mean facial expressions that were paired with task-irrelevant background images, and the background images either matched or mismatched across encoding and response phases. When the backgrounds matched, it was at either the perceptual level (uniformly oriented lines with the same orientation in encoding and response phases, in Experiment 1), or at the summary statistics level (uniformly oriented lines in the response phase that had the same orientation as the mean of randomly oriented lines that were seen in the encoding phase, in Experiment 2). Participants in Experiment 1 showed a higher ensemble precision and better discrimination sensitivity when the backgrounds matched than when they mismatched, which is consistent with the kind of robust contextual memory effect that has been seen in prior research. We further demonstrated that the context-matching facilitation effect occurred at both the perceptual level (Experiment 1) and at the summary statistics level (Experiment 2). These results demonstrate that the effects of visual working memory on perceptual averaging are obligatory, and they highlight the importance of memory-related context dependency in perceptual averaging. [ABSTRACT FROM AUTHOR]

The mean emotion from multiple facial expressions can be extracted rapidly and precisely. However, it remains debated whether mean emotion processing is automatic which can occur under no attention. To address this question, we used a passive oddball paradigm and recorded event-related brain potentials when participants discriminated the changes in the central fixation while a set of four faces was presented in the periphery. The face set consisted of one happy and three angry expressions (mean negative) or one angry and three happy expressions (mean positive), and the mean negative and mean positive face sets were shown with a probability of 20% (deviant) and 80% (standard) respectively in the sequence, or the vice versa. The cluster-based permutation analyses showed that the visual mismatch negativity started early at around 92 ms and was also observed in later time windows when the mean emotion was negative, while a mismatch positivity was observed at around 168–266 ms when the mean emotion was positive. The results suggest that there might be different mechanisms underlying the processing of mean negative and mean positive emotions. More importantly, the brain can detect the changes in the mean emotion automatically, and ensemble coding for multiple facial expressions can occur in an automatic fashion without attention. • Mixed happy and angry expressions were used in the passive oddball paradigm. • Visual mismatch negativity started early when the mean emotion was negative. • Visual mismatch positivity was found for the mean positive emotion. • Ensemble coding for multiple facial expressions could occur automatically. [ABSTRACT FROM AUTHOR]

Previous research has found that people are seen as moreattractive when they appear in a group rather than in isolation.The present study asks whether faces that surround us in timealso affect how attractive we appear to be. Participants ratedthe attractiveness of famous female faces presented in asequence of three and in isolation. We found that people dointegrate information about attractiveness over time, but thattemporal context has the opposite effect of static context.People perceived faces as less attractive in a series than inisolation. We also varied the attractiveness of surroundingfaces in order to examine how the serial position of contextualinformation might figure into people’s judgments. We foundthat faces presented earlier in the sequence figured moreheavily into people’s judgment than did faces presented laterin the sequence. These findings highlight the role of temporalcontext in perceptions of attractiveness.

Groups, teams, and collectives —people— are incredibly important to human behavior. People live in families, work in teams, and celebrate and mourn together in groups. Despite the huge variety of human group activity and its fundamental importance to human life, social-psychological research on person perception has overwhelmingly focused on its namesake, the person, rather than expanding to consider people perception. By looking to two unexpected partners, the vision sciences and organization behavior, we find emerging work that presents a path forward, building a foundation for understanding how people perceive other people. And yet this nascent field is missing critical insights that scholars of social vision might offer: specifically, for example, the chance to connect perception to behavior through the mediators of cognition and motivational processes. Here, we review emerging work across the vision and social sciences to extract core principles of people perception : efficiency, capacity, and complexity. We then consider complexity in more detail, focusing on how people perception modifies person-perception processes and enables the perception of group emergent properties as well as group dynamics. Finally, we use these principles to discuss findings and outline areas fruitful for future work. We hope that fellow scholars take up this people-perception call. [ABSTRACT FROM AUTHOR]

Ensemble coding and attention are two mechanisms utilized by our visual system to overcome the limitation of visual processing when confronted with the overwhelming visual information. Recent evidence in ensemble coding of size suggests that the attended items contributed more to the averaging. On the other hand, some new evidence also indicates that reduced attention jeopardies the perceptual averaging of stimuli. What is the relationship between attention and ensemble coding? To answer this question, in the current study, we tested whether an exogenous attentional cue would influence the reported mean emotion of a crowd. We showed participants a group of four faces with different emotions. Participants' attention was guided to the happiest or saddest face (attention conditions), or not to any specific face (baseline condition). The results supported the notion that the attention alters the ensemble perception of the facial expression by elevating the weight of that face in the ensemble representation. This opens the question for the neural mechanisms of ensemble coding and its connection to visual attention. [ABSTRACT FROM AUTHOR]

Dyslexic individuals have been reported to have reduced global motion sensitivity, which could be attributed to various causes including atypical magnocellular or dorsal stream function, impaired spatial integration, increased internal noise and/or reduced external noise exclusion. Here, we applied an equivalent noise experimental paradigm alongside a traditional motion-coherence task to determine what limits global motion processing in dyslexia. We also presented static analogues of the motion tasks (orientation tasks) to investigate whether perceptual differences in dyslexia were restricted to motion processing. We compared the performance of 48 dyslexic and 48 typically developing children aged 8 to 14 years in these tasks and used equivalent noise modelling to estimate levels of internal noise (the precision associated with estimating each element's direction/orientation) and sampling (the effective number of samples integrated to judge the overall direction/orientation). While group differences were subtle, dyslexic children had significantly higher internal noise estimates for motion discrimination, and higher orientation-coherence thresholds, than typical children. Thus, while perceptual differences in dyslexia do not appear to be restricted to motion tasks, motion and orientation processing seem to be affected differently. The pattern of results also differs from that previously reported in autistic children, suggesting perceptual processing differences are condition-specific.

Ensemble coding is the ability of the visual system to extract a summary statistic from a set of stimuli. For example, observers often spontaneously extract an average face identity from a set of faces. Ensemble coding is known to operate in the frame of a distributed/global attention model. Because both attention and holistic processing are modulated by emotion – where positive emotions broaden the scope of attention and facilitate global processing, whereas negative emotions narrow the scope of attention and promote local processing – the current research explored whether emotional states could affect visual averaging of multiple face identities. Participants completed an ensemble-coding task before and after their emotion was induced via film clips. In the ensemble-coding task, a set of four face identities was shown briefly, followed by a probe face. Participants judged whether the probe face was presented in the preceding set. Evidence for ensemble coding was indexed by responses that treated an average face of the preceding set as a member of that set. The results showed that the tendency to choose this average was modulated by emotional states. Visual averaging increased after seeing positive film clips, but decreased after seeing negative film clips. These results support Frederickson's broaden-and-built theory, and extended its application to ensemble perception. [ABSTRACT FROM AUTHOR]

Recent research has emphasized the importance of using images that incorporate natural variability in appearance (i.e., ambient images) to assess face learning and recognition. Across five tasks, we provide the first examination of older adults' face learning and recognition in ambient images. Young and older adults showed comparable performance in three tasks: when recognizing a familiar face across ambient images, extracting average representations of an identity (i.e., ensemble coding) and learning a new identity from multiple images in a perceptual task. However, compared to young adults, older adults have even more difficulty matching images of unfamiliar faces and despite showing comparable benefits in sensitivity, older adults adopted a more conservative response bias after being exposed to low variability in appearance in a face memory task, resulting in them failing to recognize novel instances of a newly learned identity. We discuss the implications of our findings for older adults and the insights our findings provide for understanding both the development of face learning and recognition in childhood and the own-race recognition advantage. [ABSTRACT FROM AUTHOR]

The human visual system is able to extract summary statistics from sets of similar items, but the underlying neural mechanism remains poorly understood. Using functional magnetic resonance imaging (fMRI) and an encoding model, we examined how the neural representation of ensemble coding is constructed by manipulating the task-relevance of ensemble features. We found a gradual increase in orientation-selective responses to the mean orientation of multiple stimuli along the visual hierarchy only when these orientations were task-relevant. Such responses to the ensemble orientation were present in the extrastriate area, V3, even when the mean orientation was not task-relevant, indicating that the ensemble representation can co-exist with the task-relevant individual feature representation. Ensemble orientations were also represented in frontal regions, but those representations were robust only when each mean orientation was linked to a motor response dimension. Together, our findings suggest that the neural representation of the ensemble percept is formed by pooling signals at multiple levels of the visual processing stream.

In this study, we investigated whether the first impression of a crowd of faces-crowd perception-is influenced by social background and cognitive processing. Specifically, we explored whether males and females, two groups that are distinct biologically and socially, differ in their ability to extract ensemble characteristics from crowds of faces that were comprised of different identities. Participants were presented with crowds of similar faces and were instructed to scroll through a morphed continuum of faces until they found a face that was representative of the average identity of each crowd. Consistent with previous research, females were more precise in single face perception. Furthermore, the results showed that females were generally more accurate in estimating the average identity of a crowd. However, the correlation between single face discrimination and crowd averaging differed between males and females. Specifically, male subjects' ensemble integration slightly compensated for their poor single face perception; their performance on the crowd perception task was not as poor as would be expected from their single face discrimination ability. Overall, the results suggest that group perception is not an isolated or uniform cognitive mechanism, but rather one that interacts with biological and social processes.

In nearly every interpersonal encounter, people readily gather socio-visual cues to guide their behavior. Intriguingly, social information is most effective in directing behavior when it is perceived in crowds. For example, the shared gaze of a crowd is more likely to direct attention than is a single person's gaze. Are people equipped with mechanisms to perceive a crowd's gaze as an ensemble? Here, we provide the first evidence that the visual system extracts a summary representation of a crowd's attention; observers rapidly pooled information from multiple crowd members to perceive the direction of a group's collective gaze. This pooling occurred in high-level stages of visual processing, with gaze perceived as a global-level combination of information from head and pupil rotation. These findings reveal an important and efficient mechanism for assessing crowd gaze, which could underlie the ability to perceive group intentions, orchestrate joint attention, and guide behavior.

In nearly every interpersonal encounter, people readily gather socio-visual cues to guide their behavior. Intriguingly, social information is most effective in directing behavior when it is perceived in crowds. For example, the shared gaze of a crowd is more likely to direct attention than is a single person's gaze. Are people equipped with mechanisms to perceive a crowd's gaze as an ensemble? Here, we provide the first evidence that the visual system extracts a summary representation of a crowd's attention; observers rapidly pooled information from multiple crowd members to perceive the direction of a group's collective gaze. This pooling occurred in high-level stages of visual processing, with gaze perceived as a global-level combination of information from head and pupil rotation. These findings reveal an important and efficient mechanism for assessing crowd gaze, which could underlie the ability to perceive group intentions, orchestrate joint attention, and guide behavior.

Individuals can rapidly and precisely judge the average of a set of similar items, including both low-level (Ariely, 2001) and high-level objects (Haberman & Whitney, 2007). However, to date, it is unclear whether ensemble perception is based on viewpoint-invariant object representations. Here, we tested this question by presenting participants with crowds of sequentially presented faces. The number of faces in each crowd and the viewpoint of each face varied from trial to trial. This design required participants to integrate information from multiple viewpoints into one ensemble percept. Participants reported the mean identity of crowds (e.g., family resemblance) using an adjustable, forward-oriented test face. Our results showed that participants accurately perceived the mean crowd identity even when required to incorporate information across multiple face orientations. Control experiments showed that the precision of ensemble coding was not solely dependent on the length of time participants viewed the crowd. Moreover, control analyses demonstrated that observers did not simply sample a subset of faces in the crowd but rather integrated many faces into their estimates of average crowd identity. These results demonstrate that ensemble perception can operate at the highest levels of object recognition after 3-D viewpoint-invariant faces are represented.

Individuals can rapidly and precisely judge the average of a set of similar items, including both low-level (Ariely, 2001) and high-level objects (Haberman & Whitney, 2007). However, to date, it is unclear whether ensemble perception is based on viewpoint-invariant object representations. Here, we tested this question by presenting participants with crowds of sequentially presented faces. The number of faces in each crowd and the viewpoint of each face varied from trial to trial. This design required participants to integrate information from multiple viewpoints into one ensemble percept. Participants reported the mean identity of crowds (e.g., family resemblance) using an adjustable, forward-oriented test face. Our results showed that participants accurately perceived the mean crowd identity even when required to incorporate information across multiple face orientations. Control experiments showed that the precision of ensemble coding was not solely dependent on the length of time participants viewed the crowd. Moreover, control analyses demonstrated that observers did not simply sample a subset of faces in the crowd but rather integrated many faces into their estimates of average crowd identity. These results demonstrate that ensemble perception can operate at the highest levels of object recognition after 3-D viewpoint-invariant faces are represented.

Reading the prevailing emotion of groups of people ("crowd emotion") is critical to understanding their overall intention and disposition. It alerts us to potential dangers, such as angry mobs or panicked crowds, giving us time to escape. A critical aspect of processing crowd emotion is that it must occur rapidly, because delays often are costly. Although knowing the timing of neural events is crucial for understanding how the brain guides behaviors using coherent signals from a glimpse of multiple faces, this information is currently lacking in the literature on face ensemble coding. Therefore, we used magnetoencephalography to examine the neurodynamics in the dorsal and ventral visual streams and the periamygdaloid cortex to compare perception of groups of faces versus individual faces. Forty-six participants compared two groups of four faces or two individual faces with varying emotional expressions and chose which group or individual they would avoid. We found that the dorsal stream was activated as early as 68 msec after the onset of stimuli containing groups of faces. In contrast, the ventral stream was activated later and predominantly for individual face stimuli. The latencies of the dorsal stream activation peaks correlated with participants' response times for facial crowds. We also found enhanced connectivity earlier between the periamygdaloid cortex and the dorsal stream regions for crowd emotion perception. Our findings suggest that ensemble coding of facial crowds proceeds rapidly and in parallel by engaging the dorsal stream to mediate adaptive social behaviors, via a distinct route from single face perception. [ABSTRACT FROM AUTHOR]

A characteristic feature of daily life is encountering people in groups. Surprisingly, however, at least during the initial stages of processing, research has focused almost exclusively on the construal of single individuals. As such, it remains unclear whether person and people (i.e., group) perception yield comparable or divergent outcomes. Addressing this issue, here we explored a core social-cognitive topic—stereotype activation—by presenting both single and multiple facial primes in a sequential-priming task. In addition, the processes underlying task performance were probed using a drift diffusion model analysis. Based on prior work, it was hypothesised that multiple (vs. single) primes would increase stereotype-based responding. Across two experiments, a consistent pattern of results emerged. First, stereotype priming was insensitive to the number of primes that were presented and occurred only at a short prime-target stimulus onset asynchrony (i.e., 250 ms). Second, priming was underpinned by a bias towards congruent (vs. incongruent) prime-target responses. Collectively these findings advance understanding of the emergence and origin of stereotype priming during person and people perception. [ABSTRACT FROM AUTHOR]

Because the environment is cluttered, objects rarely appear in isolation. The visual system must therefore attentionally select behaviorally relevant objects from among many irrelevant ones. A limit on our ability to select individual objects is revealed by the phenomenon of visual crowding: an object seen in the periphery, easily recognized in isolation, can become impossible to identify when surrounded by other, similar objects. The neural basis of crowding is hotly debated: while prevailing theories hold that crowded information is irrecoverable - destroyed due to over-integration in early stage visual processing - recent evidence demonstrates otherwise. Crowding can occur between high-level, configural object representations, and crowded objects can contribute with high precision to judgments about the "gist" of a group of objects, even when they are individually unrecognizable. While existing models can account for the basic diagnostic criteria of crowding (e.g., specific critical spacing, spatial anisotropies, and temporal tuning), no present model explains how crowding can operate simultaneously at multiple levels in the visual processing hierarchy, including at the level of whole objects. Here, we present a new model of visual crowding-the hierarchical sparse selection (HSS) model, which accounts for object-level crowding, as well as a number of puzzling findings in the recent literature. Counter to existing theories, we posit that crowding occurs not due to degraded visual representations in the brain, but due to impoverished sampling of visual representations for the sake of perception. The HSS model unifies findings from a disparate array of visual crowding studies and makes testable predictions about how information in crowded scenes can be accessed.

The accurate perception of human crowds is integral to social understanding and interaction. Previous studies have shown that observers are sensitive to several crowd characteristics such as average facial expression, gender, identity, joint attention, and heading direction. In two experiments, we examined ensemble perception of crowd speed using standard point-light walkers (PLW). Participants were asked to estimate the average speed of a crowd consisting of 12 figures moving at different speeds. In Experiment 1, trials of intact PLWs alternated with trials of scrambled PLWs with a viewing duration of 3 seconds. We found that ensemble processing of crowd speed could rely on local motion alone, although a globally intact configuration enhanced performance. In Experiment 2, observers estimated the average speed of intact-PLW crowds that were displayed at reduced viewing durations across five blocks of trials (between 2500 ms and 500 ms). Estimation of fast crowds was precise and accurate regardless of viewing duration, and we estimated that three to four walkers could still be integrated at 500 ms. For slow crowds, we found a systematic deterioration in performance as viewing time reduced, and performance at 500 ms could not be distinguished from a single-walker response strategy. Overall, our results suggest that rapid and accurate ensemble perception of crowd speed is possible, although sensitive to the precise speed range examined. [ABSTRACT FROM AUTHOR]

It is well established that ensemble coding is regulated by physical similarity and variance in a set of stimuli. For example, observers are more accurate at judging the mean size of objects in a set if the overall size variance in the set is small. However, sometimes similarity among set members can be purely subjective. For example, faces from another race tend to look more similar than faces from one's own race. Very little is known about whether such subjective similarity also regulates ensemble coding in the same manner as objective similarity. To investigate this question, we had British and Chinese participants view sets of four faces that were of either own-race or other-race, own-gender or other-gender. After viewing each set the task was to judge whether a test face was presented in the set. Our results showed that, as demonstrated in prior research, participants often mistook a morphed set average to be a member of the set. Critically, this tendency to average a face set was not stronger for other-race faces. Hence contrary to objective similarity, subjectively perceived similarity in the other-race faces does not facilitate ensemble coding. The results in our British group also replicated de Fockert and Gautrey's (Psychonomic Bulletin & Review 20 (3), 468-473, 2013) own-gender effect, where observers showed more averaging for own-gender faces. However, our Chinese subjects displayed the same level of averaging for both genders. This suggests a cultural difference in ensemble coding, where the own-gender bias may be overridden by a stronger tendency to employ ensemble coding in Chinese participants. [ABSTRACT FROM AUTHOR]

Most visual scenes contain information at different spatial scales, including the local and global, or the detail and gist. Global processes have become increasingly implicated in research examining summary statistical perception, initially as the output of ensemble coding, and more recently as a gating mechanism for selecting which information is included in the averaging process itself. Yet local and global processing are known to be rapidly integrated by the visual system, and it is plausible that global-level information, like spatial organization, may be included as an input during ensemble coding. We tested this hypothesis using an ensemble shape-perception task in which observers evaluated the mean aspect ratios of sets of ellipses. In addition to varying the aspect ratios of the individual shapes, we independently varied the spatial arrangements of the sets so that they had either flat or tall organizations at the global level. We found that observers made precise summary judgments about the average aspect ratios of the sets by integrating information from multiple shapes. More importantly, global flat and tall organizations were incorporated into ensemble judgments about the sets; summary judgments were biased in the directions of the global spatial arrangements on each trial. This global-to-local integration even occurred when the global organizations were masked. Our results demonstrate that the process of summary representation can include information from both the local and global scales. The gist is not just an output of ensemble representation – it can be included as an input to the mechanism itself. [ABSTRACT FROM AUTHOR]

Digits serve as useful tools for studying the interaction between low-level perceptual representations and higher-level semantic information, and also the degree to which processing these stimulus attributes relies on similar or different mechanisms. Following a body of literature that debates the influence of high-level, semantic information on perceptual processing, and work by Van Opstal and colleagues (2011) investigating whether subliminally presented digit arrays affect estimates of numerical averages, here we explored the temporal dynamics of extracting numerical values associated with each digit in an array. Specifically, we examined reaction times (RTs) for estimating the average of digit arrays of varying sizes to determine whether numerical meaning is extracted in parallel, or instead may require serial processing of individual digits. In Experiment 1, participants completed a numerical mean estimation task, along with visual search tasks designed to yield RT patterns across increasing display sizes thought to be characteristic of serial and parallel processes. In Experiment 2, we controlled for brightness cues that could have contributed to performance in Experiment 1. In both experiments, comparing RT patterns for the numerical averaging tasks to those of the search tasks suggested that semantic information from multiple digits may be extracted by a parallel processing mechanism. Unlike in either search task, RTs improved with increasing display size, indicating a potential benefit of larger displays as has been reported for extracting ensemble, or summary statistical representations of lower-level visual information.

The ability to recognize identity despite within‐person variability in appearance is likely a face‐specific skill and shaped by experience. Ensemble coding – the automatic extraction of the average of a stimulus array – has been proposed as a mechanism underlying face learning (allowing one to recognize novel instances of a newly learned face). We investigated whether ensemble encoding, like face learning and recognition, is refined by experience by testing participants with upright own‐race faces and two categories of faces with which they lacked experience: other‐race faces (Experiment 1) and inverted faces (Experiment 2). Participants viewed four images of an unfamiliar identity and then were asked whether a test image of that same identity had been in the study array. Each test image was a matching exemplar (from the array), matching average (the average of the images in the array), non‐matching exemplar (a novel image of the same identity), or non‐matching average (an average of four different images of the same identity). Adults showed comparable ensemble coding for all three categories (i.e., reported that matching averages had been present more than non‐matching averages), providing evidence that this early stage of face learning is not shaped by face‐specific experience. [ABSTRACT FROM AUTHOR]

Our visual system is able to extract information on facial attractiveness from groups of faces that contain both coarse and detailed information. This raises the question: What information is extracted from a face group? Is the attractiveness perception of multiple faces driven by high or low spatial frequency that can highlight the local or global information of the faces, respectively? In the first experiment, we adapted participants to four unattractive faces with full bandwidth (FB), high spatial frequency (HSF), and low spatial frequency (LSF). We observed significant aftereffects in the HSF faces adaptation condition, which suggests that the perception of multiple unattractive faces is largely driven by HSF information. In the second experiment, we found a similar but different pattern in the direct‐rating tasks, suggesting distinct perception mechanisms in unattractive versus attractive faces. In the third experiment, both the adaptation and direct‐rating paradigms suggested that perception of multiple attractive faces is largely driven by LSF information. Overall, results from the three experiments together found that perception of multiple attractive and unattractive faces depends on visual information from different spatial frequencies, suggesting distinctive mechanisms in processing attractive and unattractive groups of faces. [ABSTRACT FROM AUTHOR]

Statistical summary representations (SSRs) are thought to be computed by the visual system to provide a rapid summary of the properties of sets of similar objects. Recently, it has been suggested that a change in the statistical properties of a set can be identified even when changes to the individual items comprising the set cannot. Haberman and Whitney (2011) showed that subjects were correctly able to report which of 2 consecutively presented sets of faces was, on average, happier, even when participants were unable to localize any of the items contributing to this change. In this article, we revisit this conclusion and suggest that the results supporting it may be an artifact of the paradigm used. In 4 experiments, we find little evidence to suggest that subjects can reliably detect a change in the average size or emotion of an array of faces when they are unable to localize changes to individual items. The results are well accounted for by assuming that observers are selectively attending to individual items and then inferring the direction of the overall change based on the behavior of the attended items. We suggest that this occurs because change localization requires focused attention to individual items, impeding calculation of SSRs, which requires global attention to the entire set. We conclude that there is currently little evidence that SSRs can facilitate change detection when individual change localization fails. Public Significance Statement: Previous research suggests that when faced with a lot of similar information, the visual system conserves resources by compressing it into more efficient statistical summary representations. Researchers have suggested such representations allow us to notice when a scene has changed, even when we do not see any one item in the scene change. Here we show that this conclusion is premature because it is based on a task that can be done without computing summary representations. [ABSTRACT FROM AUTHOR]

During ensemble coding, the visual system extracts summary information from input that has been integrated, facilitating gist-level judgments about objects and features that belong together. In contrast, input can be segmented, allowing for quick categorical distinctions between objects. Integration and segmentation usually work in parallel but may sometimes conflict in the context of ensemble coding. To investigate this possibility, we examined summary perception of aspect ratio (i.e., "tallness/flatness"). Aspect ratio has a category boundary (e.g., a circle), and individual aspect ratios may be perceptually exaggerated—segmented—away from this boundary. We predicted that summary perception of multiple aspect ratios would be disrupted when, as a set, they spanned the category boundary, since integration and segmentation would then be at odds. We found that when observers reported the average aspect ratio of a set of ellipses, they were less sensitive to the mean of sets that included both tall and flat ellipses, compared to sets comprised of tall or flat ellipses. Follow-up experiments suggest this occurred because segmentation distorted the appearance of ellipses away from the category boundary, exaggerating set heterogeneity. These experiments advance understanding of how the visual system summarizes information by showing that integration and segmentation can conflict. Public Significance Statement: The visual system uses two broad strategies to transform input into representations that are concise and useful. Sometimes, it integrates information in order to make generalizations, and other times it segments information to highlight differences. Here, we show that these two fundamental computational methods can conflict. Our findings provide insight into how the solution to some computational problems faced by the visual system can actually constrain, or conflict with, the solution to different problems. [ABSTRACT FROM AUTHOR]

Face perception is an important ability in social interaction. Holistic processing of a face enables us to understand facial attributes easily despite similarity of faces. Ensemble coding of multiple faces enables us to judge the characteristics of a crowd easily despite the limited capacity of the visual system. The current study investigated whether holistic processing of a face is different from ensemble coding of multiple faces and, if so, how. We tested how face inversion influenced both holistic processing and ensemble coding. Participants were asked to discriminate emotion intensities of either a single face or a crowd of faces (angry or happy face[s]). More important, face(s) or facial features were sometimes presented upside-down. We found that a face inversion effect was larger in discriminating individual emotion than in discriminating emotion in a crowd. As the number of inverted components increased, both discrimination abilities were more disrupted. The degree of disruption varied depending on different emotions and features in holistic processing, but it did not vary in ensemble coding. The inversion effect was weaker in ensemble coding than in holistic processing because noise produced by inversion might have cancelled out in averaging. Different inversion effects depending on different emotions and facial features were observed only in holistic processing because uneven contributions of facial features to individual emotion processing might have reduced the effectiveness of noise cancellation. Together, these results suggest that ensemble coding provides a powerful mechanism of noise cancellation involved with individual representation. [ABSTRACT FROM AUTHOR]

When exposed to others' emotional responses, people often make rapid decisions as to whether these others are members of their group or not. These group categorization decisions have been shown to be extremely important to understanding group behavior. Yet, despite their prevalence and importance, we know very little about the attributes that shape these categorization decisions. To address this issue, we took inspiration from ensemble coding research and developed a task designed to reveal the influence of the mean and variance of group members' emotions on participants' group categorization. In Study 1, we verified that group categorization decreases when the group's mean emotion is different from the participant's own emotional response. In Study 2, we established that people identify a group's mean emotion more accurately when its variance is low rather than high. In Studies 3 and 4, we showed that participants were more likely to self-categorize as members of groups with low emotional variance, even if their own emotions fell outside of the range of group emotions they saw, and that this preference is seen for judgments of both positive and negative group emotions. In Study 5, we showed that this unique preference for low group emotional variance is special to group categorization and does not appear in a more basic face categorization task. Our studies reveal unexplored and important tendencies in group categorization based on group emotions. [ABSTRACT FROM AUTHOR]

Research has shown that observers often spontaneously extract a mean representation from multiple faces/objects in a scene even when this is not required by the task. This phenomenon, now known as ensemble coding, has so far mainly been based on data from Western populations. This study compared East Asian and Western participants in an implicit ensemble-coding task, where the explicit task was to judge whether a test face was present in a briefly exposed set of faces. Although both groups showed a tendency to mistake an average of the presented faces as target, thus confirming the universality of ensemble coding, East Asian participants displayed a higher averaging tendency relative to the Westerners. To further examine how a cultural default can be adapted to global or local processing demand, our second experiment tested the effects of priming global or local processing orientation on ensemble coding via a Navon task procedure. Results revealed a reduced tendency for ensemble coding following the priming of local processing orientation. Together, these results suggest that culture can influence the proneness to ensemble coding, and the default cultural mode is malleable to a temporary processing demand. [ABSTRACT FROM AUTHOR]

Ensemble coding – the rapid extraction of a perceptual average – has been proposed as a potential mechanism underlying face learning. We tested this proposal across five pre-registered experiments in which four ambient images of an identity were presented in the study phase. In Experiments 1 and 2a-c, participants were asked whether a test image was in the study array; these experiments examined the robustness of ensemble coding. Experiment 1 replicated ensemble coding in an online sample; participants recognize images from the study array and the average of those images. Experiments 2a-c provide evidence that ensemble coding meets several criteria of a possible learning mechanism: It is robust to changes in head orientation (± 60o), survives a short (30s) delay, and persists when images of two identities are interleaved during the study phase. Experiment 3 examined whether ensemble coding is sufficient for face learning (i.e., facilitates recognition of novel images of a target identity). Each study array comprised four ambient images (variability + average), a single image, or an average of four images (average only). Participants were asked whether a novel test image showed the identity from a study array. Performance was best in the four-image condition, with no difference between the single-image and average-only conditions. We conclude that ensemble coding of facial identity is robust but that the perceptual average per se is not sufficient for face learning. [ABSTRACT FROM AUTHOR]

Ensemble coding refers to the brain's ability to rapidly extract summary statistics, such as average size and average cost, from a large set of visual stimuli. Although ensemble coding is thought to circumvent a capacity limit of visual working memory, we recently observed a VWM-like capacity limit in an ensemble task where observers extracted the average sweetness of groups of food pictures (i.e., they could only integrate information from four out of six available items), thus suggesting the involvement of VWM in this novel form of cross-modal ensemble coding. Therefore, across two experiments we investigated if this cross-modal ensemble capacity limit could be explained by individual differences in VWM processing. To test this, observers performed both an ensemble task and a VWM task, and we determined 1) how much information they integrated into their ensemble percepts, and 2) how much information they remembered from those displays. Interestingly, we found that individual differences in VWM capacity did not explain differences in performance on the ensemble coding task (i.e., high-capacity individuals did not have significantly higher "ensemble abilities" than low-capacity individuals). While our data cannot definitively state whether or not VWM is necessary to perform the ensemble task, we conclude that it is certainly not sufficient to support this cognitive process. We speculate that the capacity limit may be explained by 1) a bottleneck at the perceptual stage (i.e., a failure to process multiple visual features across multiple items, as there are no singular features that convey taste), or 2) the interaction of multiple cognitive systems (e.g., VWM, gustatory working memory, long term memory). Our results highlight the importance of examining ensemble perception across multiple sensory and cognitive domains to provide a clearer picture of the mechanisms underlying everyday behavior. • Different sensory modalities (taste/vision) can interact during ensemble coding. • Item capacity limits in ensemble coding arise when taste/vision need to interact. • This capacity limit is similar to that found in visual working memory (VWM). • We found that this capacity limit was not explained by VWM capacity. • Thus, visual working memory is not sufficient to support this cognitive process. [ABSTRACT FROM AUTHOR]

The hierarchical view of working memory suggested that object ensemble could also be stored into working memory by treating ensemble properties as single “unit.” However, it remains unclear whether ensemble representation in working memory is vulnerable to attention demanding. The present study designed a dual-task paradigm constituting of a memory retaining task and an attention-demanding arrow flanker task. Participants were firstly presented an array (4 or 9) of facial images with neutral expressions and then shown a left- or right-orientated arrow surrounded by four congruent or incongruent oriented arrows or short lines. Participants judged the orientation of the target arrow and then indicated whether a probe facial image was present or absent in the preceding facial array. The probe face consisted of four conditions: (1) a morphed average face of prior face set, (2) a morphed average face of another face set, (3) an exemplar face of prior set, and (4) an exemplar face of another face set. Results confirmed that participants implicitly coded the average facial image of preceding set and retained in working memory. More importantly, the memory representation of ensemble property (e.g., average facial identity) was independent of flanker type. In sum, this study provided further evidence of the hierarchical view of working memory and suggested that attention was not a pre-requisite for the retaining of ensemble properties in working memory.