Search

When processing visual scenes, we tend to prioritize information in the foreground, often at the expense of background information. The foreground bias has been supported by data demonstrating that there are more fixations to foreground, and faster and more accurate detection of targets embedded in foreground. However, it is also known that semantic consistency is associated with more efficient search. Here, we examined whether semantic context interacts with foreground prioritization, either amplifying or mitigating the effect of target semantic consistency. For each scene, targets were placed in the foreground or background and were either semantically consistent or inconsistent with the context of immediately surrounding depth region. Results indicated faster response times (RTs) for foreground and semantically consistent targets, replicating established effects. More importantly, we found the magnitude of the semantic consistency effect was significantly smaller in the foreground than background region. To examine the robustness of this effect, in Experiment 2, we strengthened the reliability of semantics by increasing the proportion of targets consistent with the scene region to 80%. We found the overall results pattern to replicate the incongruous effect of semantic consistency across depth observed in Experiment 1. This suggests foreground bias modulates the effects of semantics so that performance is less impacted in near space., (© 2024. Crown.)

Real world search tasks often involve action on a target object once it has been located. However, few studies have examined whether movement-related costs associated with acting on located objects influence visual search. Here, using a task in which participants reached to a target object after locating it, we examined whether people take into account obstacles that increase movement-related costs for some regions of the reachable search space but not others. In each trial, a set of 36 objects (4 targets and 32 distractors) were displayed on a vertical screen and participants moved a cursor to a target after locating it. Participants had to fixate on an object to determine whether it was a target or distractor. A rectangular obstacle, of varying length, location, and orientation, was briefly displayed at the start of the trial. Participants controlled the cursor by moving the handle of a robotic manipulandum in a horizontal plane. The handle applied forces to simulate contact between the cursor and the unseen obstacle. We found that search, measured using eye movements, was biased to regions of the search space that could be reached without moving around the obstacle. This result suggests that when deciding where to search, people can incorporate the physical structure of the environment so as to reduce the movement-related cost of subsequently acting on the located target.

Real-world search behavior often involves limb movements, either during search or after search. Here we investigated whether movement-related costs influence search behavior in two kinds of search tasks. In our visual search tasks, participants made saccades to find a target object among distractors and then moved a cursor, controlled by the handle of a robotic manipulandum, to the target. In our manual search tasks, participants moved the cursor to perform the search, placing it onto objects to reveal their identity as either a target or a distractor. In all tasks, there were multiple targets. Across experiments, we manipulated either the effort or time costs associated with movement such that these costs varied across the search space. We varied effort by applying different resistive forces to the handle, and we varied time costs by altering the speed of the cursor. Our analysis of cursor and eye movements during manual and visual search, respectively, showed that effort influenced manual search but did not influence visual search. In contrast, time costs influenced both visual and manual search. Our results demonstrate that, in addition to perceptual and cognitive factors, movement-related costs can also influence search behavior. NEW & NOTEWORTHY Numerous studies have investigated the perceptual and cognitive factors that influence decision making about where to look, or move, in search tasks. However, little is known about how search is influenced by movement-related costs associated with acting on an object once it has been visually located or acting during manual search. In this article, we show that movement time costs can bias visual and manual search and that movement effort costs bias manual search.

When you walk into a large room, you perceive visual information that is both close to you in depth and farther in the background. Here, we investigated how initial scene representations are affected by information across depth. We examined the role of background and foreground information on scene gist by using chimera scenes (images with a foreground and background from different scene categories). Across three experiments, we found a foreground bias: Information in the foreground initially had a strong influence on the interpretation of the scene. This bias persisted when the initial fixation position was on the scene background and when the task was changed to emphasize scene information. We concluded that the foreground bias arises from initial processing of scenes for understanding and suggests that scene information closer to the observer is initially prioritized. We discuss the implications for theories of scene and depth perception.

Scene processing is fundamentally influenced and constrained by spatial layout and spatial associations with objects. However, semantic information has played a vital role in propelling our understanding of real-world scene perception forward. In this article, we review recent advances in assessing how spatial layout and spatial relations influence scene processing. We examine the organization of the larger environment and how we take full advantage of spatial configurations independently of semantic information. We demonstrate that a clear differentiation of spatial from semantic information is necessary to advance research in the field of scene processing.

How are scene representations stored in memory? Researchers have often posited that scene representations have a hierarchical structure with background elements providing a scaffold for more detailed foreground elements. To further investigate scene representation and the role of background and foreground information, we introduced a new stimulus set: chimera scenes, which have the central block of objects belonging to one scene category (foreground), and the surrounding structure belonging to another (background). We used a contextual cueing paradigm and emphasized the relative importance of each by having the target placed on either the background or foreground. In a transfer block, we found that though changes to the background were highly detrimental to search performance for background targets, search performance was only slightly affected by changes to either the foreground or the background for foreground targets. These results indicate that rather than a fixed hierarchy, the structure of scene representations are more aptly captured by a parallel model that stores information flexibly. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Studies have established that scene context guides attention during visual search, but it is not yet clear how. In this study, we examined how attention is deployed across scenes using an attentional capture paradigm. Using the Surface Guidance Framework (Castelhano & Pereira, 2019), we defined target-relevant and target-irrelevant scene regions for each target object and compared how attentional capture of a suddenly onsetting distractor differs for object and letter searches. We found an enhancement of capture effects when distractors appeared within target-relevant regions, with greater proportions of distractors fixated and greater proportions of saccades made toward the distractor for object searches, but not for letter searches. Thus, attention in the real world can be flexibly and spatially distributed on the basis of contextual information, with the Surface Guidance Framework presenting a powerful tool for exploring attentional guidance in real-world scenes.

The use of eye movements to explore scene processing has exploded over the last decade. Eye movements provide distinct advantages when examining scene processing because they are both fast and spatially measurable. By using eye movements, researchers have investigated many questions about scene processing. Our review will focus on research performed in the last decade examining: (1) attention and eye movements; (2) where you look; (3) influence of task; (4) memory and scene representations; and (5) dynamic scenes and eye movements. Although typically addressed as separate issues, we argue that these distinctions are now holding back research progress. Instead, it is time to examine the intersections of these seemingly separate influences and examine the intersectionality of how these influences interact to more completely understand what eye movements can tell us about scene processing.

Many studies in reading have shown the enhancing effect of context on the processing of a word before it is directly fixated (parafoveal processing of words). Here, we examined whether scene context influences the parafoveal processing of objects and enhances the extraction of object information. Using a modified boundary paradigm called the Dot-Boundary paradigm, participants fixated on a suddenly onsetting cue before the preview object would onset 4° away. The preview object could be identical to the target, visually similar, visually dissimilar or a control (black rectangle). The preview changed to the target object once a saccade toward the object was made. Critically, the objects were presented on either a consistent or an inconsistent scene background. Results revealed that there was a greater processing benefit for consistent than inconsistent scene backgrounds and that identical and visually similar previews produced greater processing benefits than other previews. In the second experiment, we added an additional context condition in which the target location was inconsistent, but the scene semantics remained consistent. We found that changing the location of the target object disrupted the processing benefit derived from the consistent context. Most importantly, across both experiments, the effect of preview was not enhanced by scene context. Thus, preview information and scene context appear to independently boost the parafoveal processing of objects without any interaction from object-scene congruency.

Adults with High Functioning Autism Spectrum Disorders (ASD) viewed scenes with people in them, while having their eye movements recorded. The task was to indicate, using a button press, whether the pictures were normal, or in some way weird or odd. Oddities in the pictures were categorized as violations of either perceptual or social norms. Compared to a Typically Developed (TD) control group, the ASD participants were equally able to categorize the scenes as odd or normal, but they took longer to respond. The eye movement patterns showed that the ASD group made more fixations and revisits to the target areas in the odd scenes compared with the TD group. Additionally, when the ASD group first fixated the target areas in the scenes, they failed to initially detect the social oddities. These two findings have clear implications for processing difficulties in ASD for the social domain, where it is important to detect social cues on-line, and where there is little opportunity to go back and recheck possible cues in fast dynamic interactions. Autism Res 2016, 9: 879-887. © 2015 International Society for Autism Research, Wiley Periodicals, Inc., (© 2015 International Society for Autism Research, Wiley Periodicals, Inc.)

How does one know where to look for objects in scenes? Objects are seen in context daily, but also used for specific purposes. Here, we examined whether an object's function can guide attention during visual search in scenes. In Experiment 1, participants studied either the function (function group) or features (feature group) of a set of invented objects. In a subsequent search, the function group located studied objects faster than novel (unstudied) objects, whereas the feature group did not. In Experiment 2, invented objects were positioned in locations that were either congruent or incongruent with the objects' functions. Search for studied objects was faster for function-congruent locations and hampered for function-incongruent locations, relative to search for novel objects. These findings demonstrate that knowledge of object function can guide attention in scenes, and they have important implications for theories of visual cognition, cognitive neuroscience, and developmental and ecological psychology., (© The Author(s) 2016.)

In the present study, we examined how gaze guidance is affected by immediately available information in the periphery and investigated how search strategies differed across manipulations in the availability of scene context and object content information. Across 3 experiments, participants performed a visual search task in scenes while using a gaze-contingent moving-window paradigm. Extrafoveal information was manipulated across conditions to examine the contributions of object content, scene context, or some combination of the two. Experiment 1 demonstrated a possible interaction between scene context and object content information in improving guidance. Experiments 2 and 3 supported the notion that object content is selected for further scrutiny based on its position within scene context. These results suggest a prioritization of object information based on scene context, such that contextual information acts as a framework in the selection of relevant regions, and object information can then affect which specific locations in those regions are selected for further examination.

Behavioral coordination and synchrony contribute to a common biological mechanism that maintains communication, cooperation and bonding within many social species, such as primates and birds. Similarly, human language and social systems may also be attuned to coordination to facilitate communication and the formation of relationships. Gross similarities in movement patterns and convergence in the acoustic properties of speech have already been demonstrated between interacting individuals. In the present studies, we investigated how coordinated movements contribute to observers' perception of affiliation (friends vs. strangers) between two conversing individuals. We used novel computational methods to quantify motor coordination and demonstrated that individuals familiar with each other coordinated their movements more frequently. Observers used coordination to judge affiliation between conversing pairs but only when the perceptual stimuli were restricted to head and face regions. These results suggest that observed movement coordination in humans might contribute to perceptual decisions based on availability of information to perceivers.

An ongoing challenge in scene perception is identifying the factors that influence how we explore our visual world. By using multiple versions of paintings as a tool to control for high-level influences, we show that variation in the visual details of a painting causes differences in observers' gaze despite constant task and content. Further, we show that by switching locations of highly salient regions through textural manipulation, a corresponding switch in eye movement patterns is observed. Our results present the finding that salient regions and gaze behavior are not simply correlated; variation in saliency through textural differences causes an observer to direct their viewing accordingly. This work demonstrates the direct contribution of low-level factors in visual exploration by showing that examination of a scene, even for aesthetic purposes, can be easily manipulated by altering the low-level properties and hence, the saliency of the scene., (PsycINFO Database Record (c) 2014 APA, all rights reserved.)

Autism spectrum disorder (ASD) and typically developed (TD) adult participants viewed pairs of scenes for a simple "spot the difference" (STD) and a complex "which one's weird" (WOW) task. There were no group differences in the STD task. In the WOW task, the ASD group took longer to respond manually and to begin fixating the target "weird" region. Additionally, as indexed by the first-fixation duration into the target region, the ASD group failed to "pick up" immediately on what was "weird". The findings are discussed with reference to the complex information processing theory of ASD (Minshew & Goldstein, 1998 ).

Although the use of semantic information about the world seems ubiquitous in every task we perform, it is not clear whether we rely on a scene's semantic information to guide attention when searching for something in a specific scene context (e.g., keys in one's living room). To address this question, we compared contribution of a scene's semantic information (i.e., scene gist) versus learned spatial associations between objects and context. Using the flash-preview-moving-window paradigm Castelhano and Henderson (Journal of Experimental Psychology: Human Perception and Performance 33:753-763, 2007), participants searched for target objects that were placed in either consistent or inconsistent locations and were semantically consistent or inconsistent with the scene gist. The results showed that learned spatial associations were used to guide search even in inconsistent contexts, providing evidence that scene context can affect search performance without consistent scene gist information. We discuss the results in terms of hierarchical organization of top-down influences of scene context.

Older and younger readers read sentences in which target words were masked 40 to 60 ms after fixation onset. Masking only the target word caused more disruption than did masking each word in the sentence, and this effect was stronger for the younger readers than for the older readers. Although older readers had longer eye fixations than did younger readers, the results indicated that the masking effect was comparable for the 2 groups. However, for both groups, how long the eyes remained in place was strongly influenced by the frequency of the fixated word (even though it had been rapidly replaced by the mask and was no longer there when the eyes did move). This is compelling evidence that for both older and younger readers, cognitive/lexical processing has a very strong influence on when the eyes move in reading., ((c) 2011 APA, all rights reserved.)

Can the visual system extrapolate spatial layout of a scene to new viewpoints after a single view? In the present study, we examined this question by investigating the priming of spatial layout across depth rotations of the same scene (Sanocki & Epstein, 1997). Participants had to indicate which of two dots superimposed on objects in the target scene appeared closer to them in space. There was as much priming from a prime with a viewpoint that was 10° different from the test image as from a prime that was identical to the target; however, there was no reliable priming from larger differences in viewpoint. These results suggest that a scene's spatial layout can be extrapolated, but only to a limited extent.

Older and younger readers read sentences as their eye movements were recorded, and the boundary paradigm (Rayner, 1975) was used to present either a valid or an invalid parafoveal preview of a target word. During the saccade to the target word, the preview word changed to the target word. For early measures of processing time (first fixation duration and single fixation duration), the standard preview benefit effect (shorter fixation times on the target word with a valid preview than an invalid preview) was obtained for both older and younger readers. However, for gaze duration and go-past time, the preview benefit was somewhat attenuated in the older readers in comparison to the younger readers, suggesting that on some fixations older readers obtain less preview benefit from the word to the right of fixation., ((c) 2010 APA, all rights reserved.)

Many experiments have shown that knowing a target's visual features improves search performance over knowing the target name. Other experiments have shown that scene context can facilitate object search in natural scenes. In this study, we investigated how scene context and target features affect search performance. We examined two possible sources of information from scene context--the scene's gist and the visual details of the scene--and how they potentially interact with target-feature information. Prior to commencing search, participants were shown a scene and a target cue depicting either a picture or the category name (or no-information control). Using eye movement measures, we investigated how the target features and scene context influenced two components of search: early attentional guidance processes and later verification processes involved in the identification of the target. We found that both scene context and target features improved guidance, but that target features also improved speed of target recognition. Furthermore, we found that a scene's visual details played an important role in improving guidance, much more so than did the scene's gist alone.

The size of the perceptual span (or the span of effective vision) in older readers was examined with the moving window paradigm (G. W. McConkie & K. Rayner, 1975). Two experiments demonstrated that older readers have a smaller and more symmetric span than that of younger readers. These 2 characteristics (smaller and more symmetric span) of older readers may be a consequence of their less efficient processing of nonfoveal information, which results in a riskier reading strategy., ((c) 2009 APA, all rights reserved.)

In two experiments, memory was tested for changes in viewpoints in naturalistic scenes. In the key study condition, participants viewed two images of the same scene from viewpoints 40 degrees apart. There were two other study conditions: The two study images were identical or were of different scenes. A test image followed immediately, and participants judged whether it was identical to either of the study images. The scene in the test image was always the same as in a study image and was at least 20 degrees from any study image on different trials. Two models were tested: (1) views stored and retrieved independently and (2) views combined at retrieval. The crucial test of these hypotheses involved a comparison (in the key study condition) of the interpolation condition (the test image was presented between the two study images and 20 degrees from both) and the extrapolation condition (it was 20 degrees from one study image and 60 degrees from the other). Performance in the interpolation condition was far worse than what was predicted by the first model, whereas the second model fit the data quite well. The latter model is parsimonious in that it integrates previous experiences without requiring the integration of the views in memory. We review some of this model's broader implications.

Expanding on the seminal work of G. Buswell (1935) and I. A. Yarbus (1967), we investigated how task instruction influences specific parameters of eye movement control. In the present study, 20 participants viewed color photographs of natural scenes under two instruction sets: visual search and memorization. Results showed that task influenced a number of eye movement measures including the number of fixations and gaze duration on specific objects. Additional analyses revealed that the areas fixated were qualitatively different between the two tasks. However, other measures such as average saccade amplitude and individual fixation durations remained constant across the viewing of the scene and across tasks. The present study demonstrates that viewing task biases the selection of scene regions and aggregate measures of fixation time on those regions but does not influence other measures, such as the duration of individual fixations.

Recent studies have suggested that eye movement patterns while viewing scenes differ for people from different cultural backgrounds and that these differences in how scenes are viewed are due to differences in the prioritization of information (background or foreground). The current study examined whether there are cultural differences in how quickly eye movements are drawn to highly unusual aspects of a scene. American and Chinese viewers examined photographic scenes while performing a preference rating task. For each scene, participants were presented with either a normal or an unusual/weird version. Even though there were differences between the normal and weird versions of the scenes, there was no evidence of any cultural differences while viewing either scene type. The present study, along with other recent reports, raises doubts about the notion that cultural differences can influence oculomotor control in scene perception.

Participants searched for a picture of an object, and the object was either a typical or an atypical category member. The object was cued by either the picture or its basic-level category name. Of greatest interest was whether it would be easier to search for typical objects than to search for atypical objects. The answer was"yes," but only in a qualified sense: There was a large typicality effect on response time only for name cues, and almost none of the effect was found in the time to locate (i.e., first fixate) the target. Instead, typicality influenced verification time-the time to respond to the target once it was fixated. Typicality is thus apparently irrelevant when the target is well specified by a picture cue; even when the target is underspecified (as with a name cue), it does not aid attentional guidance, but only facilitates categorization.

In 3 experiments the authors used a new contextual bias paradigm to explore how quickly information is extracted from a scene to activate gist, whether color contributes to this activation, and how color contributes, if it does. Participants were shown a brief presentation of a scene followed by the name of a target object. The target object could be consistent or inconsistent with scene gist but was never actually present in the scene. Scene gist activation was operationalized as the degree to which participants respond "yes" to consistent versus inconsistent objects, reflecting a response bias produced by scene gist. Experiment 1 demonstrated that scene gist is activated after a 42-ms exposure and that the strength of the activation increases with longer presentation durations. Experiments 2 and 3 explored the contribution of color to the activation of scene gist. The results revealed that color has an influence across a wide variety of scenes and is directly associated with scene gist.

Individual differences in eye movements during picture viewing were examined across image format, content, and foveal quality in 3 experiments. Experiment 1 demonstrated that an individual's fixation durations were strongly related across 3 types of scene formats and that saccade amplitudes followed the same pattern. In Experiment 2, a similar relationship was observed for fixation durations across faces and scenes, although the amplitude relationship did not hold as strongly. In Experiment 3, the duration and amplitude relationships were observed when foveal information was degraded and even removed. Eye movement characteristics differ across individuals, but there is a great deal of consistency within individuals when viewing different types of images., (Copyright (c) 2008 APA, all rights reserved.)

What role does the initial glimpse of a scene play in subsequent eye movement guidance? In 4 experiments, a brief scene preview was followed by object search through the scene via a small moving window that was tied to fixation position. Experiment 1 demonstrated that the scene preview resulted in more efficient eye movements compared with a control preview. Experiments 2 and 3 showed that this scene preview benefit was not due to the conceptual category of the scene or identification of the target object in the preview. Experiment 4 demonstrated that the scene preview benefit was unaffected by changing the size of the scene from preview to search. Taken together, the results suggest that an abstract (size invariant) visual representation is generated in an initial scene glimpse and that this representation can be retained in memory and used to guide subsequent eye movements., ((c) 2007 APA, all rights reserved)

Many experiments have shown that the human visual system makes extensive use of contextual information for facilitating object search in natural scenes. However, the question of how to formally model contextual influences is still open. On the basis of a Bayesian framework, the authors present an original approach of attentional guidance by global scene context. The model comprises 2 parallel pathways; one pathway computes local features (saliency) and the other computes global (scene-centered) features. The contextual guidance model of attention combines bottom-up saliency, scene context, and top-down mechanisms at an early stage of visual processing and predicts the image regions likely to be fixated by human observers performing natural search tasks in real-world scenes., (Copyright 2006 APA.)

In contextual cueing, the position of a target within a group of distractors is learned over repeated exposure to a display with reference to a few nearby items rather than to the global pattern created by the elements. The authors contrasted the role of global and local contexts for contextual cueing in naturalistic scenes. Experiment 1 showed that learned target positions transfer when local information is altered but not when global information is changed. Experiment 2 showed that scene-target covariation is learned more slowly when local, but not global, information is repeated across trials than when global but not local information is repeated. Thus, in naturalistic scenes, observers are biased to associate target locations with global contexts., (Copyright 2006 APA, all rights reserved.)

Eye movements were monitored during a recognition memory test of previously studied pictures of full-color scenes. The test scenes were identical to the originals, had an object deleted from them, or included a new object substituted for an original object. In contrast to a prior report (Parker, 1978), we found no evidence that object deletions or substitutions could be recognized on the basis of information acquired from the visual periphery. Deletions were difficult to recognize peripherally, and the eyes were not attracted to them. Overall, the amplitude of the average saccade to the critical object during the memory test was less than 4.5 degrees of visual angle in all conditions and averaged 4.1 degrees across conditions. We conclude that information about object presence and identity in a scene is limited to a relatively small region around the current fixation point.