Search

Physical interactions between objects, or between an object and the ground, are amongst the most biologically relevant for live beings. Prior knowledge of Newtonian physics may play a role in disambiguating an object’s movement as well as foveation by increasing the spatial resolution of the visual input. Observers were shown a virtual 3D scene, representing an ambiguously rotating ball translating on the ground. The ball was perceived as rotating congruently with friction, but only when gaze was located at the point of contact. Inverting or even removing the visual context had little influence on congruent judgements compared with the effect of gaze. Counterintuitively, gaze at the point of contact determines the solution of perceptual ambiguity, but independently of visual context. We suggest this constitutes a frugal strategy, by which the brain infers dynamics locally when faced with a foveated input that is ambiguous.

Supported by NIH EY018875 (AMN), BBSRC grants BB/M001660/1 (JH), BB/M002543/1 (AW), and BB/MM001210/1 (MB). When we track an object moving in depth, our eyes rotate in opposite directions. This type of “disjunctive” eye movement is called horizontal vergence. The sensory control signals for vergence arise from multiple visual cues, two of which, changing binocular disparity (CD) and inter-ocular velocity differences (IOVD), are specifically binocular. While it is well known that the CD cue triggers horizontal vergence eye movements, the role of the IOVD cue has only recently been explored. To better understand the relative contribution of CD and IOVD cues in driving horizontal vergence, we recorded vergence eye movements from ten observers in response to four types of stimuli that isolated or combined the two cues to motion-in-depth, using stimulus conditions and CD/IOVD stimuli typical of behavioural motion-in-depth experiments. An analysis of the slopes of the vergence traces and the consistency of the directions of vergence and stimulus movements showed that under our conditions IOVD cues provided very little input to vergence mechanisms. The eye movements that did occur coinciding with the presentation of IOVD stimuli were likely not a response to stimulus motion, but a phoria initiated by the absence of a disparity signal. Publisher PDF

Significance Navigating a 3D world requires sensitivity to motion in depth. The human visual system extracts two stereoscopic cues to motion in depth but little is known about the visual pathways that support their computation. Here, we show that achromatic inputs drive a 3D motion signal computed from slow changes in binocular disparity. However, the other 3D motion signal, based on interocular velocity differences, may draw preferentially on information carried by the evolutionarily ancient koniocellular pathway. Paradoxically, this pathway is thought to be far less sensitive to both motion and stereoscopic depth, yet, we find evidence for its involvement in the extraction of motion through depth. Our findings demonstrate an unanticipated role for the koniocellular pathway in a fundamental perceptual mechanism., Motion in depth (MID) can be cued by high-resolution changes in binocular disparity over time (CD), and low-resolution interocular velocity differences (IOVD). Computational differences between these two mechanisms suggest that they may be implemented in visual pathways with different spatial and temporal resolutions. Here, we used fMRI to examine how achromatic and S-cone signals contribute to human MID perception. Both CD and IOVD stimuli evoked responses in a widespread network that included early visual areas, parts of the dorsal and ventral streams, and motion-selective area hMT+. Crucially, however, we measured an interaction between MID type and chromaticity. fMRI CD responses were largely driven by achromatic stimuli, but IOVD responses were better driven by isoluminant S-cone inputs. In our psychophysical experiments, when S-cone and achromatic stimuli were matched for perceived contrast, participants were equally sensitive to the MID in achromatic and S-cone IOVD stimuli. In comparison, they were relatively insensitive to S-cone CD. These findings provide evidence that MID mechanisms asymmetrically draw on information in precortical pathways. An early opponent motion signal optimally conveyed by the S-cone pathway may provide a substantial contribution to the IOVD mechanism.

Two binocular sources of information serve motion-in-depth (MID) perception: changes in disparity over time (CD), and interocular velocity differences (IOVD). While CD requires the computation of small spatial disparities, IOVD could be computed from a much lower-resolution signal. IOVD signals therefore might still be available under conditions of binocular vision impairment (BVI) with limited or no stereopsis, for example, amblyopia.Sensitivity to CD and IOVD was measured in adults who had undergone therapy to correct optical misalignment or amblyopia in childhood (n = 16), as well as normal vision controls with good stereoacuity (n = 8). Observers discriminated the interval containing a smoothly oscillating MID "test" stimulus from a "control" stimulus in a two-interval forced choice paradigm.Of the BVI observers with no static stereoacuity (n = 9), one displayed evidence for sensitivity to IOVD only, while there was otherwise no sensitivity for either CD or IOVD in the group. Generally, BVI observers with measurable stereoacuity (n = 7) displayed a pattern resembling the control group: showing a similar sensitivity for both cues. A neutral density filter placed in front of the fixing eye in a subset of BVI observers did not improve performance.In one BVI observer there was preserved sensitivity to IOVD but not CD, though overall only those BVI observers with at least gross stereopsis were able to detect disparity- or velocity-based cues to MID. The results imply that these logically distinct information sources are somehow coupled, and in some cases BVI observers with no stereopsis may still retain sensitivity to IOVD.

Objectives To determine the impact of adherence to spectacle wear on visual acuity (VA) and developing literacy following vision screening at age 4–5 years. Design Longitudinal study nested within the Born in Bradford birth cohort. Setting and participants Observation of 944 children: 432 had failed vision screening and were referred (treatment group) and 512 randomly selected (comparison group) who had passed (

Virtual reality presents a new set of challenges and opportunities for both engineers and neuroscientists. Here we provide an overview of a programme designed by a group of psychologists, neuroscientists and VR specialists to address some of the most outstanding issues in the field ranging from the very low-level (for example, how the brain processed motion-in-depth signals generated by stereoscopic display devices) to the very high level (how virtual environments can lead to a sense of immersion and emotional engagement). We present data from psychophysical, electrophysiological and neuroimaging experiments and explain how different research methodologies can be applied to different problems in the field of VR/AR. We end by describing an open-source, extensible software package for studying issues in VR that can interface to common laboratory measurement equipment and discussing future directions and challenges facing the neuroscience and VR engineering communities.

Purpose To determine presenting visual acuity levels and explore the factors associated with failing vision screening in a multi-ethnic population of UK children aged 4-5 years. Methods Visual acuity (VA) using the logMAR Crowded Test was measured in 16541 children in a population-based vision screening programme. Referral for cycloplegic examination was based on national recommendations (>0.20logMAR in one or both eyes). Presenting visual impairment (PVI) was defined as VA >0.3logMAR in the better eye. Multivariable logistic regression was used to assess the association of ethnicity, maternal and early-life factors with failing vision screening and PVI in participants of the Born in Bradford birth cohort. Results 2467/16541 (15%) failed vision screening, 732 (4.4%) had PVI. Children of Pakistani (OR 2.49; 95% CI: 1.74 to 3.60) and other ethnicities (OR 2.00; 95% CI: 1.28 to 3.12) showed increased odds of PVI compared to white children. Children born to older mothers (OR 1.63; 95% CI: 1.19 to 2.24) and of low birth weight (OR 1.52; 95% CI: 1.00 to 2.34) also showed increased odds. Follow-up results were available for 1068 (43.3%) children, 993 (93%) were true positives; 932 (94%) of these had significant refractive error. Astigmatism (>1DC) (44%) was more common in children of Pakistani ethnicity and hypermetropia (>3.0DS) (27%) in white children (Fisher’s exact p

Are objects remembered with a more saturated color? Some of the evidence supporting this statement comes from research using "memory colors"-the typical colors of particular objects, for example, the green of grass. The problematic aspect of these findings is that many different exemplars exist, some of which might exhibit a higher saturation than the one measured by the experimenter. Here we avoid this problem by using unique personal items and comparing long- and short-term color memory matches (in hue, value, and chroma) with those obtained with the object present. Our results, on average, confirm that objects are remembered as more saturated than they are.

We have previously shown (Bloj et al., 2008; Abstracts Materials & Sensations 2008) that under particular conditions colour memory is independent of presentation media, and of the illuminants under which colours are viewed. In the present study we investigate whether colour naming is also unaffected by these two factors. Forty-eight colour samples from the Natural Colour System (NCS) collection were presented as real paper samples or as accurate computer simulations displayed on a calibrated monitor. The colour swatches could be presented under a daylight illuminant ― two intensities, 85 ('D1') or 60 cd m ―2 ('D2') ― or a purple illuminant, 45 cd m ―2 ('Lily'). The colour samples were shown in arrays of 16 (4 x 4 layout) and the observer's task was to assign one of the eleven basic colour terms to each of the samples. Six observers repeated this colour naming task five times for each presentation medium and illuminant. On average, in 73% of the cases the same colour term was assigned to surface and display colours. This level of agreement was highest for colour samples under daylight (D1-82%, D2-73%) and poor for Lily (65%). Although colour memory is unaffected by the nature of the colour stimulus, here we show that there are limitations to cross-media agreement in colour naming.

This issue of Interface Focus is a collection of papers arising out of a Royal Society Discussion meeting entitled ‘Understanding images in biological and computer vision’ held at Carlton Terrace on the 19th and 20th February, 2018. There is a strong tradition of inter-disciplinarity in the study of visual perception and visual cognition. Many of the great natural scientists including Newton [1], Young [2] and Maxwell (see [3]) were intrigued by the relationship between light, surfaces and perceived colour considering both physical and perceptual processes. Brewster [4] invented both the lenticular stereoscope and the binocular camera but also studied the perception of shape-from-shading. More recently, Marr's [5] description of visual perception as an information processing problem led to great advances in our understanding of both biological and computer vision: both the computer vision and biological vision communities have a Marr medal. The recent successes of deep neural networks in classifying the images that we see and the fMRI images that reveal the activity in our brains during the act of seeing are both intriguing. The links between machine vision systems and biology may at sometimes be weak but the similarity of some of the operations is nonetheless striking [6]. This two-day meeting brought together researchers from the fields of biological and computer vision, robotics, neuroscience, computer science and psychology to discuss the most recent developments in the field. The meeting was divided into four themes: vision for action, visual appearance, vision for recognition and machine learning.

A proposed method visualizes the surface appearance of living human brain tissue. The goal is to investigate whether realistic models of living anatomy are possible and, if so, whether they provide added value to anatomy education and training simulators. From calibrated photography of exposed brain tissue and suitable alternatives, experiments provided data for a bidirectional reflectance distribution function, which was then used for rendering. Employing a GPU, real-time visualization of the brain's surface supported ambient occlusion, advanced texturing, subsurface scattering, and specularity.

SummaryThere has been an intense discussion among the public about the colour of a dress, shown in a picture posted originally on Tumblr (http://swiked.tumblr.com/post/112073818575/guys-please-help-me-is-this-dress-white-and; accessed on 10:56 am GMT on Tue 24 Mar 2015). Some people argue that they see a white dress with golden lace, while others describe the dress as blue with black lace. Here we show that the question “what colour is the dress?” has more than two answers. In fact, there is a continuum of colour percepts across different observers. We measured colour matches on a calibrated screen for two groups of observers who had reported different percepts of the dress. Surprisingly, differences between the two groups arose mainly from differences in lightness, rather than chromaticity of the colours they adjusted to match the dress. We speculate that the ambiguity arises in the case of this particular image because the distribution of colours within the dress closely matches the distribution of natural daylights. This makes it more difficult to disambiguate illumination changes from those in reflectance.

This research was supported by the Engineering and Physical Sciences Research Council (EPSRC). Although luminance and color are thought to be processed independently at early stages of visual processing, there is evidence that they interact at later stages. For example, chromatic information has been shown to enhance or suppress depth from luminance depending on whether chromatic edges are aligned or orthogonal with luminance edges. Here we explored more generally how chromatic information interacts with luminance information that specifies shape from shading. Using a depth-matching task, we measured perceived depth in sinusoidal and square-wave gratings (specifying close-to sinusoidal and triangle-wave depth profiles, respectively) in three conditions. In the first, as we varied luminance contrast in the presence of an orthogonal chromatic grating, perceived depth increased (consistent with classical shape from shading). When we held the luminance at a fixed contrast and varied the chromatic grating in the other two conditions (orthogonal or aligned), we found large and inconsistent individual differences. Some participants exhibited the expected pattern of enhancement and suppression, but most did not, either for the sinusoidal or square-wave stimuli. Our results cast doubt on the idea that the interaction demonstrates a single high-level heuristic linked to depth perception. Instead, we speculate that interactions are more likely due to early cross-channel masking Publisher PDF

In this paper we present a new technique for the display of High Dynamic Range (HDR) images on Low Dynamic Range (LDR) displays. The described process has three stages. First, the input image is segmented into luminance zones. Second, the tone mapping operator (TMO) that performs better in each zone is automatically selected. Finally, the resulting tone mapping (TM) outputs for each zone are merged, generating the final LDR output image. To establish the TMO that performs better in each luminance zone we conducted a preliminary psychophysical experiment using a set of HDR images and six different TMOs. We validated our composite technique on several (new) HDR images and conducted a further psychophysical experiment, using an HDR display as reference, that establishes the advantages of our hybrid three-stage approach over a traditional individual TMO.

The luminance and colour gradients across an image are the result of complex interactions between object shape, material and illumination. Using such variations to infer object shape or surface colour is therefore a difficult problem for the visual system. We know that changes to the shape of an object can affect its perceived colour, and that shading gradients confer a sense of shape. Here we investigate if the visual system is able to effectively utilise these gradients as a cue to shape perception, even when additional cues are not available. We tested shape perception of a folded card object that contained illumination gradients in the form of shading and more subtle effects such as inter-reflections. Our results suggest that observers are able to use the gradients to make consistent shape judgements. In order to do this, observers must be given the opportunity to learn suitable assumptions about the lighting and scene. Using a variety of different training conditions, we demonstrate that learning can occur quickly and requires only coarse information. We also establish that learning does not deliver a trivial mapping between gradient and shape; rather learning leads to the acquisition of assumptions about lighting and scene parameters that subsequently allow for gradients to be used as a shape cue. The perceived shape is shown to be consistent for convex and concave versions of the object that exhibit very different shading, and also similar to that delivered by outline, a largely unrelated cue to shape. Overall our results indicate that, although gradients are less reliable than some other cues, the relationship between gradients and shape can be quickly assessed and the gradients therefore used effectively as a visual shape cue. Publisher PDF

Cue-conflict studies have been used with considerable success to examine the mechanisms underlying the integration of different sensory cues. Our recent studies have used these methods to examine the combination of stereo-disparity and shading cues in realistically rendered stimuli. The stimuli featured circular convexities with cyclopean shading and a stereo-cue based upon a densely dotted surface texture—other cues (shape outline and surface texture gradient) were controlled for. In our first experiment observers made depth discriminations while disparity noise was manipulated; we were able to demonstrate that for most observers cues are combined optimally—ie, PSEs and response variances shifted towards the more reliable channel. In a follow-on study we have examined how these cue-combinations are affected by presentation timing—with forwards and backwards masking. For most observers the adage that shading provides a quick and dirty mechanism for making depth judgements seems to be supported. Observers can make reliable depth judgements based upon shading when the difference in depth is relatively fine. However, for fine discriminations more time is required, and by this time the more accurate information from the stereo-channel has become available and is used.

This paper presents an advanced method of visualizing the surface appearance of living brain tissue. We have been granted access to the operating theatre during neurosurgical procedures to obtain colour data via calibrated photography of exposed brain tissue. The specular reflectivity of the brain's surface is approximated by analyzing a gelatine layer applied to animal flesh. This provides data for a bidirectional reflectance distribution function (BRDF) that is then used the rendering process. Rendering is achieved in realtime by utilizing the GPU, and includes support for ambient occlusion, advanced texturing, sub surface scattering and specularity. Our goal is to investigate whether realistic visualizations of living anatomy can be produced and so provide added value to anatomy education.

We have previously shown (Bloj et al., 2008; Abstracts MaterialsSensations 2008) that under particular conditions colour memory is independent of presentation media, and of the illuminants under which colours are viewed. In the present study we investigate whether colour naming is also unaffected by these two factors. Forty-eight colour samples from the Natural Colour System (NCS) collection were presented as real paper samples or as accurate computer simulations displayed on a calibrated monitor. The colour swatches could be presented under a daylight illuminant - two intensities, 85 ('D1') or 60 cd m(-2) ('D2') - or a purple illuminant, 45 cd m(-2) ('Lily'). The colour samples were shown in arrays of 16 (4 × 4 layout) and the observer's task was to assign one of the eleven basic colour terms to each of the samples. Six observers repeated this colour naming task five times for each presentation medium and illuminant. On average, in 73% of the cases the same colour term was assigned to surface and display colours. This level of agreement was highest for colour samples under daylight (D1-82%, D2-73%) and poor for Lily (65%). Although colour memory is unaffected by the nature of the colour stimulus, here we show that there are limitations to cross-media agreement in colour naming.

In this paper, we investigate how controlled changes to image properties and orientation affect eye movements for repeated viewings of images of natural scenes. We make changes to images by manipulating low-level image content (such as luminance or chromaticity) and/or inverting the image. We measure the effects of these manipulations on human scanpaths (the spatial and chronological path of fixations), additionally comparing these effects to those predicted by a widely used saliency model (L. Itti & C. Koch, 2000). Firstly we find that repeated viewing of a natural image does not significantly modify the previously known repeatability (S. A. Brandt & L. W. Stark, 1997; D. Noton & L. Stark, 1971) of scanpaths. Secondly we find that manipulating image features does not necessarily change the repeatability of scanpaths, but the removal of luminance information has a measurable effect. We also find that image inversion appears to affect scene perception and recognition and may alter fixation selection (although we only find an effect on scanpaths with the additional removal of luminance information). Additionally we confirm that visual saliency as defined by L. Itti and C. Koch’ s( 2000) model is a poor predictor of real observer scanpaths and does not predict the small effects of our image manipulations on scanpaths.

Visual psychophysicists, who study object, color, and light perception, have a demand for software that produces complex but, at the same time, physically accurate stimuli for their experiments. The number of computer graphic packages that simulate the physical interaction of light and surfaces is limited, and mostly they require the purchase of a license. RADIANCE (Ward, 1994), however, is freely available and popular in the visual perception community, making it a prime candidate. We have shown previously that RADIANCE’S simulation accuracy is greatly improved when color is coded by spectra, rather than by the originally envisaged RGB triplets (Ruppertsberg & Bloj, 2006). Here, we present a method for spectral rendering with RADIANCE to generate hyperspectral images that can be converted to XYZ images (CIE 1931 system) and then to machine-dependent RGB images. Generating XYZ stimuli has the added advantage of making stimulus images independent of display devices and, thereby, facilitating the process of reproducing results across different labs. Materials associated with this article may be downloaded from www.psychonomic.org.

We present a numerical analysis of rendered pairs of rooms, in which the spectral power distribution of the illuminant in one room matched the surface reflectance function in the other room, and vice versa. We ask whether distinction between the rooms is possible and on what cues this discrimination is based. Using accurately rendered three-dimensional (3D) scenes, we found that room pairs can be distinguished based on indirect illumination, as suggested by A. L. Gilchrist and A. Jacobsen (1984). In a simulated color constancy scenario, we show that indirect illumination plays a pivotal role as areas of indirect illumination undergo a smaller appearance change than areas of direct illumination. Our study confirms that indirect illumination can play a critical role in surface color recovery and shows how computer rendering programs, which model the light-object interaction according to the laws of physics, are valuable tools that can be used to analyze and explore what image information is available to the visual system from 3D scenes.