Search

Since Yarbus's seminal work, vision scientists have argued that our eye movement patterns differ depending upon our task. This has recently motivated the creation of multi-fixation pattern analysis algorithms that try to infer a person's task (or mental state) from their eye movements alone. Here, we introduce new algorithms for multi-fixation pattern analysis, and we use them to argue that people have scanpath routines for judging faces. We tested our methods on the eye movements of subjects as they made six distinct judgments about faces. We found that our algorithms could detect whether a participant is trying to distinguish angriness, happiness, trustworthiness, tiredness, attractiveness, or age. However, our algorithms were more accurate at inferring a subject's task when only trained on data from that subject than when trained on data gathered from other subjects, and we were able to infer the identity of our subjects using the same algorithms. These results suggest that (1) individuals have scanpath routines for judging faces, and that (2) these are diagnostic of that subject, but that (3) at least for the tasks we used, subjects do not converge on the same "ideal" scanpath pattern. Whether universal scanpath patterns exist for a task, we suggest, depends on the task's constraints and the level of expertise of the subject.

We trained a neurocomputational model on six categories of photographic images that were used in a previous fMRI study of object and face processing. Multivariate pattern analyses of the activations elicited in the object-encoding layer of the model yielded results consistent with two previous, contradictory fMRI studies. Findings from one of the studies [Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science, 293, 2425-2430, 2001] were interpreted as evidence for the object-form topography model. Findings from the other study [Spiridon, M., & Kanwisher, N. How distributed is visual category information in human occipitotemporal cortex? An fMRI study. Neuron, 35, 1157-1165, 2002] were interpreted as evidence for neural processing mechanisms in the fusiform face area that are specialized for faces. Because the model contains no special processing mechanism or specialized architecture for faces and yet it can reproduce the fMRI findings used to support the claim that there are specialized face-processing neurons, we argue that these fMRI results do not actually support that claim. Results from our neurocomputational model therefore constitute a cautionary tale for the interpretation of fMRI data. [ABSTRACT FROM AUTHOR]

Anatomical evidence shows that our visual field is initially split along the vertical midline and contralaterally projected to different hemispheres. It remains unclear at which processing stage the split information converges. In the current study, we applied the Double Filtering by Frequency (DFF) theory (Ivry & Robertson, 1998) to modeling the visual field split; the theory assumes a right-hemisphere/low-frequency bias. We compared three cognitive architectures with different timings of convergence and examined their cognitive plausibility to account for the left-side bias effect in face perception observed in human data. We show that the early convergence model failed to show the left-side bias effect. The modeling, hence, suggests that the convergence may take place at an intermediate or late stage, at least after information has been extracted/encoded separately in the two hemispheres, a fact that is often overlooked in computational modeling of cognitive processes. Comparative anatomical data suggest that this separate encoding process that results in differential frequency biases in the two hemispheres may be engaged from V1 up to the level of area V3a and V4v, and converge at least after the lateral occipital region. The left-side bias effect in our model was also observed in Greeble recognition; the modeling, hence, also provides testable predictions about whether the left-side bias effect may also be observed in (expertise-level) object recognition. [ABSTRACT FROM AUTHOR]

Abstract: There is behavioral evidence that different visual categorization tasks on various types of stimuli (e.g., faces) are sensitive to distinct visual characteristics of the same image, for example, spatial frequencies. However, it has been more difficult to address the question of how early in the processing stream this sensitivity to the information relevant to the categorization task emerges. The current study uses scalp event-related potentials recorded in humans to examine how and when information diagnostic to a particular task is processed during that task versus during a task for which it is not diagnostic. Subjects were shown diagnostic and anti-diagnostic face images for both expression and gender decisions (created using Gosselin and Schyns’ Bubbles technique), and asked to perform both tasks on all stimuli. Behaviorally, there was a larger advantage of diagnostic over anti-diagnostic facial images when images designed to be diagnostic for a particular task were shown when performing that task, as compared to performing the other task. Most importantly, this interaction was seen in the amplitude of the occipito-temporal N170, a visual component reflecting a perceptual stage of processing associated with the categorization of faces. When participants performed the gender categorization task, the N170 amplitude was larger when they were presented with gender diagnostic images than with expression-diagnostic images, relative to their respective non-diagnostic stimuli. However, categorizing faces according to their facial expression was not significantly associated with a larger N170 when subjects categorized expression diagnostic cues relative to gender-diagnostic cues. These results show that the influence of higher-level task-oriented processing may take place at the level of visual categorization stages for faces, at least for processes relying on shared diagnostic features with facial identity judgments, such as gender cues. [Copyright &y& Elsevier]