Search

Supplemental material, sj-pdf-1-pss-10.1177_09567976231179378 for The Costs of Paying Overt and Covert Attention Assessed With Pupillometry by Damian Koevoet, Christoph Strauch, Marnix Naber and Stefan Van der Stigchel in Psychological Science

We study the effects of statistical learning and retro-cueing on visual working memory in a task that requires participants to encode four shapes and later report whether a probe matches the shape presented at this position before. In an existing experiment (Experiment 1), we found main effects of statistical learning (now referred to as stimulus probability) on sensitivity (i.e. d') such that high probability locations were associated with better sensitivity. Further, we found a main effect for retro-cueing such that retro-cued locations were associated with higher sensitivity. We also found an interaction between retro-cue and stimulus probability such that the retro-cue had no additional benefit in the high probability condition, but had an additional benefit on sensitivity in the low stimulus condition. Response times were found shorter for the retro-cue compared to the neutral cue. The main effect of probability as well as the interaction between probability and retro-cue were non-significant. In the first experiment (Experiment 2) associated with this pre-registration, we aim to replicate these findings. Importantly, two parts of the original experiment were changed. 1) The number of trials is going to be doubled. 2) The stimulus probabilities for high/low chance of being retro-cued change from 67-11% to 40-20%. We also now ask whether participants were able to indicate which of the locations was the high stimulus probability location after the experiment. In the second experiment (Experiment 3) associated with this pre-registration, we aim to follow up on these findings. This experiment is identical to Experiment 2, but the statistical probabilities are as follows: high 30, 30. 30%; low 10% Also, we ask whether participants are able to indicate which of the locations was the low stimulus probability location (instead of the high probability location in Experiment 2, again after the experiment).

Purpose: It is unclear how the iris deforms during changes in pupil size. Here, we report an application of a multi-feature iris tracking method, which we call irissometry, to investigate how the iris deforms and affects the eye position signal as a function of pupil size. Methods: To evoke pupillary responses, we repeatedly presented visual and auditory stimuli to healthy participants while we additionally recorded their right eye with a macro lens-equipped camera. We tracked changes in iris surface structure between the pupil and sclera border (limbus) by calculating local densities (distance between feature points) across evenly spaced annular iris regions. Results: The time analysis of densities showed that the inner regions of the iris stretched more strongly as compared with the outer regions of the iris during pupil constrictions. The pattern of iris densities across eccentricities and pupil size showed highly similar patterns across participants, highlighting the robustness of this elastic property. Importantly, iris-based eye position detection led to more stable signals than pupil-based detection. Conclusions: The iris regions near the pupil appear to be more elastic than the outer regions near the sclera. This elastic property explains the instability of the pupil border and the related position errors induced by eye movement and pupil size in pupil-based eye-tracking. Tracking features in the iris produce more robust eye position signals. We expect that irissometry may pave the way to novel eye trackers and diagnostic tools in ophthalmology.

Pupils constantly change size, not only due to shifts in fixation position or changes in illuminance, but also due to changes in arousal, as elicited by a broad number of cognitive processes. In this thesis, I present pupillometric research into the effects of a process that may be considered central for human information processing: the selection of stimuli. Related literature on perceptual decision-making and visual search suggests stronger pupil dilations for targets than distractors. And indeed, in previous works, we found pupils to dilate when fixating a to be selected target in gaze-based human-computer interaction. Yet, observed effects might be attributed to exogenous factors affecting pupil dilation, such as changes in illuminance, or endogenous factors, such as varying stimulus valence. In this cumulative thesis I present results of a systematic investigation into selection using pupil dilation. Four of my original research works are completed with investigations and analyses that are reported in this thesis for the first time. In two initial experiments, pupil dilation was found to be indicative of the repeated selection of letters. Stronger pupil dilations to targets than to distractors were robust to a number of exogenous factors affecting pupil dilation simultaneously, such as abrupt changes in illuminance. Extending the view to endogenous factors on pupil dilation, we found stronger pupillary responses when reading the own name compared to other names of low self-relevance, especially under inhibition. Taking an intermediate role between exogenously and endogenously triggered processes, differential stimulus probabilities (oddball effect) might explain a substantial part of differences in effect sizes reported for selection across existing research. Investigating the interplay of selection and stimulus probability, selection consistently let pupils dilate more for targets than distractors, whereas stimulus probability alone had no main effect on pupil dilation. However, there was an interaction: Pupils dilated more when targets were rare compared to being equiprobable or frequent. Previous investigations propose that task-relevance might be the decisive precondition for effects to emerge. Narrowing down this factor, results demonstrate that stimuli must not only be task-relevant for effects to unfold, but also goal-relevant to the beholder. Integrating these findings, I present a framework for effects of selection based on pupil data: Stimuli are classified as either goal-relevant or not. In a subsequent step that is lagged to the initial classification, only goal-relevant stimuli are further evaluated regarding their relative importance or value. Results of an additional experiment, during which the consequence to errors in the paradigm was systematically varied, provide some tentative first support for this notion. The synopsis of the here described results suggests that selection can be assumed to be an integral part of key concepts in cognitive psychology, such as visual search, emotion, and phenomena such as the oddball effect. Considering possible application scenarios in human-computer interaction, a ROC analysis shows that pupils indeed revealed which perceptually equal stimuli are selected and which are rejected above chance. Still, such classification performances are - as of today - too low to allow pupil-based intent recognition alone, suggesting that other predictors would have to be integrated as well. However, selection has to be considered as central to how we as humans process information. The systematic analysis of pupil dilation therefore proves to be a useful method for not only investigating cognition and perception for basic research, but also for applications.

When games are too easy or too difficult, they are likely to be experienced as unpleasant. Therefore, identifying the ideal level of game difficulty is crucial for providing players with a positive experience during gaming. Performance data is typically used to determine how challenged a player is; however, this information is not always available. Pupil diameter has recently been suggested as a continuous option for tracking gaming appraisal. In this paper, we describe two experiments with in total 55 participants playing 'Pong' under four levels of difficulty. Difficulty was manipulated via ball-speed (Experiment 1) and racket-size (Experiment 2) ranging from under-to overload. Pupil dilation and appraisal were maximal under medium difficulty (compared to easy and hard levels). These findings demonstrate the usefulness of pupil diameter as basis for psychophysiologically dynamic difficulty adjustment as it is sensitive both to under- A nd overload, hence underlining pupil dilation's potential value for user-adaptive interfaces in general.

The use of gaze promises fast and smart user interaction. Mimicking human gaze interaction, we suggest a framework based on the vision of integrating fixations, pupil size, and microsaccade dynamics. Recent work has shown that fixations can be differentiated between focal and ambient, where the former are important for further decisional processes, and the latter are rather used for orienting. Psychophysiological measures suggest that pupil dilation and microsaccades can reveal user intention in real time. We propose a selection mechanism that takes into account microsaccades and pupil diameter changes but only within focal fixations., Eye Tracking for Spatial Research, Proceedings of the 3rd International Workshop