Search

Your search keyword '"Tamietto, Marco"' showing total 338 results
Start Over Author "Tamietto, Marco"
338 results on '"Tamietto, Marco"'

1. Explainable Emotion Decoding for Human and Computer Vision

Author

Borriero, Alessio, Milazzo, Martina, Diano, Matteo, Orsenigo, Davide, Villa, Maria Chiara, Di Fazio, Chiara, Tamietto, Marco, and Perotti, Alan

Subjects
Computer Science - Computer Vision and Pattern Recognition, Electrical Engineering and Systems Science - Image and Video Processing, Quantitative Biology - Neurons and Cognition
Abstract

Modern Machine Learning (ML) has significantly advanced various research fields, but the opaque nature of ML models hinders their adoption in several domains. Explainable AI (XAI) addresses this challenge by providing additional information to help users understand the internal decision-making process of ML models. In the field of neuroscience, enriching a ML model for brain decoding with attribution-based XAI techniques means being able to highlight which brain areas correlate with the task at hand, thus offering valuable insights to domain experts. In this paper, we analyze human and Computer Vision (CV) systems in parallel, training and explaining two ML models based respectively on functional Magnetic Resonance Imaging (fMRI) and movie frames. We do so by leveraging the "StudyForrest" dataset, which includes functional Magnetic Resonance Imaging (fMRI) scans of subjects watching the "Forrest Gump" movie, emotion annotations, and eye-tracking data. For human vision the ML task is to link fMRI data with emotional annotations, and the explanations highlight the brain regions strongly correlated with the label. On the other hand, for computer vision, the input data is movie frames, and the explanations are pixel-level heatmaps. We cross-analyzed our results, linking human attention (obtained through eye-tracking) with XAI saliency on CV models and brain region activations. We show how a parallel analysis of human and computer vision can provide useful information for both the neuroscience community (allocation theory) and the ML community (biological plausibility of convolutional models)., Comment: This work has been accepted to be presented to The 2nd World Conference on eXplainable Artificial Intelligence (xAI 2024), July 17-19, 2024 - Malta

Published
2024

2. Disentangling attentional and affective contribution to contagious yawning

Author

Palagi, Elisabetta, Celeghin, Alessia, Tamietto, Marco, Winkielman, Piotr, and Norscia, Ivan

Subjects
Biomedical and Clinical Sciences, Health Sciences, Attention, Humans, Imitative Behavior, Yawning, Yawn contagion, Spontaneous mimicry, Emotional resonance, Attentional biases, Cross-species perspective, Medical and Health Sciences, Psychology and Cognitive Sciences, Behavioral Science & Comparative Psychology, Biomedical and clinical sciences, Health sciences
Published
2022

4. The neuroethology of spontaneous mimicry and emotional contagion in human and non-human animals

Author

Palagi, Elisabetta, Celeghin, Alessia, Tamietto, Marco, Winkielman, Piotr, and Norscia, Ivan

Subjects
Behavioral and Social Science, Basic Behavioral and Social Science, Biotechnology, Mental health, Animals, Behavior, Animal, Emotions, Facial Expression, Humans, Imitative Behavior, Primates, Social Behavior, Yawning, Spontaneous mimicry, Emotional resonance, Yawn contagion, Play face, Medical and Health Sciences, Psychology and Cognitive Sciences, Behavioral Science & Comparative Psychology
Abstract

Spontaneous mimicry appears fundamental to emotional perception and contagion, especially when it involves facial emotional expressions. Here we cover recent evidence on spontaneous mimicry from ethology, psychology and neuroscience, in non-human and human animals. We first consider how mimicry unfolds in non-human animals (particularly primates) and how it relates to emotional contagion. We focus on two forms of mimicry-related phenomena: facial mimicry and yawn contagion, which are largely conserved across mammals and useful to draw evolutionary scenarios. Next, we expand on the psychological evidence from humans that bears on current theoretical debates and also informs non-human animal research. Finally, we cover the neural bases of facial mimicry and yawn contagion. We move beyond the perception/expression/experience trichotomy and from the correlational to the causal evidence that links facial mimicry to emotional contagion by presenting evidence from neuroimaging, direct manipulation, neuro-stimulation and lesion studies. In conclusion, this review proposes a bottom-up, multidisciplinary approach to the study of spontaneous mimicry that accounts for the evolutionary continuity linking non-human and human animals.

Published
2020

5. Towards a comparative science of emotion: Affect and consciousness in humans and animals

Author

Paul, Elizabeth S, Sher, Shlomi, Tamietto, Marco, Winkielman, Piotr, and Mendl, Michael T

Subjects
Mental Health, Behavioral and Social Science, Mind and Body, Clinical Research, Development of treatments and therapeutic interventions, 5.9 Resources and infrastructure (treatment development), Disputed aetiology and other, Animals, Brain, Consciousness, Emotions, Humans, Interoception, Neurosciences, Unconscious, Psychology, Affect, Componential, Neural correlates, Subjective emotion, Unconscious emotion, Medical and Health Sciences, Psychology and Cognitive Sciences, Behavioral Science & Comparative Psychology
Abstract

The componential view of human emotion recognises that affective states comprise conscious, behavioural, physiological, neural and cognitive elements. Although many animals display bodily and behavioural changes consistent with the occurrence of affective states similar to those seen in humans, the question of whether and in which species these are accompanied by conscious experiences remains controversial. Finding scientifically valid methods for investigating markers for the subjective component of affect in both humans and animals is central to developing a comparative understanding of the processes and mechanisms of affect and its evolution and distribution across taxonomic groups, to our understanding of animal welfare, and to the development of animal models of affective disorders. Here, contemporary evidence indicating potential markers of conscious processing in animals is reviewed, with a view to extending this search to include markers of conscious affective processing. We do this by combining animal-focused approaches with investigations of the components of conscious and non-conscious emotional processing in humans, and neuropsychological research into the structure and functions of conscious emotions.

Published
2020

22. Opportunities and challenges for a maturing science of consciousness

Author

Michel, Matthias, Beck, Diane, Block, Ned, Blumenfeld, Hal, Brown, Richard, Carmel, David, Carrasco, Marisa, Chirimuuta, Mazviita, Chun, Marvin, Cleeremans, Axel, Dehaene, Stanislas, Fleming, Stephen M., Frith, Chris, Haggard, Patrick, He, Biyu J., Heyes, Cecilia, Goodale, Melvyn A., Irvine, Liz, Kawato, Mitsuo, Kentridge, Robert, King, Jean-Remi, Knight, Robert T., Kouider, Sid, Lamme, Victor, Lamy, Dominique, Lau, Hakwan, Laureys, Steven, LeDoux, Joseph, Lin, Ying-Tung, Liu, Kayuet, Macknik, Stephen L., Martinez-Conde, Susana, Mashour, George A., Melloni, Lucia, Miracchi, Lisa, Mylopoulos, Myrto, Naccache, Lionel, Owen, Adrian M., Passingham, Richard E., Pessoa, Luiz, Peters, Megan A. K., Rahnev, Dobromir, Ro, Tony, Rosenthal, David, Sasaki, Yuka, Sergent, Claire, Solovey, Guillermo, Schiff, Nicholas D., Seth, Anil, Tallon-Baudry, Catherine, Tamietto, Marco, Tong, Frank, van Gaal, Simon, Vlassova, Alexandra, Watanabe, Takeo, Weisberg, Josh, Yan, Karen, and Yoshida, Masatoshi

Published
2019
Full Text
View/download PDF

39. A deep neural network model of the primate superior colliculus for emotion recognition

Author

Méndez, Carlos Andrés, Celeghin, Alessia, Diano, Matteo, Orsenigo, Davide, Ocak, Brian, Tamietto, Marco, Méndez, Carlos Andrés, Celeghin, Alessia, Diano, Matteo, Orsenigo, Davide, Ocak, Brian, and Tamietto, Marco

Abstract

Although sensory processing is pivotal to nearly every theory of emotion, the evaluation of the visual input as ‘emotional’ (e.g. a smile as signalling happiness) has been traditionally assumed to take place in supramodal ‘limbic’ brain regions. Accordingly, subcortical structures of ancient evolutionary origin that receive direct input from the retina, such as the superior colliculus (SC), are traditionally conceptualized as passive relay centres. However, mounting evidence suggests that the SC is endowed with the necessary infrastructure and computational capabilities for the innate recognition and initial categorization of emotionally salient features from retinal information. Here, we built a neurobiologically inspired convolutional deep neural network (DNN) model that approximates physiological, anatomical and connectional properties of the retino-collicular circuit. This enabled us to characterize and isolate the initial computations and discriminations that the DNN model of the SC can perform on facial expressions, based uniquely on the information it directly receives from the virtual retina. Trained to discriminate facial expressions of basic emotions, our model matches human error patterns and above chance, yet suboptimal, classification accuracy analogous to that reported in patients with V1 damage, who rely on retino-collicular pathways for non-conscious vision of emotional attributes. When presented with gratings of different spatial frequencies and orientations never ‘seen’ before, the SC model exhibits spontaneous tuning to low spatial frequencies and reduced orientation discrimination, as can be expected from the prevalence of the magnocellular (M) over parvocellular (P) projections. Likewise, face manipulation that biases processing towards the M or P pathway affects expression recognition in the SC model accordingly, an effect that dovetails with variations of activity in the human SC purposely measured with ultra-high field functional magnetic res

Published
2022

46. Collicular vision guides nonconscious behavior

Author

Tamietto, Marco, Cauda, Franco, Corazzini, Luca Latini, Savazzi, Silvia, Marzi, Carlo A., Goebel, Rainer, Weiskrantz, Lawrence, and de Gelder, Beatrice

Subjects
Vision -- Physiological aspects, Human acts -- Physiological aspects, Human acts -- Observations, Human behavior -- Physiological aspects, Human behavior -- Observations, Health, Psychology and mental health
Published
2010

Catalog

Books, media, physical & digital resources
See catalog results