1. Does the Goal Matter? Emotion Recognition Tasks Can Change the Social Value of Facial Mimicry towards Artificial Agents
- Author
-
Giulia Perugia, Maike Paetzel-Prüsmann, Isabelle Hupont, Giovanna Varni, Mohamed Chetouani, Christopher Edward Peters, Ginevra Castellano, Eindhoven University of Technology [Eindhoven] (TU/e), Department of Information Technology (DIT-UPPSALA), Uppsala University, Department of Linguistics [Potsdam], Universität Potsdam, European Commission - Joint Research Centre [Seville] (JRC), Laboratoire Traitement et Communication de l'Information (LTCI), Institut Mines-Télécom [Paris] (IMT)-Télécom Paris, Perception, Interaction, Robotique sociales (PIROS), Institut des Systèmes Intelligents et de Robotique (ISIR), Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), Division of Computational Science and Technology [Stockholm] (CST), Royal Institute of Technology [Stockholm] (KTH ), and Human Technology Interaction
- Subjects
FOS: Computer and information sciences ,Computer Science - Human-Computer Interaction ,[SCCO.COMP]Cognitive science/Computer science ,Affect (psychology) ,050105 experimental psychology ,Human–robot interaction ,human-agent interaction ,uncanny valley ,Human-Computer Interaction (cs.HC) ,[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI] ,Facial Action Coding System ,Computer Science - Robotics ,03 medical and health sciences ,human-robot interaction ,0302 clinical medicine ,facial action coding system ,[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing ,Artificial Intelligence ,TJ1-1570 ,[INFO.INFO-RB]Computer Science [cs]/Robotics [cs.RO] ,0501 psychology and cognitive sciences ,Mechanical engineering and machinery ,Affective computing ,affective computing ,Original Research ,Robotics and AI ,Facial expression ,[SCCO.NEUR]Cognitive science/Neuroscience ,05 social sciences ,anthropomorphism ,[INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV] ,Uncanny valley ,QA75.5-76.95 ,Human Computer Interaction ,Människa-datorinteraktion (interaktionsdesign) ,Computer Science Applications ,Action (philosophy) ,facial mimicry ,Electronic computers. Computer science ,[SCCO.PSYC]Cognitive science/Psychology ,Mimicry ,Psychology ,Robotics (cs.RO) ,030217 neurology & neurosurgery ,Cognitive psychology - Abstract
In this paper, we present a study aimed at understanding whether the embodiment and humanlikeness of an artificial agent can affect people's spontaneous and instructed mimicry of its facial expressions. The study followed a mixed experimental design and revolved around an emotion recognition task. Participants were randomly assigned to one level of humanlikeness (between-subject variable: humanlike, characterlike, or morph facial texture of the artificial agents) and observed the facial expressions displayed by a human (control) and three artificial agents differing in embodiment (within-subject variable: video-recorded robot, physical robot, and virtual agent). To study both spontaneous and instructed facial mimicry, we divided the experimental sessions into two phases. In the first phase, we asked participants to observe and recognize the emotions displayed by the agents. In the second phase, we asked them to look at the agents' facial expressions, replicate their dynamics as closely as possible, and then identify the observed emotions. In both cases, we assessed participants' facial expressions with an automated Action Unit (AU) intensity detector. Contrary to our hypotheses, our results disclose that the agent that was perceived as the least uncanny, and most anthropomorphic, likable, and co-present, was the one spontaneously mimicked the least. Moreover, they show that instructed facial mimicry negatively predicts spontaneous facial mimicry. Further exploratory analyses revealed that spontaneous facial mimicry appeared when participants were less certain of the emotion they recognized. Hence, we postulate that an emotion recognition goal can flip the social value of facial mimicry as it transforms a likable artificial agent into a distractor., Comment: 27 pages, 8 figures, 7 tables (Submitted to Frontiers in Robotics and AI, Human-Robot Interaction)
- Published
- 2021
- Full Text
- View/download PDF