A Study on the Interaction between Human and Smart Devices Based on Emotion Recognition

In this study we focus on the effect of the interaction between humans and device when emotion recognition smart device is used. We propose that emotion based smart device is the most effective device in interacting with human when it comes to user-centered device. Forty participants watched Smart TV with three different user interfaces; remote controller, gesture recognition, voice recognition system and emotional recognition system. When they used the TV with the remote controller and voice recognition system, gesture recognition, they were given interesting and sad contents and were to choose any contents they want to see within a limited time. With emotion recognition system, Fraunhofer IIS SHORETM demo software, participants’ facial expression was automatically detected and they were provided with contents according to their emotions. This research offers a new concept that emotion-based smart device that can interact with humans will be the most effective user interface in HCI. The study will discuss how people feel and how Smart TV will respond accordingly.