1. Proof-of-Concept Study: a Mobile Application to Derive Clinical Outcome Measures from Expression and Speech for Mental Health Status Evaluation
- Author
-
Michael Vernon, Bill Byrom, Paul Watts, David Crundall, Philip Breedon, and Francesco Luke Siena
- Subjects
Mobile & Wireless Health ,Autism Spectrum Disorder ,Contempt ,media_common.quotation_subject ,Health Status ,Medicine (miscellaneous) ,Health Informatics ,Anger ,Clinical outcome assessments ,Video analysis ,03 medical and health sciences ,0302 clinical medicine ,Health Information Management ,Outcome Assessment, Health Care ,Humans ,Speech ,Valence (psychology) ,International Affective Picture System ,030304 developmental biology ,media_common ,0303 health sciences ,Facial expression ,Mobile Applications ,Sadness ,Facial Expression ,Happiness ,Mental health ,Selfie ,Psychology ,030217 neurology & neurosurgery ,Information Systems ,Clinical psychology - Abstract
This proof-of-concept study aimed to assess the ability of a mobile application and cloud analytics software solution to extract facial expression information from participant selfie videos. This is one component of a solution aimed at extracting possible health outcome measures based on expression, voice acoustics and speech sentiment from video diary data provided by patients. Forty healthy volunteers viewed 21 validated images from the International Affective Picture System database through a mobile app which simultaneously captured video footage of their face using the selfie camera. Images were intended to be associated with the following emotional responses: anger, disgust, sadness, contempt, fear, surprise and happiness. Both valence and arousal scores estimated from the video footage associated with each image were adequate predictors of the IAPS image scores (p
- Published
- 2020