1. Learn to Walk Across Ages: Motion Augmented Multi-Age Group Gait Video Translation
- Author
-
Daigo Muramatsu, Liqing Zhang, Jianfu Zhang, Yiyi Zhang, Yasushi Yagi, Li Niu, and Yasushi Makihara
- Subjects
General Computer Science ,Computer science ,Speech recognition ,Feature extraction ,Age progression ,General Engineering ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,02 engineering and technology ,010501 environmental sciences ,Translation (geometry) ,01 natural sciences ,Facial recognition system ,Motion (physics) ,gait video generation ,Gait (human) ,Gait aging ,0202 electrical engineering, electronic engineering, information engineering ,Task analysis ,Image translation ,020201 artificial intelligence & image processing ,General Materials Science ,lcsh:Electrical engineering. Electronics. Nuclear engineering ,lcsh:TK1-9971 ,0105 earth and related environmental sciences - Abstract
We propose a framework for multi-age group gait video translation in which, for the first time, individuality-preserving aging patterns in walking style are learnt. More specifically, we build our framework on an existing multi-domain image translation model. Because the existing multi-domain image translation model was originally designed for a still image, we extend it to gait video by introducing a motion-augmented network architecture with three streams, where gait period, period-normalized phase-synchronized gait video, and its frame difference sequence are each input to one stream. We then train the network to ensure three aspects: aging effect (using an age group classification loss), individuality preservation (using a reconstruction loss), and gait realism (using an adversarial loss). Our framework quantitatively and qualitatively outperforms state-of-the-art age progression/regression methods on the largest gait database, OULP-Age, with respect to both age group classification and identity recognition.
- Published
- 2021