Elbows Higher! Performing, Observing and Correcting Exercises by a Virtual Trainer

In the framework of our Reactive Virtual Trainer (RVT) project, we are developing an Intelligent Virtual Agent (IVA) capable to act similarly to a real trainer. Besides presenting the physical exercises to be performed, she keeps an eye on the user. She provides feedback whenever appropriate, to in-troduce and structure the exercises, to make sure that the exercises are per-formed correctly, and also to motivate the user. In this paper we talk about the corpora we collected, serving a basis to model repetitive exercises on high level. Then we discuss in detail how the actual performance of the user is com-pared to what he should be doing, what strategy is used to provide feedback, and how it is generated. We provide preliminary feedback from users and out-line further work.