Search

Pitch perception training is one of the important aspects of music learning. Long-term training is required for improving one's sense of pitch. However, conventional standard pitch perception training is typically monotonous and is therefore prone to be unfavored by students. With advancements in multimedia technology, it is currently possible to utilize digital games in pitch perception training. In recent years, virtual reality has become a technology trend with wide application in various fields. In this paper, a pitch perception training game combining the elements of shooting game in VR environment is proposed. In the proposed game, different monsters correspondingly appear at different game levels along with a specific pitch. The player has to use a gun to select the pitch corresponding to the targeted monster using a piano-keyboard-like bullet magazine, and pull the trigger to defeat the monster. Through this game, it is expected that the player will become more motivated to participate in pitch perception training.

Lighting is one of the essential elements of the theater. With the advancement of interactive technology, It is possible for performers to control the parameters of the moving stage light through gestures or body movements directly. In this paper, an interactive lighting system controlled by the performer’s body movement is proposed. Performers wearing Myo Armband, a gesture sensing device, can interact with the moving stage light, controlling the orientation, colors, brightness, flickering patterns, and timing, through the user-friendly graphical interface.

This research proposes an interactive audio-visual system for the new trend in performing arts that incorporates interactive technology into traditional performance. In order to break the limit of movement space and to simplify the hardware and software configuration, smartphones are used to replace regular wireless sensors and to track the arm movements of the performer. The detected sensor data are sent to the interactive systems on computers through WIFI for further analysis and interpretation of which the result will be used to control the real-time audio and video processing.