Context Aware Multimodal Interaction Model in Standard Natural Classroom

Standard Natural Classroom (SNC) is a real-time classroom based on smart space and e-Learning technologies, which aims at creating face-to-face, interactive and pervasive learning experience for both local and remote students. In this paper, the phrase “interaction” refers to human-computer interaction, teacher-student interaction and student-student interaction in hybrid learning process. The characteristics of these interactions are multimodal and context aware. In this paper, we first draw an outline of SNC and Virtual Interaction Classroom (VIC). Second, we introduce a so called “Context Aware Multimodal Interaction” (CAMI) concept, and the multimodal and context information in SNC. Finally, we describe the implementation of a real-time Context Aware Multimodal Interaction Model (CAMIM) which is universal, extendable and efficient. We will illustrate the architecture of CAMIM, then we will demonstrate the Interaction Task Set (ITS) and CAMI fusion strategy. In particular, automated planning technology Hierarchical Task Network (HTN) is introduced into this model.