Search

Collaborative learning has numerous benefits such as enhancing learners' critical thinking, developing social skills, and improving learning gains. While engaging in this interactive process, learners' satisfaction toward their partners plays a crucial role in defining the success of the collaboration. However, detecting learners' satisfaction during an ongoing collaboration remains challenging, and there are no automatic techniques to predict learners' satisfaction. In this paper, we propose a multimodal approach to automatically predict peer satisfaction for co-located collaboration with features extracted from 44 middle school learners' collaborative dialogues. We investigated three types of features extracted from learners' dialogues: 1) linguistic features indicating semantics and sentiment; 2) acoustic-prosodic features including energy and pitch; and 3) visual features including eye gaze, head pose, facial action units, and body pose. We then trained several regression models with each of those features to predict the peer satisfaction scores that learners received from their partners. The results revealed that head position and body location were significant indicators of peer satisfaction: lower head and body distances between partners were associated with more positive peer satisfaction. Next, we investigated the influence of multimodal feature fusion methods on peer satisfaction prediction accuracy: early fusion versus late fusion. We report the comparison results between models trained with (1) best-performing unimodal features, (2) multimodal features combined by early fusion, and (3) multimodal features combined by late fusion. This line of research reveals how multimodal features from collaborative dialogues are associated with peer satisfaction, and represents a step toward the development of real-time intelligent systems that support collaborative learning.

Collaborative learning offers numerous benefits to learners, largely due to the dialogue that is unfolding between them. However, there is still much to learn about the structure of collaborative dialogue, and especially little is known about co-creative dialogues during learning. This paper reports on a study with learners engaged in co-creative tasks where the learners wrote code to create a song and while engaging in textual dialogue as they did so. After gathering the textual dialogue and the actions within the interface, we learned a hidden Markov model (HMM) to reveal co-creative states. The seven-state model revealed four states primarily composed of coding actions that included browsing the curriculum documents, working in the code editor, compiling the code successfully, and receiving a compile error. The remaining three states are primarily composed of dialogue that can be characterized as social, aesthetic, and technical dialogue. Next, we analyzed the relationships between the co-creative states revealed by the HMM and students' partner satisfaction scores from a post-survey. The results reveal the relative frequency of actions in certain states and some transitions between states were predictive of partner satisfaction. For example, partner satisfaction was negatively associated with the "Compilation Error" state and with the relative frequency of transitions from the "Curriculum Browsing" state to the "Code Editing" state. Partner satisfaction was also negatively associated with the relative frequency of transitions from the "Aesthetic Dialogue" state to the "Technical Dialogue" state and the "Code Editing" state. This line of investigation reveals how co-creative processes are associated with partner satisfaction, and holds the potential to inform scaffolding for collaborative learning.