Search

This paper explores co-design in Japanese education for deploying data-driven educational technology and practice. Although there is a growing emphasis on data to inform educational decision-making and personalize learning experiences, challenges such as data interoperability and inconsistency with teaching goals prevent practitioners from participating. Co-design, characterized by involving various stakeholders, is instrumental in addressing the evolving needs of technology deployment. Japan's educational context aligns with co-design implementation, with a learning and evidence analytics infrastructure facilitating data collection and analysis. From the Japanese co-design practice of educational technologies, the paper highlights a 6-phase co-design framework: motivate, pilot, implement, refine, evaluate, and maintain. The practices focus on data-driven learning strategies, technology interventions, and across-context dashboards, covering assorted learning contexts in Japan. By advocating for a co-design culture and data-driven approaches to enhance education in Japan, we offer insights for education practitioners, policymakers, researchers, and industry developers.

This article originated from a working group on "Learning beyond formal schooling through human--computer--human interaction (HCHI)" convened at the UNESCO EDUSummIT 2023 in Kyoto (Japan). A polylogue approach was adopted by engaging eight co-authors whose diverse perspectives culminated in propositions that addressed the pivotal question: How should the connections between formal, non-formal, and informal learning be considered in a digitally mediated world? Formal learning is typically structured, organized and chronologically arranged institutional learning, whereas informal learning is associated with everyday learning across contexts throughout one's life, and non-formal learning is a hybrid of these forms of learning. Considering the growing prominence of informal and non-formal learning in a digitally mediated world, the evolving learning ecosystem calls for a recalibration of the emphasis on formal learning. In this regard, HCHI has the potential to mediate human--human interactions, thereby bridging formal and informal learning. Our articulated position is to preserve the distinct boundaries and inherent complexities of each type of learning while creating opportunities or 'bridges' to authentically draw on the processes of each through meaningful actions. The polylogue yielded three propositions to bridge the connections between formal, non-formal and informal learning spaces in a digitally mediated world: (a) formal education institutions can establish strategic alliances and collaborations with learning organizations beyond the formal educational system, (b) the creation of digital learning communities within formal and non-formal spaces exemplify a paradigm of operation in an unregulated, student-centric cohesive space where the educator is a co-participant, (c) the recognition of the value of informal learning experiences by formal education institutions is critical, with emphasis on the learning process rather than the product.

Self-directed learning (SDL) requires students to take initiative to learn and control their own learning process. Literature highlights the importance of SDL for lifelong learning. Yet, little understanding is known regarding how to support SDL at the school level, specifically for out-of-class learning context. To fill up this gap, this research developed a learning dashboard and integrated SDL process management in GOAL system. It was implemented to provide support for out-of-class online self-directed extensive reading (SDER) at a high school level. A two-group study conducted during a three-week spring vacation found the experimental group (N = 35, with SDL support) achieved significantly more reading outcomes than the control group (N = 12, without SDL support). Detailed GOAL interaction behavior analysis of the experimental group showed that viewing learning dashboard was significantly correlated with reading outcomes as well as interactions related to SDL process management. These findings highlights positive effect of SDL support in GOAL on students' out-of-class SDER outcomes as well as their SDL behaviors. The study provided implications for research related to extensive reading and SDL support for out-of-class learning.

Explainable recommendation, which provides an explanation about why a quiz is recommended, helps to improve transparency, persuasiveness, and trustworthiness. However, little research examined the effectiveness of the explainable recommender, especially on academic performance. To survey its effectiveness, the authors evaluate the math academic performance among middle school students (n=115) by giving pre- and post-test questions based evaluation techniques. During the pre- and post-test periods, students were encouraged to use the Bayesian Knowledge Tracing model based explainable recommendation system. To evaluate how well the students were able to do what they could not do, the authors defined growth rate and found recommended quiz clicked counts had a positive effect on the total number of solved quizzes (R=0.343, P=0.005) and growth rate (R=0.297, P=0.017) despite no correlation between the total number of solved quizzes and growth rate. The results suggest that the use of an explainable recommendation system that learns efficiently will enable students to do what they could not do before.

In-class group work activities are found to promote the interpersonal skills of learners. To support the teachers in facilitating such activities, we designed a learning analytics-enhanced technology framework, Group Learning Orchestration Based on Evidence (GLOBE) using data-driven approaches. In this study, we implemented the algorithmic group formation and group work evaluation systems in a Japanese junior high school context. Data from a series of 12 collaborative learning activities were used to validate the difference in the measured heterogeneity of the formed homogeneous and heterogeneous groups compared to random grouping. Further, the peer rating and self-perception of the group work were compared for comparative reading and idea exchange tasks. We found algorithmically formed groups, considering the learner model data, either heterogeneously or homogeneously performed better than random grouping. Specifically, students in groups created by the homogeneous algorithm received higher peer ratings and more positive self-perception of group work in the idea exchange group tasks. We did not find significant differences in the comparative reading tasks. Along with the empirical findings, this work presents a paradigm of continuous data-driven group learning support by incorporating the peer and teacher evaluation scores as an input to the subsequent algorithmic grouping.

Data-driven platforms with rich data and learning analytics applications provide immense opportunities to support collaborative learning such as algorithmic group formation systems based on learning logs. However, teachers can still get overwhelmed since they have to manually set the parameters to create groups and it takes time to understand the meaning of each indicator. Therefore, it is imperative to explore predictive indicators for algorithmic group formation to release teachers from the dilemma with explainable group formation indicators and recommended settings based on group work purposes. Employing learning logs of group work from a reading-based university course, this study examines how learner indicators from different dimensions before the group work connect to the subsequent group work processes and consequences attributes through correlation analysis. Results find that the reading engagement and previous peer ratings can reveal individual achievement of the group work, and a homogeneous grouping strategy based on reading annotations and previous group work experience can predict desirable group performance for this learning context. In addition, it also proposes the potential of automatic group formation with recommended parameter settings that leverage the results of predictive indicators.

The use of blockchain in education has become one of the trending topics in education technology research. However, only a handful of education blockchain solutions have provided a measure of the impact on students' learning outcomes, teaching, or administrative processes. This work reviews how academic data stored on the blockchain is being visualized across various education blockchain solutions. We argue that education's uniqueness requires a different visualization approach that supports students' learning activities, advances teaching methods, and facilitates administrative procedures. We identify a consistent trend where most of the proposed education blockchain solutions focus on credentials collection and do not provide a way to make sense of the blockchain's data. Thus, we conducted a needs analysis by interviewing four teachers to understand essential features when accessing distributed academic data, report these results and use them to inform the features of our proposed visualizations. Our unique contributions include: presenting typical use cases of distributed learning records from multiple education institutes and demonstrating how past learning records of students stored on the blockchain can be visualized to support current learning. We also propose a method of visualization to increase the data awareness of information owners through the blockchain.