Patterns of reading behaviour in digital hypertext environments.

Background: Computer‐based assessment allows for the monitoring of reader behaviour. The identification of patterns in this behaviour can provide insights that may be useful in informing educational interventions. Objectives: Our study aims to explore what different patterns of reading activity exist, and investigates their interpretation and consistency across different task sets (units), countries, and languages. Three patterns were expected: on‐task, exploring and disengaged. Methods: Using log data from the PISA 2012 digital reading assessment (9226 students from seven countries), we conducted hierarchical cluster analyses with typical process indicators of digital reading assessments. We identified different patterns and explored whether they remained consistent across different units. To validate the interpretation of the identified patterns, we examined their relationship to performance and student characteristics (gender, socio‐economic status, print reading skills). Results and Conclusions: The results indicate a small number of transnational clusters, with unit‐specific differences. Cluster interpretation is supported by associations with student characteristics—for example, students with low print reading skills were more likely to show a disengaged pattern than proficient readers. Exploring behaviour tended to be exhibited only once across the three units: It occurred in the first unit for proficient readers and in later units for less skilled readers. Major Takeaways: Behavioural patterns can be identified in digital reading tasks that may prove useful for educational monitoring and intervention. Although task situations are designed to evoke certain behaviours, the interpretation of observed behavioural patterns requires validation based on task requirements, assessment context and relationships to other available information. Lay Description: What is already known about the subject matter?: Students differ in how they read, comprehend and use digital information.Indicators from process data provide insight about how students engage with digital reading tasks. What does this paper add to the subject matter?: Based on multiple process indicators, a small number of clusters indicating different behavioural activity can be distinguished.These clusters can be described as on‐task, passive, hasty, exploring, disengaged, persistent and lost interest.A meaningful interpretation of the clusters must consider the requirements of the underlying tasks. Implications for practice and/or policy: Knowledge of how students engage with digital resources may provide useful feedback for teachers to guide students' learning or intervene when they struggle.Educational monitoring: The high comparability of country‐specific results suggests an invariant set of solution strategies in the digital reading assessment. [ABSTRACT FROM AUTHOR]