Search

Background: Computer‐based assessment allows for the monitoring of reader behaviour. The identification of patterns in this behaviour can provide insights that may be useful in informing educational interventions. Objectives: Our study aims to explore what different patterns of reading activity exist, and investigates their interpretation and consistency across different task sets (units), countries, and languages. Three patterns were expected: on‐task, exploring and disengaged. Methods: Using log data from the PISA 2012 digital reading assessment (9226 students from seven countries), we conducted hierarchical cluster analyses with typical process indicators of digital reading assessments. We identified different patterns and explored whether they remained consistent across different units. To validate the interpretation of the identified patterns, we examined their relationship to performance and student characteristics (gender, socio‐economic status, print reading skills). Results and Conclusions: The results indicate a small number of transnational clusters, with unit‐specific differences. Cluster interpretation is supported by associations with student characteristics—for example, students with low print reading skills were more likely to show a disengaged pattern than proficient readers. Exploring behaviour tended to be exhibited only once across the three units: It occurred in the first unit for proficient readers and in later units for less skilled readers. Major Takeaways: Behavioural patterns can be identified in digital reading tasks that may prove useful for educational monitoring and intervention. Although task situations are designed to evoke certain behaviours, the interpretation of observed behavioural patterns requires validation based on task requirements, assessment context and relationships to other available information. Lay Description: What is already known about the subject matter?: Students differ in how they read, comprehend and use digital information.Indicators from process data provide insight about how students engage with digital reading tasks. What does this paper add to the subject matter?: Based on multiple process indicators, a small number of clusters indicating different behavioural activity can be distinguished.These clusters can be described as on‐task, passive, hasty, exploring, disengaged, persistent and lost interest.A meaningful interpretation of the clusters must consider the requirements of the underlying tasks. Implications for practice and/or policy: Knowledge of how students engage with digital resources may provide useful feedback for teachers to guide students' learning or intervene when they struggle.Educational monitoring: The high comparability of country‐specific results suggests an invariant set of solution strategies in the digital reading assessment. [ABSTRACT FROM AUTHOR]

Clinical trials for the treatment of schizophrenia now often include cognitive assessments in addition to clinical ratings of symptoms. Recently, these trials have included cross-national assessments. It is not clear if translated psychological tests produce consistent results across different languages. This paper presents the results of a study of the comparability of the results of cognitive assessments in different English-speaking countries and a number of countries where tests were translated into other languages. Performance on tests of executive functioning, verbal and visuo-spatial learning and memory, language skills, psychomotor speed, and vigilance was compared across the first episode patients with schizophrenia (n=301) assessed in six different languages (English, French, Finnish, German, Hebrew, and Afrikaans), including two different countries where patients were assessed in English and other languages: Canada (French) and South Africa (Afrikaans). The variance in performance across the sites tested in English was as large as the variance between English and non-English speakers when all tests were considered. Performance differences across English and other languages were found only for executive functions, vigilance, and psychomotor speed, with executive functioning differences nonsignificant when education was considered. No differences were found between English and non-English speakers in Canada. These results suggest that the translation of tests of memory and verbal skills can lead to consistent results across translated versions of the tests. Differences between countries were greater than differences between languages, suggesting the need to consider representativeness of patient samples in terms of local educational attainment. In general, these data support the validity of cross-national neuropsychological assessments. [Copyright &y& Elsevier]