Search

This study reports on two key aspects relating to the use of the Online Learning Readiness Self-Check (OLRSC) survey, which has been proposed as identifying non-traditional students' readiness for online learning, and their strengths and weaknesses in six key areas. The first aspect validates the use of the instrument based on data from 199 students engaged in an online tertiary enabling course at a regional university in Australia. Factor analysis verified the scale structure of the instrument; however, two items were removed prior to the final analysis due to low communality and/or high cross loading with other items. This is followed by an examination of whether the instrument might be useful for the early identification of students who are at risk of disengagement from the enabling program. While it was hypothesised that the instrument, which measured factors such as the quality of interaction with peers and instructors, their capacity to manage technology and how well they managed learning, should have been a useful tool to identify early disengagement, the hypothesis was not supported. No significant associations were identified between any of the instrument's scales and early withdrawal from the course or completion of the first unit of study. Future recommendations for educators are made with a view to improving student engagement.

While several test concordance tables have been published, the research underpinning such tables has rarely been examined in detail. This study aimed to survey the publically available studies or documentation underpinning the test concordance tables of the providers of four major international language tests, all accepted by the Australian Department of Home Affairs for Australian visa purposes. To evaluate the concordance studies, we first identified the good practice principles in concordance research through a review of both the relevant literature and leading professional standards in the field of educational measurement and language assessment. Next, we reviewed the concordance studies against the identified good practice principles. Our findings revealed that the information supplied by test providers varied, with some making the full research papers available, whereas others providing little information about their underpinning research. None of the concordance studies fulfilled all the good practice principles. Based on the findings of this study, we offer recommendations for future concordance research in the field of language testing as well as suggestions for practice.

Social identity is an important social determinant of student outcomes such as mental health and well-being. Currently, no validated social identity measures exist for adolescents in secondary school settings. A new 'Adolescent Social Identity' measure was developed by adapting two social identity dimensions from a validated reputation enhancement scale. The Social Identity Measure comprises two scales of 10 items each to measure how adolescents think their peers view them (e.g., reputational status) in terms of their conforming and nonconforming behaviour (Self-perception of Public Self) and how adolescents would ideally like to be viewed (Ideal Public Self) by peers. Exploratory and confirmatory factor analyses were conducted along with assessments of reliability, validity, and measurement invariance. Conforming and Nonconforming subscales for both scales were shown to be reliable, valid, and invariant across age and gender groupings. There were significant but small differences in the latent means for gender.

The purpose of our study was to assess the test-retest reliability and concurrent validity of the 30 sec Sit to Stand test in a sample of adolescents. We recruited 30 male (58%) and 22 female (42%) participants (mean age = 15.77 years ± 0.46). Participants completed the 30-sec Sit to Stand and standing long jump tests on two occasions separated by 1 week. The rank order repeatability of the Sit to Stand test for the entire group was good (ICC = 0.84, 95% CI's [0.71 to 0.91]), systematic error was low (1.7 repetitions ± 2.9), and the typical error between tests was 2.1 repetitions (95% CI's 1.73 to 2.55). Sit to Stand results were significantly associated with lower body power (r = 0.55, p < 0.001). Our study demonstrated that the 30-sec Sit to Stand test has moderate-to-high test--retest reliability and acceptable concurrent validity in a population of adolescents.

This study involved examining the psychometric properties of the Tripartite Occupational Well-Being Scale (TOWBS) among a sample of 502 Australian teachers. The TOWBS (12 items) comprises three factors of subjective vitality, behavioral engagement, and professional growth. The TOWBS -- Short (3 items) assesses a broad factor of occupational well-being. Results confirmed the reliability, factor structure, and longitudinal measurement invariance of the scale scores for both scales. In addition, the two forms of the scale functioned similarly across different teacher characteristics, and the well-being factors were demonstrated to be associated with four external correlates in plausible ways (workplace buoyancy, psychological detachment, somatic burden, emotional exhaustion). Combined, findings offer support for the scale as an assessment of teacher well-being. Implications for research and practice are discussed.

Background: Objective Structured Clinical Examinations (OSCEs) are a simulation-based assessment tool used extensively in medical education for evaluating clinical competence. OSCEs are widely regarded as more valid, reliable, and valuable compared to traditional assessment measures, and are now emerging within professional psychology training programs. While there is a lack of findings related to the quality of OSCEs in published psychology literature, psychometric properties can be inferred by investigating implementation. Accordingly, the current review assessed implementation of OSCEs within psychology programs against a set of Quality Assurance Guidelines (QAGs). Methods: A systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) recommendations. Electronic databases including ProQuest Psychology, PsycArticles, Psychology and Behavioural Sciences Collection, PsycInfo and key indexing databases such as Scopus, ProQuest, and Web of Science were used to identify relevant articles. Twelve full-text articles met all inclusion criteria and were included in the review. Results: There was considerable heterogeneity in the quality of studies and reporting of OSCE data. Implementation of OSCEs against QAGs revealed overall adherence to be "Fair." Conclusion: The current review consolidated what is known on psychometric quality of OSCEs within psychology programs. A further need for quantitative evidence on psychometric soundness of OSCEs within psychology training is highlighted. Furthermore, it is recommended that future training programs implement and report OSCEs in accordance with standardized guidelines.

High self-efficacy is a marker of successful teaching and is, therefore, a subject of great interest to research on inclusive education. One of the most frequently used instruments to assess such beliefs is the Teacher Efficacy for Inclusive Practice (TEIP) scale. Although used widely, some studies did not precisely replicate the original factor structure, and no short form of the TEIP scale currently exists, although this could enhance measurement efficiency. This study: (1) systematically assessed the TEIP scale's factor structure and psychometric properties; (2) identified potentially problematic items and developed a more concise short form of the scale; and (3) evaluated its dimensionality and criterion and convergent validities using three validation samples of teachers in three different countries (486 in Switzerland, 189 in Australia and 276 in Canada). Compared to the full-length TEIP scale, the TEIP-SF uses half the items, demonstrates better model fit and reveals a clearer distinction of domain-specific factors. In conclusion, the TEIP-SF represents a concise, efficient means of assessing teachers' self-efficacy about teaching in inclusive classrooms.

Studies are emerging documenting the experience of fatigue, exhaustion and loss of functioning that has long been described by autistic adults as autistic burnout. New assessment tools are needed to enable identification and diagnosis. Here, we sought to identify factors associated with severity, develop an autistic burnout assessment and test the prepublication AASPIRE Autistic Burnout Measure tool. A co-produced survey of 141 autistic adults with experience of autistic burnout (98% above cut-off for depression) was subjected to exploratory factor analysis and scale reduction to identify a grouping of Autistic Burnout Severity Items. Autistic Burnout Severity Items showed strong overall internal consistency and acceptable internal consistency across four factors. Masking and depression were associated with the Autistic Burnout Severity Items, once variation in alexithymia, interoception, repetitive behaviours, sensory sensitivities and autism severity had been adjusted for. There is some suggestion that the Autistic Burnout Measure may not be as robust as the Autistic Burnout Severity Items, particularly as it showed a significant relationship with depression but not masking. Our findings alongside recent literature highlight a core phenomenon, comprising exhaustion, withdrawal and cognitive overload, associated with stressors potentially unique to autistic people. Further disambiguation from autistic shutdown and other conditions is needed in work towards the measurement of autistic burnout.

The Parents' Evaluation of Developmental Status (PEDS), PEDS: Developmental Milestones (PEDS: DM) and PEDS tools (i.e., the PEDS and PEDS:DM combined for use) are parent-reported screening tools frequently used to identify young children requiring early intervention. An ideal screening tool for all contexts would be brief, inexpensive with appropriate test items and good psychometric properties. A scoping review was conducted to review studies that used the PEDS, PEDS:DM, and PEDS tools to screen for the need for further referrals and evaluation through parent report. Thirty articles, ranging from 2003 to 2020, conducted in high-income countries (HICs) and lower-middle income countries (LMICs), were included from the 1,468 records identified. Studies conducted in HICs (n = 19) included screening of special population groups and comparing validated tools. LMIC studies (n = 11) focused on translations, combination of the PEDS tools, validations of tools, and use of an app-based tool (mHealth). High referral rates were obtained with PEDS (23-41%) and PEDS:DM (12-54%) in LMICs where at-risk populations are more prevalent and cultural differences may affect tool validity. A global dearth of research on PEDS:DM and PEDS tools exist; the review highlights factors that influence the validity and impact widespread use of the screening measures, especially in diverse populations and LMICs.

Career development learning is increasingly emphasized as a curricular strategy to prepare students for their post-compulsory school transitions to further study or employment. Educators require career development frameworks and resources to support students' reflective learning. The present research tested a hypothesized Career Education and Development Framework (CEDF) comprising eight factors: The understanding of self; opportunities; influences; goal setting; decision-making; taking action; reflecting/reviewing; and confidence. The hypothesized framework was tested by confirmatory factor analysis (CFA) using data from two independent studies with samples (n = 567, n = 272) of senior secondary school students from different schools and jurisdictions. In addition to acceptable overall fit, invariance testing revealed consistency across gender on most factors.

Understanding students' perceptions of Christian education is essential for schools seeking to make changes that enhance opportunities for students to understand and engage with Christian faith. This study introduces and describes the validation of an accessible survey that probes students' perceptions of the Christian culture of their school and the degree to which the school culture has influenced their willingness to engage with and adopt a faith stance. Schools can use the survey to identify areas for change related to the school climate, teaching and social-emotional learning, in conversation with teachers and students.

Childhood social and emotional competencies are recognized as teachable skills affecting well-being and developmental outcomes across the life span. This study sought to develop and validate a brief self-report measure of social-emotional competencies in middle childhood. The study used items from the 2015 Middle Childhood Survey, administered to a representative subsample of the New South Wales Child Development Study cohort, comprising sixth grade students (n = 26,837; aged 11-12 years) attending primary school in New South Wales, Australia. Exploratory and confirmatory factor analyses assessed the latent structure of social-emotional competencies, and item response theory and construct validity analyses evaluated the reliability, validity, and psychometric properties of the derived measure. A correlated five-factor model outperformed other latent structures (one-factor, higher order, and bifactor models) and was consistent with the framework developed by the Collaborative for Academic, Social, and Emotional Learning that informs the Australian school-based social-emotional learning curriculum, incorporating the following: Self-Awareness; Self-Management; Social Awareness; Relationship Skills; and Responsible Decision-Making. This brief (20-item), psychometrically sound, self-report measure of social-emotional competencies in middle childhood provides capacity for exploration of these skills as mediators and moderators of developmental outcomes across the life span.

There are growing expectations in Australia and internationally that school educators will engage with and use research to improve their practice. In order to support educators to respond to such expectations, there is a need to be able to accurately assess the levels of educators' research engagement. At present, however, few psychometrically sound instruments are available. Drawing on two studies of Australian educators (n = 1,311) and utilising Rasch analysis, supported by confirmatory factor analysis, this paper reports on the development of a brief eight-item scale that demonstrates validity and reliability and evidenced unidimensionality in the second study. The scale is intended as a quick, easy-to-use tool for educators to gain insights into their beliefs about the value of engaging with research, their actions around using research, and their confidence in finding, interpreting, and judging the quality of relevant research. Notwithstanding the need for further testing, this paper argues that the scale has the potential to be applicable to other educational contexts and to contribute to future research into educators' research engagement and its assessment. The scale can also provide school and education system leaders, as well as evaluators and researchers, with data regarding educators' research engagement over time, allowing for research use supports and resources to be better targeted.

The objective of the study was to validate adapted versions of the Glasgow Anxiety Scale for people with Intellectual Disabilities (GAS-ID) simultaneously developed in English and French. A sample of 361 youth with mild to moderate intellectual disability (ID) (M = 15.78 years) from Australia (English-speaking) and Canada (French-speaking) participated in this study. The results supported the factor validity and reliability, measurement invariance (between English and French versions), a lack of differential items functioning (as a function of youth's age and ID level, but not sex in the English-Australian sample), temporal stability (over one year interval), and convergent validity (with global self-esteem and school loneliness) of a bi-factor exploratory structural equation modeling representation of the GAS-ID. The present study supports the psychometric properties of the English-Australian and French-Canadian versions of the adapted GAS-ID.

It is a requirement for pre-service students in Initial Teacher Education programs in Australia to successfully complete a teaching performance assessment (TPA) before they graduate. This follows similar requirements in other international contexts, particularly the United States, where standard-based assessment is also a focus. As members of the design team of a TPA, which was affirmed by a nationally appointed Expert Advisory Group in Australia, we examine the social processes contributing to the development of a high-stakes assessment task. Significant challenges emerged through the nature of the task and the responsibility developers had for ensuring validity and fairness, but also because the design team comprised of teacher educators from ten universities. Using collaborative self-study as a methodology we examine our reflexive narratives and find that collaborative leadership and key personal dispositions are at the heart of the design process. These enable us to identify, examine and navigate arising tensions.

Raising the quality of initial teacher education can make an important contribution to raising the overall quality of the school system. In Australia, the National Framework for Professional Standards for Teaching is used as a common framework to set standards for the accreditation of teacher education programs. However, institution-wise assessments need to be carried out regularly to explore the quality of preparation pre-service teachers receive and to what extent they feel well prepared to enter teaching. This will enable teacher education programs to implement strategies to strengthen the link between university coursework and professional practice of pre service teachers. This paper discusses the development and validation of a scale to measure pre- service teachers' perceptions of preparedness to teach, readiness to engage with the teaching profession and self-efficacy in teaching. The study also proposes a model describing the relationship among these variables. Data was collected from 235 final year pre-service teachers using a newly developed questionnaire at an Australian university. Data shows that the Pre service Teacher Professional Experience (PTPE) scale is a theoretically sound, gender invariant and psychometrically valid instrument. The implications of using the scale in teacher education programmes are discussed in the context of the findings.

The Reading the Mind in the Eyes Test (RMET) is a purported theory of mind measure and one that reliably differentiates autistic and non-autistic individuals. However, concerns have been raised about the validity of the measure, with some researchers suggesting that the multiple-choice format of the RMET makes it susceptible to the undue influence of compensatory strategies and verbal ability. We compared the performance of autistic (N = 70) and non-autistic (N = 71) adults on the 10-item multiple-choice RMET to that of a free-report version of the RMET. Both the autistic and non-autistic groups performed much better on the multiple-choice than the free-report RMET, suggesting that the multiple-choice format enables the use of additional strategies. Although verbal IQ was correlated with both multiple-choice and free-report RMET performance, controlling for verbal IQ did not undermine the ability of either version to discriminate autistic and non-autistic participants. Both RMET formats also demonstrated convergent validity with a well-validated adult measure of theory of mind. The multiple-choice RMET is, however, much simpler to administer and score.

Students more than ever are completing their university studies online. At the onset of the COVID-19 pandemic, most higher education providers were required to move to exclusively deliver online curriculum. It is therefore imperative that educators have access to psychometrically sound measures of students' online learning experiences. The reliability and validity properties of the "Distance Education Learning Environments Scale" (DELES) and "Student Engagement in the e-Learning Environment Scale" (SELES) were examined. A sample of 151 Australian undergraduate students completed the DELES and SELES after completing their studies online during 2020 due to COVID-19. Cronbach alpha coefficients, subscale item correlations and linear regression analyses were completed with bootstrapping. Cronbach alpha coefficients for the SELES subscales ranged from 0.68 to 0.93 and 0.75 to 0.96 for the DELES subscales. The within subscale correlations ranged from 0.29 to 0.66 for the SELES (p < 0.001) and 0.30 to 0.68 for the DELES (p < 0.001) and the between subscale correlations ranged from 0.18 to 0.75 (p < 0.001) respectively. Regression findings indicated that the SELES and DELES subscale models each accounted for 56.6% and 22.2% of the unique variance of the DELES Enjoyment, respectively. These findings present important psychometric evidence about the DELES and SELES.

Cosmology concepts encompass complex spatial and temporal relations that are counterintuitive. Cosmology findings, because of their intrinsic interest, are often reported in the public domain with enthusiasm, and students come to cosmology with a range of conceptions some aligned and some at variance with the current science. This makes cosmology concepts challenging to teach, and also challenging to evaluate students' conceptual understanding. This study builds on previous research of the authors investigating the methodological challenges for characterising students' cosmology conceptions and the reasoning underlying these. Insights from student responses in two iterations of an open-ended instrument were used to develop a concept inventory that combined cosmological conceptions with reasoning levels based on the SOLO taxonomy. This paper reports on the development and validation of the Cosmology Concept Inventory (CosmoCI) for high school. CosmoCI is a 28-item multiple-choice instrument that was implemented with grade 10 and 11 school students (n = 234) in Australia and Sweden. Using Rasch analysis in the form of a partial credit model (PCM), the paper describes a validated progression in student reasoning in cosmology across four conceptual dimensions, supporting the utility of CosmoCI as an assessment tool which can also instigate rich discussions in the science classroom.

There is a need for robust, empirically-validated conceptualisations of teachers' attitudes towards teaching science, with a view to understand how these might explain their intention to teach science. The "Dimensions of Attitudes Toward Science" (DAS) theoretical framework suggests that cognitive, affective and perceived control dimensions of teachers' professional attitudes may be related to their behavioural intention to teach science. While the DAS framework has been employed in numerous studies investigating the attitudes of preservice and inservice teachers, its efficacy remains mostly unknown. The current study employed a cross-sectional survey research design to investigate the question, "to what extent does the DAS theoretical framework explain primary preservice teachers' intention to prioritise teaching science in their future practice?" Early childhood and primary preservice teachers (n = 250) at an Australian university completed the DAS instrument prior to completing a science curriculum unit. Structural equation modelling revealed inadequate/poor model fit across multiple indices. Perceived relevance of science education and enjoyment teaching science were statistically significant predictors of preservice teachers' intention to prioritise teaching science, whereas other attitudinal constructs from the framework were not significant in this research. These findings warrant further attention to theories of behaviour and behaviour change in science education research.

This study aimed to review the validity and/or reliability of light-intensity physical activity (LPA) questionnaires and identify the most suitable questionnaires for measurement of LPA in adults. Following the PRISMA-P 2020 guidelines, we searched MEDLINE, PsycINFO, CINAHL, Scopus, Embase, and MedNar. Only studies that targeted adults [greater than or equal to]18 years old and used LPA measured by accelerometer and/or heart rate monitor as an objective criterion were included. The search resulted in 2748 article hits, from which we extracted 16 studies with 14 questionnaires. The 7-Day Sedentary and LPA Log and LPA Questionnaire were specifically designed for LPA measurement, and the Community Health Activities Model Program for Seniors physical activity self-report questionnaire scale has been revised for LPA measurement. These questionnaires had comparatively high reliability and validity in this review. Most studies contained methodological limitations such as test-retest period. In the future, more accurate reliability/validity studies should be conducted for each questionnaire.

This study fills a gap with TPACK instrumentation by validating a survey instrument for use specifically with secondary mathematics in-service teachers in the United States using an instrument originally developed in Australia (Handal et al., 2012). A comparable national sample was surveyed in the U.S. to the original Australian instrumentation study. Findings revealed the factor structure of the Australian TPACK instrument differed when used in the U.S. and presents a new validated instrument (TPACK-M-US) for use with secondary mathematics in-service teachers in the U.S. We provide three sources of validity evidence (e.g. Instrument or Test Content, Internal Structure, Response Processes). Appropriate uses and interpretations are discussed in addition to the importance of validation research for educational settings.

A caring school community can enhance whole-school wellbeing including the wellbeing of school staff, which directly impacts on student academic, social and emotional wellbeing. This study firstly examines the validity and reliability of a proposed wholeschool staff wellbeing evaluation tool which uses a set of whole-school wellbeing indicators to identify strengths and areas for improvement within the school environment which may be impacting on staff wellbeing. Secondly, the association between factors found within the whole-school staff wellbeing tool with staff self-reported mental health are examined, and finally, the influence of person characteristics and role of factors on perceived whole-school staff wellbeing are determined. Cross-sectional data were collected from 801 school staff from six non-government schools in Australia as part of the School Staff Wellbeing Project. Results confirmed and validated the hypothesised structure of the whole-school staff wellbeing evaluation tool with staff relationships (leadership, staff), staff engagement (active, supported), staff emotional wellbeing (supported through policies and opportunities) and school climate (culture and values) found to be significant predictors of mental health. Prioritising resources to building supportive staff relationships, school climate, and providing opportunities to promote staff emotional wellbeing, were found to have the greatest impact on staff mental health. Characteristics such as age, gender, education, role, and length of time working in schools predicted perceptions of the whole-school's general wellbeing. The whole-school staff wellbeing evaluation tool provides a useful screening and self-evaluation measure to identify whole-school staff wellbeing strengths and areas for improvement in staff wellbeing.

Purpose: This study aimed to develop and test a measure of real-time continuous speech understanding to be used with natural dialogues. Method: The measure was based on a category monitoring paradigm and employed five existing recordings of natural dialogues from which the different test categories and associated target words were derived. For each dialogue, a listener was first given a semantic category and asked to press a button as quickly as possible whenever they heard an instance of the category. We tested 63 younger adults, using five semantic categories (family, media, season, temperature, and travel) at three noise levels (in quiet, 0 dB, and -5 dB signal-to-noise ratio [SNR]). Performance was measured in terms of accuracy and response time. Results: The results showed clear differences between the three noise conditions regardless of the semantic category. The peak of the response distribution was highest and earliest for the quiet condition and was reduced with decreasing SNR. The responses varied across categories, reflecting differences in the complexity of a given category or the typicality of the association between target words and their category. Broad categories and/or target words that were less directly associated with their category had decreased hit rates and increased response times. Conclusion: The results were discussed in terms of the sensitivity (hit rate) of the performance measure, as well as whether it picked up higher level semantic, context, and discourse properties of the dialogues.

This study proposes a revision (R) of the Center for Epidemiologic Studies Depression Scale for youth with ID (CESD-ID) in English and French. 346 youth (36.02% girls) with mild (51.26%) and moderate (48.78%) ID (11-22 years; M = 15.69), enrolled in secondary schools in Canada (French-speaking; n = 115), and Australia (English-speaking; n = 231), as well as their parents and teachers, participated in this study. Results support the reliability, factor validity, equivalence (sex, ID level, comorbidities, and country), and convergent validity (with youth-, parent-, and teacher-rated measures of depression, anxiety, and loneliness/social isolation) of the CESD-ID-R. The CESD-ID-R allows youth with ID to provide a reliable and valid assessment of their depressive mood and happiness suitable for epidemiological studies.

This study investigated the psychometric properties of the Geriatric Anxiety Inventory (GAI) in younger adults. Participants were 212 younger adults age M = 22 (range = 17-53) years. They completed a demographic information questionnaire and self-report measures: the GAI, the Depression Anxiety Stress Scales (DASS), the Generalized Anxiety Disorder-7 (GAD-7), the Patient Health Questionnaire-9 (PHQ-9), the Penn State Worry Questionnaire (PSWQ), and the Worry Behaviors Inventory (WBI). Data from the GAI were collected at two time points, one week apart, and data from other self-report measures were collected once via Qualtrics, an online survey platform. The internal consistency and test-retest score reliability of the GAI were excellent. It had good congruent validity with other anxiety measures, limited divergent validity with depression measures, and sound convergent validity with worry measures. The GAI showed good discrimination between probable cases and noncases of generalized anxiety disorder (participants who scored [greater than or equal to] 8 on the GAD-7) and its optimal cutoff score for probable cases of GAD was [greater than or equal to] 12. A unidimensional component structure of the GAI best fit this study's data. This study has provided preliminary evidence that the GAI is reliable and valid for use in an Australian sample of younger adults.

Purpose: The purpose of this paper is to develop a measure of practitioner sense of competence when treating children with disruptive behaviours. Design/methodology/approach: Two online surveys were conducted with health, social work and psychology practitioners (n = 113 and n = 239, respectively) working within varied Australian clinical settings. Study 1 developed scale items and conducted an exploratory factor analysis of the initial Professional Sense of Competence Scale (ProSOCS). Study 2 conducted confirmatory factor analysis and tested the construct validity of the scale. Findings: Study 1 established a three-factor model, which accounted for 56.9% of variance in the ProSOCS items. Study 2 confirmed the three-factor model and considered an alternative unidimensional model. Study 2 demonstrated good convergent validity with measures of knowledge and general sense of competence. Originality/value: The ProSOCS is a valid and reliable way to measure three subscales of a more global composite score of practitioner sense of competence when treating children with disruptive behaviours. Disruptive behaviour represents one of the most common reasons for child presentation in mental health care settings. Understanding how sense of competence among professionals who treat disruptive behaviours in children relates to their level of training, treatment decisions and outcomes could help to enhance use of evidence-based treatment strategies and complement strategies for measuring competence-based training in post-graduate settings.

The "Test of Visual Perceptual Skills -- Fourth Edition" (TVPS-4) is a recently revised assessment of motor-free perceptual abilities, that was standardized in the United States. The TVPS-4 is commonly used by pediatric occupational therapists, health professionals and educators, therefore it is important that its psychometric properties and use in cross-cultural contexts are investigated. The study aim was to examine the convergent validity of the TVPS-4 when completed by Australian children. Thirty typically developing children aged 6-12 years (17 females and 13 males; mean age 8.7 years; SD = 1.7) completed the TVPS-4, the "Developmental Test of Visual Perception -- Third Edition" (DTVP-3) and the "Motor-Free Perception Test -- Fourth Edition" (MVPT-4). Spearman Rho correlation analyses with bootstrapping were completed to examine the associations between the TVPS-4, DTVP-3 and MVPT-4. The TVPS-4 total scale raw score exhibited strong significant correlations with the DTVP-3 (rho = 0.745, p < 0.000) and MVPT-4 (rho = 0.791, p < 0.000) total scale raw scores, and moderate to strong significant correlations with all of the DTVP-3 subscales (rho = 0.540 to 0.717, p = 0.002 to 0.000) and three of the MVPT-4 subscales (rho = 0.536 to 0.695, p = 0.004 to 0.000). Several weak to moderate significant correlations were found between the TVPS-4 and DTVP-3 subscale raw scores (rho = 0.370 to 0.607, p = 0.044 to 0.001). The TVPS-4 and MVPT-4 subscale raw scores exhibited several weak to strong, positive and statistically significant associations (rho = 0.385 to 0.600, p = 0.036 to 0.001). Australian children appeared to complete the TVPS-4 without any cross-cultural issues. The study findings suggest that the TVPS-4 assesses some similar motor-free perceptual abilities as the DTVP-3 and MVPT-4. This study provides some preliminary insights about the TVPS-4's convergent validity with the Australian context. The primary clinical implication is that the study findings add to the TVPS-4's body of validity evidence. Further research studies are recommended.

Background: The construct of physical literacy is gaining traction internationally and yet measurement of physical literacy is in its infancy. This paper describes the development of a pictorial child report scale of perceived physical literacy based on the comprehensive Australian Physical Literacy Framework, which includes 30 elements within four domains (physical, psychological, cognitive and social). Methods: An expert reference committee with academic and industry representatives from physical education, sport and education was formed to provide input to each stage of the process. Qualitative research methods were used to (a) determine a character that was gender neutral, not representative of a particular race or ethnicity and appealing to children, and (b) the content (i.e. relationship between item images, wording and format with the intended construct) and response processes (i.e. interpretation of items) of the Physical Literacy in Children Questionnaire (PL-C Quest). A total of 17 children aged 4-12 years were interviewed as part of the study. Results: A 'bunny' character was preferred by children. Overall, children interpreted most images as intended by the researchers, and, in many cases, without having to hear the words that went with the images. Some of the image scenarios were amended and redrawn according to the suggestions received from children and the expert reference group. Discussion: This study has provided qualitative evidence based on the content of the PL-C Quest elements and domains, on the ways respondents understand, and interpret the items. This is the first step towards the development and testing of a pictorial instrument to comprehensively measure children's self-perceived physical literacy.

The present study is an attempt to construct an information processing skills scale for higher secondary students. Information processing skills scale was developed and standardized based on the theoretical concept "Information skills in the school" engaging learners in constructing knowledge by State of New South Wales, Department of Education and Training (2007) by administering 325 randomly selected higher secondary school students of Puducherry region, thereby conducting item analysis to eliminate the inconsistent items in the tool. The final form of information processing skills scale consists of 47 items classified into six dimensions, namely-defining, locating, selecting, organizing, presenting, and assessing. All the items of information processing skills scale are likert type with five point rating.

There is growing recognition that literacy learning takes place in the years prior to formal schooling and that young children develop literacy-like behaviours through exposure to interactions in shared contexts in which literacy is a component. Despite this, there are few assessments that measure the very early literacy skills that children develop before 36 months of age. This article reports on the design and validation of a new instrument -- the Early Literacy Engagement Assessment (ELEA). This tool was developed to provide insights into the impact of Conversational Reading, a key pedagogical strategy implemented at Families as First Teachers playgroups, on young children's early receptive and expressive vocabulary and literacy skills. The instrument was trialled with 104 children living in locations across Melbourne, Victoria, and 39 Aboriginal children living in remote communities in the Northern Territory. The trial process was undertaken in two phases: (1) a technical assessment to test item consistency, characteristics and placement and (2) concurrent validity testing against items from the Clinical Evaluation of Language Fundamentals Preschool-2 tool. The findings from the trial and validation process indicate that overall the ELEA discriminates well between children of high and low ability, and it is a useful tool in the authentic assessment of expressive and receptive vocabulary skills in young children.

Objective Structured Clinical Examinations (OSCEs) have become ubiquitous as a form of assessment in medical education but involve substantial resource demands and considerable local variation. A detailed understanding of the processes by which OSCEs are designed and administered could improve feasibility and sustainability. This exploration of OSCE design is informed by Practice Theory, which suggests assessment design processes are dynamic, social and situated activities. The overall purpose is to provide insights that inform on-the-ground OSCE administration. Fifteen interviews were conducted with OSCE academics and administrators from three medical schools in Australia, the United Kingdom and Canada. Drawing from post-qualitative inquiry, Schatzki's Practice Theory was used both as a sensibility and as an analytic framework. OSCE design was characterised by planning activities, administration activities, negotiation activities and bureaucratic activities; it involves significant and resource-intensive effort in negotiation and coordination. There was considerable local variation but at the same time activities were remarkably consonant across national boundaries. There was a tension between general understandings such as reliability and validity that underpin the OSCE and the improvisational practices associated with design and administration. Our findings highlighted the role of blueprints as a key coordinating artefact but with too many rules and procedures prompting cycles of bureaucracy and complexity. Emphasising coordination rather than standardisation might ease workloads, support adaptation to local environments and prevent an overly reductive approach to this assessment format.

Often included within 'high-risk sibling' studies, the Autism Observation Scale for Infants (AOSI) has only one independent replication study and no evaluation with community-ascertained cohorts. We administered the AOSI and established clinical measures with 103 infants (68% male) at 'high autism likelihood' on the Social Attention and Communication Surveillance - Revised (SACS-R) tool, at 9-14 months of age and again 6months later. AOSI Total scores showed adequate internal consistency and strong inter-rater agreement (live- or video-coded) and were approximately normally distributed at each visit. Modest significant associations presented between Time 1 AOSI scores and concurrent developmental/adaptive skills measures. Concurrent associations were stronger at Time 2, particularly between AOSI Total and Autism Diagnostic Observation Schedule (ADOS) Social Affect scores. AOSI scores were only moderately associated across Time 1 and 2 assessments, as were Time 1 AOSI with Time 2 ADOS scores. These data from a clinically indicated cohort broadly replicate previous AOSI validity accounts from 'high-risk sibling' studies, particularly beyond the first year. Strong inter-rater agreement indicates viable AOSI inclusion within protocols necessitating blinded evaluation (e.g. intervention trials). Moderate within-participant stability suggests that, like 'high-risk siblings,' community-ascertained infants experience variable early trajectories. [This article was co-written by the AICES Team.]

Objective: The Behaviour Assessment System for Children, Third Edition (BASC-3) is a rating scale for screening emotional and behavioural disorders in children and adolescents commonly utilised in Australia but relies on a US normative sample. This study assessed the cross-cultural validity of the BASC-3 by evaluating the original factor structures of the BASC-3 Teacher Rating Scale Children (TRS-C) and Parent Rating Scale Children (PRS-C) with a clinical sample of Australian children. This study hypothesised that the factor structure of the BASC-3 TRS-C and PRS-C would yield acceptable or good fit indices among the Australian sample. Method: Analyses were conducted on parent and teacher ratings of 716 children (298 children for the TRS-C and 418 children for the PRS-C) with a mean age of 8.63 (SD = 1.54) from a psychology training clinic in Melbourne, Australia. Single-factor congeneric modelling and second-order confirmatory factor analyses examined how well the TRS-C and PRS-C factor structure fit the Australian data. Results: Good and acceptable model fit and significant factor loadings were found in the single-factor congeneric modelling and second-order factor modelling. Conclusions: The results provide supporting evidence of the cross-cultural validity of the BASC-3 TRS-C and PRS-C among Australian children presenting with clinical challenges.

Objective: The Wechsler Preschool and Primary Scale of Intelligence -- Fourth Edition Australian and New Zealand Standardised Edition (WPPSI-IV[superscript A&NZ]) is one of the most widely used intelligence assessments for children aged 2 years 6 months to 7 years 7 months. Given the impact of clinical and placement decisions that are supported by WPPSI-IV[superscript A&NZ] results, it is important to provide evidence of criterion-related validity. Criterion-related validity refers to the degree to which test scores are associated with an external criterion (e.g., pre-existing diagnosis or classification). Method: Two studies of children with intellectual giftedness (n = 19) and intellectual disability (n = 15) were conducted to determine if the constructs measured by the WPPSI-IVA&NZ perform as expected in criterion groups with known characteristics. Results: Independent sample t-tests revealed mean composite scores for intellectually gifted children were significantly higher than matched controls, with the exception of the Processing Speed Index and Cognitive Proficiency Index. Children with intellectual disability on average obtained significantly lower mean scores on all composites relative to matched controls. Conclusion: Results indicated that the WPPSI-IV[superscript A&NZ] can provide valid estimates of intellectual ability for children with intellectual giftedness and intellectual disability that align with their previous diagnosis or classification.

The 2-minute step test (2MST) requires minimal resources and is valid in adults older than 60 years. Here we investigate if the 2MST can be used to estimate peak oxygen consumption (VO[subscript 2]peak) in healthy middle-aged adults (40-59 years old). Thirty-six participants completed the 2MST and a maximal graded treadmill test with breath-by-breath gas analysis. Outcome measures included the number of steps completed in the 2MST, VO[subscript 2]peak (ml/kg/min), waist circumference (cm), resting blood pressure (mmHg) and body mass index (kg/m[superscript 2]). Data were analyzed using Pearson correlation coefficients and multivariate linear regression analyses. There was a moderate relationship between 2MST peak steps completed and VO[subscript 2]peak (r = 0.54, p = 0.001). The 2MST model, including 2MST peak steps, height and waist circumference, predicted VO[subscript 2]peak with r = 0.80 (p < 0.001). The 2MST may be a good predictor of VO[subscript 2]peak in healthy middle-aged adults, and may be suitable for primary health-care settings and large-scale epidemiological studies. Trial registration: Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12617000091303, http://www.ANZCTR.org.au/ACTRN12617000091303.aspx, date registered: 17 January 2017.

The aim of this study was to determine the validity and reliability of the Movement Environment Rating Scale (MOVERS), using data from 13 early childhood education and care (ECEC) settings. Test-retest reliability was calculated using ICCs, percentage agreement and weighted Kappa. Internal consistency was examined using Cronbach's alpha. To examine concurrent validity between the MOVERS and Sustained Shared Thinking and Emotional Well-being Scale (SSTEW) scale and the Environmental Policy and Assessment Observation (EPAO), correlation coefficients were computed. Multi-level regression analyses were conducted to examine the criterion validity of MOVERS and children's outcomes. ICC was 0.959 (p < 0.0001), weighted Kappa was 0.904 (p < 0.001), and percentage agreement was 69%-100%. Cronbach's alpha of MOVERS was [alpha] = 0.94 and [alpha] = 0.89. Statistically significant correlations between MOVERS subscales and some SSTEW and EPAO sub-areas were reported. Item 4 (Body movement to support fine motor skills) of MOVERS and children's fine motor skills was significantly correlated. This study shows that MOVERS is a reliable and valid scale that can, with training, be confidently used for research, audit, self-evaluation for practice improvement.

Self-assessment is a fundamental skill for professionals because self-assessment can promote self-regulated learning and professional development. However, studies reporting the use of self-assessment instruments in the professional training context are scarce. This study aimed to re-evaluate the psychometric properties of the Self-assessment Practice Scale (SaPS), which was originally developed in the school context, and extend its use to the professional training context. A sample of 200 investigative interviewer trainees from Australia and North America were invited to complete the modified SaPS. After removing misfitting items, the confirmatory factor analysis results confirmed a first-order four-factor solution. The multidimensional Rasch analysis demonstrated that the resultant 16 items had satisfactory fit to the Rasch model. In general, the results supported the use of the 16-item modified SaPS as a valid measure for the sample in this study. The potential of using the SaPS in professional training contexts is discussed.

Scientific reasoning competencies are highlighted in science education policy papers and standard documents in various countries around the world and pre-service science teachers are asked to develop them during teacher training as part of their professional competencies. In order to monitor the development of pre-service science teachers' scientific reasoning competencies during their course of studies and to enable evidence-based improvements of teacher training, instruments for the assessment of scientific reasoning competencies are needed. However, studies propose that the validity of most instruments for assessing scientific reasoning competencies available so far can be questioned. This study presents an English translation of an already developed German multiple-choice instrument to assess pre-service science teachers' scientific reasoning competencies. A sample of N = 105 Australian pre-service science teachers participated in this study by answering the translated instrument. Quantitative (differential item functioning, Mantel-Haenszel statistic) and qualitative (think-aloud protocols) analyses provide validity evidence for the translated instrument. Furthermore, the interpretation of the data as an indicator for the participating Australian pre-service science teachers' scientific reasoning competencies suggests that there is a need for a more explicit emphasis on scientific reasoning in Australian science teacher training.

This article presents preliminary analysis of a test item in a large-scale study design to promote the development of geometric reasoning progression. Two sets of data were analysed to validate the item designed to assess secondary school students' knowledge of a rectangle. The first data set involved 155 Year 4-10 students from seven trial schools across social strata. The second data set involved 585 Year 7-10 students from eleven project schools situated in lower socio-economic areas. The aim was to audit Australian students' knowledge of hierarchy of shapes and document the process of validating a test item. The findings indicated that an iterative process of design, test and redesign, incorporating Sfard's mathematical discourse framework and a multi-stage Rasch analysis, is vital in validating the results. A distinct change in students' reasoning about rectangle is observed and this is not due to age. Moreover, Rasch analysis identified eight distinct thinking zones to assist in mapping out a learning progression for developing geometric reasoning.

This study reflects that teacher education in Health and Physical Education (HPE) has long grappled with the challenge of how to disrupt pre-service teachers' (PSTs) established attitudes about HPE that may limit their capacity to positively engage with a diverse student population. This paper describes the development, validation and interpretation of the Stereotypical Attitudes in Health and Physical Education scale (SAHPE) for use in teacher education institutions. The scale was developed as a means of exploring the extent to which PSTs perpetuate or reject discriminatory attitudes and stereotypes that have been identified as having some historical and cultural acceptance in Health and Physical Education. It was designed as a tool to generate data that can be used by teacher educators with PSTs to better understand and problematise stereotypical attitudes that ultimately impact diversity and inclusion in HPE classrooms. This paper details the design process and pilot research that enabled validation of the scale for use by Australian teacher educators. For the purposes of validation, the SAHPE scale was administered to 109 pre-service teachers at one Australian university. Rasch modelling and confirmatory factor analysis using AMOS version 20.0 was employed to determine the measurement properties of the instrument and the construct validity of factors. Results from the study showed that a 17-item factor structure of the SAHPE is a valid and reliable predictor of a construct related to stereotypical attitudes. The discussion addresses the future application of the SAHPE as an instrument for teacher educators to use in efforts to enhance inclusion in HPE.

The impact of targeted professional development activities on teachers' perceptions of self-efficacy with mobile learning remains understudied. Power (2015a) used the Mobile Teacher's Sense of Efficacy Scale (mTSES) survey instrument to measure the effects of a mobile learning themed professional development course on teachers' confidence with and interest in mobile learning. The current study looks at changes in perceptions of self-efficacy amongst participants in another open course about mobile learning called "Instructional Design for Mobile Learning" (ID4ML), which took place from May 4-June 6, 2015 (Power, Bartoletti & Kilgore, 2015). The purpose of this study is to verify the reliability and construct validity of the mTSES instrument developed by Power (2015a, 2015b) and Power, Cristol and Gimbert (2014), and to explore trends in self-efficacy changes amongst a more diversified participant population. This paper reports on the findings from the analysis of data collected using the mTSES tool. The findings provide useful feedback on the impacts of participating in the ID4ML course. They also provide further support for the utility of the mTSES instrument as a measure of perceptions of self-efficacy with mobile learning. These findings point to the potential utility of the mTSES as a tool for both planning and evaluating mLearning professional development training for teachers.