Search

This study reports on two key aspects relating to the use of the Online Learning Readiness Self-Check (OLRSC) survey, which has been proposed as identifying non-traditional students' readiness for online learning, and their strengths and weaknesses in six key areas. The first aspect validates the use of the instrument based on data from 199 students engaged in an online tertiary enabling course at a regional university in Australia. Factor analysis verified the scale structure of the instrument; however, two items were removed prior to the final analysis due to low communality and/or high cross loading with other items. This is followed by an examination of whether the instrument might be useful for the early identification of students who are at risk of disengagement from the enabling program. While it was hypothesised that the instrument, which measured factors such as the quality of interaction with peers and instructors, their capacity to manage technology and how well they managed learning, should have been a useful tool to identify early disengagement, the hypothesis was not supported. No significant associations were identified between any of the instrument's scales and early withdrawal from the course or completion of the first unit of study. Future recommendations for educators are made with a view to improving student engagement.

Social identity is an important social determinant of student outcomes such as mental health and well-being. Currently, no validated social identity measures exist for adolescents in secondary school settings. A new 'Adolescent Social Identity' measure was developed by adapting two social identity dimensions from a validated reputation enhancement scale. The Social Identity Measure comprises two scales of 10 items each to measure how adolescents think their peers view them (e.g., reputational status) in terms of their conforming and nonconforming behaviour (Self-perception of Public Self) and how adolescents would ideally like to be viewed (Ideal Public Self) by peers. Exploratory and confirmatory factor analyses were conducted along with assessments of reliability, validity, and measurement invariance. Conforming and Nonconforming subscales for both scales were shown to be reliable, valid, and invariant across age and gender groupings. There were significant but small differences in the latent means for gender.

It is a requirement for pre-service students in Initial Teacher Education programs in Australia to successfully complete a teaching performance assessment (TPA) before they graduate. This follows similar requirements in other international contexts, particularly the United States, where standard-based assessment is also a focus. As members of the design team of a TPA, which was affirmed by a nationally appointed Expert Advisory Group in Australia, we examine the social processes contributing to the development of a high-stakes assessment task. Significant challenges emerged through the nature of the task and the responsibility developers had for ensuring validity and fairness, but also because the design team comprised of teacher educators from ten universities. Using collaborative self-study as a methodology we examine our reflexive narratives and find that collaborative leadership and key personal dispositions are at the heart of the design process. These enable us to identify, examine and navigate arising tensions.

Values are conceptualized as the standards individuals use to determine the status of events and actions and are considered to influence individuals' behaviours, reasoning, and perceptions. Based on a synthesis of six school-based student values enhancement programs, this paper reports on the development of the Children's Values Questionnaire (CVQ). This Questionnaire was conceptualized as composing of seven dimensions: Self-Concept; Behaviour; Healthy Life; Social; School Climate; Emotional Intelligence; World View and 26 related sub-dimensions. A total of 848 co-educational students (52% male, 48% female) from Years (Grades) 4 to 7, ages 9 to 13+ years, across 11 Australian schools completed the 95-item CVQ Questionnaire. The Cronbach alpha coefficient of the instrument was 0.94, indicating that the questionnaire had good internal consistency. The inter-correlation between its seven dimensions clustered at Pearson r = 0.55. An exploratory factor analysis was supportive of the CVQ's theoretical construct (Norm Fit Index of the data to the theoretical construct, 0.09). Girls rated themselves higher than boys (p < 0.001) on items related to Playing by the Rules, Responsibility, Creativity, Empathy, and Communication, and boys rated themselves higher than girls on Physical Activities items (p < 0.001). Older students (Years 6 and 7) compared to younger students (Years 4 and 5) demonstrated greater discernment and differentiation of context (p < 0.05), the growing influence of peer friendship in their value beliefs and an increase in confidence in social settings (p < 0.001). The relationship of the CVQ to Schwartz's Universal Valued Goals is reported in the paper, along with examples of the application of the CVQ in schools.

Raising the quality of initial teacher education can make an important contribution to raising the overall quality of the school system. In Australia, the National Framework for Professional Standards for Teaching is used as a common framework to set standards for the accreditation of teacher education programs. However, institution-wise assessments need to be carried out regularly to explore the quality of preparation pre-service teachers receive and to what extent they feel well prepared to enter teaching. This will enable teacher education programs to implement strategies to strengthen the link between university coursework and professional practice of pre service teachers. This paper discusses the development and validation of a scale to measure pre- service teachers' perceptions of preparedness to teach, readiness to engage with the teaching profession and self-efficacy in teaching. The study also proposes a model describing the relationship among these variables. Data was collected from 235 final year pre-service teachers using a newly developed questionnaire at an Australian university. Data shows that the Pre service Teacher Professional Experience (PTPE) scale is a theoretically sound, gender invariant and psychometrically valid instrument. The implications of using the scale in teacher education programmes are discussed in the context of the findings.

A caring school community can enhance whole-school wellbeing including the wellbeing of school staff, which directly impacts on student academic, social and emotional wellbeing. This study firstly examines the validity and reliability of a proposed wholeschool staff wellbeing evaluation tool which uses a set of whole-school wellbeing indicators to identify strengths and areas for improvement within the school environment which may be impacting on staff wellbeing. Secondly, the association between factors found within the whole-school staff wellbeing tool with staff self-reported mental health are examined, and finally, the influence of person characteristics and role of factors on perceived whole-school staff wellbeing are determined. Cross-sectional data were collected from 801 school staff from six non-government schools in Australia as part of the School Staff Wellbeing Project. Results confirmed and validated the hypothesised structure of the whole-school staff wellbeing evaluation tool with staff relationships (leadership, staff), staff engagement (active, supported), staff emotional wellbeing (supported through policies and opportunities) and school climate (culture and values) found to be significant predictors of mental health. Prioritising resources to building supportive staff relationships, school climate, and providing opportunities to promote staff emotional wellbeing, were found to have the greatest impact on staff mental health. Characteristics such as age, gender, education, role, and length of time working in schools predicted perceptions of the whole-school's general wellbeing. The whole-school staff wellbeing evaluation tool provides a useful screening and self-evaluation measure to identify whole-school staff wellbeing strengths and areas for improvement in staff wellbeing.

This article describes the development and subsequent testing of scales representing functions and features of school communication among staff in Australian primary schools using the Organisational Communication in Primary Schools Questionnaire (OCPSQ). The OCPSQ was developed to measure aspects of communication occurring vertically between school leadership and staff members and horizontally among staff members. Elements of classical, human relations, and cultural theories were used to guide questionnaire development. Items were developed to represent theorised communication constructs derived from previous literature. Exploratory factor analysis was used to identify the underlying structure of aspects of communication. Confirmatory factor analysis was employed as a validation of the OCPSQ and its constructs. An interpretable ten-factor solution, representing salient functions and features of organisational communication, was established. Scales generated by the OCPSQ were found to have high reliabilities. The scales represented supportive, directive, cultural, and democratic functions, as well as features of communication relating to openness and load.

The present study is an attempt to construct an information processing skills scale for higher secondary students. Information processing skills scale was developed and standardized based on the theoretical concept "Information skills in the school" engaging learners in constructing knowledge by State of New South Wales, Department of Education and Training (2007) by administering 325 randomly selected higher secondary school students of Puducherry region, thereby conducting item analysis to eliminate the inconsistent items in the tool. The final form of information processing skills scale consists of 47 items classified into six dimensions, namely-defining, locating, selecting, organizing, presenting, and assessing. All the items of information processing skills scale are likert type with five point rating.

This study reflects that teacher education in Health and Physical Education (HPE) has long grappled with the challenge of how to disrupt pre-service teachers' (PSTs) established attitudes about HPE that may limit their capacity to positively engage with a diverse student population. This paper describes the development, validation and interpretation of the Stereotypical Attitudes in Health and Physical Education scale (SAHPE) for use in teacher education institutions. The scale was developed as a means of exploring the extent to which PSTs perpetuate or reject discriminatory attitudes and stereotypes that have been identified as having some historical and cultural acceptance in Health and Physical Education. It was designed as a tool to generate data that can be used by teacher educators with PSTs to better understand and problematise stereotypical attitudes that ultimately impact diversity and inclusion in HPE classrooms. This paper details the design process and pilot research that enabled validation of the scale for use by Australian teacher educators. For the purposes of validation, the SAHPE scale was administered to 109 pre-service teachers at one Australian university. Rasch modelling and confirmatory factor analysis using AMOS version 20.0 was employed to determine the measurement properties of the instrument and the construct validity of factors. Results from the study showed that a 17-item factor structure of the SAHPE is a valid and reliable predictor of a construct related to stereotypical attitudes. The discussion addresses the future application of the SAHPE as an instrument for teacher educators to use in efforts to enhance inclusion in HPE.

The impact of targeted professional development activities on teachers' perceptions of self-efficacy with mobile learning remains understudied. Power (2015a) used the Mobile Teacher's Sense of Efficacy Scale (mTSES) survey instrument to measure the effects of a mobile learning themed professional development course on teachers' confidence with and interest in mobile learning. The current study looks at changes in perceptions of self-efficacy amongst participants in another open course about mobile learning called "Instructional Design for Mobile Learning" (ID4ML), which took place from May 4-June 6, 2015 (Power, Bartoletti & Kilgore, 2015). The purpose of this study is to verify the reliability and construct validity of the mTSES instrument developed by Power (2015a, 2015b) and Power, Cristol and Gimbert (2014), and to explore trends in self-efficacy changes amongst a more diversified participant population. This paper reports on the findings from the analysis of data collected using the mTSES tool. The findings provide useful feedback on the impacts of participating in the ID4ML course. They also provide further support for the utility of the mTSES instrument as a measure of perceptions of self-efficacy with mobile learning. These findings point to the potential utility of the mTSES as a tool for both planning and evaluating mLearning professional development training for teachers.

Based on Chickering and Gamson's (1987) Seven Principles for Good Practice, this research project attempted to revitalize the principles by merging them with Merrill's (2006) Different Levels of Instructional Strategy. The aim was to develop, validate, and standardize a measurement instrument (DLISt7) using a pretest-posttest Internet quasi-experiment. It was proposed that the instrument could then be used as a rubric either for facilitating the implementation of DLISt7, or as a set of unobtrusive diagnostic indicators for assessing the quality of learning experienced by students in blended and online courses. The study was conducted across five faculties at a regional Australian multi-campus university. The intent was to contribute to knowledge building by leveraging the data that had been collected, analyzed, and reported to generate awareness about the likelihood of scaffolding and scaling, varying levels of instructional strategies for communicating expectations, and relaying information. The idea was to produce a tool that would create more opportunities for more of the principles to be put to good use as an effectiveness multiplier. The findings from the analysis conducted using exploratory and confirmatory factor analysis verified the validity of DLISt7 and demonstrated excellent internal reliability values.

The importance of developing and assessing student critical thinking at university can be seen through its inclusion as a graduate attribute for universities and from research highlighting the value employers, educators and students place on demonstrating critical thinking skills. Critical thinking skills are seldom explicitly assessed at universities. Commercial critical thinking assessments, which are often generic in context, are available. However, literature suggests that assessments that use a context relevant to the students more accurately reflect their critical thinking skills. This paper describes the development and evaluation of a chemistry critical thinking test (the Danczak--Overton--Thompson Chemistry Critical Thinking Test or DOT test), set in a chemistry context, and designed to be administered to undergraduate chemistry students at any level of study. Development and evaluation occurred over three versions of the DOT test through a variety of quantitative and qualitative reliability and validity testing phases. The studies suggest that the final version of the DOT test has good internal reliability, strong test-retest reliability, moderate convergent validity relative to a commercially available test and is independent of previous academic achievement and university of study. Criterion validity testing revealed that third year students performed statistically significantly better on the DOT test relative to first year students, and postgraduates and academics performed statistically significantly better than third year students. The statistical and qualitative analysis indicates that the DOT test is a suitable instrument for the chemistry education community to use to measure the development of undergraduate chemistry students' critical thinking skills.

The Australian Professional Teaching Standards require pre-service teachers to complete a minimum number of days of professional experience in order to graduate. Problems can arise, however, when the evaluation of their professional experience against the Standards shifts from the providers of teacher education programmes to school-based supervising teachers. The Lesson Observation On-line Platform (LOOP) begins to address these problems by utilising a secure, shared digital platform to facilitate evidence-based evaluation of the performance of pre-service teachers. In this research, we evaluated the potential of LOOP to assess pre-service teachers against the Standards as well as to enhance the professional development of both pre-service teachers and their supervising teachers. The responses from two pre-service teachers and their supervising teachers demonstrate that the methodological matters can be easily overcome. Nevertheless our findings indicate that there are several practical issues that need to be overcome if LOOP were to be fully successful.

The article "Designing criterion-referenced assessment" (Burton, 2006) appeared in the "Journal of Learning Design," Volume 1, Issue 2 in 2006. Nine years later, Associate Professor Burton reflects upon her original article. when the article was written, the author worked at the Queensland University of Technology (QUT). At that time, the development of criterion-referenced assessment rubrics was gaining momentum. In 2015, as the author writes this reflection, all 37 Australian universities that support a law school universally accept criterion-referenced assessment as opposed to norm-referenced assessment. This year, the author started working at the University of the Sunshine Coast and is proud to say that its assessment policy explicitly endorses the development of criterion-referenced assessment rubrics. The author has published several journal articles on designing and implementing criterion-referenced assessment rubrics and it continues to be a quintessential research interest. The main strength of the 2006 article is that it is based on fundamental principles of assessment, which remain relevant today. The discussion focused on the dichotomy between criterion-referenced assessment and norm-referenced assessment; definitions for criteria and standards; strategies to enhance the reliability, validity and transparency of criterion-referenced assessment rubrics; recommendation that markers are provided with marked examples of student work; recommendation that students apply a criterion-referenced assessment rubric to formative assessment; and the implicit promotion of diverse and authentic assessment. These themes are multi-disciplinary, and appeal to a wide audience of teachers and students. This article is a reflection upon that original article. The article as it appeared in 2006 is also presented. With the author's approval, minor edits have been made, the referencing and other conventions updated to APA 6.0 and the numbering of figures altered to reflect the new publication. [For "Designing Criterion-Referenced Assessment," see EJ1066490.]

The study objectives were to develop, trial and evaluate a cross-cultural adaptation of the Adaptive Behavior Assessment System-Second Edition Teacher Form (ABAS-II TF) ages 5-21 for use with Indigenous Australian students ages 5-14. This study introduced a multiphase mixed-method design with semi-structured and informal interviews, school observations, and psychometric analyses of existing and new Northern Territory student data. It trained teachers to undertake psychological testing of Indigenous students. The cross-cultural adaptation was performed according to the internationally recommended methodology, using forward translation, back-translation, revision by an expert committee, and a pilot trial. The reliability was estimated through internal consistency and standard error of measurement. The validity was assessed through test content, response process, internal structure, internal consistency, age group differences, inter-correlations among adaptive domains, and correlations with other variables. A clinical validity study tested students' performance with and without special education needs. The results indicated good internal consistency for the adaptive domains and composite score (Social Adaptive Domain, alpha = 0.92; Conceptual Adaptive Domain, alpha = 0.94; Personal Adaptive Domain, alpha = 0.78; General Adaptive Composite, alpha = 0.94). The standard error of measurement indicated high test accuracy. Content-, construct-, and concurrent validity were measured. Concurrent validity evaluated the mean scores of students with and without special education needs, indicated significant variance (p<0.001). The data showed that the cross-cultural adaptation process was successful, and the adapted instrument demonstrated satisfactory psychometric properties, making it valid and reliable to use in the Indigenous context

Results from the Survey of Adult Skills, also known as PIAAC (Programme for the International Assessment of Adult Competencies), were recently made available for 24 participating countries. PIAAC involves several developments in relation to the earlier international "adult skills" surveys (IALS in the 1990s and ALL in the 2000s), notably the use of computer administration of the survey. In this paper, I focus on understanding these studies, by considering conceptual issues, methodological validity of research design and execution, and presentation of results. I consider several of the sample items for numeracy published by OECD (2012). And I discuss illustrative results from Australia made available in February 2013, by the Australian Bureau of Statistics. The paper shows when and how to be sceptical when reading international survey reports. It also opens up questions concerning the relevance of the results, and the other types of research that may be needed, in different national and local contexts.

A significant body of literature attests to the influence of social contexts on students' engagement with school. A review of this literature led to the construction of a self-report instrument designed to measure Social-Relational Support for Education (SRSE). The conceptual framework underlying the SRSE instrument focuses on the factors that can potentially boost student engagement: these include young people's relationships with peers, teachers, and parents. Specifically, the SRSE seeks to measure young people's perceptions of the education-related values espoused by those to whom they relate most closely, as well as their sense of belonging at school. The psychometric properties of the SRSE measure are assessed in this paper through examining the congeneric properties of each hypothesised latent factor, confirmatory factor analysis of responses to the full SRSE instrument, and invariance testing. Results indicate strong factor loadings of all items on their respective scales and excellent overall model fit. The SRSE scale presented in this paper provides an essential foundation that will allow a comprehensive examination of the relationships between students' social-relational contexts and their engagement with school.

Currently there is a need for measures to examine the issue of sustaining students' enrolment intentions over an extended period of study in physics, a subject which is generally perceived as hard and demanding by students. This paper addresses this gap in research by describing the development and the assessment of psychometric properties of the Physics Motivation Questionnaire, which examines the predictive relations among senior secondary physics students' achievement motivation, sustained engagement and sustained enrolment intentions. The theoretical framework of the instrument largely draws on the Expectancy-Value theory of achievement motivation and the latent variables are assessed through six measures. Data shows that the Physics Motivation Questionnaire is a theoretically sound and psychometrically valid instrument which has utility in examining physics at a topic-specific level. The questionnaire makes a unique contribution to the physics enrolment literature and has significant implications for educational practitioners. These implications are discussed in the context of the findings.

Over the last two decades, social capital has received increasing attention in the international literature. Despite the popularity of the construct, problems concerning definition, theoretical conceptualisation, and measurement continue to plague research and policy in this area. This investigation aimed to address this gap by developing a new social capital instrument to test the theorised nature of the construct. Utilising a sample of 1371 young Australians living in disadvantaged communities, the newly developed Social Capital and Cohesion Scale (SCCS) combined the commonalities in the current theoretical conceptualisations of social capital defining it as a multi-level, multidimensional construct consisting of trust and reciprocity across family, peer, neighbour, and institutional networks. To test the convergent validity of the scale, relations with mental health were also examined. Confirmatory factor analysis results demonstrated that the SCCS was a valid and reliable multidimensional scale, which was invariant across both regional and gender groups. Correlational analysis demonstrated that associations with depression, anxiety, and stress were consistent with past research thereby strengthening the validity of the SCCS measure

Every sphere of life has been revolutionised by science. Thus, science understanding is an increasingly precious resource throughout the world. Despite the widely recognised need for better science education, the percentage of school students studying science is particularly low, and the numbers of students pursuing science continue to decline internationally. This study establishes a new measure to investigate students' science self-concepts, motivation, and aspirations. The instrument shows sound psychometric properties in investigating secondary students' science self-concepts in different disciplines of science. Though available data show that students' science self-concepts are domain specific, it could not be shown that motivation and aspirations are.

While peer-assisted learning (PAL) continues to gain momentum internationally among educators and curricula, its use within the paramedic profession is still novel and untested. Therefore having instruments with strong measurement properties to use in paramedic PAL is important. This study is an investigation into the dimensionality and reliability of the 10-item Clinical Teaching Preference Questionnaire (CTPQ) at a large Australian university in 2011 and 2012. Data from the CTPQ completed by first year undergraduate paramedics (N = 218) were analysed using a Principal Components Analysis (PCA) with varimax rotation. The majority of the participants were female 68% (n = 150) and aged less than 26 years of age 85% (n = 187). Results from the PCA indicated a three-factor solution, accounting for 61.3% of the total variance. All item loading coefficients were well above 0.40. Findings from the PCA provide preliminary results that the CTPQ is multidimensional producing a three-factor solution: Peer Learning Management, Peer-Led Supervision, and Instructor-Led Supervision. Other results demonstrated poor internal consistency and a large number of nonredundant residuals indicating further psychometric examination of the CTPQ is required.

This paper aims to develop a valid method to assess the key competencies of the exercise physiology profession acquired through work-integrated learning (WIL). In order to develop a competency-based assessment, the key professional tasks needed to be identified and the test designed so students' competency in different tasks and settings could be assessed. The objective structured clinical examination (OSCE) was adopted for this purpose. Key competencies for practice were identified by clinical academics, practicing accredited exercise physiologists (AEPs), and by a review of the exercise physiology scope of practice document. Final year exercise physiology students who had completed professional placements participated in three pilot OSCEs. Content validity was evaluated following feedback from students and staff, and test results were analyzed to confirm reliability. Key competencies were grouped within the domains of communication, clinical and procedural skills, and technical proficiency. The results indicate that the OSCE is a valid and reliable method of assessment of the key professional competencies of exercise physiology students acquired through WIL.

The assessment of literacy and numeracy skills of students as they enter school for the first time is not yet established nation-wide in Australia. However, a large proportion of primary schools have chosen to assess their starting students on the Performance Indicators in Primary Schools-Baseline Assessment (PIPS-BLA). This series of three studies aimed to establish whether (a) items in the Reading and Mathematics scales of the PIPS-BLA function differently for Indigenous and non-Indigenous students; (b) easier items developed for both scales are able to target Indigenous low-scoring students more reliably; and (c) factors such as gender, age, geolocation and ESL status are related to high and low levels of performance. The samples consisted of Indigenous and non-Indigenous students from metropolitan, regional and remote areas in Western Australia starting school in the years 2007 to 2013. The Rasch model was used to examine the operation of items. Both scales showed very little differential item functioning; the new items improved the measures for low-scoring students only marginally; and ESL status predicted performance most strongly. Female students performed better than male students and regional and metropolitan students better than remote students. These findings support previous research. Some reasons for the lowest performances are discussed.

This research is a validation study of a survey instrument to assess student self-regulation which aims to fill a methodological gap by capturing self-regulation processes while completing learner-generated digital media (LGDM) assignments. For this purpose, the study developed and validated a self-regulation learning questionnaire. Data were gathered from seven science subjects (Years 1 to 3, n = 341) which used LGDM assignments during Semester 1, 2017. Students were asked to complete a 40-item online questionnaire. The questionnaire was administered at three times during the semester (Weeks 2, 6, and 10). Exploratory factor analysis was used to identify factor structures, followed by confirmatory factor analysis to test the validity of the constructs defined by exploratory factor analysis. Analysis of the data revealed a ten-factor structure -- six concerning self-regulation, two concerning student attitudes towards LGDM assignments, one concerning assignment ownership, and one concerning assignment motivation. The variables empirically verified in this study have important practical implications, as they could provide educators with the direction in which to target interventions to improve learners' experiences with LDGM. The study findings also contribute to the field by providing scholars with a validated research instrument that can be used in future studies.

Effective teamwork is integral to the functioning of many professions. Employers desire work-ready graduates who have developed the so-called 'soft skills' involved in teamwork. One way for students to practise and gain feedback on their team skills is through team-based assessment tasks. The TeamUP Rubric was developed to teach and assess five domains of teamwork skills through peer feedback. Initial evaluation of the five domains and use of the TeamUP with health and arts students has provided initial support for its utility as a measure of teamwork. In the current study the scale structure of each of the five domains was evaluated using Mokken scale analysis (MSA). MSA is a non-parametric item response theory approach that evaluates the internal structure of an evaluation tool. One-hundred and seventy-seven primary education students were recruited for the study. All participants were undertaking a teamwork assignment in a unit of study in their education degree at an Australian regional university. They completed the TeamUP Rubric assessment for themselves and for each of the students in their team. Each TeamUP domain met the requirements for a Mokken scale. The current study supports the validity of the scores derived from the TeamUP Rubric and further supports its use as a tool for teaching and assessing teamwork.

This study examined the validity of using teacher-administered educational and intelligence tests to screen students for learning disabilities (LDs). Twenty-seven Technical and Further Education (TAFE) students from regional Victoria who were enrolled in a program that was designed to reconnect school dropouts with education via TAFE participated in the study. The findings from this study provide preliminary evidence for the validity of using the Kaufman Brief Intelligence Test-Second Edition (KBIT-2) and limited evidence for using the Standard Progressive Matrices (SPM) as measures of intelligence for the screening of students with LDs. (Contains 3 tables.)

While researchers working within the "Student Learning Research" framework have developed or adapted questionnaires to gather information on students' experiences of blended learning, no questionnaire has been developed to enquire about teachers' experiences in such learning environments. The present article reports the development and testing of a novel questionnaire on "approaches to e-teaching," which may be employed to investigate the experience of teaching when e-learning is involved. Results showed suitable reliability and validity. Also, when exploring associations between the novel questionnaire scales and those of the well-known "approaches to teaching" inventory (Prosser and Trigwell, 2006), results from correlation and cluster analyses suggest that student-focused approaches to teaching are needed for significant use of digital technology to emerge. For practice, this relevant outcome implies that teaching needs to be considered holistically when supporting teachers to incorporate e-learning in their practice: because it seems they approach online teaching coherently with the face-to-face side of the blended experience.

Historically, responses to the Course Experience Questionnaire (CEQ) were required to be collected by self-administered paper or online questionnaire to be eligible for official analysis. CEQ responses collected by telephone were excluded from the final analysis file to minimise the potential for bias due to mode effects: systematic variation in responses obtained using different data collection methods. For the 2010 CEQ, however, telephone data collection was permitted to maximise response rates, with responses collected in this manner included in the final analysis file for the first time. In all, nearly a tenth of all valid responses to the 2010 CEQ were collected by telephone, with institutional use of telephone data collection ranging from 18 to 56% of all responses received for that institution. Using regression and matching methods, this article seeks to identify mode effects in the 2010 CEQ data that cannot be attributed to compositional differences between the telephone and self-administered respondent samples. Implications for survey practice are also discussed. [This paper was first presented at the Annual Conference of the Australasian Association for Institutional Research, "Let the sunshine in," Gold Coast, 9-11 November 2011.]

Demands for accountability have seen the implementation of large scale testing programs in Australia and internationally. There is, however, a growing body of evidence to show that externally imposed testing programs do not have a sustained impact on student achievement. It has been argued that teacher assessment is more effective in raising student achievement levels. However, it is also often argued that teacher assessments are less reliable than the results of testing programs. This paper presents a study in which teachers judged writing scripts using the process of pairwise comparison to generate a scale. The analysis showed high internal consistency of the teacher judgements. The scale locations from pairwise comparisons were highly correlated with scale estimates for the same students from a large-scale testing program. The results demonstrate it is possible to efficiently obtain highly reliable and valid teacher judgements using the process of pairwise comparison. Reliability indices are also provided for a series of small-scale assessments that used the same methodology in a range of other domains. The results support the findings of the main study. The article discusses the benefits of using the method to supplement and validate results from large-scale testing programs. (Contains 4 tables and 1 figure.)

The "Multidimensional Attitudes toward Inclusive Education Scale" (MATIES) was developed to effectively measure affective, cognitive and behavioural aspects of attitudes, within the realm of inclusive education that includes physical, social and curricular inclusion. Models within Item Response Theory and Classical Test Theory were used for calibrating the subscales. Using a sample of primary and secondary school regular teachers in Victoria, pilot study analyses indicate that the final three subscales of eighteen items successfully met standards for internal reliability, content validity, construct validity, criterion validity and convergent validity; and provide preliminary evidence to warrant further use of this instrument for the purpose of measuring teachers' attitudes toward inclusive education. (Contains 1 figure and 4 tables.)

Criterion-referenced assessment arguably results in greater reliability, validity and transparency than norm-referenced assessment. This article examines this assertion with reference to an example from a second year undergraduate law unit at the Queensland University of Technology, LWB236 Real Property A. When designing criterion-referenced assessment sheets for a course, an incremental approach should be taken to reflect that skills are progressively developed throughout the course. The incremental development and assessment of skills has been strongly supported by the literature as opposed to developing and assessing skills in a one-off manner. This article discusses how skills may be developed and assessed across three levels of a degree (or course). It builds on the existing research by recommending a model for taking an incremental approach to implementing criterion-referenced assessment across the three levels of a course. This recommended model is relevant to the designers of criterion-referenced assessment in all disciplines.