Search

While several test concordance tables have been published, the research underpinning such tables has rarely been examined in detail. This study aimed to survey the publically available studies or documentation underpinning the test concordance tables of the providers of four major international language tests, all accepted by the Australian Department of Home Affairs for Australian visa purposes. To evaluate the concordance studies, we first identified the good practice principles in concordance research through a review of both the relevant literature and leading professional standards in the field of educational measurement and language assessment. Next, we reviewed the concordance studies against the identified good practice principles. Our findings revealed that the information supplied by test providers varied, with some making the full research papers available, whereas others providing little information about their underpinning research. None of the concordance studies fulfilled all the good practice principles. Based on the findings of this study, we offer recommendations for future concordance research in the field of language testing as well as suggestions for practice.

This paper suggests rethinking the doctoral examination process in Australia to enable a closer alignment with the aims of the learning programme. The doctoral examination processes generally aim to assess the candidate's research capability, the quality and originality of the candidate's contribution to knowledge, and to authenticate that the work undertaken is in fact that of the candidate. However, based on a review of the Australian system for examining it is clear that the process does not fully align with the aims of the current doctorate and that modest changes could remedy this situation. The paper concludes with some suggestions for change which might enhance the assessment process of Australia's highest academic award and issues which need to be considered.

The implementation of the national Research Engagement and Impact Assessment in Australia provides a timely opportunity to review attempts to improve the non-academic impact of academic research. The impact agenda represents a new phase in academic research evaluation and funding, characterised by a heightened need to demonstrate a return on public investments in research. New imperatives seek the reorientation of some academic research towards more directly driving national innovation, meeting the needs of business, and contributing to improved social and economic outcomes. This paper reviews the policy journey of research impact in Australia from the proposed, but never implemented, Research Quality Framework (RQF) to the National Innovation and Science Agenda (NISA). Our analysis of policy developments from the Howard to the Turnbull Governments highlights the controversial nature of research impact assessment and the political and methodological challenges that have accompanied its implementation.

The paper describes a study revealing a number of factors that influence how Bachelor of Education students perceive assessment. These factors include personal histories, student teacher relationships, opportunities for personalisation and deep learning, notions of relevance, and anxiety issues. "Personal histories", as a term used to describe students' previous experiences, provided participants with an experiential reference point for thinking and talking about aspects of the assessment process. However, the learning and assessment context together with individual motivations, rather than personal histories, seemed to determine the learning approach adopted. The paper is likely to be of interest to those involved in designing assessments for training teachers.

The acceptance of the Scholarship of Teaching and Learning (SoTL) as a legitimate form of scholarly investigation and the shape that it takes in post-secondary education are inherently discipline-specific. This paper examines how the character and heritage of public administration influence the acceptance of SoTL, and the form that it takes. It argues that the applied nature of public administration and its interdisciplinary character have influenced SoTL in the discipline. This study concludes systematic self-reflection by disciplines may be needed to identify potential factors that limit the acceptance and/or direction of SoTL in a discipline.

This study compares the use and efficacy of assessment grading tools within postgraduate education courses in a regional Australian university and a regional university in the US. Specifically, we investigate how the quality of postgraduate education courses can be improved through the use of assessment rubrics or criterion referenced assessment sheets (CRA sheets). The researchers used a critical review of rubrics from Master of Education courses, interviews and a modified form of the Delphi method to investigate how one can assure the quality of assessment grading tools and their effects on student motivation and learning. The research resulted in the development of a checklist, in the form of a set of questions, that lecturers should ask themselves before writing rubrics or CRA sheets. The paper demonstrates how assessment grading tools might be researched, developed, applied and constantly improved in order to advance the Scholarship of Teaching and Learning.

This paper investigates the use of new media technologies, in particular wikis, for the compiling and grading of group assessment tasks. Wikis are open web pages that can be viewed and modified by anyone with internet access and are well known for their collaborative nature. Wikis are also transparent, which means that any edit/modification is recorded and attributed to a specific user. Such transparency has immense implications for the assessment of group work, as one of the major criticisms of group assessment tasks made by students relates to fairness in the distribution of grades. Therefore, the aims of this paper are to examine whether a wiki can help make the grading of group work fairer and whether the wiki environment encourages students to engage more directly with the contributions of other group members, thereby making it a truly collaborative experience.(Contains 3 figures.)

A fundamental aspect of work integrated learning (WIL) is the development of professional competence, the ability of students to perform in the workplace. Alignment theory therefore suggests that the assessment of WIL should include an assessment of students' demonstration of professional competence in the workplace. The assessment of professional competence in WIL is, however, problematic. It may be impractical for the academic supervisor to directly assess professional competence if there are a large number of students in external placements. If evidence of professional competence is provided by the student, the student's ability to articulate his or her own capabilities will interfere with the validity of the assessment. If evidence of professional competency is provided by the supervisor then the assessment is heavily dependent on the individual supervisor and may be unreliable. This paper will examine the literature relating to the assessment of professional competence in WIL. The paper will be informed by the author's experience in coordinating a WIL subject in an undergraduate law course. It will recommend that a mix of evidence provided by the student, the workplace supervisor and the academic supervisor should be used to assess professional competence in WIL.

This paper examines the uptake of Rasch measurement in language testing through a consideration of research published in language testing research journals in the period 1984 to 2009. Following the publication of the first papers on this topic, exploring the potential of the simple Rasch model for the analysis of dichotomous language test data, a debate ensued as to the assumptions of the theory, and the place of the model both within Item Response Theory (IRT) more generally and as appropriate for the analysis of language test data in particular. It seemed for some time that the reservations expressed about the use of the Rasch model might prevail. Gradually, however, the relevance of the analyses made possible by multi-faceted Rasch measurement to address validity issues within performance-based communicative language assessments overcame language testing researchers' initial resistance. The paper outlines three periods in the uptake of Rasch measurement in the field, and discusses the research which characterized each period. (Contains 4 tables and 12 notes.)

Purpose: The purpose of this paper is to analyse and summarise the Australian research on the impact of vocational education and training (VET) on transitions to work for young people aged 15 to 24 years. Design/methodology/approach: The methodology involved the compilation of statistics on VET participation by young people and a review of research on the topic of young people and the longer-term impact of VET on transitions into work. Research included in the review was restricted to Australian research published during or after 2005. Findings: The findings suggest that young people who participate in VET experience better employment outcomes compared to young people who do not participate in post-school education and training. However, the smoothness of the transition into work varies for young people who participate in VET programs. Programs linked to the workplace provide the most rapid and successful transitions while other VET programs, such as certificate I and II courses, often require further study at a higher level in order for students to achieve their desired job. The paper also shows that school VET programs have a particularly positive effect on transitions into work for early school leavers. Originality/value: The paper consolidates the knowledge on how VET assists young people's transitions into work. By focusing on longitudinal research, the paper enhances the understanding of the longer-term impact of VET for young people. (Contains 1 table, 3 figures and 3 notes.)

Assessment equity concerns all educational authorities and practitioners. When educators consider issues of equity, their predominant concern is accommodation of students with special needs, cultural issues, and creating alternative assessment activities that have equivalence to standard activities, so as not to advantage or disadvantage any student in their demonstration of knowledge. This paper examines equity issues in assessment from a legal perspective, drawing on case history from Australia, and based in discrimination and disability law. The paper is intended to assist authorities and practitioners to understand legal implications of educational assessment in order to promote practices that reduce the likelihood of legal claims and the resultant use of financial and human resources away from educational activities. However, the discussion of cases and judgements is also intended to raise issues of whether educational providers and authorities should be more conscionable in their consideration of educational equity and assessment. (Contains 28 notes.)

Drawing on the Queensland School Reform Longitudinal Study (QSRLS), this paper documents the assessment practices of about 250 Queensland primary and secondary classrooms and the extent to which they align with those pedagogical practices described as "productive pedagogies" in the research. In considering the extent of this alignment, the paper outlines in some detail the concept of "productive assessment", which also developed out of the research. The QSRLS demonstrated the necessity of aligning pedagogies and assessment practices with curriculum purposes to enhance student learning and contribute to socially just outcomes. A lack of visible alignment in the assessment practices of teachers in the study is demonstrated and discussed. When considered in conjunction with the low intellectual demands of the pedagogies observed, there are serious social justice implications to be drawn from the research. The paper also shows the significance of systemic assessment policies in relation to teacher assessment practices. The paper conceptualizes "productive assessment" in relation to broader sociological considerations of assessment practices. Some possible explanations for the findings are proffered and some brief recommendations about a way forward in relation to teacher professional development around assessment literacy are suggested. (Contains 1 table and 3 notes.)

Assessment as a field of investigation has been influenced by a limited number of perspectives. These have focused assessment research in particular ways that have emphasised measurement, or student learning or institutional policies. The aim of this paper is to view the phenomenon of assessment from a practice perspective drawing upon ideas from practice theory. Such a view places assessment practices as central. This perspective is illustrated using data from an empirical study of assessment decision-making and uses as an exemplar the identified practice of 'bringing a new assessment task into being.' It is suggested that a practice perspective can position assessment as integral to curriculum practices and end separations of assessment from teaching and learning. It enables research on assessment to de-centre measurement and take account of the wider range of people, phenomena and things that constitute it.

This paper addresses the issue of service quality evaluation within the higher education sector and stresses the need to develop measures that are both psychometrically and practically sound. The paper argues that recent debate surrounding the development of such measures has been too strongly geared toward their psychometric performance, with little regard for their practical value. While the paper supports the need to develop valid, reliable and replicable measures of service quality, it is suggested that educators must not lose sight of the original purpose for which these measures were designed, i.e. their practical value in informing continuous quality improvement efforts. It critiques the use of disconfirmation models and reports on a study of students' perceptions of quality using importance-performance analysis (IPA). The technique allows specific failings in the quality of support issues to be identified and their importance to a quality improvement programme assessed. (Contains 3 tables and 1 figure.)

The assessment of children in their years before school and their first years of school has been, traditionally, informal. Further, assessment of children's mathematical skills at this level has been infrequent compared to social, emotional and physical assessments. However, there are contexts where reliable, valid, standardised data from assessment in mathematics are required. This paper outlines the development of two assessment tools for mathematics that were originally developed for such contexts. Item Response Theory (IRT) analyses enabled the construction of assessment forms that address the range of abilities of 4- to 8-year-old children, and provided the scales used for constructing formative and summative reports of achievement. A description of the development of the assessment tools and the IRT analysis that provides the reporting formats are presented together with some research uses of the tools. (Contains 7 figures and 2 tables.)

Metacognition has been accorded a role in both mathematical problem solving and in the learning of mathematics. There has been consistent advocacy of the need for the promotion of metacognitive activity in both domains. Such advocacy can only be effective if the advocated process is well understood. In this paper we have four goals: to describe a "multi-method" technique developed to study student mathematical metacognition; to set out the structural elements and configuration of a coherent model of metacognition in the domain of mathematical problem solving; to report on the empirical utility (and validity) of this model; and, to report the insights into student mathematical metacognition arising from the research. Multi-Method Interview Tasks are appended. (Contains 4 figures.)

Phelan (2000) has produced a complex bibliometric analysis of the international contribution of Australian educational research based upon publications and citations reported in the journals indexed by the Institute for Scientific Information--the Standard & Poors of the academic world. This paper examines Phelan's analysis, showing its strengths and weaknesses, as well as examining his proposal for the establishment of an Australian database along the lines of the ISI's index. (Contains 1 table and 2 notes.)

Background: A growing body of evidence suggest an association between physical activity levels and students psychological well-being. A number of research studies have evaluated playground interventions that aim to increase physical activity levels, decrease conflict and bullying, and improve students behaviour. The HAPPY Study will evaluate the success of an intervention combining environmental modifications, teacher development, and peer support that can culminate in an easy to implement, low cost and effective model for increasing physical activity, and improving psychological well-being for children.Methods/design: Data will be collected at six New South Wales (NSW) primary schools, on physical activity levels, on-task time during classes, and social support for physical activity during a 12 month Cluster Controlled Trial (CT). Three quantitative data collection tools will be used to capture student's physical activity levels during lunch and recess breaks (the SOPARC tool), student's on-task behaviour during classes following recess and lunch breaks (the BOSS tool) and where students receive the most encouragement to be physically active from (the Physical Activity Social Support Scale survey). Baseline data will be analysed against follow-up data, collected after an intervention that is rolled out in all schools as part of a stepped wedge CT design.Discussion: A review of relevant Australian and New Zealand literature suggests that playground interventions can be successful at increasing physical activity levels, increasing social and conflict resolution skills in students, and decreasing incidences of bullying. This study will investigate any correlation between physical activity levels, and student behaviour during classes following breaks.Trial Registration: Australian and New Zealand Clinical Trials Register ACTRN12616000575437 , registered May 2016. [ABSTRACT FROM AUTHOR]

Purpose: In the higher education sector, the evaluation of learning and teaching projects is assuming a role as a quality and accountability indicator. The purpose of this paper is to investigate how learning and teaching project evaluation is approached and critiques alignment between evaluation theory and practice. Design/Methodology/Approach: The emergent realism paradigm provides the theoretical framework with a pragmatic approach to mixed-methods data collection. Thematic analysis was used to analyze the transcripts of interviews with 15 project leaders. Findings: Four key themes on project evaluation emerged: how evaluation is conceptualized, particularly the overlap, even conflation, between evaluation and research; capability building within the sector; resourcing in terms of time and money; and the role of an action-oriented approach to evaluation. The authors conclude that misalignment exists between evaluation theory and the practice of project evaluation and that this relationship can be further inhibited by a project leader's perception of evaluation. Practical Implications: A series of strategies for developing capacity across the higher education sector for project evaluation are presented. These include the development and provision of: a time allocation for evaluation in future and ongoing project plans with procedures to revisit the project and assess impact; models of how to incorporate evaluation into the research cycle; constructive feedback on evaluation reports from the university funding body; and networking opportunities to disseminate learnings from project evaluations. Originality/Value: This study focusses on the under-researched area of evaluation of learning and teaching projects in higher education, providing research-based evidence for strategies to develop sector capacity.

This paper reports on the outcomes of a three-year study investigating the use of digital technologies to increase the authenticity of high-stakes summative assessment in four Western Australian senior secondary courses. The study involved 82 teachers and 1015 students and a range of digital forms of assessment using computer-based exams, digital portfolios and audiovisual recordings. The results were analysed using a feasibility framework concerning manageability, technical facility, functional operation and pedagogic alignment. By the end of the study, each form of assessment that was implemented was found to be feasible once some obstacles were overcome. Two methods of marking were tried, analytical rubric-based marking and holistic comparative pairs marking, with the latter found to generate more reliable scores. With the increased use of digital technologies in schools and the expectation that children will achieve more complex performances, more use of digital forms of assessment will be required.

Background: Current evidence suggests that chlamydia screening programmes can be cost-effective, conditional on assumptions within mathematical models. We explored differences in cost estimates used in published economic evaluations of chlamydia screening from seven countries (four papers each from UK and the Netherlands, two each from Sweden and Australia, and one each from Ireland, Canada and Denmark).Methods: From these studies, we extracted management cost estimates for seven major chlamydia sequelae. In order to compare the influence of different sequelae considered in each paper and their corresponding management costs on the total cost per case of untreated chlamydia, we applied reported unit sequelae management costs considered in each paper to a set of untreated infection to sequela progression probabilities. All costs were adjusted to 2013/2014 Great British Pound (GBP) values.Results: Sequelae management costs ranged from £171 to £3635 (pelvic inflammatory disease); £953 to £3615 (ectopic pregnancy); £546 to £6752 (tubal factor infertility); £159 to £3341 (chronic pelvic pain); £22 to £1008 (epididymitis); £11 to £1459 (neonatal conjunctivitis) and £433 to £3992 (neonatal pneumonia). Total cost of sequelae per case of untreated chlamydia ranged from £37 to £412.Conclusions: There was substantial variation in cost per case of chlamydia sequelae used in published chlamydia screening economic evaluations, which likely arose from different assumptions about disease management pathways and the country perspectives taken. In light of this, when interpreting these studies, the reader should be satisfied that the cost estimates used sufficiently reflect the perspective taken and current disease management for their respective context. [ABSTRACT FROM AUTHOR]

Objective: Professional sport occupies a prominent cultural position in societies across the globe and commercial organisations make use of this to promote their products. The present scoping review explores existing academic literature on the relationship between professional sports clubs and food and drink marketing and considers how this relationship may impact upon the public's health.Design: The scoping review searched six databases. Experts were also consulted. Records written in languages other than English were excluded. We also excluded records relating to mega events (e.g. Olympics, Football World Cup) and alcohol marketing, because of the attention already given to these.Setting: Professional sports clubs.Results: We identified 18 166 titles, reviewed 163 abstracts and read twenty-six full texts. We included six papers in the review. Four were from Australia and New Zealand. The Australasian literature focused largely on the marketing of foods and beverages to children and the potential impact on consumption. Single papers from researchers in Turkey and the USA were identified. The Turkish paper analysed shirt sponsorship in football leagues internationally and showed food and beverage (including alcohol) companies were the most common sponsors. The US paper examined a mixed reaction to a football team named after an energy drink.Conclusions: Commercial relationships between professional sports clubs and Big Food corporations have largely eluded scrutiny in much of the world. The current review highlights the lack of public health research on these relationships. Research exploring the interdependent commercial practices of food and drink companies and professional sports clubs is urgently needed. [ABSTRACT FROM AUTHOR]

Issues: Drug consumptions rooms (DCR) and supervised injecting facilities (SIF) are expanding internationally. Previous reviews have not systematically addressed evaluation methodologies.Approach: Results from systematic searches of scientific databases in English until June 2017 were coded for paper type, country and year of publication. For evaluation papers, study outcome, methodology/study design and main indicators of DCR/SIF 'exposure' were recorded.Key Findings: Two hundred and nineteen eligible peer-reviewed papers were published since 1999: the majority from Canada (n = 117 papers), Europe (n = 36) and Australia (n = 32). Fifty-six papers reported evaluation outcomes. Ecological study designs (n = 10) were used to assess the impact on overdose, public nuisance and crime; modelling techniques (n = 6) estimated impact on blood-borne diseases, overdose deaths and costs. Papers using individual-level data included four prospective cohorts (n = 28), cross-sectional surveys (n = 7) and service records (n = 5). Individual-level data were used to assess safer injecting practice, uptake into health and social services and all the other above outcomes except for impact on crime and costs. Four different indicators of DCR/SIF attendance were used to measure service 'exposure'.Implications: Research around DCRs/SIFs has used ecological, modelling, cross-sectional and cohort study designs. Further research could involve systematic inclusion of a control group of people who are eligible but do not access SIFs, validation of self-reported proportion of injections at SIFs or a stepped-wedge or a cluster trial comparing localities.Conclusions: Methodologies appropriate for DCR/SIF evaluation have been established and can be readily replicated from the existing literature. Research on operational aspects, implementation and transferability is also warranted. [ABSTRACT FROM AUTHOR]

Many reports have identified a perceived lack of quality in regard to assessment feedback in higher education contexts. One research study in 2007 on undergraduate university students found that less than half of the students (46%) collected their formative feedback, suggesting that from their perspective feedback clearly was not fulfilling the role it should. This is a study of 465 graduate students and 101 undergraduate students studying teacher education at a major Australian university. The study investigated what students perceived to be effective, quality feedback based upon their extensive higher education experiences. Students identified preferences in regard to form, detail and timing of assessment feedback. The data were collected by means of pen and paper survey and identified which strategies the students perceived to be the most effective, particularly within the context of large cohort teaching and written assessment formats. Findings agreed with research elsewhere regarding problems with assessment feedback quality and quantity, but students also provided clear indications of how realistic improvements could be made in terms of assessment feedback processes and strategies. (Contains 4 tables.)

Ongoing and rapid change is having a significant impact on the social and cultural contexts of assessment in higher education. Change and innovation have been driven not only by advances in our knowledge of effective practice but also by government policies, the latter often resulting in uncertainty regarding the freedoms and responsibilities of the academic role and erosion of professional confidence. As confidence is considered central to the ability to learn about and master new practices, understanding and enhancing this significant component of an assessment culture is therefore a fundamental challenge to institutional efforts to improve assessment practice. This paper reports the outcomes of an investigation of academic confidence, a preliminary "mapping" activity undertaken to inform plans for developing the assessment leadership capacities of course/subject coordinators. The investigation took the form of an online survey of all course coordinators. Outcomes include the identification of areas of high and low confidence and their correlation with demographic data such as length of experience. Open-ended comments provided rich qualitative data on possible reasons for high and low confidence. (Contains 2 tables.)

All tertiary institutions in Australia use the same Course Experience Questionnaire (CEQ); however, for the internal evaluation of teaching they use their own surveys. This paper performs an analysis of the internal Quality of Teaching Surveys (QTS) used in Australian universities. We classify the questions within the QTS surveys. This classification is used to explore how different universities' surveys are similar to each other. We find that some universities use a QTS that is quite distinct from other universities. We also investigate whether there is a particular pattern to the types of questions used in the surveys. We find that there are some question types that are employed widely in a typical survey and others that are not. This analysis can be used by universities to determine how their surveys compare to their peer institutions and other institutions across Australia. (Contains 3 tables, 2 figures and 9 notes.)

Postdevelopmental perspectives in early childhood education and care increasingly reference alternative ways of understanding learning, growth and development in early learning. Drawing on these ideas, this paper examines research findings which focused on early childhood teachers' understandings of multiage grouping. The findings suggested that teachers used predominantly developmental approaches to describing their experiences of multiage grouping, and proposed that the use of postdevelopmental perspectives in multiage grouping research has the potential to realise new ways of understanding learning and development as both concepts and practices within the multiage classroom. (Contains 2 tables.)

The evaluation of government-financed research has become increasingly important in the last few decades in terms of increasing the quality of, and payoff from, the research that is done, reducing the cost of doing it, and lending public credibility to the manner in which research is funded. But there are very large differences throughout the world in the extent to which systems used promote these results. This paper briefly presents the dimensional results of a study designed to comparatively evaluate the national-level research evaluation models in sixteen countries on five merit-defining dimensions. (Contains 6 figures.)

The Life-Patterns project is a panel-cohort longitudinal study following the life trajectories of 1,908 young people who left school in Victoria in 1991. The project attempts to obtain nuanced pictures of young people's lives in three ways: using a reflexive longitudinal study design, with opportunities for participant feedback and influence on future questionnaire design; using a mix of large-numbers surveying with smaller-numbers in-depth interviewing; and by building ongoing relationships with participants through regular feedback reports on the findings and the impact of the research. The paper uses the example of this project to explore the challenge of participatory approaches to large-numbers longitudinal research. (Contains 1 figure and 2 notes.)

Critical research in education is not what it used to be. It must now engage with a differently structured and globalized world with different social and material conditions for its peoples. This paper sets out to name the contemporary structure of feeling in which education researchers now work, particularly in terms of what now is to be the object of their educational theorizing and research and what are to be the intellectual resources brought to bear on such activity. The intention is to open up debate, recognizing that there are no easy answers and yet acknowledging the need for answers to be attempted. It is, therefore, an invitation premised on an optimism of the will to complement legitimate pessimism of the intellect. It concludes that a critical engagement with these matters demands a modernist/postmodernist, reconstructive/deconstructive reflexivity in the mobilizing of a new sociological imagination applied across the broad spectrum which is educational research.

National and international rankings of institutional performance are playing a growing role in contemporary higher education. It is critical that researchers develop pragmatic, educationally sensitive and methodologically informed approaches for managing this aspect of higher education. This paper compares three approaches for modelling key indicators which underpin a national evaluation of university education in Australia: rankings of aggregate institutional performance; comparisons of institutional change over time; and performance variations within fields of education. The results show that simple institution-level aggregations are misleading, and that contemporary analytical methods must be used to account for the influence of fields of education. More broadly, the findings expose the need for a more robust methodological development of university rankings.

In tertiary institutions in Australia, and no doubt elsewhere, there is increasing pressure for accountability. No longer are academics assumed "a priori" to be responsible and capable of self management in teaching and assessing the subjects they run. Procedures are being dictated more from the "top down". Although academics may not always appreciate "top down" policies on teaching and learning, they should at least be open to the possibility that the policies may indeed have merit. On the other hand, academics should never be expected to blindly accept policies dictated from elsewhere. Responsible academics generally also need to evaluate for themselves the validity and legitimacy of externally introduced new policies and procedures. At one Australian tertiary institution, the Academic Board recently endorsed a new assessment policy, to implement criterion referenced assessment (CRA) throughout the university. This new policy is being promoted by the university's teaching and learning support services and is to be implemented gradually throughout the university. As stated in the university's manual of policies and procedures (MOPP) the "fundamental approach" to the assessment of students was to be one based on "criterion referencing". Such Assessment was to be free of any notion of awarding grades dependent on a bell curve, and the criteria against which a student's work was to be assessed would have to be communicated in a detailed and clear way in advance of the actual assessment. Thus, for each piece of assessment, criteria must be given to students, with performance standards for each criteria detailing clearly what standard must be reached on each criterion to achieve a certain result. It is stated in the MOPP that CRA will give the assessment process "a great deal of objectivity" and will contribute to the "reliability and validity of the assessment task". Moreover, it is stated that high, but attainable, standards will "motivate students and focus their energy on learning rather than on competition with peers". The teaching team of the final year Information Technology Project Management subject had a strong commitment to continuous improvement processes in the presentation and running of the subject. Given that the university had endorsed a new assessment policy that would soon relate to third year courses, the team decided to apply for, and were subsequently awarded, a faculty grant to implement and test the possible benefits of the endorsed CRA policy. An independent project, funded at faculty level, was undertaken to evaluate the effect of the new assessment policy on a final year unit. The project took a team-based approach to studying the use and effectiveness of criterion referenced assessment. All seven members of the unit's teaching and marking groups were included in the decision making surrounding the design, development, and implementation of CRA and an environment was created in which the team members could openly communicate their experience of CRA. Members of the group initially held a variety of beliefs about CRA that ranged from a dismissal of CRA as merely the latest teaching and learning fad, to keen interest in how it might practically operate in the unit. This diversity of thought was regarded as valuable and in keeping with the attempt to take an impartial "warts and all" view of the CRA implementation, noting equally its positive and negative impacts. It was found that many of the purported advantages attributed in the literature to CRA were not forthcoming. Moreover, some unexpected results were uncovered. While prior research suggests that CRA's failures are due to implementation errors, our work suggests that the real problem is that the assumptions behind CRA are flawed. This paper discusses the outcomes of the project for the students, for the academics, and for the institution. (Contains 2 tables.)

Assessment is one of the key elements of the teaching and learning process. It provides teachers with a means of evaluating the quality of their instruction. Students also use it to drive and direct their learning. Online teaching and learning will continue to become more important to Australian universities in order for them to remain competitive and economically viable. In the online environment, assessment is no less critical than in traditional face to face environments. However, assessment risks being overlooked or at least marginalised in the rush to place course content online. This paper provides a snapshot of the prevalence and characteristics of online assessment in Australian universities during 2004. It highlights useful information regarding the use of online assessment in the university sector and illustrates that overall this crucial area is not being given the attention or resources it requires. (Contains 9 tables and 2 figures.)

While a large amount of interest has been shown in the use of peer and self-assessment, few studies have considered the effect of stress on the students involved. None have considered whether the resultant stress itself might account for any noticeable improvements in student performance. The research presented in this paper addresses this question. An experimental design measured the effects of type of assessment and gender on student stress levels and performance. Results suggest that females are more stressed by self-assessment than males and that being subjected to self- and peer assessment, while more stressful, leads to improved student performance in summative tasks.

This article outlines the development and trial of peer assessment procedures for implementation within a music performance context in the Australian tertiary environment. An overview of the literature on peer assessment is presented, followed by reference to specific trials of peer assessment within a tertiary music student context. The paper then presents the rationale for and methodology applied in developing two forms of peer assessment of music performance, for trial across one academic year. Student evaluation data obtained via mid- and end-of-year questionnaires are analysed and discussed, as are implications for further research.

Explores the current status of the empirical-analytical methodology and its "positivist" ideologies in environmental education research through the critical analysis of three criticisms outlined in an article by Robottom and Hart. Suggests that the criticisms misrepresent empirical-analytical methodology in their dismissal of it as behaviorist and/or traditional positivist in nature. Contains 45 references. (Author/JRH)

OBJECTIVE: This paper describes the introduction of formative feedback into a psychiatry attachment at an Australian university and evaluates students' responses to that initiative. METHOD: Students were provided with formative feedback sessions employing a standardized instrument, also used at the end of the attachment for summative assessment. They were asked to both define formative feedback and rate its usefulness on a questionnaire, providing open-ended written comments where appropriate. RESULTS: The concept and purpose of formative feedback were understood by 91.9% of the students who completed a questionnaire. The vast majority considered it to be useful, but some identified the need for constructive criticism and structured feedback as important characteristics of formative sessions. CONCLUSIONS: Rigorous research is needed to establish whether formative feedback impacts summative assessments. However, it is clear that such feedback is desirable, in that it increases student confidence and direction. We encourage our colleagues to consider introducing and evaluating formative feedback into psychiatry curricula.