Search

This paper is a polemical discussion of assessment in teacher education. Working from the proposition that assessment serves a number of important purposes for a range of stakeholders (students, employers, quality assurance agencies, government), it argues that there is considerable potential for conflict between the different purposes. In an age of accountability and standards, assessment for learning may lose out to assessment of learning. The paper outlines a range of characteristics associated with assessment for learning and draws on examples of practitioner research to illustrate various approaches and methods of assessment that can improve the balance between these different purposes.

Since their introduction in the 1990s, explicit standards documents have pervaded higher education assessment--success likely linked to their compatibility with constructive alignment and quality assurance regimes. Researchers, however, criticise that such documents are based on a misconception of standards as explicit and absolute, when in fact standards have tacit and contextual qualities that make it impossible to codify them fully. This article considers how practitioners conceive of standards. It identifies the range of concepts of standards, and looks at which were dominant or marginal in 24 external examiners' responses to interview questions about their examining practice. The article identifies a significant gap between the theoretical positions asserted in the research literature and the conceptions held by experienced academics tasked with guaranteeing national standards. It considers implications for quality assurance and reflects on whether the dominance of transparency and accountability discourses leads academics to contort the way they talk about standards.

Unreliability in marking is well documented, yet we lack studies that have investigated assessors' detailed use of assessment criteria. This project used a form of Kelly's repertory grid method to examine the characteristics that 24 experienced UK assessors notice in distinguishing between students' performance in four contrasting subject disciplines: that is their implicit assessment criteria. Variation in the choice, ranking and scoring of criteria was evident. Inspection of the individual construct scores in a sub-sample of academic historians revealed five factors in the use of criteria that contribute to marking inconsistency. The results imply that, whilst more effective and social marking processes that encourage sharing of standards in institutions and disciplinary communities may help align standards, assessment decisions at this level are so complex, intuitive and tacit that variability is inevitable. We conclude that universities should be more honest with themselves and with students, and actively help students to understand that application of assessment criteria is a complex judgement and there is rarely an incontestable interpretation of their meaning.

An increasingly regulated higher education sector is renewing its attention to those activities referred to as "moderation" in its efforts to ensure that judgements of student achievement are based on appropriate standards. Moderation practices conducted throughout the assessment process can result in purposes identified as equity, justification, accountability and community building. This paper draws on the limited studies of moderation and wider relevant research on judgement, standards and professional learning to test commonly used moderation practices against these identified purposes. The paper concludes with recommendations for maximising the potential of moderation practices to establish and maintain achievement standards.

In a context of international concern about academic standards, the practice of external examining is widely admired for its role in defending standards. Yet a contradiction exists between this faith in examining and continuing concerns about standards. This article argues that external examining rests on assumptions about standards which are significantly open to challenge. Six assumptions relating to the conceptual context, the operation and the nature of examiners themselves are analysed drawing on a review of the available evidence. The analysis challenges the notion of a consensus on standards and the potential to vest in individuals the ability to represent that consensus when judging the comparability of academic standards in a stable and appropriate way. The issues raised have relevance to the UK and to other national systems using external examiners or seeking to guarantee academic standards by, in some cases, adopting quality assurance approaches developed in the UK.

There is growing international concern to regulate and assure standards in higher education. External peer review of assessment, often called external examining, is a well-established approach to assuring standards. Australian higher education is one of several systems without a history of external examining for undergraduate programmes that is currently considering the approach. What can entrants to external examining at that level learn from the UK higher education system's long history of external examining? To that end, this paper reports on a mixed methods research project designed to investigate current practices in how academic standards are conceived, constructed and applied by external examiners and debates the implications of the findings for the development of external examining in other countries. The findings suggest that the potential of experienced peers in a subject discipline to provide the assurance of standards is limited. It concludes by presenting various possible enhancements that might be considered.

In the continuing concern about academic standards in the higher education sector a great deal of emphasis has been placed on quality assurance procedures rather than on considering how university tutors learn to grade the quality of work produced by students. As part of a larger research project focused on how tutors grade student coursework, this paper offers a new metaphor for such tutor learning, based on a sociocultural perspective. The research project used think-aloud protocols recorded as university tutors graded student coursework, and this was followed by semi-structured interviews. The voluntary participants consisted of 25 lecturers in four contrasting domains--humanities, art and design, medicine and teacher education--in three universities, two teaching-led and one research intensive. We developed a metaphorical framework that helps to understand the work and learning of the lecturers and tested it by applying it to analysis of the tutor interview data. Grading, writing feedback, second marking and moderation are important situated professional learning opportunities for tutors to debate and reach agreement on the academic standard demonstrated by student coursework. The metaphor considers professional learning as interplay between the vertical domain of public knowledge and the horizontal domain of teachers' practical wisdom. The metaphor presented in this paper is proposed for critical consideration and wider use by academics, teachers, academic developers and teacher educators as an aid to better understanding of teacher's professional learning.

This research study explores the assessment practices in two higher education art and design departments. The key aim of this research was to explore art and design studio assessment practices as lived and experienced by art and design lecturers. This work draws on two bodies of pre-existing research. Firstly this study adopted methodological approaches that have been employed to good effect to explore assessment in text based subjects (think aloud) and moderation mark agreement (observation). Secondly the study builds on existing research into the assessment of creative practice. By applying thinking aloud methodologies in a creative practice assessment context the authors seek to illuminate the "in practice", rather than espoused, assessment approaches adopted. The analysis suggests that lecturers in the study employed three macro conceptions of quality to support the judgement process, namely the demonstration of significant learning over time, the demonstration of effective studentship and the presentation of meaningful art/design work.

This article, using a student outcomes definition of academic standards, reports on academics' sense of standards as enacted through marking practices. Twelve lecturers from two UK universities were asked to "think aloud" as they graded written assignments followed by a semi-structured interview. The interview data were used to investigate the source of tutors' standards, their sense of accountability for their grading judgements, their use of artefacts and their attitude to internal and external moderation. The findings suggest that tutors believe there are established and shared academic standards in existence for their discipline and they endeavour to maintain them. There was no evidence of significant pressure or practice related to lowering of standards, although differences in tutors' tacit "standards' frameworks" have the potential for bias. Whilst moderation has some power to secure standards within teams, the article discusses the implications of the research for assuring standards across universities and disciplines.

This article considers the failure of theory to provide a workable model for academic standards in use. Examining the contrast between theoretical perspectives, it argues that there are four dimensions for which the academy has failed to provide an adequate theoretical account of standards: documented or tacit knowledge of standards; norm or criterion referenced grading; analytical or holistic judgement processes; and broad or local consensus on standards. It concludes that whilst a techno-rational perspective poorly represents the actual practice of standards in use, alternative, interpretivist accounts do not satisfy demands for reliability, transparency and fairness. It concludes by outlining an alternative framework for safeguarding standards: systematising a range of processes for learning about and safeguarding standards, particularly for new staff; reviewing the role and potential of documented standards; building staff awareness and assessment literacy; and establishing trust in standards by students and other stakeholders. (Contains 1 table.)

This article seeks to illuminate the gap between UK policy and practice in relation to the use of criteria for allocating grades. It critiques criterion-referenced grading from three perspectives. Twelve lecturers from two universities were asked to "think aloud" as they graded two written assignments. The study found that assessors made holistic rather than analytical judgements. A high proportion of the tutors did not make use of written criteria in their marking and, where they were used, it was largely a post hoc process in refining, checking or justifying a holistic decision. Norm referencing was also found to be an important part of the grading process despite published criteria. The authors develop the notion of tutors' "standards frameworks", influenced by students' work, and providing the interpretive lens used to decide grades. The implications for standards, and for students, of presenting the grading process as analytical and objective are discussed.

Theoretical approaches to understanding student engagement with assessment and feedback are increasingly emphasising the importance of dialogue in recognition that learning tacit knowledge is an active, shared process. This paper evaluates an experimental approach to providing feedback which was designed to create a dialogue between tutor and student without additional work for staff. Tutors on an outdoor studies degree attempted to set up a dialogue with students by providing written feedback in response to students' questions about their work, requested on their assignment cover sheets. Data were collected in the form of their feedback questions, interviews with students and a focus group of staff. The data indicate that the approach encouraged students to think about their writing but that students' limited understanding of staff expectations and standards limits their ability to initiate a meaningful dialogue with their tutors. More positively, the research suggests that if staff capitalise on and develop existing peer discussion of assessment, it may provide an important foundation for the greater challenge of entering into a dialogue with academic staff.

This article draws on developing theory regarding assessment and marking to explore the impact of staff values regarding widening participation on grading decisions. It reports on an innovative creative arts module delivered for students with complex disabilities. Data collection included observation of teaching, interviews with staff, students and learning support staff, recordings of two academic team discussions and a questionnaire on moderation issues completed by staff. Whilst the students were very positive about the experience, the data identified pace of learning, the role of support workers and issues in authenticating student learning as aspects for future development. In particular, the research suggests that staff tackled the tension between valuing academic standards and inclusion by recasting student achievement as different rather than inferior, interpreting assessment rubrics in the light of their individual "frameworks" for assessment. The article considers whether this recasting of standards illuminates the problematic nature of standards and assessment criteria in higher education.

This article challenges a number of assumptions underlying marking of student work in British universities. It argues that, in developing rigorous moderation procedures, we have created a huge burden for markers which adds little to accuracy and reliability but creates additional work for staff, constrains assessment choices and slows down feedback to students. In this under-researched area of higher education, the article will explore whether there are other ways to provide confidence in marking and grading. These might divert this energy into productive activities with useful outcomes for students and learning.

This paper reports on the second phase of a project designed to improve students' understanding of assessment demands. In Stage 1, Level 1 students were involved in a range of activities culminating in peer marking. This peer assessment was, itself, marked by the tutors to encourage students to engage positively with the process. Stage 2 of the project investigated whether these various intervention activities had any long-term impact on sports studies students' approach to writing assignments. Interviews were conducted with six students who participated in Stage 1. For comparison purposes, a matched group of students from another vocationally-related course were also interviewed. The findings suggest that the peer assessment did encourage students to pay attention to assessment information. However, the students placed greater stress on the role of informal support, particularly verbal clarification of written guidance and feedback. The article concludes with a discussion of the implications for practice.

This article addresses a number of the theoretical and practical issues raised by using personal development planning (PDP) to enhance employability. It briefly discusses the background, rationale and evidence for PDP. It also considers the problems associated with policy implementation: the practicalities of embedding personal development planning into programmes of study, and the problems of curriculum fragmentation, student attitudes and integration with student services. This discussion is followed by the description and evaluation of an innovative third-year social science module designed to tackle these challenges. Finally, the authors provide some recommendations for the further development of PDP in higher education.

This article analyses interim findings of an ongoing action research project into the use of assessment criteria and grade descriptors in the assessment process. The project is multidisciplinary and covers areas as diverse as Sports Sociology, Economics, Youth and Community Studies, and Education. The idea is to equip first-year students with the tools necessary for raising achievement and for matching their own aspirations with what is expected of them in higher education. This is seen as particularly important with widening access attracting a higher proportion of non-traditional entrants with little exposure to higher education. Assimilation into higher education culture is often a fraught encounter and research (Yorke 2001; Yorke and Thomas 2003) suggests that induction into the requirements of individual subjects, curriculum innovation and the integration of academic skills can aid retention. The project offers a variety of methodologies emphasizing the "situated" nature of academic literacy. The immediate benefits from the pilot study of Sports Studies students have already been demonstrated (Bloxham and West 2004) and the longitudinal research now being undertaken will indicate whether the type of intervention discussed below can have lasting effects.

Students need to understand assessment processes in order to succeed in higher education. However, recent research has identified how difficult it is for students to become absorbed into the assessment culture of their disciplines, with a recognition that providing written criteria and grade descriptors is not enough to make this tacit "knowledge" transparent to novice students. This paper reports on an exercise where sports studies students used assessment criteria to mark their peers work coupled with an assessment of their peer marking and feedback comments. The latter was included to encourage students to engage seriously with the peer assessment. Analysis of the data indicates considerable benefits for the students in terms of use of criteria, awareness of their achievements and ability to understand assessment feedback.