Search

Since their introduction in the 1990s, explicit standards documents have pervaded higher education assessment – success likely linked to their compatibility with constructive alignment and quality assurance regimes. Researchers, however, criticise that such documents are based on a misconception of standards as explicit and absolute, when in fact standards have tacit and contextual qualities that make it impossible to codify them fully. This article considers how practitioners conceive of standards. It identifies the range of concepts of standards, and looks at which were dominant or marginal in 24 external examiners’ responses to interview questions about their examining practice. The article identifies a significant gap between the theoretical positions asserted in the research literature and the conceptions held by experienced academics tasked with guaranteeing national standards. It considers implications for quality assurance and reflects on whether the dominance of transparency and accountability discourses leads academics to contort the way they talk about standards. [ABSTRACT FROM AUTHOR]

An increasingly regulated higher education sector is renewing its attention to those activities referred to as ‘moderation’ in its efforts to ensure that judgements of student achievement are based on appropriate standards. Moderation practices conducted throughout the assessment process can result in purposes identified as equity, justification, accountability and community building. This paper draws on the limited studies of moderation and wider relevant research on judgement, standards and professional learning to test commonly used moderation practices against these identified purposes. The paper concludes with recommendations for maximising the potential of moderation practices to establish and maintain achievement standards. [ABSTRACT FROM PUBLISHER]

Unreliability in marking is well documented, yet we lack studies that have investigated assessors’ detailed use of assessment criteria. This project used a form of Kelly’s repertory grid method to examine the characteristics that 24 experienced UK assessors notice in distinguishing between students’ performance in four contrasting subject disciplines: that is their implicit assessment criteria. Variation in the choice, ranking and scoring of criteria was evident. Inspection of the individual construct scores in a sub-sample of academic historians revealed five factors in the use of criteria that contribute to marking inconsistency. The results imply that, whilst more effective and social marking processes that encourage sharing of standards in institutions and disciplinary communities may help align standards, assessment decisions at this level are so complex, intuitive and tacit that variability is inevitable. We conclude that universities should be more honest with themselves and with students, and actively help students to understand that application of assessment criteria is a complex judgement and there is rarely an incontestable interpretation of their meaning. [ABSTRACT FROM AUTHOR]

In a context of international concern about academic standards, the practice of external examining is widely admired for its role in defending standards. Yet a contradiction exists between this faith in examining and continuing concerns about standards. This article argues that external examining rests on assumptions about standards which are significantly open to challenge. Six assumptions relating to the conceptual context, the operation and the nature of examiners themselves are analysed drawing on a review of the available evidence. The analysis challenges the notion of a consensus on standards and the potential to vest in individuals the ability to represent that consensus when judging the comparability of academic standards in a stable and appropriate way. The issues raised have relevance to the UK and to other national systems using external examiners or seeking to guarantee academic standards by, in some cases, adopting quality assurance approaches developed in the UK. [ABSTRACT FROM PUBLISHER]

In the continuing concern about academic standards in the higher education sector a great deal of emphasis has been placed on quality assurance procedures rather than on considering how university tutors learn to grade the quality of work produced by students. As part of a larger research project focused on how tutors grade student coursework, this paper offers a new metaphor for such tutor learning, based on a sociocultural perspective. The research project used think-aloud protocols recorded as university tutors graded student coursework, and this was followed by semi-structured interviews. The voluntary participants consisted of 25 lecturers in four contrasting domains-humanities, art and design, medicine and teacher education-in three universities, two teaching-led and one research intensive. We developed a metaphorical framework that helps to understand the work and learning of the lecturers and tested it by applying it to analysis of the tutor interview data. Grading, writing feedback, second marking and moderation are important situated professional learning opportunities for tutors to debate and reach agreement on the academic standard demonstrated by student coursework. The metaphor considers professional learning as interplay between the vertical domain of public knowledge and the horizontal domain of teachers' practical wisdom. The metaphor presented in this paper is proposed for critical consideration and wider use by academics, teachers, academic developers and teacher educators as an aid to better understanding of teacher's professional learning. [ABSTRACT FROM AUTHOR]

This article, using a student outcomes definition of academic standards, reports on academics' sense of standards as enacted through marking practices. Twelve lecturers from two UK universities were asked to 'think aloud' as they graded written assignments followed by a semi-structured interview. The interview data were used to investigate the source of tutors' standards, their sense of accountability for their grading judgments, their use of artefacts and their attitude to internal and external moderation. The findings suggest that tutors believe there are established and shared academic standards in existence for their discipline and they endeavour to maintain them. There was no evidence of significant pressure or practice related to lowering of standards, although differences i tutors' tacit 'standards' frameworks'' have the potential for bias. Whilst moderation has some power to secure standards within teams, the article discusses the implications of the research for assuring standards across universities and disciplines. [ABSTRACT FROM AUTHOR]

This article considers the failure of theory to provide a workable model for academic standards in use. Examining the contrast between theoretical perspectives, it argues that there are four dimensions for which the academy has failed to provide an adequate theoretical account of standards: documented or tacit knowledge of standards; norm or criterion referenced grading; analytical or holistic judgement processes; and broad or local consensus on standards. It concludes that whilst a techno-rational perspective poorly represents the actual practice of standards in use, alternative, interpretivist accounts do not satisfy demands for reliability, transparency and fairness. It concludes by outlining an alternative framework for safeguarding standards: systematising a range of processes for learning about and safeguarding standards, particularly for new staff; reviewing the role and potential of documented standards; building staff awareness and assessment literacy; and establishing trust in standards by students and other stakeholders. [ABSTRACT FROM PUBLISHER]

This article seeks to illuminate the gap between UK policy and practice in relation to the use of criteria for allocating grades. It critiques criterion-referenced grading from three perspectives. Twelve lecturers from two universities were asked to ‘think aloud’ as they graded two written assignments. The study found that assessors made holistic rather than analytical judgements. A high proportion of the tutors did not make use of written criteria in their marking and, where they were used, it was largely a post hoc process in refining, checking or justifying a holistic decision. Norm referencing was also found to be an important part of the grading process despite published criteria. The authors develop the notion of tutors’ standards frameworks, influenced by students’ work, and providing the interpretive lens used to decide grades. The implications for standards, and for students, of presenting the grading process as analytical and objective are discussed. [ABSTRACT FROM AUTHOR]

Theoretical approaches to understanding student engagement with assessment and feedback are increasingly emphasising the importance of dialogue in recognition that learning tacit knowledge is an active, shared process. This paper evaluates an experimental approach to providing feedback which was designed to create a dialogue between tutor and student without additional work for staff. Tutors on an outdoor studies degree attempted to set up a dialogue with students by providing written feedback in response to students' questions about their work, requested on their assignment cover sheets. Data were collected in the form of their feedback questions, interviews with students and a focus group of staff. The data indicate that the approach encouraged students to think about their writing but that students' limited understanding of staff expectations and standards limits their ability to initiate a meaningful dialogue with their tutors. More positively, the research suggests that if staff capitalise on and develop existing peer discussion of assessment, it may provide an important foundation for the greater challenge of entering into a dialogue with academic staff. [ABSTRACT FROM AUTHOR]

This article draws on developing theory regarding assessment and marking to explore the impact of staff values regarding widening participation on grading decisions. It reports on an innovative creative arts module delivered for students with complex disabilities. Data collection included observation of teaching, interviews with staff, students and learning support staff, recordings of two academic team discussions and a questionnaire on moderation issues completed by staff. Whilst the students were very positive about the experience, the data identified pace of learning, the role of support workers and issues in authenticating student learning as aspects for future development. In particular, the research suggests that staff tackled the tension between valuing academic standards and inclusion by recasting student achievement as different rather than inferior, interpreting assessment rubrics in the light of their individual 'frameworks' for assessment. The article considers whether this recasting of standards illuminates the problematic nature of standards and assessment criteria in higher education. [ABSTRACT FROM AUTHOR]

This article challenges a number of assumptions underlying marking of student work in British universities. It argues that, in developing rigorous moderation procedures, we have created a huge burden for markers which adds little to accuracy and reliability but creates additional work for staff, constrains assessment choices and slows down feedback to students. In this under-researched area of higher education, the article will explore whether there are other ways to provide confidence in marking and grading. These might divert this energy into productive activities with useful outcomes for students and learning. [ABSTRACT FROM AUTHOR]

This paper reports on the second phase of a project designed to improve students’ understanding of assessment demands. In Stage 1, Level 1 students were involved in a range of activities culminating in peer marking. This peer assessment was, itself, marked by the tutors to encourage students to engage positively with the process. Stage 2 of the project investigated whether these various intervention activities had any long-term impact on sports studies students’ approach to writing assignments. Interviews were conducted with six students who participated in Stage 1. For comparison purposes, a matched group of students from another vocationally-related course were also interviewed. The findings suggest that the peer assessment did encourage students to pay attention to assessment information. However, the students placed greater stress on the role of informal support, particularly verbal clarification of written guidance and feedback. The article concludes with a discussion of the implications for practice. [ABSTRACT FROM AUTHOR]

Students need to understand assessment processes in order to succeed in higher education. However, recent research has identified how difficult it is for students to become absorbed into the assessment culture of their disciplines, with a recognition that providing written criteria and grade descriptors is not enough to make this tacit 'knowledge' transparent to novice students. This paper reports on an exercise where sports studies students used assessment criteria to mark their peers work coupled with an assessment of their peer marking and feedback comments. The latter was included to encourage students to engage seriously with the peer assessment. Analysis of the data indicates considerable benefits for the students in terms of use of criteria, awareness of their achievements and ability to understand assessment feedback. [ABSTRACT FROM AUTHOR]