Search

This paper proposes a new way of flipping small group classes in quantitative courses by active reading and peer marking using the virtual learning environment. We aim to engage students in the learning material by attempting a problem followed by peer marking based on some given solution guideline before they are exposed to another similar problem to solve during the small group classes. We design a quasi-experiment to evaluate the effect of peer marking by introducing an incentive in one such problem set and not in the other. The solution to the class problem is to act as the 'incentive', to be released only to the participants of the peer assessment. Using the data of two units from two UK universities and 'incentives' as instrumental variables to participation, our quantitative findings reveal the effect of participating in one more peer marking as a 3% increase in final marks on average. The qualitative analysis based on focus group discussions shows that the process increases student engagement, satisfaction, confidence and overall learning responsibility. The challenges often lie to establish a clear understanding of the purpose and the process of peer marking to ensure student buy-in to the system.

The analysis of exemplars of different quality is a potentially powerful tool in enabling students to understand assessment expectations and appreciate academic standards. Through a systematic review methodology, this paper synthesises exemplar-based research designs, exemplar implementation and the educational effects of exemplars. The review of 40 empirical exemplar-based studies indicated frequent use of post-intervention evaluation designs. The integrated use of exemplars and strategies such as rubrics, peer or self-assessment was a major pedagogic feature to enhance students' understanding of standards and aid their generation of internal feedback for self-monitoring. There was evidence suggesting that the combined use of exemplars with these strategies could advance students' academic performance and development of self-regulated learning. The review results set future directions for exemplar-based studies: quantitative research would benefit from controlled manipulation of variables to disentangle the effects of exemplars and those of other strategies; qualitative research could profitably use self-reflective diaries, think aloud protocols or classroom observations to develop deeper understandings of exemplar implementation. The key pedagogical implication recommends students' production of an assignment draft prior to exposure to exemplars so that they can compare their own work with exemplars and then make improvements independently of teachers.

Increasingly, attention is being turned toward the actions of students in relation to feedback. This paper presents the outcomes of a questionnaire study researching what undergraduate and postgraduate architecture students perceive as the purpose of feedback, how they use feedback on their coursework, and what makes them more likely to act on it. An overarching theme in their conception of feedback's purpose was that of a guide for improving coursework and learning. Two key dimensions that facilitated use over the longer term were feedback being generative and informing their working methods. The study revealed students engaging in a range of strategies with both formative and summative feedback to prioritise their next work; these could form the basis of facilitating wider adoption of these methods across the student body. There were similarities, but also substantial differences, between how undergraduate and postgraduate students reported perceiving and utilising feedback, which may have impact on feedback provision to enhance uptake and use. Whereas undergraduate students saw feedback's purpose in terms of directing improvement, postgraduates were more likely to see their own role in the process. Postgraduates were more likely to question feedback's validity over the longer term.

Research on contract cheating usually considers most forms of outsourcing combined, although studies have found that students more commonly obtain work from those known to them, rather than from commercial sites; yet little research exists which explores which variables and motivators may be associated with this type of outsourcing. Strategies employed to reduce student interaction with essay mills are unlikely to have an impact on reducing outsourcing from friends or family. Implementation of practical responses requires knowledge unique to the different methods of outsourcing. This paper presents statistical analysis undertaken on an international research population to consider which variables were statistically able to predict university student's engagement in assignment outsourcing from either friends, family or other students. Situational factors, such as knowledge of other student's cheating, and believing cheating is acceptable, were found to have a correlation to self-reported outsourcing behaviours. Individual factors did not show statistical significance in predicting student engagement with outsourcing from those known to them.

This paper draws on staff and student consultations conducted during the development of Student Minds' University Mental Health Charter to identify five key tensions which can arise in assessment design and strategy when seeking to balance the wellbeing of students with pedagogical, practical and policy considerations. It highlights the need to acknowledge the pressures of assessment on staff wellbeing as well as students. The particular tensions explored include the need to balance challenge against the psychological threats this can entail; the varying impacts of traditional and novel forms of assessment; the differing demands of collaborative and individual work; the tensions between ideal strategies and those which are practically feasible; and the ways in which feedback is given (as a constructive learning tool) and received (often as a psychological threat). These tensions can provide a valuable point of reflection for educators who need to critically and proactively navigate these conflicts within their own assessment design and practices, as part of a wider whole university approach to promoting student wellbeing.

Pedagogic discourse on feedback has shifted away from teachers' actions towards how it is used by students to improve their work and learning strategies. In architecture programmes feedback occurs through a combination of methods; this paper presents the outcomes of a questionnaire study researching undergraduate and postgraduate students' perceptions of which they considered most and least useful, and how they could be enhanced. With increased attention on dialogic approaches to feedback, the study provides insight into students' views of the relative utility of several dialogic feedback methods. Key themes that emerged which affect feedback utility are the environment in which feedback takes place, feedback discourse and message content. Although the signature pedagogy is centred on verbal dialogue, the perceived value of that dialogue varied significantly; some methods were considered much more useful, others left students uncertain and seeking greater clarification within the feedback message. The study suggests contact time be considered qualitatively as well as quantitatively. Another significant finding is students' desire for more visual feedback, which may be salient to disciplines across the art and design subject area. Other implications for practice are discussed.

Much is made of students generally rating assessment lower than other aspects of their educational experience. It is frequently cited in research literature as evidence for a general crisis in assessment, and it strongly influences institutional enhancement efforts and media coverage of student feedback. Focusing on the UK's National Student Survey, this paper draws on a range of published empirical research to argue against the idea that relatively low scores for assessment-related survey questions indicate a general problem with assessment. Students tend to rate the quality of assessment lower when they are unhappy with the assessment outcome, and students tend to be unhappy with assessment outcomes. We therefore shouldn't be surprised at the relatively low scores for assessment-related questions. This does not mean that there isn't a general problem with assessment in higher education, just that low scores for assessment questions in student surveys aren't good evidence for it. Researchers should cite better evidence of problems with assessment quality; institutions should think more carefully before focusing enhancement efforts on assessment; and we should all generally be much more cautious about interpreting the results of quantitative student surveys.

Student engagement has become a key feature of UK higher education, but until recently there has been a lack of data to track, benchmark and drive enhancement. In 2015 the first full administration ran in the UK a range of survey items drawn from the US-based National Survey of Student Engagement (NSSE). This is the latest example of international adaptations of NSSE, and was prompted by the need to collect actionable data, related to core elements of learning and teaching, that can be used for institutional improvement efforts. This paper describes the background and development of the UK Engagement Survey, focusing on the two pilot years in 2013 and 2014 and the full administration phase in 2015. This involved a complementary mix of qualitative and quantitative data analysis, and engagement with students in the testing process. Cognitive testing was conducted with 85 students over two years and data from the full 2015 administration involved 24,387 students. The political context of student engagement in relation to national satisfaction surveys, and the implications of running a generalist-based survey in a subject-specific higher education context are discussed.

The research informing this paper set out to investigate the qualitative experiences of students, supervisors and tutors involved in a summative collaborative assessment of placement learning on an undergraduate professional qualifying programme in the UK. Analysis of data gathered through semi-structured interviews provides valuable insights into its use. In particular, engagement in a collaborative assessment brings a degree of exposure for all concerned. Participants need to feel "able" to participate, and ability to participate is linked to notions of agency and autonomy. Collaborative assessment design needs to acknowledge power relations and include strategies to reduce imbalances. The importance of recognising and working with the complexities of assessment should not be underestimated. Criterion referencing offers a guide to support consistency but can also falsely present assessment as mechanistic and instrumental. The research shows that it is in the "doing" of assessment that a "shared language" is developed. It demonstrates the value of active student engagement in assessment in relation to the construction and use of theory, developing reflective practice and assessment literacy. The collaborative assessment provides students with the opportunity to experience a "performance of understanding" in a community of practice that, whilst pressured, reflects "real" professional life.

Constraints in resourcing and student dissatisfaction with assessment feedback mean that the effectiveness of our feedback practices has never been so important. Drawing on findings from a three-year study focused on student engagement with feedback, this paper reveals the limited extent to which effectiveness can be accurately measured and challenges many of the assumptions and beliefs about effectiveness of feedback practices. Difficulties relating to multiple purposes of feedback, its temporal nature and the capabilities of evaluators reveal that measuring effectiveness is fraught with difficulty. The paper argues that the learner is in the best position to judge the effectiveness of feedback, but may not always recognise the benefits it provides. Therefore, the pedagogic literacy of students is key to evaluation of feedback and feedback processes.

This paper considers the appropriateness of introducing formal learning agreements in a higher education institution (HEI). It begins by examining the current legal nature of the student/university relationship and the legal status of formal learning agreements. The paper then explores the impact of such agreements on student satisfaction by reviewing the literature pertaining to student satisfaction and discussing the findings from a collaborative inquiry (CI) event, questionnaires and semi-structured interviews. It also considers the title that such an agreement should bear and the possible content of such an agreement. The conclusion reached, is that a judiciously constructed learning agreement can potentially improve the service that students receive, promote the notion that a student is a member of a community, influence student expectations and thus increase student satisfaction. It is therefore an option that should be carefully considered, particularly as the vast majority of students who responded to the questionnaire distributed as part of the study supported the introduction of learning agreements. (Contains 7 tables and 2 notes.)

This paper reports the effect of continuous summative assessment on the behaviour and learning environment of students. Assessing the performance of students is considered to be the most important thing a teacher can do for their students and it can have a profound effect on their learning. Continuous summative assessment was introduced as a form of assessment on a module within an undergraduate degree at a UK university. Student perceptions of the process were sought via a questionnaire and interviews. The paper describes the effect the assessment had on student motivation, their approach to learning and the change to their learning environment. The conclusion reached is that while continuous summative assessment may be time-consuming to administer, the rewards of an enhanced learning environment for students outweigh the additional burden on staff. The results should be of interest to those academics who are concerned with assessment and its impact on behaviour.

University College Northampton (UCN) provides undergraduate and postgraduate courses in a wide range of subjects. In the past, instances of plagiarism were considered rare and were dealt with by academic staff on a case-by-case basis. However, the increase in instances detected by staff has led to a need to address the issue more consistently. The University has, for many years, provided students with a definition of plagiarism and has developed a procedure to deal with it. The definition however, did not provide adequate guidance to students, and staff have reported the plagiarism procedure to be unsatisfactory. Discussions with colleagues and students illuminated a general lack of understanding of plagiarism and a wide range of values and attitudes about the issue. It also appeared that the provision of student support and the application of sanctions were inconsistent. Before any institution-wide changes in policy could be initiated, research was needed to clarify staff and student attitudes to plagiarism and develop a common framework. The overall aim of this research was to contextualise the problem at UCN; to produce evidence, raise awareness of the issues and encourage debate about the pedagogical issues associated with it. It was hoped that this would facilitate the changes in culture that would provide the environment for a holistic revision of institutional practice. This paper outlines the results of the initial distribution of a questionnaire to 53 (10.6%) academics and 509 (5.1%) students to elicit data about the issues associated with plagiarism. It is part of a larger action research project using a mixed methodology. As part of the survey, staff and students were asked to estimate how frequently certain tactics were employed by students to improve their coursework grades. The tactics described were based on those described by Norton et al. (1996) in their paper '"Rules of the Game" in essay writing'. This allowed a comparison between staff and students so far, have provided sufficient evidence to initiate strategies and staff and student development activities with collegiate interest and support.

This paper examines the issues which postgraduate students and tutors experienced as they engaged in receiving, providing and requesting feedback, as well as the strategies which they adopted as they sought resolution of these issues. The study employed a case study approach, using data obtained from semi-structured and stimulated recall interviews with students and staff from three discipline areas at one university in the UK. The findings reinforce the conclusions that have been drawn in a number of previous studies in terms of the sources of dissatisfaction emerging from individual interactions and institutional practices. Additionally, however, the results expand on our current understanding of feedback and agency in higher education by illustrating how participants sought out imaginative solutions to the challenges they experienced, in order to enhance the effectiveness of the feedback process. The diversity of the strategies used provides evidence of student and tutor agency, and has implications for current feedback practices and future research in this area.

This study aims to ascertain student and staff attitudes to and perceptions of audio feedback made available via the virtual learning environment (VLE) for summative assessment. Consistent with action research and reflective practice, this study identifies best practice, highlighting issues in relation to implementation with the intention of redesigning activities in the light of the findings. It utilises four case studies where audio feedback was provided to students using the Wimba voice authoring tool within Blackboard Learn+ for various types of summative assessment. The intention was to identify how and in what context audio feedback via the VLE is effective and why. The research was undertaken via a combination of techniques, including a student survey and staff reflective logs. The findings indicate that students liked the convenience, effectiveness, flexibility and personalised nature of this feedback, but raised concerns with some aspects of the technology. This paper also makes practical recommendations for the use of the feedback mechanism, focusing on the most effective use of the digital medium, and highlights directions for future research.

The aim of this research is to present the determinants of students' perceptions of quality and experience of study at international branch campuses in Malaysia, a country that is set to become an academic hub in Asia. This study used a multi-method approach for data collection. The respondents comprised 245 students (both undergraduate and postgraduate) from six renowned international branch campuses operating in the country--three from Australia, two from the UK and one from India. In addition, a total of 21 face-to-face interviews were conducted after the survey. The results revealed that across the seven dimensions examined concerning education and non-education qualities--university reputation/image, programme quality, lecturers and teaching quality, student learning environment, effective use of technology, counselling and academic advising support, and social life (direct/indirect) facilities--the students were largely satisfied. The paper adds to the existing body of research on higher education service quality, particularly on students' perceptions and expectations of international branch campuses.

This paper explores the views of a group of students who took an oral performance assessment in a first-year mathematics module. Such assessments are unusual for most subjects in the UK, but particularly within the generally homogenous assessment diet of undergraduate mathematics. The evidence presented here resonates with some, but not all, of the existing literature on oral assessment and suggests that, despite concerns about anxiety and fairness, students see oral assessments as encouraging a focus on understanding, being relatively authentic and reactive to their needs. We argue that, suitably implemented, oral assessment may be a viable assessment method for straddling the "assessment for" and "assessment of" learning divide in higher education.

There has been much research and discussion relating to variations in plagiaristic activity observed in students from different demographic backgrounds. Differences in behaviour have been noted in many studies, although the underlying reasons are still a matter of debate. Existing work focuses mainly on textual plagiarism, and most often derives results by studying (small) groups of overseas students studying in a Western context. This study investigates understanding of source-code plagiarism (i.e. plagiarism of computer programmes) amongst university students in China. The survey instrument was a Chinese translation of a survey previously administered in English in the UK. This paper reports the results of the exploratory survey conducted in China, and compares these results to those from a parallel survey conducted in the UK. The results show that there is a significant difference in understanding between the respondents from the two surveys, and suggest topics which a future and more comprehensive study may focus on.

Assessment and feedback remains one of the categories that students are least satisfied with within the United Kingdom National Student Survey. The Student Charter promotes the use of various formats of feedback to enhance student learning. This study evaluates the use of audio MP3 as an alternative feedback mechanism to written feedback for physiotherapy students undergoing practical viva voce assessment. In a pilot and larger study, a total of 37 students and 4 tutors were surveyed regarding their views on the use of audio feedback, with response rates of 45 and 100%, respectively. The paper reports qualitative data supporting the use of audio feedback in this context to provide prompt, detailed feedback that clarifies understanding to the students.

This paper reports on an action research project into the development of a "democratic feedback model" with students on an education studies programme at a post-1992 university in the UK. Building on work that has explored the dialogic dimensions of assessment and feedback, the research explored the potential for more "democratic" practice in this area. Although much learning and teaching on the programme in question took a collaborative and dialogic approach, assessment and feedback were modelled entirely differently, around the concept of an "expert" marker and "novice" marked. The findings of the research indicate the elements necessary for "democratic feedback", and illustrate the emotional impact of moving from more transmission-based models, grounded in notions of expertise, towards democratic practice. They also highlight the ways in which such work can alert students to the imperfect, messy and human nature of the assessment process. Although the model has limited applicability in its extant form, its constitutive elements might be usefully incorporated within existing practice to promote democratic learning.

This paper describes an investigation into the written feedback provided by tutors on Language assignments, together with students' responses to it. The study replicates a previous study of assignment feedback in Technology, in order to determine the extent to which the characteristics underlying common feedback practice and students' perceptions of effective feedback vary according to discipline. Drawing on two Spanish modules, the researchers analysed over 4000 feedback comments on 72 scripts, identifying their "category" and "depth" in accordance with the classification used in the Technology study. With regard to "categories," it was found that Language tutors' comments related more to skills development than to content, the opposite tendency to that observed in Technology. With regard to "depth," corrections formed a lower proportion of Language tutors' comments, but the proportions indicating errors and providing explanations were both greater than in Technology. This analysis was followed by interviews with 20 of the students whose assignment feedback had been analysed. The differences and similarities between the ways feedback is perceived by students of Languages and Technology are discussed. The authors conclude that a methodological approach involving cross-subject replication is a powerful means of uncovering subject-specific assumptions on assignment feedback.

Group projects are recognised as effective means of engaging students with work-related skills and promoting cooperative learning. This paper reports findings of a small survey--a group project designed to reduce problems associated with the process of production of group goods and services: free-riding and monitoring participation level. The survey elicits information on students' perception of the group project, random group membership and intra-group random selection of presenters of their group report. A compilation of summary statistics of the survey data shows that the design and evaluation of the project helped to reduce free-riding and incentivised students to monitor the group members' level of commitment to the project as well as their understanding of the assignment. (Contains 1 table and 2 notes.)

In the biosciences, a professional placement experience in academia or industry is intended to contribute to a student's personal and professional training. While there is a general acknowledgement that a placement experience is beneficial for students, recent years have seen a decline in the number of students choosing to go on placements. Using a mixed-method research design, this paper explores the attitudes that influence the bioscience students' decisions on whether or not to undertake a year in a professional placement. Other questions considered in this study were whether placements influence student attitudes towards learning and if students achieve a better degree classification and better employment because of placement. Perspectives from academic staff and employers were compared with student perspectives on the added value of undertaking an extended placement during a period of study at university. While our findings reaffirm some of the perceived advantages of a professional placement in terms of learning and employability, it identifies important factors that influence student decisions not to undertake placements, revealing interesting questions on the placement perspectives between the student, academic tutor and employer. (Contains 6 tables and 1 figure.)

This paper explores incentives for students to engage with continuous learning outside the classroom, i.e. independent study. Two questionnaires were completed with undergraduate students, asking them quantitative and qualitative questions regarding their engagement (or lack thereof) with weekly readings which are non-assessed and non-monitored. The questionnaires identified that the majority of students do not complete the readings despite a consensus that they are crucial for understanding the course material. The two primary reasons expressed for not undertaking independent study are lack of "assessment" or time-bound deadlines and poor "access" to reading material. Students were also asked to imagine potential incentives to encourage the completion of weekly readings, and then ranked these ideas in the second questionnaire. The two proposals with a majority of student support are the introduction of assessment measures to incentivise weekly readings (albeit with some student opposition to such an interventionalist approach) and the introduction of mechanisms that provide greater access to learning materials. These findings introduce the role of "access" as a key mechanism to stimulate independent study, thus challenging the literature's emphasis on assessment as the primary means to facilitate learning. (Contains 4 figures and 2 notes.)

Creation of multimedia (MM) could be a valuable diversification of assessment methods within non-technical modules. The apparent popularity of sites based on user-generated video content such as YouTube and also of podcasting suggests that relevant skills and interest are becoming more mainstream. Translating book learned knowledge into visual forms involves a specific type of intellectual challenge. It seems possible that generating short MM presentations will increasingly come to be part of organisational communication, making it an increasingly authentic form of assessment. It could simply be a fun and creative variant of the group presentation. However, there is an entrenched cultural suspicion of the visual as superficial. The "technical skills" involved may give unfair advantage to some students. Any change process is likely to meet resistance and raise novel and unexpected obstacles to its perception as a fair form of assessment. The paper explores these issues and outlines the investigation of them in the MAIK (Multimedia Assessment In Knowledge) action research project. It discusses in detail justifications for the design of the assessment task in this context, evaluates the success of this structure and reflects on what was learned from the project about the issues. (Contains 1 table.)

While there is considerable research on the first-year experience, much less has been written about the impact of assessment and feedback practices on that experience. This paper explores how formative assessment and feedback might be used to enhance the first-year experience and enable students to develop the skills needed for self-regulated learning. It also explores how technology might support formative assessment practices in the current higher education context, where modularisation, larger student numbers and lower staff-student ratios have all reduced opportunities for formative support. A framework is proposed for the design of large-cohort first-year courses based on two recent literature reviews. This provides a lens through which to analyse two first-year courses (Psychology and French) that were redesigned with funding from the Re-engineering Assessment Practices (REAP) project. Evaluations show that both course redesigns resulted in high levels of student satisfaction, in performance improvements in final exams when compared with previous years and in workload efficiency gains brought about by the application of technology. Ways of improving on these designs based on the proposed framework are discussed. (Contains 4 tables.)

Students' response to the feedback they receive on written assignments is an important but relatively under-researched aspect of teaching and learning. This paper presents an analysis of over 3000 written comments made on 106 assignments in three course modules in a Technology faculty, and also the results of telephone interviews with 43 of the students whose commented assignment had been analysed. The interviews explored how usable students found the comments, including their response to specific comments that their tutor had made on the assignment. When the results from the interviews were matched to the types of comment found in the analysis, it became apparent that students find some types of comment considerably more usable. These findings are discussed in the light of the current state of assessment practice, and possible future avenues for research in this area are suggested. (Contains 4 tables.)

Students need to understand assessment processes in order to succeed in higher education. However, recent research has identified how difficult it is for students to become absorbed into the assessment culture of their disciplines, with a recognition that providing written criteria and grade descriptors is not enough to make this tacit "knowledge" transparent to novice students. This paper reports on an exercise where sports studies students used assessment criteria to mark their peers work coupled with an assessment of their peer marking and feedback comments. The latter was included to encourage students to engage seriously with the peer assessment. Analysis of the data indicates considerable benefits for the students in terms of use of criteria, awareness of their achievements and ability to understand assessment feedback.