Search

As part of GCSE (General Certificate of Secondary Education) reforms in England, requirements for assessing application in science increased. Setting examination questions in context facilitates testing application as students need to apply what they know and understand to a particular situation. This research explored the nature of the contexts used in reformed GCSE combined science examinations and compared contexts used in a specification which specifically emphasises contextualised learning to those in other specifications. Eight combined science specimen examination papers were selected, including four from GCSE Twenty First Century Science (21C). A qualitative coding frame was used to code each contextualised item. Various strategies for testing in context were present. Contextual features that might risk introducing construct-irrelevant variance were infrequent but may suggest areas for attention in setter training. 21C papers included a higher proportion of items with detailed contexts and a higher proportion of items set in science-related adult/professional settings. [ABSTRACT FROM AUTHOR]

The article presents the discussion on educational research making considerable progress in describing activities promoting more effective student learning bridging the fields of educational assessment and self regulated learning.

The OECD's Programme for International Student Assessment (PISA) has become one of the key studies for evidence-based education policymaking across the globe. PISA has however received a lot of methodological criticism, including how the test scores are created. The aim of this paper is to investigate the so-called 'conditioning model', where background variables are used to derive student achievement scores, and the impact it has upon the PISA results. This includes varying the background variables used within the conditioning model and analysing its impact upon countries relatively positions in the PISA rankings. Our key finding is that the exact specification of the conditioning model matters; cross-country comparisons of PISA scores can change depending upon the statistical methodology used. [ABSTRACT FROM AUTHOR]

Systemic disruptions from COVID-19 have transformed the assessment landscape in Canada and across the world. Alongside repeated shifts to emergency remote teaching, large-scale assessments and summative evaluations were cancelled in many jurisdictions, and repeated concerns were raised about ensuring equity and access to quality education. This paper investigates the rapid – and in many cases innovative – responses teachers offered to these challenges at the height of the pandemic. Drawing on prolonged semi-structured interviews with 17 secondary school teachers in Ontario, Canada, the paper provides a detailed account of Ontario's approach to assessment during COVID-19, exemplified by participants' lived experiences. Results highlight the notion of emergency remote assessment, the vital role of assessment in stemming widening equity and well-being gaps, and emerging consequences from this period. These data offer critical insights into the future of our forever-changed education landscape, and position classroom assessment as a priority player in this work. [ABSTRACT FROM AUTHOR]

The study at the heart of this paper was conducted in 2017 to gather data on Irish post-primary teachers' conceptions of assessment at the time immediately following the introduction of a revised policy for assessment by the Department of Education and Skills (DES). Central to the reform policy was an increased emphasis on formative assessment and a requirement that teachers engage in summative assessment for certification purposes – something that had never applied previously. The paper provides an overview of the literature on teachers' beliefs, including Brown's (2004, 2006) Teachers' Conceptions of Assessment Inventory. Data from an implementation of the inventory with 489 Irish teachers are used to consider how they conceive of assessment, how these conceptions compare and contrast with those held by teachers in other jurisdictions where the instrument has been used and how the data might be used to inform policy change and implementation in Ireland. [ABSTRACT FROM AUTHOR]

The educational system in Ghana has undergone various reforms as a result of colonisation, changes in government and constitutional amendments. These reforms have been accompanied by changes in educational assessment programmes. This paper explored the history of educational assessment in Ghana, understanding how educational reforms, colonisation and political accountability have shaped the use of assessment information in contemporary Ghanaian educational context. High-stakes nature of large-scale assessment in Ghana has cultivated infertile ground for teachers' formative assessment practices. Assessment is mainly perceived as serving accountability purposes, obscuring the improvement function (i.e. formative purpose) of assessment in students' learning and fuelling ongoing tensions between classroom assessment and the more visible, higher stakes summative assessments. Research-informed assessment policy and sustained collaborative professional learning about assessment are critical to support a conceptual shift among all educational stakeholders to help them understand, value, and use formative assessment to support the learning needs of every students. [ABSTRACT FROM AUTHOR]

An editorial is presented on controversies in educational assessment continue to challenge researchers across countries and regions. Topics include aspiration for a world of peace, prosperity, and dignity where girls and women live free from discrimination; and education systems enhancing equality for all students through the large-scale assessment studies such as PISA.

With the exponential increase in the volume of data available in the 21st century, data literacy skills have become vitally important in work places and everyday life. This paper provides a systematic review of available data literacy assessments targeted at different audiences and educational levels. The results can help researchers and practitioners better understand the current state of data literacy assessments in terms of issues related to 1) educational levels and audiences; 2) data literacy definitions and competencies; 3) assessment types and item formats; and 4) reliability and validity evidence. The results from the present review led us to conclude that teaching and assessing data literacy is still an emerging field in education. Therefore, high-quality assessment tools are greatly needed to provide valuable insights for students and instructors to monitor progress as well as facilitate and support teaching and learning. [ABSTRACT FROM AUTHOR]

Assessment systems reward certainty and thrive on predictability. However, the COVID-19 pandemic has punished our assessment systems severely for over reliance on controlled premises for our high stakes assessment, and this should compel us to re-examine the reliance on certainty and control in our assessment policies and reforms. Singapore is a useful context to examine such re-examination of assessment imperatives on a national scale. The city-state typically orchestrates its major policy reform with great discipline, standardisation, and detailed co-ordination. However, such qualities may not be ideal for its assessment reform needs in the post-pandemic future. Three recent assessment reforms are examined as examples of pre-pandemic assessment policies predicated on certainty. This paper discusses whether such reforms are fit for post-pandemic purpose(s), and argues for shifting the emphasis of assessment from securing examination reliability to developing learners' assessment resilience. [ABSTRACT FROM AUTHOR]

This paper details a two-stage process for standard setting using an extended pairwise comparison method. It describes the application of a new process of establishing a set of scaled and ordered performances as a basis for exemplifying standards. In stage one, the method of pairwise comparison was used to generate data from pairwise judgements made at the criterion level and overall grade. In stage two, judges identified where the pass/fail boundary lay in relation to a selected subset of ordered performances generated from stage one. The combined evidence from the two-stage process demonstrates the method's application to establish exemplified standards using on-balance judgements across multiple criteria. The approach combines expert judgement and statistical data to provide a basis for comparable cross-institution assessments against standards in the case of a summative assessment of professional competence in teacher education. It may be relevant to any discipline with professional standards and complex performance assessments. [ABSTRACT FROM AUTHOR]

The use of internal assessment within GCSE qualifications has always aroused controversy, primarily because of concerns about the authorship of students' work. This has led to tighter controls and a reduction in its use over the last decade. The paper argues that the focus on the authentication of student work has neglected other aspects of fairness, such as ensuring that assessments elicit students' best performance. Students' accounts can contribute to our understanding of test fairness by showing what affects their performance and how these assessments are enacted within their contexts. The paper draws on a study which surveyed 1600 GCSE students and held focus groups with 128 others in Northern Ireland and Wales, in addition to data from the WISERDEducation multi-cohort study. A number of factors, including the assessment environment, reportedly affected students' performance. According to student comments, the ways in which the assessment guidelines were enacted varied considerably between contexts, with significant fairness implications. Abbreviations: CCEA: Council for the Curriculum, Examinations and Assessment; GCSE: General Certificate of Secondary Education; FG: Focus Group; FSM: Free School Meals; NI: Northern Ireland; UK: United Kingdom; UNCRC: United Nations Convention on the Rights of the Child; US: United States; WJEC: Welsh Joint Education Committee [ABSTRACT FROM AUTHOR]

In this paper, we present and discuss the results of a systematic review of concept mapping-based interventions in primary and secondary science education. We identified the following recommendations for science educators on how to successfully apply concept mapping as a method for formative assessment: firstly, concept mapping should be constructed in teaching, preferably on repeated occasions. Secondly, concept mapping should be carried out individually if personal understanding is to be elicited; however, collaborative concept mapping might foster discussions valuable for developing students' understanding and for activating them as instructional resources and owners of their own learning. Thirdly, low-directed mapping seems most suitable for formative assessment. Fourthly, technology-based or peer assessments are useful strategies likely to reduce the load of interpretation for the educator and are compatible with timely feedback. Finally, elaboration should be part of the feedback, activating students as the owners of their own learning. [ABSTRACT FROM AUTHOR]

Diverse strategies for marking GCSE examinations have been identified, ranging from simple automatic judgements to complex cognitive operations requiring considerable expertise. However, little is known about patterns of strategy usage or how such information could be utilised by examiners. We conducted a quantitative analysis of previous verbal protocol data collected from twelve experienced examiners using a concurrent 'think aloud' method. Two contrasting examination papers had been marked: mathematics and business studies. Five senior examiners were interviewed about the findings. The analysis revealed differences in strategy usage among individual examiners, but most strikingly, between subjects and among question parts. For most questions, examiners used strategy combinations rather than single strategies. Business studies question parts could be categorised according to whether they entailed simple or complex strategies. However, most mathematics question parts entailed a mixture of diverse strategies. The examiners identified potential implications of the findings for examiner training and modernising marking systems. [ABSTRACT FROM AUTHOR]

Education systems are increasingly being called upon to implement new technology-based assessment systems that generate efficiencies, better meet changing stakeholder expectations, or fulfil new assessment purposes. These assessment systems require coordinated organisational effort to implement and can be expensive in time, skill and other resources. This paper explores the nexus between assessment planning and organisational strategy in the context of technology-based assessment implementation. Two planning tools, an Assessment Planning and Review Framework (the Framework) and an Assessment-Capability Matrix (the Matrix), are provided to assist organisations to manage this nexus. The Framework is a reformulation of prominent assessment design frameworks, developed for a broader, interdisciplinary audience. Its extension through the incorporation of organisational capability concerns led to the development of the Matrix. The Framework and the Matrix create an interface from principled assessment design to organisational strategy that is explored through five predominantly technology-based assessment design pathways. [ABSTRACT FROM AUTHOR]

Exploiting the potential that Assessment for Learning (AfL) offers to optimise student learning is contingent on both teachers’ knowledge and use of AfL and the fidelity with which this translates into their daily classroom practices. Quantitative data derived from the use of an Assessment for Learning Audit Instrument (AfLAI) with a large sample (n = 594) across 42 primary schools in the Republic of Ireland serve to deprivatise teachers’ knowledge and use of AfL and the extent to which AfL is embedded in their work. The data confirm that there is urgent need for high-quality teacher professional development to build teacher assessment literacy. However, fiscal constraints coupled with the fractured nature of current provision renders it impossible to offer sustained support on a national scale in the immediate term. In response, this paper proposes the adoption of a design-based implementation research approach to site-based collaborations between researchers, teachers and other constituent groups, such as that engaged in by the authors over recent years, as a mechanism for addressing teachers’ needs in a manner that also supports other participants’ professional interests. [ABSTRACT FROM PUBLISHER]

Teachers require specialised assessment knowledge and skills in order to effectively assess student learning. These knowledge and skills develop over time through ongoing teacher learning and experiences. The first part of this paper presents a Summative Assessment Literacy Rubric (SALRubric) constructed to track the development of secondary science teachers’ summative assessment literacy. The analytic rubric consists of 10 dimensions spread across three categories drawn from the literature and context-specific empirical evidence: knowledge of assessment, understanding the context for assessment, and recognising the impact of assessment. The second part of this paper applies the SALRubric in a case study to explore the development of summative assessment literacy of New Zealand secondary science pre-service and novice teachers. An increasing sophistication in these teachers’ summative assessment literacy was evident over 20 months albeit in a nuanced manner for individual teachers. The rubric was a very useful tool for evaluating and documenting shifts in teachers’ summative assessment literacy over time. Implications of the use of SALRubric are discussed in terms of summative assessment literacy practice and development. [ABSTRACT FROM PUBLISHER]

In a context of increasing demand for quality and equity in education and a sharp focus on accountability, classroom teachers are also expected to support and improve learning outcomes for pupils in response to their individual needs. This paper explores three issues: how teachers understand assessment in relation to their students’ learning, the curriculum and their pedagogical choices; how teachers’ capacity to use assessment to improve students’ learning can be developed through career-long professional learning (CLPL); and how teachers’ learning can be implemented and sustained in schools, both locally and nationally. In considering these issues, recent thinking about learning and assessment and CLPL are considered alongside empirical evidence from the development and implementation of assessment processes and approaches to professional development in Scotland. The paper emphasises the importance of a dynamic framework of CLPL that recognises the individuality of teachers’ learning needs and the consequent need for tailored professional learning opportunities with different combinations of support and challenge at school, local and national levels. [ABSTRACT FROM PUBLISHER]

An achievement test score can be viewed as a joint function of skill and will, of knowledge and motivation. However, when interpreting and using test scores, the 'will' part is not always acknowledged and scores are mostly interpreted and used as pure measures of student knowledge. This paper argues that students' motivation to do their best on the assessment - their test-taking motivation - is important to consider from an assessment validity perspective. This is true not least in assessment contexts where the assessment outcome has no consequences for the test-taker. The paper further argues that the quality of assessment of test-taking motivation also needs attention. Theoretical and methodological issues related to the assessment of test-taking motivation are presented from a validity perspective, and findings from empirical studies on the relation between test stakes, test-taking motivation and test performance are presented. [ABSTRACT FROM AUTHOR]

In alignment with the New Academic Structure, the Hong Kong Diploma of Secondary Education Examination (HKDSE) was launched in 2012 to replace the former Hong Kong Certificate of Education Examination (HKCEE) as certification for completion of secondary education, and the Hong Kong Advanced Level Examination (HKALE) as the main credentials for university admission in Hong Kong. Standards-referenced reporting is adopted for the HKDSE with the objective of reporting candidates' results against a set of prescribed levels of achievement based on typical performances at those levels. Clearly defined standards facilitate learning and teaching as well as enable users of the qualification, including tertiary institutions and employers, to set appropriate entrance/job requirements. The standards are set and maintained by expert judgement supported by psychometric data to ensure fairness and consistency of standards across subjects and across cohorts. Systemic and implementation issues and their resolutions are discussed in the context of the education reform in Hong Kong. [ABSTRACT FROM AUTHOR]

This paper analyses the psychometric paradigm for understanding educational measurement and standard setting by considering the extent to which that understanding is based on metaphors. I argue that through the metaphors 'more is up' and 'good is up' we spatialise concepts that are not intrinsically spatial. Human abilities form a distinct conceptual category, with complex and varying rules for the correct usage of different ability terms. The fact that most abilities can be discussed in terms of both 'possession' and of 'more or less' invites reification, spatialisation, and hence the application of measurement metaphors. Insights into the measurement of abilities can be gained by careful consideration of how ability terms are used in normal discourse, especially of athletic abilities which are partly quantified in terms of attributes that are physically measureable. The fuzziness of natural language creates some of the problems in understanding standards in both psychometrics and physical measurement. [ABSTRACT FROM AUTHOR]

Equity in assessment concerns all educational authorities and practitioners. While educators commonly consider issues of equity in terms of accommodations for students with special needs, or addressing cultural difference, equity issues in educational assessment have emerged outside these bases. This paper examines equity assessment issues, drawing predominantly on case history from the United States of America (US) with examples from Australia and England, to demonstrate areas that may draw legal consideration. The discussion shows that the legal standard to establish inequity is high and sometimes illogical from an educational perspective. The paper is intended to assist understanding of legal implications of educational assessment in order to reduce the likelihood of legal claims and the resultant redirection of valuable resources from educational provision. The discussion is also intended to broaden thinking on matters that impact on the provision of equitable educational and assessment opportunities for all students. [ABSTRACT FROM AUTHOR]

In this paper, I will argue that it is possible to use data from large‐scale international and national mathematics assessment programmes, whose attention is on summative achievement, to provide formative information that informs teachers about the effects of their classroom practice. However, to have impact on, and be useful for, classroom practitioners, these achievement data need to be reworked and re‐presented in ways that are plausible, provide a basis for inferences about practice, and be appropriate for the intended audience. This paper examines achievement‐focused assessment programmes in terms of their aims and approaches, and develops the argument that formative assessment possibilities are present, within these programmes, although usually hidden. Examples are drawn from several sources to support this argument, and demonstrate a variety of approaches that have been taken in the past. Suggestions for further action are made. [ABSTRACT FROM AUTHOR]

This paper focuses on reconfiguring assessment processes so that they support a learning function, in addition to the more traditional measurement function. In the first half of the paper we discuss a framework for ‘learning‐oriented assessment’ derived from a project carried out in Hong Kong. We conceptualize learning‐oriented assessment as containing three key components: assessment tasks as learning tasks; student involvement in assessment; and explicitly forward‐looking feedback. The second half of the paper presents an action research case in which the first author implemented some of the principles of learning‐oriented assessment within a module in a teacher education context. The module, focusing on multimedia and web authoring, was taught through blended learning with an emphasis on peer learning and project‐based learning. A particular feature was the interplay between students’ learning experiences and the module assessments. [ABSTRACT FROM AUTHOR]

This paper analyses aspects of a Hong Kong school curriculum reform, which recommends amongst other things, a greater focus on assessment for learning. It outlines the principles of the reform as it pertains to assessment and discusses how structural changes are being employed to lend support to changes in the assessment culture in Hong Kong. The paper draws on a previous problematic attempt to introduce formative assessment through the Target-Oriented Curriculum initiative. Two examples of assessment for learning practice of 'early adopters' are used to illustrate both the potential and some of the challenges of implementation in the Hong Kong primary school context. From these cases, are drawn out some of the facilitating and inhibiting factors impinging on the implementation of assessment for learning in schools, building on a model of professional growth. [ABSTRACT FROM AUTHOR]

Whilst there is evidence of significant investment in policy-led initiatives to raise attainment in schools, there is rather less evidence of the positive impact of such initiatives. In this paper we explore stakeholder views of recent initiatives in assessment in Scotland in an attempt to discern the relationships between assessment policy, research and practice in schools. Against a background of major assessment initiatives and by drawing on data from two national consultations, the paper illustrates the complexities inherent in following advice for policy developments to begin from where people are now. Finally, the paper explores the possibility of a new assessment journey for researchers, teachers and policy-makers, one which acknowledges the complex process of community-based transformational change. [ABSTRACT FROM AUTHOR]

Marking reliability is purported to be produced by having an effective community of practice. No experimental research has been identified which attempts to verify empirically the aspects of a community of practice that have been observed to produce marking reliability. This research outlines what that community of practice might entail and presents two experimental studies on the effects of particular aspects of community of practice on examiners' marking reliability. In the first study, the impact of exemplar work is investigated: examiners were provided with mark schemes and some examiners were provided with exemplar scripts and given feedback about the marking of those scripts. In the second study, the effects of discussion of the mark scheme are explored: all examiners received mark schemes and exemplar scripts, but some examiners did not attend a coordination meeting. Neither procedure (use of exemplar scripts or discussion between examiners) demonstrated an improvement in marking reliability, which called into question the predictive utility of the theory of community of practice. [ABSTRACT FROM AUTHOR]

New Zealand's defined coastal boundaries, isolation and small population were favourable factors to minimise the spread of COVID-19. Decisive governmental leadership and a public willing to comply with high-level lockdown in the first phase, resulted in minimal disruption to assessment. But as the pandemic progressed through Delta and Omicron variants, concerns grew about equitable access to assessments, declining school attendance, and inequitable educational outcomes for students, especially of Māori and Pacific heritage. School and educational agency experiences of high stakes assessment in a period of uncertainty were examined through document analysis and research interviews. Using Gewirtz's contextual analysis of the multi-dimensional and complex nature of justice, and Rogoff's conceptual framework of three planes of socio-cultural analysis: the personal (learner), inter-personal (school) and institutional (educational agencies), revealed that though collaborative adaptations minimised assessment disruptions on wellbeing and equity of access, they did not transform high stakes assessment. [ABSTRACT FROM AUTHOR]

Singapore’s education system has often been characterised as exam-oriented. This paper describes efforts (‘windmills’) made by the Government to constructively respond to the ‘winds of change’ in the education system. A committee called the Primary Education Review and Implementation (PERI) Committee was appointed to study and recommend the priorities, programmes and resources needed to revise primary education in Singapore. The Committee recommended that a balanced school-based assessment system that provides constructive feedback, enabling more meaningful learning in support of both academic and non-academic aspects of a pupil’s development, be carried out under the label of ‘Holistic Assessment’. This paper is an attempt at surfacing the challenges (‘walls’) in implementing ‘Holistic Assessment’ on a large scale, highlighting in particular, the tensions perceived by stakeholders concerning the interaction between formative assessment and accountability systems. It documents how stakeholders, namely teachers and parents, perceive and typify the concept of ‘Holistic Assessment’. The findings provide insights into the consequent realities of a nationwide shift in assessment purpose and discourse on teachers and parents. [ABSTRACT FROM PUBLISHER]

This paper examines assessment policies for K-12 education in Ontario, Canada. We begin with a discussion of Ontario's education system, and then turn our focus to Ontario's K-12 assessment policies serving multiple purposes for accountability and classroom learning. We first examine the Educational Quality and Accountability Office (EQAO), which is responsible for Ontario's province-wide literacy and numeracy assessments by focusing on the nature of its educational stakes, its implications for Ontario's diverse student populations and its alignment with Ontario's curriculum. We then turn to Ontario's policies geared towards classroom-based, teacher-led assessments, such as the Growing Success initiative and the Steps to English Proficiency assessment framework. Together, these policies coexist and function like a double-edged sword for teachers because of conflicting expectations and roles. We conclude with some suggestions for further enhancing Ontario's assessment policies through the integration of technology and building of teachers' assessment competencies. [ABSTRACT FROM AUTHOR]

Since our 1998 review of research on classroom assessment and learning was published, we have contributed to theorising formative assessment, but recognise that this work is incomplete. In this paper, we take up a suggestion by Perrenoud that any theory of formative assessment must be embedded within a wider theoretical field, specifically, within a theory of pedagogy. We propose a model whereby the design of educational activities and associated assessments is influenced by the theories of pedagogy, instruction and learning, and by the subject discipline, together with the wider context of education. We explore how teachers may develop productive relationships between the formative and summative functions of classroom assessment, so that their judgements may inform the formal external assessment of students, thus increasing the validity of those assessments. We also show how the model informs the development of theories that give appropriate weight to the role of assessment as part of pedagogy. [ABSTRACT FROM AUTHOR]

In recent years, school-based assessment (SBA) has been incorporated into the English Language subject of a traditional high-stakes public examination, the Hong Kong Certificate of Education Examination. As reactions from various stakeholder groups have been mixed, it was necessary to review this new practice. This paper reports on a study of 33 English language teachers who have been frontline SBA assessors. The study aimed to better understand (1) teacher-assessors’ perceptions of the English SBA, (2) their professional development needs in relation to implementing SBA, (3) their perceptions of how students could benefit from SBA and (4) the pressing issues arising from the SBA implementation. The study found that, while many participants agreed that SBA could be beneficial to students’ English learning, there was much room for improvement in all four aspects investigated. In particular, some problems identified at the very beginning of the implementation of the English SBA have still persisted. [ABSTRACT FROM PUBLISHER]

Norway has seen major changes in the field of educational assessment over the past decade, following the 2001 ‘PISA shock’ that stimulated reform of the entire primary and secondary education systems: new outcome-based curricula with cross-disciplinary basic skills were accompanied by major revision of assessment regulations, comprehensive government projects promoting formative assessment, national tests as a main component in a new national quality assessment system and new regulations for examinations and teacher reporting of overall achievement marks. The paper provides a historical context to the country’s prohibition of formal marking in primary education and the recent tensions determining how assessment criteria should be stated and used for formative and summative purposes. It is argued that Norwegian primary and secondary education is riddled with unresolved tensions as to the role of assessment criteria and national tests, sparked by incremental implementation of assessment policies and principles accompanying the new outcomes-based curricula. [ABSTRACT FROM PUBLISHER]

Aligning curriculum change and assessment reforms has been a topic of great concern in Namibia for over the past 23 years. This is because during the pre-colonial period and continuing in post-independence Namibia, national examinations have been used mainly for the certification and selection of learners at Junior and Senior secondary school phases. Despite this, there is great need to align curriculum changes, standards and assessment in Namibia, since this is viewed as critical for the effectiveness of any education system. Hence, this paper attempts to cross-examine the challenges associated with curriculum alignment issues, changes and assessment reforms in Namibia. This was done by reviewing and analysing relevant documents such as curriculum, policies and examination results among others. Particular attention is paid to the Junior and Senior secondary school levels due to the fact that at these phases there are two major national terminal examinations. [ABSTRACT FROM PUBLISHER]

Building assessment capacity of educators has historically been unregulated practice in post-independence Malawi. However, recent attempts by government to integrate curriculum and assessment reforms and the introduction of continuous assessment in the system have represented a significant policy shift. These and several other initiatives have necessitated the empowerment, in terms of assessment knowledge and skills, of educators at different levels of the system to support implementation of the reforms. This paper discusses the strategies that Malawi has followed so far to institutionalise the development of assessment capacity and highlights the challenges that it has faced in its efforts to improve the capacity of its staff in assessment. Key lessons for other African and developing nations from the Malawian experience have also been noted. [ABSTRACT FROM PUBLISHER]

This paper contrasts the role and approach taken by the International Association for the Evaluation of Educational Achievement (IEA) with that of the OECD in the conduct of their respective large-scale assessment programmes. It is argued that the differences in the approaches taken in the conduct of the respective assessments are not merely technical in nature but rather reflect fundamental differences in the theoretical and philosophical underpinnings of the two assessment strategies. This examination addresses the issues raised by McGaw in an earlier paper in which he challenges some aspects of the approach taken by the IEA in the Progress in Reading Literacy Study (PIRLS). It suggests that despite suggestions to the contrary that some aspects of the PISA indicators programmes are not inherently unproblematic. [ABSTRACT FROM AUTHOR]

This paper explores the ways in which assessment has developed and is developing in Scotland. The article begins by providing background information on Scotland's educational system. The second section tracks the relationship between curriculum and assessment in Scotland for children aged 3-14, 14-16 and 16+. The third section explores Scotland's current attempt to develop a coherent assessment system. The fourth section focuses on the major curriculum review presently underway in Scotland and reflects on the emerging future for Scottish Education. Connections between ideas of Learning, Assessment and Excellence are explored and issues being faced by one small country trying to develop a coherent assessment system that is both just and dependable are identified. [ABSTRACT FROM AUTHOR]

In this theoretical paper the informal assessment practices of two experienced teachers are used as cases for generating questions about future developments in formative assessment practice. Both teachers maintain a consistent formative assessment focus on the development of their students as enquirers, and one of them supplements this with explicit self‐assessment activities. However, there are subject‐specific gaps in the ways in which they assess and describe their students and these are not addressed in widely promulgated advice about formative assessment. Questions are raised about how teachers might be supported to develop their assessment of subject‐specific behaviour. [ABSTRACT FROM AUTHOR]

The paper examines the rationale and the uses of portfolios in initial teacher education. This rationale is then applied to explore the development and implementation of the Professional Development Portfolio (PDP) as an integral part of the initial teacher education programme offered by the Faculty of Education, University of Malta. The paper considers the responses of students and lecturers to this mode of assessment; in particular, how the tensions between the formative and summative functions of portfolios were experienced and responded to at institutional level. The paper is the result of the debates and discussions among the three authors. Deborah Chetcuti and Grace Grima were directly involved in the development of the assessment innovation, Patricia Murphy was a visiting academic and external examiner during the period. [ABSTRACT FROM AUTHOR]

This paper presents the results of an experimental evaluation of a change in assessment practice in one comprehensive secondary school. The school divided 104 Year 7 pupils into four mixed-ability teaching groups. One of these was given enhanced formative feedback on their work for one year, but no marks or grades. The other three groups were given marks and grades with minimal comments, which was the usual prior practice in this school (and many others). Using data derived from assessment, prior attainment, pupil attitudes and background information, we conducted a contextualized analysis of progress in the four teaching groups for all subjects. This showed that progress in the treatment group (formative feedback only) was substantially inferior to that of the other three groups. In this paper, we also use data from observation of the process and from group interviews with the students involved, to help explain these results. Our findings are relevant to a consideration of the often lessened impact of research findings when 'rolled' out into wider practice, and what may be done about this. [ABSTRACT FROM AUTHOR]

This paper reports the initial results of a study that was designed to develop and rest an instrument that could identify the elements of an individual's capacity for lifelong learning. We anticipated that the components of this capacity would include a complex mix of dispositions, lived experiences, social relations, values, attitudes and beliefs and that these various factors would coalesce to shape the nature of an individual's engagement with any particular leaning opportunity. The instrument that was developed—the Evaluating Lifelong Learning Inventory—was trialled with pupils across a range of ages and subject to factor analytic study. The data have proved robust over successive factor analytic studies, allowing the identification of seven dimensions of learning power and reliable scales to assess these. These dimensions appear to be capable of differentiating between efficacious, engaged and energized learners and passive, dependent and fragile learners. Whilst further, larger scale field trials will be necessary to confirm these early results, the findings would appear to have significant implications for conventional models of curriculum design and classroom practice. [ABSTRACT FROM AUTHOR]

Teacher education is a hotly debated policy area in higher education and schooling portfolios, with increasing emphasis on standards and accountability. It is in this environment thatThe Standards Project(2013–2015) presented in this article began. It has at its core a three-part commitment: first, to undertake a comprehensive audit and analysis of all teacher education programmes in the state of Queensland, Australia, to establish the approaches and practices Universities relied on to preparing beginning teachers as assessment capable; second, to take account of multiple perspectives and approaches in initial teacher education to integrating data into how beginning teachers are prepared to source and use evidence for improving learning and teaching; and further, to develop new principles, policy and practices for reviewing and moderating teacher education programmes against professional standards. The paper proposes a move beyond the discourse of professional standards of practice towards a complementary discourse of standards of evidence. In our collaboration we drew on two fields, namely the writing on teacher education including reviews, and the field of assessment, both considered within broader sociocultural theory applied to assessment. [ABSTRACT FROM PUBLISHER]

This article provides an analysis of the integration of assessment for learning principles in the newly revised five-year Master of Education programme at the University of Oslo, Norway, across didactic subjects, pedagogy and school practice. The analysis draws on lecture notes, student videos and student exam papers among 143 student teachers, aiming to identify (a) the operationalisation of the assessment curriculum at the university campus, and in school practice, (b) how the student teachers use assessment principles as tools in their instructional designs and (c) how they self-assess their teaching practice. Our main finding is that student teachers seem to be more concerned with assessing their students than using self-assessment to improve their instruction. Based on the findings, we argue the importance of relating the teaching and learning activities with the assessment situations used in the teacher education programme. [ABSTRACT FROM PUBLISHER]

Through an extended commentary on the empirical articles in this special issue 'Signature Assessment and Feedback Practices in the Disciplines' we elaborate the concepts of signature assessment and signature feedback practices by developing a new taxonomy of their elements. We propose that signature assessments focus on conceptual, epistemological, social, material and/or moral dimensions of the discipline. We also propose four discipline-specific sources of feedback information, particularly highlighting what we are calling consequential feedback, which can be generated by users of disciplinary knowledge or objects. Finally, we identify three levels of feedback timings that can support students' use of feedback information: rhythms, cycles, and spirals. Based on gaps in the literature in relation to this taxonomy, we identify areas for further empirical research that will advance understanding and application of signature assessment and signature feedback practices. [ABSTRACT FROM AUTHOR]

Focuses on teachers as public examiners on mathematics papers. Development of the curriculum with teachers as the examiners of their own students; Teachers' experiences of tension between their roles as teachers and examiners; Various ways in which the teachers resolved their conflicting roles; Questions on the validity of the assessment.

This study explores lower secondary school teachers' arguments and perceptions for using a 26-point grading scale (26-PGS), and gender differences in assessment practice. An explanatory sequential design was conducted. First, teachers (n = 6) assessment of students' text (n = 182)was analysed.In the subsequent phase, an open-ended questionnaire with teachers (n = 54) was conducted and analysed. The study revealed that the teachers perceive that the 26-PGS provides precision. Teachers highlight the significance of using the 26-PGS as an alternative assessment method, aiming to foster students' growth, and as a message to motivate for learning. In addition, gender disparities in teachers' provision of grades and arguments of using a 26-PGS as part of their assessment practice were found. The study contributes to the existing literature by shedding light on teachers' assessment practice and gender differences regarding the use of grading scales and discuss its potential challenges in educational contexts. [ABSTRACT FROM AUTHOR]

In England, some secondary-level qualifications comprise non-exam assessments which need to undergo moderation before grading. Currently, moderation is conducted at centre (school) level. This raises challenges for maintaining the standard across centres. Recent technological advances enable novel moderation methods that are no longer bound by centre. This study used simulation to investigate the feasibility of using comparative judgement (CJ) for moderating non-exam assessments. Our study explored the effects of CJ design parameters on the CJ estimates of script quality and how to assign moderator marks after the CJ procedure. The findings showed that certain design parameters had substantial effects on reliability and suggested minimum values for CJ protocols. The method used for assigning moderator marks maintained the rank order of scripts within centres and calibrated the centres to a common standard. Using CJ for moderation could transform current assessment practices, taking advantage of technological developments and ensuring reliability and fairness. [ABSTRACT FROM AUTHOR]

The paper examines the breadth and quality of formative assessment implementation of 202 mathematics and science teachers who participated in a two-year, school-based professional development programme that focused on formative assessment. Results are triangulated using three sources of data: baseline and end-of-Year 2 data from an annual survey, logs that were completed daily at six two-week time points and reflections on formative assessment techniques that the teachers wrote weekly during the log collection periods. The data indicate that while teachers made significant improvements in some areas, certain aspects of formative assessment are less emphasised and there are some patterns around quality of implementation that suggest more targeted professional development is warranted. [ABSTRACT FROM PUBLISHER]

The purpose of this research was to examine the implementation of a professional learning project aimed at building educators’ knowledge and skills in assessment for learning (AfL) within two school districts in Ontario, Canada. Specifically, the research examined the value of a two-tierInstructional Rounds(IR) professional learning model. This professional learning model was unique because it engaged both teachers and principals in collaboratively learning and implementing AfL strategies in order to develop systemic capacity in assessment. In total, 12 principals, 48 teachers, two superintendents and two school district assessment consultants participated in the study. Data were collected through observations of IR sessions, classroom observations, interviews, IR session reflections and a post-project survey. Findings from this study report on positive changes in teachers’ and principals’ conceptions and implementation of AfL as well as on the value and challenges of IR as a professional learning model. The paper concludes with a discussion on developing systemic capacity in AfL through an IR model of professional learning. [ABSTRACT FROM PUBLISHER]

This paper makes the case for the need to study assessment reform processes from a broader and more complex perspective that takes the historical, ideological and systemic aspects of assessment policies into account. It draws on a larger study to demonstrate how the understanding of Assessment for Learning (AfL) reforms is enriched by such a perspective, taking the Chilean case as an illustrative example. The study draws on polysystems theory as an overarching theoretical tool and on critical discourse analysis and intertextuality as a means to reconstruct the polysystem of assessment reforms. These tools are used to analyse two types of sources: documents from different periods of Chilean history of education where reforms relevant to assessment were carried out, and interviews with policy authorities involved in the AfL reform as well as with teachers from different backgrounds and contexts. [ABSTRACT FROM PUBLISHER]