Search

This paper is concerned with the interlocking of democratic values and evaluation systems. A central issue in evaluation has been adherence to democratic values by speaking truth to power or taking an inclusive approach to evaluands. In parallel with these democratic endeavours, evaluation design has increasingly moved from ad-hoc evaluations toward evaluation systems. The question we raise in this paper is how compatible the democratic endeavours of evaluation are with the rise of evaluation systems as the modus operandi. We apply this question to the case of the Swedish school system and its built-in evaluation system: systematic quality work (SQW). In order to explore the research question, school principals were asked to articulate how the democratic mission is visible in their SQW. The results indicate that prominent managing logics at different school levels seem to affect how well democratic values are incorporated into the SQW, highlighting the need to address the institutional and governing setting of evaluation systems in combination with the actors’ roles and decisions in accordance with the democratic evaluation literature.

Evaluation has grown in both volume and scope across levels and sectors in recent decades, particularly in the school sector. Despite this growth, there is insufficient knowledge about how and in what ways evaluations are formed, institutionalized and used in education governance and education reforms. This thesis addresses some of these issues by studying evaluation policy. The aim of the thesis is to explore and analyse the design and possible changes in national evaluation policy in compulsory education during two periods of extensive education reforms (1988-1994 and 2008-2014). The theoretical framework builds on evaluation research and policy studies, particularly the literature on policy design. These two strands of literature are supplemented with additional analytical tools from historical institutionalism regarding policy change. Drawing on previous research, a definition of evaluation policy that incorporates the policy context and also enables studying an implicit policy is proposed. On the empirical level, the findings are based on official policy documents, material produced by national government agencies as well as evaluations and evaluation systems. The thesis shows that during the first period (1988-1994), the evaluation policy was characterized as a means of helping to implement the extensive reforms. Evaluations were to be conducted on all levels of the school system to promote development on each executive level. The policy design reflected evaluation as a learning and capacity-building tool. Schools and municipalities were positioned as owners and co-creators of evaluation knowledge. During the second period (2008-2014), the evaluation policy was partially revised in order to come to terms with inadequate evaluations and declining school results. The policy included more sanctions and hortatory tools, and more emphasis was placed on comparisons and rankings. The evaluation policy was based on the assumption that local actors should and will act on evaluative knowledge created by the agencies and international actors, and that they could be motivated to do so by the threat of, for example sanctions or issues of ranking and comparisons. The evaluation policy design was largely stable over time. However, three more incremental but significant changes were identified: i) the policy design element “agents and implementation structures” was altered, ii) the evaluation policy expanded and iii) became more directed towards national and external control. These changes also indicated more negative implications for democracy during the second period. In relation to evaluations’ democratic function the analysis showed that the evaluation policy mainly strengthened the legitimizing and controlling function, whereas the enlightenment function was not prominent. This implies a risk that issues that may be relevant from a broader democratic and societal perspective may be overlooked and not subjected to evaluation. The thesis also acknowledges and illustrates the importance of uncovering and reconstructing evaluation policies, policies that are partly veiled, since also implicit policies will have democratic implications.