Search

The paper reports an evaluation exercise led on behalf of the Regione of Lombardy during the years 2009-2011. Authors evaluated a set of regional programs (le "doti", lite rally "dowries") aimed at the employment of various categories of disadvantaged individuals. Treated subjects would receive a voucher, by which they could access a set of employment-oriented services by a set of providers, both public and private, certified by the Regione. The evaluation exercise was aimed at ranking the service providers on the basis of their effectiveness. First, the paper describes the data provided to the evaluation group, and a set of problems related to the program design. Then, the statistical models are presented: two version of a multilevel random effect models, and a model of analysis of the productive efficiency frontier (DEA). Finally, the paper explains why the ranking provided by the models cannot be used operationally, and what can be done to overcome the problems and get a satisfying evaluation of important public policies such as the one considered. [ABSTRACT FROM AUTHOR]

The paper discusses the evolution of public performance evaluation from the early nineties to the present, age of the so-called spending review. It is a re-reading of facts with an operational dimension, also to orient future choices and the growth of the country, promoting policies for the development of productive public spending and acknowledging merit. [ABSTRACT FROM AUTHOR]

Research and innovation policies have been increasingly ascribed to regions as a con- sequence of devolving power and resources from the national level to the local level. Local administrators have been empowered with new and challenging responsibilities but often lack the necessary instruments and knowledge to adequately evaluate the under- taken initiatives and to operate consistently with the European and national dimensions. In this respect impact assessment brings in a new metrics that is neither exclusively related to the scientific and/or economic value of the innovation results nor to a support function to other policies. Experts and/or ad hoc organisations are often appointed by local administrations with the task of describing the dimensions of such impact - qualifying (and quantifying) its descriptive parameters and identifying interested parties. So far this approach has not produced robust results as for the causality links generated, the additionality issue and the role of the local dimension, while the available tool-box is quite poor. This paper is intended to illustrate the results of a pilot experience carried out in the last few years in Trentino. The analysis takes into account the relations among policy makers, available tools, resources, and the role of the public administration and of professional evaluators. Conceptual and interpretative approaches and tools need further development, but the mayor weakness seems to come from the relationship between customer-and evaluators. A new market based on new rules, professional roles and shared behaviours is needed in order to address a correct evaluation pathway and to analyse policies and activities within a common frame. [ABSTRACT FROM AUTHOR]