Designing and Testing Evaluation Tools to Inform Foundation Education Reforms and Build Grantee Capacity. WCER Working Paper No. 2010-1

Beginning in 2002, The Chicago Community Trust embarked on an ambitious grant- making strategy to improve education outcomes primarily in the city of Chicago and Cook County, Illinois. Known as The Education Initiative, this effort focused on three priority grant areas: literacy, professional development, and alternative models of schools. In June, 2005 (the 3rd year of the initiative), the Trust awarded a contract to researchers at the University of Wisconsin-Madison, Wisconsin Center for Education Research (WCER) to assess the impact of the Education Initiative. During the 3rd year of the evaluation, the program officers and evaluators were especially interested in pilot testing evaluation guidelines that were developed as part of the overall evaluation of the Education Initiative. These guidelines and related evaluation reporting tools were intended to help grantees tailor projects to the foundations priorities, and help the foundation assess the impact of their diverse grant activities. The authors report on the design and pilot testing of the evaluation guidelines and reporting tools developed to support the education program of the Trust. The next section describes the impetus for developing these tools and the evaluation findings that informed their design. In the fourth section, the authors briefly describe the pilot study design and the participants. They also report findings from the pilot study. In the final section, they describe implications for use of the guidelines and tools by the Trust and other foundations. Appendices include: (1) Draft CCT Evaluation Guidelines; (2) Draft Evaluation Plan Template; and (3) Logic Model Example Adapted from BSF Grantee Model. (Contains 1 table, 7 footnotes, and 2 figures.) [This paper was written with Katie Herrem.]