The PULSE Vision & Change Rubrics, Version 1.0: A Valid and Equitable Tool to Measure Transformation of Life Sciences Departments at All Institution Types

This paper describes the development and validation of the PULSE Vision & Change Rubrics, version 1.0, a reliable tool for measuring departmental change. It was found that liberal arts institutions are farther along in implementing the recommendations of Vision and Change and that institutions overall earned the highest scores on the Curriculum rubric and the lowest scores on the Assessment rubric.
The PULSE Vision & Change Rubrics, version 1.0, assess life sciences departments’ progress toward implementation of the principles of the Vision and Change report. This paper reports on the development of the rubrics, their validation, and their reliability in measuring departmental change aligned with the Vision and Change recommendations. The rubrics assess 66 different criteria across five areas: Curriculum Alignment, Assessment, Faculty Practice/Faculty Support, Infrastructure, and Climate for Change. The results from this work demonstrate the rubrics can be used to evaluate departmental transformation equitably across institution types and represent baseline data about the adoption of the Vision and Change recommendations by life sciences programs across the United States. While all institution types have made progress, liberal arts institutions are farther along in implementing these recommendations. Generally, institutions earned the highest scores on the Curriculum Alignment rubric and the lowest scores on the Assessment rubric. The results of this study clearly indicate that the Vision & Change Rubrics, version 1.0, are valid and equitable and can track long-term progress of the transformation of life sciences departments. In addition, four of the five rubrics have broad applicability and can be used to evaluate departmental transformation by other science, technology, engineering, and mathematics disciplines.