Organizational Health Literacy: Quality Improvement Measures with Expert Consensus

Background: Organizational health literacy (OHL) is the degree to which health care organizations implement strategies to make it easier for patients to understand health information, navigate the health care system, engage in the health care process, and manage their health. Although resources exist to guide OHL-related quality improvement (QI) initiatives, little work has been done to establish measures that organizations can use to monitor their improvement efforts. Objective: We sought to identify and evaluate existing OHL-related QI measures. To complement prior efforts to develop measures based on patient-reported data, we sought to identify measures computed from clinical, administrative, QI, or staff-reported data. Our goal was to develop a set of measures that experts agree are valuable for informing OHL-related QI activities. Methods: We used four methods to identify relevant measures computed from clinical, administrative, QI, or staff-reported data. We convened a Technical Expert Panel, published a request for measures, conducted a literature review, and interviewed 20 organizations working to improve OHL. From the comprehensive list of measures identified, we selected a set of high-priority measures for review by a second expert panel. Using a modified Delphi review process, panelists rated measures on four evaluation criteria, participated in a teleconference to discuss areas of disagreement among panelists, and rerated all measures. Key Results: Across all methods, we identified 233 measures. Seventy measures underwent Delphi Panel review. For 22 measures, there was consensus among panelists that the measures were useful, meaningful, feasible, and had face validity. Five additional measures received strong ratings for usefulness, meaningfulness, and face validity, but failed to show consensus among panelists regarding feasibility. Conclusions: We identified OHL-related QI measures that have the support of experts in the field. Although additional measure development and testing is recommended, the Consensus OHL QI Measures are appropriate for immediate use.