Back to Search Start Over

Online Reviews Are Leading Indicators of Changes in K-12 School Attributes

Authors :
Linsen Li
Aron Culotta
Douglas N. Harris
Nicholas Mattei
Source :
Grantee Submission. 2023.
Publication Year :
2023

Abstract

School rating websites are increasingly used by parents to assess the quality and fit of U.S. K-12 schools for their children. These online reviews often contain detailed descriptions of a school's strengths and weaknesses, which both reflect and inform perceptions of a school. Existing work on these text reviews has focused on finding words or themes that underlie these perceptions, but has stopped short of using the textual reviews as leading indicators of school performance. In this paper, we investigate to what extent the language used in online reviews of a school is predictive of changes in the attributes of that school, such as its socio-economic makeup and student test scores. Using over 300K reviews of 70K U.S. schools from a popular ratings website, we apply language processing models to predict whether schools will significantly increase or decrease in an attribute of interest over a future time horizon. We find that using the text improves predictive performance significantly over a baseline model that does not include text but only the historical time-series of the indicators themselves, suggesting that the review text carries predictive power. A qualitative analysis of the most predictive terms and phrases used in the text reviews indicates a number of topics that serve as leading indicators, such as diversity, changes in school leadership, a focus on testing, and school safety.

Details

Language :
English
Database :
ERIC
Journal :
Grantee Submission
Publication Type :
Conference
Accession number :
ED652691
Document Type :
Speeches/Meeting Papers<br />Reports - Research
Full Text :
https://doi.org/10.1145/3543507.3583531