1. Transparent modeling of influenza incidence: Big data or a single data point from psychological theory?
- Author
-
Konstantinos V. Katsikopoulos, Özgür Şimşek, Gerd Gigerenzer, and Marcus Buckmann
- Subjects
Point (typography) ,Computer science ,Heuristic ,business.industry ,SDG 16 - Peace, Justice and Strong Institutions ,05 social sciences ,Big data ,Google Flu Trends ,Recency ,Overfitting ,Data science ,Simple heuristics ,0502 economics and business ,Psychological Theory ,Benchmark (computing) ,Naïve forecasting ,050207 economics ,Business and International Management ,Heuristics ,business ,050205 econometrics ,Simple (philosophy) - Abstract
Simple, transparent rules are often frowned upon while complex, black-box models are seen as holding greater promise. Yet in quickly changing situations, simple rules can protect against overfitting and adapt quickly. We show that the surprisingly simple recency heuristic forecasts more accurately than Google Flu Trends (GFT) which used big data analytics and a black-box algorithm. This heuristic predicts that “this week’s proportion of flu-related doctor visits equals the proportion from the most recent week.” It is based on psychological theory of how people deal with rapidly changing situations. Other theory-inspired heuristics have outperformed big data models in predicting outcomes, such as U.S. presidential elections, or other uncertain events, such as consumer purchases, patient hospitalizations, and terrorist attacks. Heuristics are transparent, clearly communicating the underlying rationale for their predictions. We advocate taking into account psychological principles that have evolved over millennia and using these as a benchmark when testing big data models.
- Published
- 2022
- Full Text
- View/download PDF