1. Aligning sampling and case selection in quantitative-qualitative research designs: Establishing generalizability limits in mixed-method studies
- Author
-
Bryan L. Sykes, Anjuli Verma, and Black Hawk Hancock
- Subjects
Cultural Studies ,validity ,replication ,sampling ,bias ,050402 sociology ,mixed methods ,05 social sciences ,050401 social sciences methods ,Sampling (statistics) ,triangulation ,Data science ,Empirical assessment ,quantitative ,0504 sociology ,Arts and Humanities (miscellaneous) ,Case selection ,Anthropology ,Statistical analyses ,qualitative ,Econometrics ,Generalizability theory ,Sociology ,generalizability ,Qualitative research - Abstract
Quantitative researchers increasingly draw on ethnographic research that may not be generalizable to inform and interpret results from statistical analyses; at the same time, while generalizability is not always an ethnographic research goal, the integration of quantitative data by ethnographic researchers to buttress findings on processes and mechanisms has also become common. Despite the burgeoning use of dual designs in research, there has been little empirical assessment of whether the themes, narratives, and ideal types derived from qualitative fieldwork are broadly generalizable in a manner consistent with estimates obtained from quantitative analyses. We draw on simulated and real-world data to assess the bias associated with failing to align samples across qualitative and quantitative methodologies. Our findings demonstrate that significant bias exists in mixed-methods studies when sampling is incongruent within research designs. We propose three solutions to limit bias in mixed-methods research.
- Published
- 2017
- Full Text
- View/download PDF