Search

Background: Paradata are (timestamped) records tracking the process of (electronic) data collection. We analysed paradata from a large household survey of questions capturing pregnancy outcomes to assess performance (timing and correction processes). We examined how paradata can be used to inform and improve questionnaire design and survey implementation in nationally representative household surveys, the major source for maternal and newborn health data worldwide., Methods: The EN-INDEPTH cross-sectional population-based survey of women of reproductive age in five Health and Demographic Surveillance System sites (in Bangladesh, Guinea-Bissau, Ethiopia, Ghana, and Uganda) randomly compared two modules to capture pregnancy outcomes: full pregnancy history (FPH) and the standard DHS-7 full birth history (FBH+). We used paradata related to answers recorded on tablets using the Survey Solutions platform. We evaluated the difference in paradata entries between the two reproductive modules and assessed which question characteristics (type, nature, structure) affect answer correction rates, using regression analyses. We also proposed and tested a new classification of answer correction types., Results: We analysed 3.6 million timestamped entries from 65,768 interviews. 83.7% of all interviews had at least one corrected answer to a question. Of 3.3 million analysed questions, 7.5% had at least one correction. Among corrected questions, the median number of corrections was one, regardless of question characteristics. We classified answer corrections into eight types (no correction, impulsive, flat (simple), zigzag, flat zigzag, missing after correction, missing after flat (zigzag) correction, missing/incomplete). 84.6% of all corrections were judged not to be problematic with a flat (simple) mistake correction. Question characteristics were important predictors of probability to make answer corrections, even after adjusting for respondent's characteristics and location, with interviewer clustering accounted as a fixed effect. Answer correction patterns and types were similar between FPH and FBH+, as well as the overall response duration. Avoiding corrections has the potential to reduce interview duration and reproductive module completion by 0.4 min., Conclusions: The use of questionnaire paradata has the potential to improve measurement and the resultant quality of electronic data. Identifying sections or specific questions with multiple corrections sheds light on typically hidden challenges in the survey's content, process, and administration, allowing for earlier real-time intervention (e.g.,, questionnaire content revision or additional staff training). Given the size and complexity of paradata, additional time, data management, and programming skills are required to realise its potential.

Background: Termination of pregnancy (TOP) is a common cause of maternal morbidity and mortality in low- and middle-income countries. Population-based surveys are the major data source for TOP data in LMICs but are known to have shortcomings that require improving. The EN-INDEPTH multi-country survey employed a full pregnancy history approach with roster and new questions on TOP and Menstrual Restoration. This mixed methods paper assesses the completeness of responses to questions eliciting TOP information from respondents and reports on practices, barriers, and facilitators to TOP reporting., Methods: The EN-INDEPTH study was a population-based cross-sectional study. The Full Pregnancy History arm of the study surveyed 34,371 women of reproductive age between 2017 and 2018 in five Health and Demographic Surveillance System (HDSS) sites of the INDEPTH network: Bandim, Guinea-Bissau; Dabat, Ethiopia; IgangaMayuge, Uganda; Kintampo, Ghana; and Matlab, Bangladesh. Completeness and time spent in answering TOP questions were evaluated using simple tabulations and summary statistics. Exact binomial 95% confidence intervals were computed for TOP rates and ratios. Twenty-eight (28) focus group discussions were undertaken and analysed thematically., Results: Completeness of responses regarding TOP was between 90.3 and 100.0% for all question types. The new questions elicited between 2.0% (1.0-3.4), 15.5% (13.9-17.3), and 11.5% (8.8-14.7) lifetime TOP cases over the roster questions from Dabat, Ethiopia; Matlab, Bangladesh; and Kintampo, Ghana, respectively. The median response time on the roster TOP questions was below 1.3 minutes in all sites. Qualitative results revealed that TOP was frequently stigmatised and perceived as immoral, inhumane, and shameful. Hence, it was kept secret rendering it difficult and uncomfortable to report. Miscarriages were perceived to be natural, being easier to report than TOP. Interviewer techniques, which were perceived to facilitate TOP disclosure, included cultural competence, knowledge of contextually appropriate terms for TOP, adaptation to interviewee's individual circumstances, being non-judgmental, speaking a common language, and providing detailed informed consent., Conclusions: Survey roster questions may under-represent true TOP rates, since the new questions elicited responses from women who had not disclosed TOP in the roster questions. Further research is recommended particularly into standardised training and approaches to improving interview context and techniques to facilitate TOP reporting in surveys.

Background: An estimated 5·1 million stillbirths and neonatal deaths occur annually. Household surveys, most notably the Demographic and Health Survey (DHS), run in more than 90 countries and are the main data source from the highest burden regions, but data-quality concerns remain. We aimed to compare two questionnaires: a full birth history module with additional questions on pregnancy losses (FBH+; the current DHS standard) and a full pregnancy history module (FPH), which collects information on all livebirths, stillbirths, miscarriages, and neonatal deaths., Methods: Women residing in five Health and Demographic Surveillance System sites within the INDEPTH Network (Bandim in Guinea-Bissau, Dabat in Ethiopia, IgangaMayuge in Uganda, Matlab in Bangladesh, and Kintampo in Ghana) were randomly assigned (individually) to be interviewed using either FBH+ or FPH between July 28, 2017, and Aug 13, 2018. The primary outcomes were stillbirths and neonatal deaths in the 5 years before the survey interview (measured by stillbirth rate [SBR] and neonatal mortality rate [NMR]) and mean time taken to complete the maternity history section of the questionnaire. We also assessed between-site heterogeneity. This study is registered with the Research Registry, 4720., Findings: 69 176 women were allocated to be interviewed by either FBH+ (n=34 805) or FPH (n=34 371). The mean time taken to complete FPH (10·5 min) was longer than for FBH+ (9·1 min; p<0·0001). Using FPH, the estimated SBR was 17·4 per 1000 total births, 21% (95% CI -10 to 62) higher than with FBH+ (15·2 per 1000 total births; p=0·20) in the 5 years preceding the survey interview. There was strong evidence of between-site heterogeneity (I 2 =80·9%; p<0·0001), with SBR higher for FPH than for FBH+ in four of five sites. The estimated NMR did not differ between modules (FPH 25·1 per 1000 livebirths vs FBH+ 25·4 per 1000 livebirths), with no evidence of between-site heterogeneity (I 2 =0·7%; p=0·40)., Interpretation: FPH takes an average of 1·4 min longer to complete than does FBH+, but has the potential to increase reporting of stillbirths in high burden contexts. The between-site heterogeneity we found might reflect variations in interviewer training and survey implementation, emphasising the importance of interviewer skills, training, and consistent implementation in data quality., Funding: Children's Investment Fund Foundation., (Copyright © 2020 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 license. Published by Elsevier Ltd.. All rights reserved.)