Search

Event history calendars (EHCs) are frequently used in social measurement to capture important information about the time ordering of events in people's lives and enable inference about the relationships of the events with other outcomes of interest. To date, EHCs have primarily been designed for face-to-face or telephone survey interviewing, and few calendar tools have been developed for more private, self-administered modes of data collection. Web surveys offer benefits in terms of both self-administration, which can reduce social desirability bias, and timeliness. We developed and tested a web application enabling the calendar-based measurement of contraceptive method use histories. These measures provide valuable information for researchers studying family planning and fertility behaviors. This study describes the development of the web application and presents a comparison of data collected from online panels using the application with data from a benchmark face-to-face survey collecting similar measures (the National Survey of Family Growth).

Objective: To assess mental health symptoms, suicidal ideation/behaviors, and treatment among a nationally representative probability sample of student veterans. Participants: Student veterans enrolled in post-secondary educational institutions and matched comparison students. Methods: Sampled participants completed an online survey (n = 1,838). Analyses accounted for the complex sample design and non-response. Results: Substantial percentages of student veterans screened positive for: depression (36.9%, 95% CI: 31.1-42.7), PTSD (35.7%, 95% CI 29.9-41.5), anxiety (29.5%, 95% CI 26.8-32.2), and suicidal ideation (14.6%, 95% CI 12.1-17.1), with student veterans having odds ratios between 1.7 to 2.4 for positive screens compared to non-veteran students. Only 41.5% (95% CI 33.0-50.0) of student veterans with positive screens received treatment, although they had 50% higher odds of receiving treatment than non-veteran students. Conclusions: Student veterans have high rates of mental health symptoms and low rates of treatment. However, they are more likely to receive treatment than comparison students.

This study presents results from a randomized experiment in the 2015-2017 National Survey of Family Growth, where a large national sample of U.S. individuals aged 15-49 was randomly assigned to one of two different versions of a survey question about sexual identity (one with three response options, including heterosexual, gay/lesbian, and bisexual, and one adding the option "something else"). Analyses of changes in the associations of sexual identity with alcohol, tobacco, and other drug use across these treatments revealed evidence of significant differences in the associations that remained robust after adjusting for socio-demographics. The results suggest that when individuals choose their sexual identity from a more limited number of response options, the heterogeneity of the sexual identity subgroups increases, weakening estimated associations of sexual identity with these behaviors. Open-ended questions may therefore be necessary to measure sexual identity and estimate its associations with substance use behaviors accurately in surveys.

The American Family Health Study (AFHS) collected family health and fertility data from a national probability sample of persons aged 18–49 between September 2021 and May 2022, using web and mail exclusively. In July 2022, we surveyed AFHS respondents and gauged their willingness to become part of a national web panel that would create novel longitudinal data on these topics. We focus on predictors of willingness to participate, identifying the potential selection bias that this type of approach may introduce. We found that efforts of this type to create a national web panel may introduce potential selection bias in estimates based on the panel respondents, with individuals having higher socioeconomic status being more cooperative. Thus, alternative recruitment strategies and re-weighting of the subsample may be needed to further reduce selection bias. We present methodological implications of our results, limitations of our approach, and suggestions for further research on this topic. [ABSTRACT FROM AUTHOR]

Many surveys target population subgroups that may not be readily identified in sampling frames. In the case study that motivated this study, the target population was households with children between the ages of 3 and 10 from two areas surrounding Cleveland, Ohio and Dallas, Texas. A standard approach is to sample households from these two areas and then screen for the presence of age-eligible children. Based on the estimated number of age-eligible households in these two areas, this approach would have required completing screening interviews with 5.4 to 5.7 households to find one eligible household. We developed a model-assisted sample design strategy to improve screening efficiency by attaching a measure of eligibility propensity to each household in the population. For this, we used a modeling and imputation strategy that combined information from several data sources: (1) the population of addresses for these two areas with demographic covariates from a commercial vendor, (2) external population data (from the American Community Survey and Census Planning Data) for these two areas, and (3) screening data from a large nationally representative survey. We first tested this sampling strategy in a pilot study and then implemented it in the main study. This strategy required 4.2 to 4.3 completed screeners to identify one eligible household. The proposed approach therefore improved the sampling efficiency by about 25% relative to the standard approach. [ABSTRACT FROM AUTHOR]

Objective: To determine the prevalence, remission, and treatment associated with DSM-5 substance use disorders (SUDs) among young adults based on college attendance. Participants: The population-based sample included 2,057 young adults aged 19-23 in college/school and 1,213 not currently attending college/school who participated from April 2012 through June 2013. Methods: Face-to-face interviews were conducted as part of a cross-sectional national survey. Results: The prevalence of any past-year DSM-5 SUD was 39.6% among young adults in college and 44.5% among those not attending college. Past-year tobacco use disorder and multiple DSM-5 SUDs were more prevalent among those not attending college. Among those with prior-to-past-year SUDs, abstinent remission was low among college (1.0%) and noncollege (1.9%) young adults. Conclusions: Approximately two in five U.S. college students had at least one past-year DSM-5 SUD. Sustained abstinent remission from SUDs is extremely rare (1-2%) and the majority of those with SUDs do not receive treatment.

In face-to-face surveys, interviewer observations are a cost-effective source of paradata for nonresponse adjustment of survey estimates and responsive survey designs. Unfortunately, recent studies have suggested that the accuracy of these observations can vary substantially among interviewers, even after controlling for household-, area-, and interviewer-level characteristics, limiting their utility. No study has identified sources of this unexplained variance in observation accuracy. Motivated by theoretical expectations from the observer bias literature, this study analyzed more than 45,000 open-ended justifications provided by interviewers in the U.S. National Survey of Family Growth (NSFG) for their observations on two key features of all sampled NSFG households: presence of children and expected probability of household response. The study finds that variability among interviewers in the cues used to record these observations (evident from the open-ended justifications) explains much of the previously unexplained variance in observation accuracy.

Objective: This study reevaluates the effects of a randomized controlled trial (RCT) of job search interventions on labor force participation. In the trial, various methods of job search interventions were included, of which about half were research-based JOBS (Job Opportunity and Basic Skills) interventions and the other half were practice-based, that is, without a theoretical or empirical base. This study compares effects of the research-based and practice-based interventions. Methods: The trial included data from 1998 to 2000 of 1,013 unemployed people in Finland with 3-year follow-up data from official labor market records. Multilevel multinomial logistic regression was used to analyze the intervention effects on labor market outcomes. Results: The results demonstrated that beneficial long-term effects were produced only in interventions based on the research-based JOBS method for participants at risk of baseline depression. In contrast, the practice-based interventions seemed to have adverse effects on employment. Conclusions: These findings indicate the importance of research-based interventions within active labor market policies.

This article presents the results of an adaptive design experiment in the recruitment of households and individuals for a two-stage national probability web or mail mixed-mode survey, the American Family Health Study (AFHS). In the screening stage, we based the adaptive design's subgroup differentiation on Esri Tapestry segmentation. We used tailored invitation materials for a subsample where a high proportion of the population was Hispanic and added a paper questionnaire to the initial mailing for a subsample with rural and older families. In the main-survey stage, the adaptive design targeted the households where a member other than the screening respondent was selected for the survey. The adaptations included emailing and/or texting, an additional prepaid incentive, and seeking screening respondents' help to remind the selected individuals. The main research questions are (i) whether the adaptive design improved survey production outcomes and (ii) whether combining adaptive design and postsurvey weighting adjustments improved survey estimates compared to performing postsurvey adjustments alone. Unfortunately, the adaptive designs did not improve the survey production outcomes. We found that the weighted AFHS estimates closely resemble those of a benchmark national face-to-face survey, the National Survey of Family Growth, although the adaptive design did not additionally change survey estimates beyond the weighting adjustments. Nonetheless, our experiment yields useful insights about the implementation of adaptive design in a self-administered mail-recruit web or mail survey. We were able to identify subgroups with potentially lower response rates and distinctive characteristics, but it was challenging to develop effective protocol adaptations for these subgroups under the constraints of the two primary survey modes and the operational budget of the AFHS. In addition, for self-administered within-household selection, it was difficult to obtain contact information from, reach, and recruit selected household members that did not respond to the screening interview. [ABSTRACT FROM AUTHOR]

Standardized interviewing (SI) and conversational interviewing are two approaches to collect survey data that differ in how interviewers address respondent confusion. This article examines interviewer-respondent interactions that occur during these two techniques, focusing on requests for and provisions of clarification. The data derive from an experimental study in Germany, where the face-to-face interviews were audio-recorded. A sample of 111 interviews was coded in detail. We find that conversational interviewers do make use of the ability to clarify respondent confusion. Although the technique improved response accuracy in the main study compared to SI, conversational interviewers seem to provide clarifications even when there is no evidence of respondent confusion. This may lengthen administration time and potentially increase data collection costs. Conversational interviewers also employ neutral probes, which are generally associated with standardized interviews, at an unexpectedly high rate. We conclude with suggestions for practice and directions for future research.

Background and Purpose Our study examined individual-, interpersonal-, community-, and policy-level associations with nicotine/tobacco use among gender-varying and gender-stable U.S. individuals. Methods Data from Waves 2–4 (2014/15–2016/18) of the Population Assessment of Tobacco and Health (n = 33,197 U.S. adolescents and adults aged ≥14 years) and state-level gender minority policy data were used. Using multivariable logistic regression, the odds of past-30-day nicotine/tobacco use at W4 were estimated as a function of gender stability/variability, psychological distress, number of tobacco products used by family/friends, anti-tobacco marketing exposure, and change in gender minority-related policies from 2015 to 2017. Results Gender-varying individuals had higher odds of nicotine/tobacco use compared with gender-stable individuals (AOR range = 1.7–2.3, p <.01). In the overall sample, positive change in gender minority policy protections (tallied from medium to high) was associated with lower odds of any nicotine/tobacco, other tobacco, and poly-tobacco use (AOR = 0.8, p <.05) compared to states with no change in their negative policies. Anti-tobacco marketing exposure was associated with lower odds of any tobacco, cigarette, e-cigarette, and poly-tobacco use compared with those who had no anti-tobacco marketing exposure (AOR = 0.9, p <.05). Higher psychological distress (AOR range = 1.7–2.4, p <.001) and an increasing number of tobacco products used by family/friends (AOR range = 1.1–1.3, p <.001) were associated with increased odds of nicotine/tobacco use. Conclusions Multilevel prevention and intervention strategies are needed to reduce the risk of nicotine/tobacco use among gender-varying and gender-stable individuals. [ABSTRACT FROM AUTHOR]