Search

BackgroundIncreasingly, Web-based health applications are developed for the prevention and management of chronic diseases. However, their reach and utilization is often disappointing. Qualitative evaluations post-implementation can be used to inform the optimization process and ultimately enhance their adoption. In current practice, such evaluations are mainly performed with end-user surveys. However, a review approach by experts in a focus group may be easier to administer and might provide similar results. ObjectiveThe aim of this study was to assess whether industrial design engineers in a focus group would address the same issues as end users in a Web-based survey when evaluating a commercial Web-based health risk assessment (HRA) with tailored feedback. MethodsSeven Dutch companies used the HRA as part of their corporate health management strategy. Employees using the HRA (N=2289) and 10 independent industrial designers were invited to participate in the study. The HRA consisted of four components: (1) an electronic health questionnaire, (2) biometric measurements, (3) laboratory evaluation, and (4) individually tailored feedback generated by decision support software. After participating in the HRA as end users, both end users and designers evaluated the program. End users completed an evaluation questionnaire that included a free-text field. Designers participated in a focus group discussion. Constructs from user satisfaction and technology acceptance theories were used to categorize and compare the remarks from both evaluations. ResultsWe assessed and qualitatively analyzed 294 remarks of 189 end users and 337 remarks of 6 industrial designers, pertaining to 295 issues in total. Of those, 137 issues were addressed in the end-user survey and 148 issues in the designer focus group. Only 7.3% (10/137) of the issues addressed in the survey were also addressed in the focus group. End users made more remarks about the usefulness of the HRA and prior expectations that were not met. Designers made more remarks about how the information was presented to end users, quality of the feedback provided by the HRA, recommendations on the marketing and on how to create more unity in the design of the HRA, and on how to improve the HRA based on these issues. ConclusionsEnd-user surveys should not be substituted for expert focus groups. Issues identified by end users in the survey and designers in the focus group differed considerably, and the focus group produced a lot of new issues. The issues addressed in the focus group often focused on different aspects of user satisfaction and technology acceptance than those addressed by the survey participants; when they did focus on the same aspects, then the nature of issues differed considerably in content.

BackgroundThe health risk assessment (HRA) is a type of health promotion program frequently offered at the workplace. Insight into the underlying determinants of participation is needed to evaluate and implement these interventions. ObjectiveTo analyze whether individual characteristics including demographics, health behavior, self-rated health, and work-related factors are associated with participation and nonparticipation in a Web-based HRA. MethodsDeterminants of participation and nonparticipation were investigated in a cross-sectional study among individuals employed at five Dutch organizations. Multivariate logistic regression was performed to identify determinants of participation and nonparticipation in the HRA after controlling for organization and all other variables. ResultsOf the 8431 employees who were invited, 31.9% (2686/8431) enrolled in the HRA. The online questionnaire was completed by 27.2% (1564/5745) of the nonparticipants. Determinants of participation were some periods of stress at home or work in the preceding year (OR 1.62, 95% CI 1.08-2.42), a decreasing number of weekdays on which at least 30 minutes were spent on moderate to vigorous physical activity (ORdayPA0.84, 95% CI 0.79-0.90), and increasing alcohol consumption. Determinants of nonparticipation were less-than-positive self-rated health (poor/very poor vs very good, OR 0.25, 95% CI 0.08-0.81) and tobacco use (at least weekly vs none, OR 0.65, 95% CI 0.46-0.90). ConclusionsThis study showed that with regard to isolated health behaviors (insufficient physical activity, excess alcohol consumption, and stress), those who could benefit most from the HRA were more likely to participate. However, tobacco users and those who rated their overall health as less than positive were less likely to participate. A strong communication strategy, with recruitment messages that take reasons for nonparticipation into account, could prove to be an essential tool for organizations trying to reach employees who are less likely to participate.

BackgroundWeb technology is increasingly being used to provide individuals with health risk assessments (HRAs) with tailored feedback. End-user satisfaction is an important determinant of the potential impact of HRAs, as this influences program attrition and adherence to behavioral advice. ObjectiveThe aim of this study was to evaluate end-user satisfaction with a web-based HRA with tailored feedback applied in worksite settings, using mixed (quantitative and qualitative) methods. MethodsEmployees of seven companies in the Netherlands participated in a commercial, web-based, HRA with tailored feedback. The HRA consisted of four components: 1) a health and lifestyle assessment questionnaire, 2) a biometric evaluation, 3) a laboratory evaluation, and 4) tailored feedback consisting of a personal health risk profile and lifestyle behavior advice communicated through a web portal. HRA respondents received an evaluation questionnaire after six weeks. Satisfaction with different parts of the HRA was measured on 5-point Likert scales. A free-text field provided the opportunity to make additional comments. ResultsIn total, 2289 employees participated in the HRA program, of which 637 (27.8%) completed the evaluation questionnaire. Quantitative analysis showed that 85.6% of the respondents evaluated the overall HRA positively. The free-text field was filled in by 29.7 % of the respondents (189 out of 637), who made 315 separate remarks. Qualitative evaluation of these data showed that these respondents made critical remarks. Respondents felt restricted by the answer categories of the health and lifestyle assessment questionnaire, which resulted in the feeling that the corresponding feedback could be inadequate. Some respondents perceived the personal risk profile as unnecessarily alarming or suggested providing more explanations, reference values, and a justification of the behavioral advice given. Respondents also requested the opportunity to discuss the feedback with a health professional. ConclusionsMost people were satisfied with the web-based HRA with tailored feedback. Sources of dissatisfaction were limited opportunities for providing additional health information outside of the predefined health and lifestyle assessment questionnaire and insufficient transparency on the generation of the feedback. Information regarding the aim and content of the HRA should be clear and accurate to prevent unrealistic expectations among end-users. Involving trusted health professionals in the implementation of web-based HRAs may enhance the use of and confidence in the HRA.

Abstract Background Physical inactivity, unhealthy dietary habits, smoking and high alcohol consumption are recognized risk factors for cardiovascular disease and cancer. Web-based health risk assessments with tailored feedback seem promising in promoting a healthy lifestyle. This study evaluates the effectiveness of a web-based health risk assessment with individually-tailored feedback on lifestyle behaviour, conducted in a worksite setting. Methods/Design The web-based health risk assessment starts with a questionnaire covering socio-demographic variables, family and personal medical history, lifestyle behaviour and psychological variables. Prognostic models are used to estimate individual cardiovascular risks. In case of high risk further biometric and laboratory evaluation is advised. All participants receive individually-tailored feedback on their responses to the health risk assessment questionnaire. The study uses a quasi-experimental design with a waiting list control group. Data are collected at baseline (T0) and after six months (T1). Within each company, clusters of employees are allocated to either the intervention or the control group. Primary outcome is lifestyle behaviour, expressed as the sum of five indicators namely physical activity, nutrition, smoking behaviour, alcohol consumption, and symptoms of burnout. Multilevel regression analysis will be used to answer the main research question and to correct for clustering effects. Baseline differences between the intervention and control group in the distribution of characteristics with a potential effect on lifestyle change will be taken into account in further analyses using propensity scores. Discussion This study will increase insight into the effectiveness of health risk assessments with tailored feedback and into conditions that may modify the effectiveness. This information can be used to design effective interventions for lifestyle behaviour change among employees. Trial registration Dutch Trial Register NTR8148.

Abstract Background Primary prevention programs at the worksite can improve employee health and reduce the burden of cardiovascular disease. Programs that include a web-based health risk assessment (HRA) with tailored feedback hold the advantage of simultaneously increasing awareness of risk and enhancing initiation of health-behaviour change. In this study we evaluated initial health-behaviour change among employees who voluntarily participated in such a HRA program. Methods We conducted a questionnaire survey among 2289 employees who voluntarily participated in a HRA program at seven Dutch worksites between 2007 and 2009. The HRA included a web-based questionnaire, biometric measurements, laboratory evaluation, and tailored feedback. The survey questionnaire assessed initial self-reported health-behaviour change and satisfaction with the web-based HRA, and was e-mailed four weeks after employees completed the HRA. Results Response was received from 638 (28%) employees. Of all, 86% rated the program as positive, 74% recommended it to others, and 58% reported to have initiated overall health-behaviour change. Compared with employees at low CVD risk, those at high risk more often reported to have increased physical activity (OR 3.36, 95% CI 1.52-7.45). Obese employees more frequently reported to have increased physical activity (OR 3.35, 95% CI 1.72-6.54) and improved diet (OR 3.38, 95% CI 1.50-7.60). Being satisfied with the HRA program in general was associated with more frequent self-reported initiation of overall health-behaviour change (OR 2.77, 95% CI 1.73-4.44), increased physical activity (OR 1.89, 95% CI 1.06-3.39), and improved diet (OR 2.89, 95% CI 1.61-5.17). Conclusions More than half of the employees who voluntarily participated in a web-based HRA with tailored feedback, reported to have initiated health-behaviour change. Self-reported initiation of health-behaviour change was more frequent among those at high CVD risk and BMI levels. In general employees reported to be satisfied with the HRA, which was also positively associated with initiation of health-behaviour change. These findings indicate that among voluntary participating employees a web-based HRA with tailored feedback may motivate those in greatest need of health-behaviour change and may be a valuable component of workplace health promotion programs.