Search

Background Digital diabetes prevention programs (digital-DPPs) are being implemented as population-based approaches to type 2 diabetes mellitus prevention in several countries to address problems with the uptake of traditional face-to-face diabetes prevention programs. However, assessments of digital-DPPs have largely focused on clinical outcomes and usability among those who have taken them up, whereas crucial information on decision-making about uptake (eg, whether a user downloads and registers on an app) and engagement (eg, the extent of use of an app or its components over time) is limited. Greater understanding of factors that influence uptake and engagement decisions may support large-scale deployments of digital-DPPs in real-world settings. Objective This study aimed to explore the key influences on uptake and engagement decisions of individuals who were offered the National Health Service Healthier You: Digital Diabetes Prevention Programme (NHS-digital-DPP). Methods A qualitative interview study was conducted using semistructured interviews. Participants were adults, aged ≥18 years, diagnosed with nondiabetic hyperglycemia, and those who had been offered the NHS-digital-DPP. Recruitment was conducted via 4 providers of the NHS-digital-DPP and 3 primary care practices in England. Interviews were conducted remotely and were guided by a theoretically informed topic guide. Analysis of interviews was conducted using an inductive thematic analysis approach. Results Interviews were conducted with 32 participants who had either accepted or declined the NHS-digital-DPP. In total, 7 overarching themes were identified as important factors in both decisions to take up and to engage with the NHS-digital-DPP. These were knowledge and understanding, referral process, self-efficacy, self-identity, motivation and support, advantages of digital service, and reflexive monitoring. Perceptions of accessibility and convenience of the NHS-digital-DPP were particularly important for uptake, and barriers in terms of the referral process and health care professionals’ engagement were reported. Specific digital features including health coaches and monitoring tools were important for engagement. Conclusions This study adds to the literature on factors that influence the uptake of and engagement with digital-DPPs and suggests that digital-DPPs can overcome many barriers to the uptake of face-to-face diabetes prevention programs in supporting lifestyle changes aimed at diabetes prevention.

Background Digital health interventions (DHIs) have the potential to improve public health by combining effective interventions and population reach. However, what biomedical researchers and digital developers consider an effective intervention differs, thereby creating an ongoing challenge to integrating their respective approaches when evaluating DHIs. Objective This study aims to report on the Public Health England (PHE) initiative set out to operationalize an evaluation framework that combines biomedical and digital approaches and demonstrates the impact, cost-effectiveness, and benefit of DHIs on public health. Methods We comprised a multidisciplinary project team including service designers, academics, and public health professionals and used user-centered design methods, such as qualitative research, engagement with end users and stakeholders, and iterative learning. The iterative approach enabled the team to sequentially define the problem, understand user needs, identify opportunity areas, develop concepts, test prototypes, and plan service implementation. Stakeholders, senior leaders from PHE, and a working group critiqued the outputs. Results We identified 26 themes and 82 user needs from semistructured interviews (N=15), expressed as 46 Jobs To Be Done, which were then validated across the journey of evaluation design for a DHI. We identified seven essential concepts for evaluating DHIs: evaluation thinking, evaluation canvas, contract assistant, testing toolkit, development history, data hub, and publish health outcomes. Of these, three concepts were prioritized for further testing and development, and subsequently refined into the proposed PHE Evaluation Service for public health DHIs. Testing with PHE’s Couch-to-5K app digital team confirmed the viability, desirability, and feasibility of both the evaluation approach and the Evaluation Service. Conclusions An iterative, user-centered design approach enabled PHE to combine the strengths of academic and biomedical disciplines with the expertise of nonacademic and digital developers for evaluating DHIs. Design-led methodologies can add value to public health settings. The subsequent service, now known as Evaluating Digital Health Products, is currently in use by health bodies in the United Kingdom and is available to others for tackling the problem of evaluating DHIs pragmatically and responsively.

Background Type 2 diabetes mellitus is one of the most common long-term conditions, and costs health services approximately 10% of their total budget. Active self-management by patients improves outcomes and reduces health service costs. While the existing evidence suggested that uptake of self-management education was low, the development of internet-based technology might improve the situation. Objective To establish the cost-effectiveness of a Web-based self-management program for people with type 2 diabetes (HeLP-Diabetes) compared to usual care. Methods An incremental cost-effectiveness analysis was conducted, from a National Health Service and personal and social services perspective, based on data collected from a multi-center, two-arm individually randomized controlled trial over 12 months. Adults aged 18 or over with a diagnosis of type 2 diabetes and registered with the 21 participating general practices (primary care) in England, UK, were approached. People who were unable to provide informed consent or to use the intervention, terminally ill, or currently participating in a trial of an alternative self-management intervention, were excluded. The participants were then randomized to either usual care plus HeLP-Diabetes, an interactive, theoretically-informed Web-based self-management program, or to usual care plus access to a comparator website containing basic information only. The participants’ intervention costs and wider health care resource use were collected as well as two health-related quality of life measures: the Problem Areas in Diabetes (PAID) Scale and EQ-5D-3L. EQ-5D-3L was then used to calculate quality-adjusted life years (QALYs). The primary analysis was based on intention-to-treat, using multiple imputation to handle the missing data. Results In total, 374 participants were randomized, with 185 in the intervention group and 189 in the control group. The primary analysis showed incremental cost-effectiveness ratios of £58 (95% CI –411 to 587) per unit improvement on PAID scale and £5550 (95% CI –21,077 to 52,356) per QALY gained by HeLP-Diabetes, compared to the control. The complete case analysis showed less cost-effectiveness and higher uncertainty with incremental cost-effectiveness ratios of £116 (95% CI –1299 to 1690) per unit improvement on PAID scale and £18,500 (95% CI –203,949 to 190,267) per QALY. The cost-effectiveness acceptability curve showed an 87% probability of cost-effectiveness at £20,000 per QALY willingness-to-pay threshold. The one-way sensitivity analyses estimated 363 users would be needed to use the intervention for it to become less costly than usual care. Conclusions Facilitated access to HeLP-Diabetes is cost-effective, compared to usual care, under the recommended threshold of £20,000 to £30,000 per QALY by National Institute of Health and Care Excellence. Trial Registration International Standard Randomized Controlled Trial Number (ISRCTN) 02123133; http://www.controlled-trials.com/ISRCTN02123133 (Archived by WebCite at http://www.webcitation.org/6zqjhmn00)

Background Recent reviews suggest Web-based interventions are promising approaches for weight management but they identify difficulties with suboptimal usage. The literature suggests that offering some degree of human support to website users may boost usage and outcomes. Objective We disseminated the POWeR (“Positive Online Weight Reduction”) Web-based weight management intervention in a community setting. POWeR consisted of weekly online sessions that emphasized self-monitoring, goal-setting, and cognitive/behavioral strategies. Our primary outcome was intervention usage and we investigated whether this was enhanced by the addition of brief telephone coaching. We also explored group differences in short-term self-reported weight loss. Methods Participants were recruited using a range of methods including targeted mailouts, advertisements in the local press, notices on organizational websites, and social media. A total of 786 adults were randomized at an individual level through an online procedure to (1) POWeR only (n=264), (2) POWeR plus coaching (n=247), or (3) a waiting list control group (n=275). Those in the POWeR plus coaching arm were contacted at approximately 7 and 28 days after randomization for short coaching telephone calls aimed at promoting continued usage of the website. Website usage was tracked automatically. Weight was assessed by online self-report. Results Of the 511 participants allocated to the two intervention groups, the median number of POWeR sessions completed was just one (IQR 0-2 for POWeR only, IQR 0-3 for POWeR plus coach). Nonetheless, a substantial minority completed at least the core three sessions of POWeR: 47 participants (17.8%, 47/264) in the POWeR-only arm and 64 participants (25.9%, 64/247) in the POWeR plus coaching arm. Participants in the POWeR plus coaching group persisted with the intervention for longer and were 1.61 times more likely to complete the core three sessions than the POWeR-only group (χ2 1=4.93; OR 1.61, 95% CI 1.06-2.47; n=511). An intention-to-treat analysis showed between-group differences in weight loss (F 2,782=12.421, P

BackgroundThe use of mobile phone technologies for health promotion and disease prevention has advanced rapidly in recent years. Text4baby is a theory-based mobile health (mHealth) program in which text messages are delivered to pregnant women and new mothers to improve their health care beliefs and behaviors and improve health status and clinical outcomes. Recent evaluations of Text4baby have found that it improves targeted health attitudes and beliefs, but effects on behavior have not yet been determined. ObjectiveIn this study, investigators aimed to evaluate Text4baby in the military women’s population. MethodsInvestigators conducted a randomized controlled trial at Madigan Army Medical Center in Tacoma, Washington, from December 2011 through September 2013. All participants were pregnant women first presenting for care at Madigan. Investigators conducted a baseline assessment using a 24-item, self-administered online survey of attitudes and behaviors related to Text4baby message content. Participants were randomized to Text4baby plus usual care (intervention) or usual care alone (control). Investigators analyzed treatment effects of Text4baby on short-term targeted outcomes 4 weeks post enrollment. ResultsFor this study, 943 patients were randomized and completed a baseline assessment. The average patient age was 28 years and nearly 70% self-identified as Caucasian. 48.7% of enrollees (459/943) completed the first follow-up assessment. Higher rates of single and working/in-school patients dropped out of the intervention arm of the study, and we adjusted for this finding in subsequent models. However, while investigators were unable to re-survey these participants, only 1.9% of Text4baby enrollees (18/943) dropped the service during the study period. Adjusted and unadjusted logistic generalized estimating equation models were developed to assess intervention effects on measured outcomes. In the model adjusting for age, marital status, having had a previous baby, and race/ethnicity, there was a significant effect of Text4baby intervention exposure on increased agreement with belief in the importance of taking prenatal vitamins (OR 1.91, 95% CI 1.08-3.34, P=.024). All of these attitudes had been targeted by at least one text message during the 4-week evaluation period examined in this study. In unadjusted models, there was a significant effect of intervention exposure on belief in the importance of visiting a health care provider to be a healthy new mother (OR 1.52, 95% CI 1.01-2.31, P=.046) and in the health risks of alcohol during pregnancy (OR 2.06, 95% CI 1.00-4.31, P=.05). No behavioral effects of the intervention were observed in this analysis. ConclusionsText4baby is a promising program that offers lessons for future mHealth activities. This large-scale study demonstrated initial effects of the program on attitudes and beliefs targeted by the messages received by women during the study period. Results confirm previous findings from Text4baby studies and other mHealth research. Future analyses will examine dosage effects of the intervention on behaviors and clinical outcomes.

BackgroundAttrition is a noted feature of eHealth interventions and trials. In 2005, Eysenbach published a landmark paper calling for a “science of attrition,” suggesting that the 2 forms of attrition—nonusage attrition (low adherence to the intervention) and dropout attrition (poor retention to follow-up)—may be related and that this potential relationship deserved further study. ObjectiveThe aim of this paper was to use data from an online alcohol trial to explore Eysenbach’s hypothesis, and to answer 3 research questions: (1) Are adherence and retention related? If so, how, and under which circumstances? (2) Do adherence and retention have similar predictors? Can these predictors adequately explain any relationship between adherence and retention or are there additional, unmeasured predictors impacting on the relationship? (3) If there are additional unmeasured predictors impacting on the relationship, are there data to support Eysenbach’s hypothesis that these are related to overall levels of interest? MethodsSecondary analysis of data from an online trial of an online intervention to reduce alcohol consumption among heavy drinkers. The 2 outcomes were adherence to the intervention measured by number of log-ins, and retention to the trial measured by provision of follow-up data at 3 months (the primary outcome point). Dependent variables were demographic and alcohol-related data collected at baseline. Predictors of adherence and retention were modeled using logistic regression models. ResultsData were available on 7932 participants. Adherence and retention were related in a complex fashion. Participants in the intervention group were more likely than those in the control group to log in more than once (42% vs 28%, P

Background: Digital interventions have been effective in improving numerous health outcomes and health behaviors; furthermore, they are increasingly being used in different health care areas, including self-management of long-term conditions, mental health, and health promotion. The full potential of digital interventions is hindered by a lack of user engagement. There is an urgent need to develop effective strategies that can promote users’ engagement with digital interventions. One potential method is the use of technology-based reminders or prompts. Objective: To evaluate the effectiveness of technology-based strategies for promoting engagement with digital interventions. Methods: Cochrane Collaboration guidelines on systematic review methodology were followed. The search strategy was executed across 7 electronic databases: the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, Web of Science, the Education Resources Information Center (ERIC), PsycINFO, and the Cumulative Index to Nursing and Allied Health Literature (CINAHL). Databases were searched from inception to September 13, 2013, with no language or publication type restrictions, using three concepts: randomized controlled trials, digital interventions, and engagement. Gray literature and reference lists of included studies were also searched. Titles and abstracts were independently screened by 2 authors, then the full texts of potentially eligible papers were obtained and double-screened. Data from eligible papers were extracted by one author and checked for accuracy by another author. Bias was assessed using the Cochrane risk of bias assessment tool. Narrative synthesis was performed on all included studies and, where appropriate, data were pooled using meta-analysis. All findings were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Results: A total of 14 studies were included in the review with 8774 participants. Of the 14 studies, 9 had sufficient data to be included in the meta-analyses. The meta-analyses suggested that technology-based strategies can potentially promote engagement compared to no strategy for dichotomous outcomes (relative risk [RR] 1.27, 95% CI 1.01-1.60, I 2 =71%), but due to considerable heterogeneity and the small sample sizes in most studies, this result should be treated with caution. No studies reported adverse or economic outcomes. Only one study with a small sample size compared different characteristics; the study found that strategies promoting new digital intervention content and those sent to users shortly after they started using the digital intervention were more likely to engage users. Conclusions: Overall, studies reported borderline positive effects of technology-based strategies on engagement compared to no strategy. However, the results have to be interpreted with caution. More research is needed to replicate findings and understand which characteristics of the strategies are effective in promoting engagement and how cost-effective they are. [J Med Internet Res 2016;18(1):e6]

BackgroundSexual health education in the United Kingdom is of variable quality, typically focusing on the biological aspects of sex rather than on communication, relationships, and sexual pleasure. The Internet offers a unique opportunity to provide sexual health education to young people, since they can be difficult to engage but frequently use the Internet as a health information resource. ObjectivesTo explore through qualitative research young people’s views on what elements of a sexual health website would be appealing and engaging, and their views on the content, design, and interactive features of the Sexunzipped intervention website. MethodsWe recruited 67 young people aged 16–22 years in London, UK. We held 21 focus groups and 6 one-to-one interviews to establish sexual health priorities, views on website look and feel, and what features of a sexual heath website would attract and engage them. Two researchers facilitated the focus groups, using a semistructured topic guide to lead the discussions and asking open questions to elicit a range of views. The discussions and interviews were audio recorded and detailed notes were made on key topics from the audio recording. Young people’s views influenced design templates for the content and interactive features of Sexunzipped. ResultsYoung people particularly wanted straightforward information on sexual pleasure, sexually transmitted infections and pregnancy, how to communicate with partners, how to develop skills in giving pleasure, and emotions involved in sex and relationships. Focus group participants wanted social interaction with other young people online and wanted to see themselves reflected in some way such as through images or videos. ConclusionsWhile it is challenging to meet all of young people’s technological and design requirements, consultation with the target audience is valuable and necessary in developing an online sexual health intervention. Young people are willing to talk about sensitive issues, enjoy the discussions, and can offer key insights that influence intervention development.

BackgroundThere has been limited study of factors influencing response rates and attrition in online research. Online experiments were nested within the pilot (study 1, n = 3780) and main trial (study 2, n = 2667) phases of an evaluation of a Web-based intervention for hazardous drinkers: the Down Your Drink randomized controlled trial (DYD-RCT). ObjectivesThe objective was to determine whether differences in the length and relevance of questionnaires can impact upon loss to follow-up in online trials. MethodsA randomized controlled trial design was used. All participants who consented to enter DYD-RCT and completed the primary outcome questionnaires were randomized to complete one of four secondary outcome questionnaires at baseline and at follow-up. These questionnaires varied in length (additional 23 or 34 versus 10 items) and relevance (alcohol problems versus mental health). The outcome measure was the proportion of participants who completed follow-up at each of two follow-up intervals: study 1 after 1 and 3 months and study 2 after 3 and 12 months. ResultsAt all four follow-up intervals there were no significant effects of additional questionnaire length on follow-up. Randomization to the less relevant questionnaire resulted in significantly lower rates of follow-up in two of the four assessments made (absolute difference of 4%, 95% confidence interval [CI] 0%-8%, in both study 1 after 1 month and in study 2 after 12 months). A post hoc pooled analysis across all four follow-up intervals found this effect of marginal statistical significance (unadjusted difference, 3%, range 1%-5%, P = .01; difference adjusted for prespecified covariates, 3%, range 0%-5%, P = .05). ConclusionsApparently minor differences in study design decisions may have a measurable impact on attrition in trials. Further investigation is warranted of the impact of the relevance of outcome measures on follow-up rates and, more broadly, of the consequences of what we ask participants to do when we invite them to take part in research studies. Trial registrationISRCTN Register 31070347; http://www.controlled-trials.com/ISRCTN31070347/31070347 Archived by WebCite at (http://www.webcitation.org/62cpeyYaY)

BackgroundExisting initiatives to support patient self-management of heart disease do not appear to be reaching patients most in need. Providing self-management programs over the Internet (web-based interventions) might help reduce health disparities by reaching a greater number of patients. However, it is unclear whether they can achieve this goal and whether their effectiveness might be limited by the digital divide. ObjectiveTo explore the effectiveness of a web-based intervention in decreasing inequalities in access to self-management support in patients with coronary heart disease (CHD). MethodsQuantitative and qualitative methods were used to explore use made of a web-based intervention over a period of 9 months. Patients with CHD, with or without home Internet access or previous experience using the Internet, were recruited from primary care centers in diverse socioeconomic and ethnic areas of North London, UK. Patients without home Internet were supported in using the intervention at public Internet services. ResultsOnly 10.6% of eligible patients chose to participate (N=168). Participants were predominantly Caucasian well-educated men, with greater proportions of male and younger CHD patients among participants than were registered at participating primary care practices. Most had been diagnosed with CHD a number of years prior to the study. Relatively few had been newly diagnosed or had experienced a cardiac event in the previous 5 years. Most had home Internet access and prior experience using the Internet. A greater use of the intervention was observed in older participants (for each 5-year age increase, OR 1.25 for no, low or high intervention use, 95% CI, 1.06-1.47) and in those that had home Internet access and prior Internet experience (OR 3.74, 95% CI, 1.52-9.22). Less use was observed in participants that had not recently experienced a cardiac event or diagnosis (≥ 5 years since cardiac event or diagnosis; OR 0.69, 95% CI, 0.50-0.95). Gender and level of education were not statistically related to level of use of the intervention. Data suggest that a recent cardiac event or diagnosis increased the need for information and advice in participants. However, participants that had been diagnosed several years ago showed little need for information and support. The inconvenience of public Internet access was a barrier for participants without home Internet access. The use of the intervention by participants with little or no Internet experience was limited by a lack of confidence with computers and discomfort with asking for assistance. It was also influenced by the level of participant need for information and by their perception of the intervention. ConclusionsThe availability of a web-based intervention, with support for use at home or through public Internet services, did not result in a large number or all types of patients with CHD using the intervention for self-management support. The effectiveness of web-based interventions for patients with chronic diseases remains a significant challenge.

BackgroundAttrition from follow-up is a major methodological challenge in randomized trials. Incentives are known to improve response rates in cross-sectional postal and online surveys, yet few studies have investigated whether they can reduce attrition from follow-up in online trials, which are particularly vulnerable to low follow-up rates. ObjectivesOur objective was to determine the impact of incentives on follow-up rates in an online trial. MethodsTwo randomized controlled trials were embedded in a large online trial of a Web-based intervention to reduce alcohol consumption (the Down Your Drink randomized controlled trial, DYD-RCT). Participants were those in the DYD pilot trial eligible for 3-month follow-up (study 1) and those eligible for 12-month follow-up in the DYD main trial (study 2). Participants in both studies were randomly allocated to receive an offer of an incentive or to receive no offer of an incentive. In study 1, participants in the incentive arm were randomly offered a £5 Amazon.co.uk gift voucher, a £5 charity donation to Cancer Research UK, or entry in a prize draw for £250. In study 2, participants in the incentive arm were offered a £10 Amazon.co.uk gift voucher. The primary outcome was the proportion of participants who completed follow-up questionnaires in the incentive arm(s) compared with the no incentive arm. ResultsIn study 1 (n = 1226), there was no significant difference in response rates between those participants offered an incentive (175/615, 29%) and those with no offer (162/611, 27%) (difference = 2%, 95% confidence interval [CI] –3% to 7%). There was no significant difference in response rates among the three different incentives offered. In study 2 (n = 2591), response rates were 9% higher in the group offered an incentive (476/1296, 37%) than in the group not offered an incentive (364/1295, 28%) (difference = 9%, 95% CI 5% to 12%, P < .001). The incremental cost per extra successful follow-up in the incentive arm was £110 in study 1 and £52 in study 2. ConclusionWhereas an offer of a £10 Amazon.co.uk gift voucher can increase follow-up rates in online trials, an offer of a lower incentive may not. The marginal costs involved require careful consideration. Trial registrationISRCTN31070347; http://www.controlled-trials.com/ISRCTN31070347 (Archived by WebCite at http://www.webcitation.org/5wgr5pl3s)

Health care and health care services are increasingly being delivered over the Internet. There is a strong argument that interventions delivered online should also be evaluated online to maximize the trial’s external validity. Conducting a trial online can help reduce research costs and improve some aspects of internal validity. To date, there are relatively few trials of health interventions that have been conducted entirely online. In this paper we describe the major methodological issues that arise in trials (recruitment, randomization, fidelity of the intervention, retention, and data quality), consider how the online context affects these issues, and use our experience of one online trial evaluating an intervention to help hazardous drinkers drink less (DownYourDrink) to illustrate potential solutions. Further work is needed to develop online trial methodology.

Background Heavy drinking is responsible for major health and social problems. Brief interventions have been shown to be effective, but there have been difficulties in reaching those who might benefit from them. Pilot studies have indicated that a Web-based intervention is likely to be acceptable to heavy drinkers and may produce some health benefits. However, there are few data on how many people might use such a program, the patterns of use, and potential benefits. Objectives The aim was to examine the demographic characteristics of users of a free, Web-based, 6-week intervention for heavy drinkers and to describe the methods by which users identified the site, the pattern of site use and attrition, the characteristics associated with completing the program, and the self-reported impact on alcohol-related outcomes. Methods Cohort study. Visitors to the Web site were offered screening with the Fast Alcohol Screening Test, and those scoring above the cutoff for risky drinking were invited to register with the program. Demographic information was collected routinely at registration, and questionnaires were completed at the end of weeks 1 and 6. The outcome measures assessed dependency (Short Alcohol Dependency Data Questionnaire), harms (modified Alcohol Problems Questionnaire), and mental health (Clinical Outcomes in Routine Evaluation–Outcome Measure). Results The records of 10000 users were analyzed. The mean age was 37.4 years, 51.1% were female, 37.5% were single, and 42.4% lived with children. The majority were White British, lived in the United Kingdom, and reported occupations from the higher socioeconomic strata. Over 70% connected to the Down Your Drink (Down Your Drink) site from another Internet-based resource, whereas only 5.8% heard about the site from a health or other professional. Much of the Web site use (40%) was outside normal working hours. Attrition from the program was high, with only 16.5% of registrants completing the whole 6 weeks. For those who completed the program, and the final outcome measures, measures of dependency, alcohol-related problems, and mental health symptoms were all reduced at week 6. Conclusions The Web-based intervention was highly used, and those who stayed with the program showed significant reductions in self-reported indicators of dependency, alcohol-related problems, and mental health symptoms; however, this association cannot be assumed to be causal. Programs of this type may have the potential to reach large numbers of heavy drinkers who might not otherwise seek help. There are significant methodological challenges and further research is needed to fully evaluate such interventions.

BACKGROUND: Interactive health communication applications (IHCAs) that combine high-quality health information with interactive components, such as self-assessment tools, behavior change support, peer support, or decision support, are likely to benefit people with long-term conditions. IHCAs are now largely Web-based and are becoming known as "Internet interventions." Although there are numerous professionally generated criteria to assess health-related websites, to date there has been scant exploration of patient-generated assessment criteria even though patients and professionals use different criteria for assessing the quality of traditional sources of health information. OBJECTIVE: We aimed to determine patients' and caregivers' requirements of IHCAs for long-term conditions as well as their criteria for assessing the quality of different programs. METHODS: This was a qualitative study with focus groups. Patients and caregivers managing long-term conditions used three (predominantly Web-based) IHCAs relevant to their condition and subsequently discussed the strengths and weaknesses of the different IHCAs in focus groups. Participants in any one focus group all shared the same long-term condition and viewed the same three IHCAs. Patient and caregiver criteria for IHCAs emerged from the data. RESULTS: There were 40 patients and caregivers who participated in 10 focus groups. Participants welcomed the potential of Internet interventions but felt that many were not achieving their full potential. Participants generated detailed and specific quality criteria relating to information content, presentation, interactivity, and trustworthiness, which can be used by developers and purchasers of Internet interventions. CONCLUSIONS: The user-generated quality criteria reported in this paper should help developers and purchasers provide Internet interventions that better meet user needs. [J Med Internet Res 2006;8(3):e13]

We wish to respond to the paper by Rada [1] and accompanying editorial by Eysenbach and Kummervold [2] in JMIR regarding our Cochrane systematic review on interactive health communication applications (IHCAs) for chronic disease. This systematic review was published in October 2004 in Issue 4 of The Cochrane Library, and we were notified of potential errors in the direction of change for clinical outcomes about 10 days after publication. We immediately reviewed our work and confirmed that errors had been made. We decided that our main responsibility was to limit the harm caused by these errors, by firstly, ensuring that all relevant stakeholders were informed as quickly as possible, and secondly, working toward correcting the errors in a transparent open fashion. Within 48 hours of the first notification, we had informed (a) the editors of the Cochrane Consumers and Communication Review Group, (b) the funders of the work, and (c) the University College London (UCL) press office. For technical reasons, it was not possible to immediately withdraw the review from The Cochrane Library website, so an alert was posted on the review, warning readers that there were errors in the direction of change for some of the behavioral and clinical outcomes and apologizing for the mistake. No one could access the review without seeing this alert. The review was withdrawn in Issue 1 of The Cochrane Library in 2005. We also made every effort to contact journalists who we knew to be writing articles about the original publication, but which had not yet been published. Since then we have continued to work closely with the editorial team of the Cochrane Consumers and Communication Review Group to revise the review. We are grateful for all the help and support we have received in this process.

I sat there agog reading your well-written, balanced, restrained, and devastating editorial on the "Cochrane disaster" [1]. I come away with the feeling that something is very wrong at Cochrane, and I'm extremely curious as to what it might be. Cochrane seems like such a good idea — so dignified, honorable, and professional — how could people get so sloppy and cavalier? If their false conclusions were of political value (defending a war, a contract, a questionable appointment) one would feel certain of having come across another outrageous conspiracy. But I can't imagine what cabal would substantially profit from finding that educating patients degrades their medical outcome. Was this just initial negligence, inattention, and then a sudden steamroller effect when a surprising finding reported by a bumbling research assistant seemed so novel and newsworthy that it attracted a misguided enthusiasm and loyalty that blinded all the participants to reality, with a perfunctory referee ritual proving inadequate to catch the errors? I've been expressing skepticism about evidence-based medical practice at our departmental meetings but was gradually being won over by that approach, but now...whose evidence? Meta-analyzed by whom? I'm not competent to understand meta-analyses and sort of took them on faith. Fie on that.

BACKGROUND: Public use of the Internet for health information is increasing but its effect on health care is unclear. We studied physicians' experience of patients looking for health information on the Internet and their perceptions of the impact of this information on the physician-patient relationship, health care, and workload. METHODS: Cross-sectional survey of a nationally-representative sample of United States physicians (1050 respondents; response rate 53%). RESULTS: Eighty-five percent of respondents had experienced a patient bringing Internet information to a visit. The quality of information was important: accurate, relevant information benefited, while inaccurate or irrelevant information harmed health care, health outcomes, and the physician-patient relationship. However, the physician's feeling that the patient was challenging his or her authority was the most consistent predictor of a perceived deterioration in the physician-patient relationship (OR = 14.9; 95% CI, 5.5-40.5), in the quality of health care (OR = 3.4; 95% CI, 1.1-10.9), or health outcomes (OR = 5.6; 95% CI, 1.7-18.7). Thirty-eight percent of physicians believed that the patient bringing in information made the visit less time efficient, particularly if the patient wanted something inappropriate (OR = 2.5; 95% CI, 1.5-4.4), or the physician felt challenged (OR = 3.6; 95% CI, 1.8-7.2). CONCLUSIONS: The quality of information on the Internet is paramount: accurate relevant information is beneficial, while inaccurate information is harmful. Physicians appear to acquiesce to clinically-inappropriate requests generated by information from the Internet, either for fear of damaging the physician-patient relationship or because of the negative effect on time efficiency of not doing so. A minority of physicians feels challenged by patients bringing health information to the visit; reasons for this require further research. [J Med Internet Res 2003;5(3):e17]