Search

Background: The Research Engagement Survey Tool (REST) was developed to examine the level of partner (e.g., patients, caregivers, advocates, clinicians, community members) engagement in research studies. The REST is aligned with eight engagement principles based on the literature and consensus reached through a five round Delphi process. Each of the engagement principles has three-five corresponding items that are assessed on two Likert type scales quantity (how often: never, rarely, sometimes, often, always, not applicable) and quality (how well: poor, fair, good, very good, excellent, not applicable). We conducted a comprehensive validation of the REST. Despite the importance of partner engagement in research, currently no gold standard measure exists. Methods: Multiple strategies were employed to validate the REST. Here, we examine the internal consistency of items for each of the eight engagement principles. In addition, we examine the convergent validity of the comprehensive (32-item) REST with other measures (e.g., medical mistrust, Community Engagement in Research Index, Partnership Self-Assessment Tool, Wilder collaboration inventory, Partnership Assessment In community-based Research). We propose two scoring approaches for the REST; one aligned with the engagement principles and the other aligned with levels of community engagement: (1) outreach and education, (2) consultation, (3) cooperation, (4) collaboration, and (5) partnership. Results: The REST has strong internal consistency (Cronbach's alpha > 0.75) for each of the eight engagement principals measured on both scales (quality and quantity). The REST had negligible (e.g., medical mistrust, community engagement in research index), low (e.g., Partnership Assessment In community-based Research, Partnership Self-Assessment Tool- benefits scale), and moderate (e.g., Wilder collaboration inventory, Partnership Self-Assessment Tool- synergy scale) statistically significant correlations with other measures based on the Spearman rank correlation coefficient. These results suggest the REST is measuring something similar and correlated to the existing measures, but it captures a different construct (perceived research engagement). Conclusions: The REST is a valid and reliable tool to assess research engagement of community health stakeholders in the research process. Valid tools to assess research engagement are necessary to examine the impact of engagement on the scientific process and scientific discovery and move the field of stakeholder engagement from best practices and lessons learned to evidence-based approaches based on empirical data. Plain English summary: Researchers often conduct studies with partners (e.g., patients, caregivers, advocates, clinicians, community members) who also have an interest in the research topic. Depending on the research study the level of partner engagement in the research process may be high or low. Partners may be involved from the beginning including determining what topic to study and what questions the study should examine. They may suggest who should be included in the study, the geographic area of focus, and the outcome measures to be examined. In addition, they may help recruit study participants, interpret study results, and plan for how to share the results with those that need to know. No standard way exists to find out how involved a partner has been in a study from the partner's perspective. Here we develop and validate survey questions to measure the level of partner engagement in research studies. We looked at existing survey questions used to measure similar topics to make sure that a person who takes the survey gets consistent scores. We tested the survey with community health stakeholders (e.g., patients, caregivers, advocates, clinicians, community members) who are research partners for studies at universities across the United States. Over 2 years, the partners took different versions of the survey online four times. We used the data we collected from each survey to revise the questions and make sure that it measures partner involvement accurately and reliably. The Research Engagement Survey Tool (REST) has 32 questions to examine eight engagement principles on two scales: quantity (how much) and quality (how well). The REST is a valid and reliable tool to examine partner engagement in research. [ABSTRACT FROM AUTHOR]

Background: Synthesis of psychometric properties of substance use measures to identify patterns of use and substance use disorders remains limited. To address this gap, we sought to systematically evaluate the psychometric properties of measures to detect substance use and misuse.Methods: We conducted a systematic review and meta-analysis of literature on measures of substance classes associated with HIV risk (heroin, methamphetamine, cocaine, ecstasy, alcohol) that were published in English before June 2016 that reported at least one of the following psychometric outcomes of interest: internal consistency (alpha), test-retest/inter-rater reliability (kappa), sensitivity, specificity, positive predictive value, and negative predictive value. We used meta-analytic techniques to generate pooled summary estimates for these outcomes using random effects and hierarchical logistic regression models.Results: Findings across 387 paper revealed that overall, 65% of pooled estimates for alpha were in the range of fair-to-excellent; 44% of estimates for kappa were in the range of fair-to-excellent. In addition, 69, 97, 37 and 96% of pooled estimates for sensitivity, specificity, positive predictive value, and negative predictive value, respectively, were in the range of moderate-to-excellent.Conclusion: We conclude that many substance use measures had pooled summary estimates that were at the fair/moderate-to-excellent range across different psychometric outcomes. Most scales were conducted in English, within the United States, highlighting the need to test and validate these measures in more diverse settings. Additionally, the majority of studies had high risk of bias, indicating a need for more studies with higher methodological quality. [ABSTRACT FROM AUTHOR]

Background: Fibromyalgia (FM), a disorder characterized by chronic widespread pain and tenderness, affects greater than five million individuals in the United States alone. Patients experience multiple symptoms in addition to pain, and among them, fatigue is one of the most bothersome and disabling. There is a growing body of literature suggesting that fatigue is a multidimensional concept. Currently, to our knowledge, no multidimensional Patient Reported Outcome (PRO) measure of FM-related fatigue meets Food and Drug Administration (FDA) requirements to support a product label claim. Therefore, the objective of this research was to evaluate qualitative and quantitative data previously gathered to inform the development of a comprehensive, multidimensional, PRO measure to assess FM-related fatigue in FM clinical trials.Methods: Existing qualitative and quantitative data from three previously conducted studies in patients with FM were reviewed to inform the initial development of a multidimensional PRO measure of FM-related fatigue: 1) a concept elicitation study involving in-depth, open-ended interviews with patients with FM in the United States (US) (N = 20), Germany (N = 10), and France (N = 10); 2) a cognitive debriefing and pilot study of a preliminary pool of 23 items (N = 20 US patients with FM); and 3) a methodology study that explored initial psychometrics of the item pool (N = 145 US patients with FM).Results: Five domains were identified that intend to capture the broad experience of FM-related fatigue reported in the qualitative research: the Global Fatigue Experience, Cognitive Fatigue, Physical Fatigue, Motivation, and Impact on Function. Seventeen of the original pool of 23 items were selected to best capture these five dimensions. These 17 items formed the basis of a newly developed multidimensional PRO measure to assess FM-related fatigue in clinical trials: the Multidimensional Daily Diary of Fatigue-Fibromyalgia-17 (MDF-Fibro-17).Conclusion: Qualitative analysis, and preliminary quantitative item level data, confirmed that FM-related fatigue is multidimensional and provided strong support for the content validity of the MDF-Fibro-17. The next stage was to quantitatively evaluate the measure to confirm the factor structure, psychometric properties, sensitivity to change, and meaningful change. This has been conducted and is being reported separately. [ABSTRACT FROM AUTHOR]

Background: Low literacy and numeracy skills are common. Adequate numeracy skills are crucial in the management of diabetes. Diabetes patients use numeracy skills to interpret glucose meters, administer medications, follow dietary guidelines and other tasks. Existing literacy scales may not be adequate to assess numeracy skills. This paper describes the development and psychometric properties of the Diabetes Numeracy Test (DNT), the first scale to specifically measure numeracy skills used in diabetes. Methods: The items of the DNT were developed by an expert panel and refined using cognitive response interviews with potential respondents. The final version of the DNT (43 items) and other relevant measures were administered to a convenience sample of 398 patients with diabetes. Internal reliability was determined by the Kuder-Richardson coefficient (KR-20). An a priori hypothetical model was developed to determine construct validity. A shortened 15-item version, the DNT15, was created through split sample analysis. Results: The DNT had excellent internal reliability (KR-20 = 0.95). The DNT was significantly correlated (p < 0.05) with education, income, literacy and math skills, and diabetes knowledge, supporting excellent construct validity. The mean score on the DNT was 61% and took an average of 33 minutes to complete. The DNT15 also had good internal reliability (KR-20 = 0.90 and 0.89). In split sample analysis, correlations of the DNT-15 with the full DNT in both sub-samples was high (rho = 0.96 and 0.97, respectively). Conclusion: The DNT is a reliable and valid measure of diabetes related numeracy skills. An equally adequate but more time-efficient version of the DNT, the DNT15, can be used for research and clinical purposes to evaluate diabetes related numeracy. [ABSTRACT FROM AUTHOR]

Background: When doctors have honest conversations with patients about their illness and involve them in decisions about their care, patients express greater satisfaction with care and lowered anxiety and depression. The Serious Illness Care Programme (the Programme), originally developed in the United States (U.S), promotes meaningful, realistic and focused conversations about patient's wishes, fears and worries for the future with their illness. The Serious Illness Conversation Guide (the guide) provides a framework to structure these conversations. The aim of this paper is to present findings from a study to examine the 'face validity', acceptability and relevance of the Guide for use within the United Kingdom (UK) health care setting.Methods: A multi-stage approach was undertaken, using three separate techniques: 1. Nominal Group Technique with clinician 'expert groups' to review the Serious Illness Conversation Guide: 14 'experts' in Oncology, Palliative Care and Communication Skills; 2. Cognitive Interviews with 6 patient and public representatives, using the 'think aloud technique'; to explore the cognitive processes involved in answering the questions in the guide, including appropriateness of language, question wording and format 3. Final stakeholder review and consensus.Results: Nominal Group Technique Unanimous agreement the conversation guide could provide a useful support to clinicians. Amendments are required but should be informed directly from the cognitive interviews. Training highlighted as key to underpin the use of the guide. Cognitive interviews The 'holistic' attention to the person as a whole was valued rather than a narrow focus on their disease. Some concern was raised regarding the 'formality' of some wording however and suggestions for amendments were made. Final stakeholder review Stakeholders agreed amendments to 5/13 prompts and unanimously agreed the UK guide should be implemented as a part of the pilot implementation of the Serious Illness Care Programme UK.Conclusion: Use of the guide has the potential to benefit patients, facilitating a 'person-centred' approach to these important conversations, and providing a framework to promote shared decision making and care planning. Further research is ongoing, to understand the impact of these conversations on patients, families and clinicians and on concordance of care delivery with expressed patient wishes. [ABSTRACT FROM AUTHOR]