Search

Background: Digital technologies are transforming the health care system. A large part of information is generated as real-world data (RWD). Data from electronic health records and digital biomarkers have the potential to reveal associations between the benefits and adverse events of medicines, establish new patient-stratification principles, expose unknown disease correlations, and inform on preventive measures. The impact for health care payers and providers, the biopharmaceutical industry, and governments is massive in terms of health outcomes, quality of care, and cost. However, a framework to assess the preliminary quality of RWD is missing, thus hindering the conduct of population-based observational studies to support regulatory decision-making and real-world evidence. Objective: To address the need to qualify RWD, we aimed to build a web application as a tool to translate characterization of some quality parameters of RWD into a metric and propose a standard framework for evaluating the quality of the RWD. Methods: The RWD-Cockpit systematically scores data sets based on proposed quality metrics and customizable variables chosen by the user. Sleep RWD generated de novo and publicly available data sets were used to validate the usability and applicability of the web application. The RWD quality score is based on the evaluation of 7 variables: manageability specifies access and publication status; complexity defines univariate, multivariate, and longitudinal data; sample size indicates the size of the sample or samples; privacy and liability stipulates privacy rules; accessibility specifies how the data set can be accessed and to what granularity; periodicity specifies how often the data set is updated; and standardization specifies whether the data set adheres to any specific technical or metadata standard. These variables are associated with several descriptors that define specific characteristics of the data set. Results: To address the need to qualify RWD, we built the RWD-Cockpit web application, which proposes a framework and applies a common standard for a preliminary evaluation of RWD quality across data sets--molecular, phenotypical, and social--and proposes a standard that can be further personalized by the community retaining an internal standard. Applied to 2 different case studies--de novo-generated sleep data and publicly available data sets--the RWD-Cockpit could identify and provide researchers with variables that might increase quality. Conclusions: The results from the application of the framework of RWD metrics implemented in the RWD-Cockpit application suggests that multiple data sets can be preliminarily evaluated in terms of quality using the proposed metrics. The output scores--quality identifiers--provide a first quality assessment for the use of RWD. Although extensive challenges remain to be addressed to set RWD quality standards, our proposal can serve as an initial blueprint for community efforts in the characterization of RWD quality for regulated settings. [ABSTRACT FROM AUTHOR]

Background: The life science industry has a strong interest in real-world data (RWD), a term that is currently being used in many ways and with varying definitions depending on the source. In this review article, we provide a summary overview of the challenges and risks regarding the use of RWD and its translation into real-world evidence and provide a classification and visualization of RWD challenges by means of the RWD Challenges Radar., Summary: Based on a systematic literature search, we identified 3 types of challenges - organizational, technological, and people-based - that must be addressed when deriving evidence from RWD to be used in drug approval and other applications. It further demonstrates that numerous different aspects, for example, related to the application field and the associated industry, must be considered. A key finding in our review is that the regulatory landscape must be carefully assessed before utilizing RWD., Key Messages: Establishing awareness and insight into the challenges and risks regarding the use of RWD will be key to taking full advantage of the RWD potential. As a result of this review, an "RWD Challenges Radar" will support the establishment of awareness by providing a comprehensive overview of the relevant aspects to be considered when employing RWD., Competing Interests: The authors have no conflicts of interest to declare., (Copyright © 2021 by S. Karger AG, Basel.)