Search

With a wide range of satellite-derived vegetation bio-geophysical products now available to users, validation efforts are required to assess their accuracy and fitness for purpose. Substantial progress in the validation of such products has been made over the last two decades, but quantification of the uncertainties associated with in situ reference measurements is rarely performed, and the incorporation of uncertainties within upscaling procedures is cursory at best. Since current validation practices assume that reference data represent the truth, our ability to reliably demonstrate compliance with product uncertainty requirements through conformity testing is limited. The Fiducial Reference Measurements for Vegetation (FRM4VEG) project, initiated by the European Space Agency, is aiming to address this challenge by applying metrological principles to vegetation and surface reflectance product validation. Following FRM principles, and in accordance with the International Standards Organisation’s (ISO) Guide to the Expression of Uncertainty in Measurement (GUM), for the first time, we describe an end-to-end uncertainty evaluation framework for reference data of two key vegetation bio-geophysical variables: the fraction of absorbed photosynthetically active radiation (FAPAR) and canopy chlorophyll content (CCC). The process involves quantifying the uncertainties associated with individual in situ reference measurements and incorporating these uncertainties within the upscaling procedure (as well as those associated with the high-spatial-resolution imagery used for upscaling). The framework was demonstrated in two field campaigns covering agricultural crops (Las Tiesas–Barrax, Spain) and deciduous broadleaf forest (Wytham Woods, UK). Providing high-spatial-resolution reference maps with per-pixel uncertainty estimates, the framework is applicable to a range of other bio-geophysical variables including leaf area index (LAI), the fraction of vegetation cover (FCOVER), and canopy water content (CWC). The proposed procedures will facilitate conformity testing of moderate spatial resolution vegetation bio-geophysical products in future validation exercises.

Decision makers need accessible robust evidence to introduce new policies to mitigate and adapt to climate change. There is an increasing amount of environmental information available to policy makers concerning observations and trends relating to the climate. However, this data is hosted across a multitude of websites often with inconsistent metadata and sparse information relating to the quality, accuracy and validity of the data. Subsequently, the task of comparing datasets to decide which is the most appropriate for a certain purpose is very complex and often infeasible. In support of the European Union’s Copernicus Climate Change Service (C3S) mission to provide authoritative information about the past, present and future climate in Europe and the rest of the world, each dataset to be provided through this service must undergo an evaluation of its climate relevance and scientific quality to help with data comparisons. This paper presents the framework for Evaluation and Quality Control (EQC) of climate data products derived from satellite and in situ observations to be catalogued within the C3S Climate Data Store (CDS). The EQC framework will be implemented by C3S as part of their operational quality assurance programme. It builds on past and present international investment in Quality Assurance for Earth Observation initiatives, extensive user requirements gathering exercises, as well as a broad evaluation of over 250 data products and a more in-depth evaluation of a selection of 24 individual data products derived from satellite and in situ observations across the land, ocean and atmosphere Essential Climate Variable (ECV) domains. A prototype Content Management System (CMS) to facilitate the process of collating, evaluating and presenting the quality aspects and status of each data product to data users is also described. The development of the EQC framework has highlighted cross-domain as well as ECV specific science knowledge gaps in relation to addressing the quality of climate data sets derived from satellite and in situ observations. We discuss 10 common priority science knowledge gaps that will require further research investment to ensure all quality aspects of climate data sets can be ascertained and provide users with the range of information necessary to confidently select relevant products for their specific application.