Search

PDF of slides presented at the January 2022 ESIP meeting, in the Recent Advancement in Marine Data Management session.The focus is on metadata collected and managed by the Shipboard Meteorological and Oceanographic System Initiative, with an emphasis on opportunities for collaboration with the marine biogeochemistry community.

There is a need in the oceanographic community for a generalized match-up capability that is publicly accessible and provides flexibility and reproducibility for use cases ranging from Ocean Science to satellite retrieval calibration and validation. The Cloud-based Data Match-Up Service (CDMS) is a collaborative effort between NASA JPL, COAPS, NCAR, and Saildrone to address this need. This talk will demonstrate the present and planned capabilities of CDMS. CDMS is an extension of the Distributed Oceanographic Match-Up Service (DOMS) which was funded by the NASA AIST program, with additional support now under NASA ACCESS to deliver a production-ready match-up capability that fully leverages cloud-native services and is ready for infusion at data archive centers and with other projects. CDMS provides a mechanism for users to input a series of geospatial references for satellite datasets and receive the in situ or satellite observations that are collocated based on provided temporal and spatial ranges. CDMS eliminates the need for one-off match-up programs that require satellite and in situ data to be housed locally as the computation occurs in the cloud and supports connectivity to remote data providers via a common set of interfaces and protocols. CDMS exposes a number of HTTP API endpoints, allowing users to execute match-up requests from their desired programming environment. The software stack that enables the CDMS match-up capability is available via the Apache Science Data Analytics Platform (SDAP) which is an Apache incubator project. This poster was presented at the July 2022 ESIP Meeting, held in Pittsburgh, PA..

The Cloud-based Data Match-Up Service (CDMS) is a collaborative effort between NASA JPL, COAPS, NCAR, and Saildrone. CDMS is an extension of the Distributed Oceanographic Match-Up Service (DOMS) which was funded by the NASA AIST program. CDMS will provide a mechanism for users to input a series of geospatial references for satellite observations and receive the in situ or satellite observations that are matched to the primary satellite data within selectable temporal and spatial search domains. This presentation was given at the 2022 NASA ESDSWG Meeting (April 19-21, 2022).

The Cloud-based Data Match-Up Service (CDMS) is a collaborative effort between NASA JPL, COAPS, NCAR, and Saildrone. CDMS is an extension of the Distributed Oceanographic Match-Up Service (DOMS) which was funded by the NASA AIST program. CDMS will provide a mechanism for users to input a series of geospatial references for satellite observations and receive the in situ or satellite observations that are matched to the primary satellite data within selectable temporal and spatial search domains. The software stack that enables CDMS match-up capability is available via the Apache Science Data Analytics Platform (SDAP), which is an Apache incubator project. Under the ACCESS program, the team plans to deliver a production-ready match-up capability that fully leverages cloud-native services.This poster was presented at the 2021 Earth Science Information Partners (ESIP) Summer Meeting held virtually in July 2021.

We developed an innovative netCDF4 specification for match-up data that can serve as a standard for one-to-one and many-to-many relationships between point data. A CSV output provides a flat/verbose version of the same information included in the netCDF. Both output file formats contain the same metadata that follows CF conventions with additional attributes added to keep track of DOMS specific information. This poster was presented at the Earth Science Information Partners (ESIP) Winter Meeting in January 2019.

The Rolling Deck to Repository (R2R) program provides US academic fleet-wide management of underway data to ensure preservation of, and access to, out national oceanographic research assets. Assessment of underway meteorological data within R2R is implemented in near-real time in partnership with the Shipboard Automated Meteorological and Oceanographic System (SAMOS) initiative. The SAMOS Initiative has been collecting, quality-evaluating, distributing, and archiving underway meteorological and oceanographic observations since 2015. To connect near-real time SAMOS data to cruises defined in the R2R cruise catalog and their relevant data and products, an automated reciprocal linking system is established between the two programs to provide URLs to their respective data download web pages. This reciprocal linking allows for SAMOS data to be organized and searched by cruise, improving the discoverability and usability of the data. On R2R's end, the linking provides users easy access to quality-evaluated data and metadata that are relevant to select cruises. This poster was presented at the Earth Science Information Partners (ESIP) Winter Meeting in January 2019.