Back to Search Start Over

A novel quality control method of time-series ocean wave observation data combining deep-learning prediction and statistical analysis.

Authors :
Xie, Jingrong
Jiang, Hao
Song, Wei
Yang, Jinkun
Source :
Journal of Sea Research. Oct2023, Vol. 195, pN.PAG-N.PAG. 1p.
Publication Year :
2023

Abstract

Quality control (QC) of marine data is a critical aspect in ensuring the usability of oceanic data. In this paper, we propose a novel QC method for time-series ocean wave data, which combines deep learning prediction and statistical analysis. Our method first realizes multi-element LSTM prediction of the time-series ocean wave observation data, capturing both temporal consistency and physical relationships between the multi-element inputs. Then, it applies peak detection on the regional mean difference ratio derived from the predicted and true values of the ocean wave data, and finally labels the anomalous data points based on peak detection results. We conducted experiments on the time-series wave data of four sites from the National Marine Science Center, China, and compared our proposed method with traditional QC method that is currently used for operational marine data quality control, as well as classic anomaly detection models including Isolation Forest and VAE-LSTM. The results show a significant improvement in the Precision, Recall, and F1 Score for erroneous samples using our proposed method. Our proposed method takes advantages of both deep learning and statistical analysis and considers physical correlation of multiple elements of marine data, effectively addressing the problem of erroneous discrimination of abnormal sea conditions in the traditional method, and providing valuable insights for the study of marine time-series observational data. • The results show a significant improvement in the Precision, Recall, and F1 Score for negative samples using our proposed approach. • By integrating deep learning and statistical methods, our proposed method achieves unsupervised quality control, effectively addressing the problem of erroneous discrimination of abnormal sea conditions in traditional methods, and providing valuable insights for the study of marine time-series observational data. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
13851101
Volume :
195
Database :
Academic Search Index
Journal :
Journal of Sea Research
Publication Type :
Academic Journal
Accession number :
171849167
Full Text :
https://doi.org/10.1016/j.seares.2023.102439