Back to Search Start Over

DAMP: accurate time series anomaly detection on trillions of datapoints and ultra-fast arriving data streams.

Authors :
Lu, Yue
Wu, Renjie
Mueen, Abdullah
Zuluaga, Maria A.
Keogh, Eamonn
Source :
Data Mining & Knowledge Discovery; Mar2023, Vol. 37 Issue 2, p627-669, 43p
Publication Year :
2023

Abstract

Time series anomaly detection is one of the most active areas of research in data mining, with dozens of new approaches been suggested each year. In spite of all these creative solutions proposed for this problem, recent empirical evidence suggests that the time series discord, a relatively simple twenty-year old distance-based technique, remains among the state-of-art techniques. While there are many algorithms for computing the time series discords, they all have limitations. First, they are limited to the batch case, whereas the online case is more actionable. Second, these algorithms exhibit poor scalability beyond tens of thousands of datapoints. In this work we introduce DAMP, a novel algorithm that addresses both these issues. DAMP computes exact left-discords on fast arriving streams, at up to 300,000 Hz using a commodity desktop. This allows us to find time series discords in datasets with trillions of datapoints for the first time. We will demonstrate the utility of our algorithm with the most ambitious set of time series anomaly detection experiments ever conducted. We will further show that our speedup improvements can be applied in the multidimensional case. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
13845810
Volume :
37
Issue :
2
Database :
Complementary Index
Journal :
Data Mining & Knowledge Discovery
Publication Type :
Academic Journal
Accession number :
162078208
Full Text :
https://doi.org/10.1007/s10618-022-00911-7