Back to Search
Start Over
Anomaly Detection in Network Traffic Using Dynamic Graph Mining with a Sparse Autoencoder
- Source :
- TrustCom/BigDataSE
- Publication Year :
- 2019
- Publisher :
- IEEE, 2019.
-
Abstract
- Network based attacks on ecommerce websites can have serious economic consequences. Hence, anomaly detection in dynamic network traffic has become an increasingly important research topic in recent years. This paper proposes a novel dynamic Graph and sparse Autoencoder based Anomaly Detection algorithm named GAAD. In GAAD, the network traffic over contiguous time intervals is first modelled as a series of dynamic bipartite graph increments. One mode projection is performed on each bipartite graph increment and the adjacency matrix derived. Columns of the resultant adjacency matrix are then used to train a sparse autoencoder to reconstruct it. The sum of squared errors between the reconstructed approximation and original adjacency matrix is then calculated. An online learning algorithm is then used to estimate a Gaussian distribution that models the error distribution. Outlier error values are deemed to represent anomalous traffic flows corresponding to possible attacks. In the experiment, a network emulator was used to generate representative ecommerce traffic flows over a time period of 225 minutes with five attacks injected, including SYN scans, host emulation and DDoS attacks. ROC curves were generated to investigate the influence of the autoencoder hyper-parameters. It was found that increasing the number of hidden nodes and their activation level, and increasing sparseness resulted in improved performance. Analysis showed that the sparse autoencoder was unable to encode the highly structured adjacency matrix structures associated with attacks, hence they were detected as anomalies. In contrast, SVD and variants, such as the compact matrix decomposition, were found to accurately encode the attack matrices, hence they went undetected.
- Subjects :
- Computer science
Network security
business.industry
Pattern recognition
02 engineering and technology
01 natural sciences
Autoencoder
Matrix decomposition
010104 statistics & probability
Singular value decomposition
0202 electrical engineering, electronic engineering, information engineering
Bipartite graph
Graph (abstract data type)
020201 artificial intelligence & image processing
Anomaly detection
Adjacency matrix
Artificial intelligence
0101 mathematics
business
Subjects
Details
- Database :
- OpenAIRE
- Journal :
- 2019 18th IEEE International Conference On Trust, Security And Privacy In Computing And Communications/13th IEEE International Conference On Big Data Science And Engineering (TrustCom/BigDataSE)
- Accession number :
- edsair.doi...........ad53b6e49452f29e719273b7af628153