Back to Search
Start Over
Characterizing E-Science File Access Behavior via Latent Dirichlet Allocation
- Source :
- 4th IEEE International Conference on Utility and Cloud Computing (UCC 2011), 4th IEEE International Conference on Utility and Cloud Computing (UCC 2011), Dec 2011, Melbourne, Australia, UCC
- Publication Year :
- 2011
- Publisher :
- HAL CCSD, 2011.
-
Abstract
- International audience; E-science is moving from grids to clouds. Getting the best of both worlds needs to build on the experience gained by the steady operation of production grids since some years. With the Grid Observatory initiative, trace data are publicly available to the computer science and engineering community and can be used for dimensioning and optimizing infrastructure. This paper proposes a new approach for analyzing behavioral traces: as most of them are indeed text documents, state of the art techniques in text mining, and specifically Latent Dirichlet Allocation, can be exploited. The advantages are twofold: providing some level of explanation inferred from the data; and a relatively scalable way to capture the temporal variability of the behavior of interest, while retaining the full dimensionality of the problem at hand. We experiment the text mining analogy approach by characterizing file access behavior. We validate the resulting probabilistic model by showing that it is capable of generating synthetic traces statistically consistent with the real ones.
- Subjects :
- Computer science
Probabilistic logic
[INFO.INFO-LG] Computer Science [cs]/Machine Learning [cs.LG]
02 engineering and technology
computer.software_genre
Grid
01 natural sciences
Latent Dirichlet allocation
010104 statistics & probability
symbols.namesake
Grid computing
[INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG]
e-Science
Scalability
[INFO.INFO-DC] Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC]
0202 electrical engineering, electronic engineering, information engineering
symbols
020201 artificial intelligence & image processing
Data mining
Graphical model
0101 mathematics
[INFO.INFO-DC]Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC]
computer
Curse of dimensionality
Subjects
Details
- Language :
- English
- Database :
- OpenAIRE
- Journal :
- 4th IEEE International Conference on Utility and Cloud Computing (UCC 2011), 4th IEEE International Conference on Utility and Cloud Computing (UCC 2011), Dec 2011, Melbourne, Australia, UCC
- Accession number :
- edsair.doi.dedup.....81292b940499b443fc08812427757656