Back to Search Start Over

Scalable and distributed architecture based on Apache Spark Streaming and PROM6 for processing RoRo terminals logs

Authors :
Hassan Badir
Azedine Boulmakoul
Mouna Amrou Mhand
Source :
Proceedings of the New Challenges in Data Sciences: Acts of the Second Conference of the Moroccan Classification Society.
Publication Year :
2019
Publisher :
ACM, 2019.

Abstract

With the increasing number of companies encompassing Big data, it is evident that the utmost challenge is to associate enormous quantity of event data to operational business processes that are extremely dynamic. To unbind the value of event data, events need to be firmly affiliated to the monitoring and control of operational processes. Nevertheless, Big data technologies converge essentially on storage, processing and rarely center on improving processes. In view of this, we advocate the integration of technologies of big data and process analysis namely Apache Kafka, Spark Streaming and PROM6. In this work, we design a scalable and distributed architecture for real time monitoring of operational business processes of a RoRo port terminal. The proposed solution permits the exploitation of process mining techniques to process large amount of events logs of several hundreds of gigabytes for process mining analysis.

Details

Database :
OpenAIRE
Journal :
Proceedings of the New Challenges in Data Sciences: Acts of the Second Conference of the Moroccan Classification Society
Accession number :
edsair.doi...........4ccfc9577c56fdddbc90abd6317db43a