Experiences with big data:Accounts from a data scientist’s perspective

Manufacturing has been rejuvenated by automation and digitalization. This has brought forth the new industrial era also called Industry 4.0. During the last few years, we have collaborated with companies from various industries that have all been going through this transformation. Through these collaborations, we have collected numerous examples of (sometimes troublesome) experiences with Big Data applications of production analytics. These experiences reflect the current state of production data and the challenges it poses. Our goal in this paper is to share those experiences and lessons learned in dealing with practical issues from data acquisition to data management and finally to data analytics.