Search

The quality of road pavements is highly impacted by environmental variables, such as temperature, humidity, and weather; and construction-related variables, such as material quality and time. In this paper, an advanced data collection and analysis system based on big data/cloud was proposed for the use of IoT location-based smart platforms for pavement quality big data at road pavement sites. For the big data platform, a relational database management system (RDBMS) for a general alphanumeric data-based infrastructure for IoT-based systems was designed based on distributed/parallel processing to enable rapid and big data collection and analysis. The structure was established based on a NoSQL-based database to enable real-time high-speed collection and analysis, and the big data platform was developed as a data collection and visualization infrastructure. When the big data system was studied using data analysis methods, the proposed system demonstrated improvements in data collection performance and analysis speed, indicating that analysis results could be derived in real time. Specifically, the data collection processing (create) speed of the NoSQL-based system (0.405 ms) was significantly higher than that of the compared existing system (21.146 ms). Real-time processing capacity was also verified based on quality big data generated on actual road pavements, and the proposed system was proven suitable for the real-time monitoring (the data collection processing) of road pavement quality big data.

Big Data means a very large amount of data and includes a range of methodologies such as big data collection, processing, storage, management, and analysis. Since Big Data Text Mining extracts a lot of features and data, clustering and classification can result in high computational complexity and the low reliability of the analysis results. In particular, a TDM (Term Document Matrix) obtained through text mining represents term-document features but features a sparse matrix. In this paper, the study focuses on selecting a set of optimized features from the corpus. A Genetic Algorithm (GA) is used to extract terms (features) as desired according to term importance calculated by the equation found. The study revolves around feature selection method to lower computational complexity and to increase analytical performance. We designed a new genetic algorithm to extract features in text mining. TF-IDF is used to reflect document-term relationships in feature extraction. Through the repetitive process, features are selected as many as the predetermined number. We have conducted clustering experiments on a set of spam-mail documents to verify and to improve feature selection performance. And we found that the proposal FSGA algorithm shown better performance of Text Clustering and Classification than using all of features. [ABSTRACT FROM AUTHOR]