Search

Quality assessment in industrial applications is often carried out through visual inspection, usually performed or supported by human domain experts. However, the manual visual inspection of processes and products is error-prone and expensive. It is therefore not surprising that the automation of visual inspection in manufacturing and maintenance is heavily researched and discussed. The use of artificial intelligence as an approach to visual inspection in industrial applications has been considered for decades. Recent successes, driven by advances in deep learning, present a possible paradigm shift and have the potential to facilitate automated visual inspection, even under complex environmental conditions. For this reason, we explore the question of to what extent deep learning is already being used in the field of automated visual inspection and which potential improvements to the state of the art could be realized utilizing concepts from academic research. By conducting an extensive review of the openly accessible literature, we provide an overview of proposed and in-use deep-learning models presented in recent years. Our survey consists of 196 open-access publications, of which 31.7% are manufacturing use cases and 68.3% are maintenance use cases. Furthermore, the survey also shows that the majority of the models currently in use are based on convolutional neural networks, the current de facto standard for image classification, object recognition, or object segmentation tasks. Nevertheless, we see the emergence of vision transformer models that seem to outperform convolutional neural networks but require more resources, which also opens up new research opportunities for the future. Another finding is that in 97% of the publications, the authors use supervised learning techniques to train their models. However, with the median dataset size consisting of 2500 samples, deep-learning models cannot be trained from scratch, so it would be beneficial to use other training paradigms, such as self-supervised learning. In addition, we identified a gap of approximately three years between approaches from deep-learning-based computer vision being published and their introduction in industrial visual inspection applications. Based on our findings, we additionally discuss potential future developments in the area of automated visual inspection.

Traffic analysis is one of the crucial tasks of intelligent transport system that utilizes deep learning for range of purposes. Many tasks, such as vehicle recognition, vehicle counting, traffic violation monitoring, vehicle speed monitoring, vehicle density and so on, can be accomplished by using cameras installed in strategic locations along roads. In this paper powerful deep learning techniques such as (Yolov5, Mask R-CNN, SSD) and state-of-the-art object tracking algorithm known as DeepSORT was used to perform real time vehicle detection and counting in a video. A new highway vehicle detection dataset with overall of 32,265, instances of four vehicle classes named: bus, car, motorbike, truck was created in this paper and utilized for training vehicle detection and counting system. Result shows that average counting accuracy by using Yolov5 combined DeepSORT reaches to 95% while reaches to 91% by using Mask R-CNN combined DeepSORT and 84% by using SSD combined DeepSORT in hard environment. From the experimental work, counting accuracy by using Yolov5 outperforms other two deep learning techniques.

Pandemics can result in large morbidity and mortality rates that can cause significant adverse effects on the social and economic situations of communities. Monitoring and predicting the spread of pandemics helps the concerned authorities manage the required resources, formulate preventive measures, and control the spread effectively. In the specific case of COVID-19, the UAE (United Arab Emirates) has undertaken many initiatives, such as surveillance and contact tracing by introducing mobile apps such as Al Hosn, containment of spread by limiting the gathering of people, online schooling and remote work, sanitation drives, and closure of public places. The aim of this paper is to predict the trends occurring in pandemic outbreak, with COVID-19 in the UAE being a specific case study to investigate. In this paper, a predictive modeling approach is proposed to predict the future number of cases based on the recorded history, taking into consideration the enforced policies and provided vaccinations. Machine learning models such as LASSO Regression and Exponential Smoothing, and deep learning models such as LSTM, LSTM-AE, and bi-directional LSTM-AE, are utilized. The dataset used is publicly available from the UAE government, Federal Competitiveness and Statistics Centre (FCSC) and consists of several attributes, such as the numbers of confirmed cases, recovered cases, deaths, tests, and vaccinations. An additional categorical attribute is manually added to the dataset describing whether an event has taken place, such as a national holiday or a sanitization drive, to study the effect of such events on the pandemic trends. Experimental results showed that the Univariate LSTM model with an input of a five-day history of Confirmed Cases achieved the best performance with an RMSE of 275.85, surpassing the current state of the art related to the UAE by over 30%. It was also found that the bi-directional LSTMs performed relatively well. The approach proposed in the paper can be applied to monitor similar infectious disease outbreaks and thus contribute to strengthening the authorities’ preparedness for future pandemics.

Accurately assessing the state of health (SOH) of lithium batteries is of great significance for improving battery safety performance. However, the current assessment for SOH suffers from the difficulty of selecting health features and the lack of uncertainty using data-driven methods. To this end, this paper proposes a health state assessment method for lithium-ion batteries based on health feature extraction and an improved Informer model. First, multiple features that can reflect the SOH of lithium-ion batteries were extracted from the charging and discharging time, the peak value of incremental capacity curve (ICC), and the inflection point value of differential voltage curve, etc., and the correlation between multiple health features and the health state was evaluated by gray correlation analysis. Then, an improved Informer model is proposed to establish a health state estimation method for lithium-ion batteries. Finally, the proposed algorithm is tested and validated using publicly available battery charge/discharge datasets and compared with other algorithms. The results show that the method in this paper can realize high-precision SOH prediction with a root-mean-square error (RMSE) of 0.011, and the model fit reaches more than 98%.

With the exponential growth of data, extracting actionable insights becomes resource-intensive. In many organizations, normalized relational databases store a significant portion of this data, where tables are interconnected through some relations. This paper explores relational learning, which involves joining and merging database tables, often normalized in the third normal form. The subsequent processing includes extracting features and utilizing them in machine learning (ML) models. In this paper, we experiment with the propositionalization algorithm (i.e., Wordification) for feature engineering. Next, we compare the algorithms PropDRM and PropStar, which are designed explicitly for multi-relational data mining, to traditional machine learning algorithms. Based on the performed experiments, we concluded that Gradient Boost, compared to PropDRM, achieves similar performance (F1 score, accuracy, and AUC) on multiple datasets. PropStar consistently underperformed on some datasets while being comparable to the other algorithms on others. In summary, the propositionalization algorithm for feature extraction makes it feasible to apply traditional ML algorithms for relational learning directly. In contrast, approaches tailored specifically for relational learning still face challenges in scalability, interpretability, and efficiency. These findings have a practical impact that can help speed up the adoption of machine learning in business contexts where data is stored in relational format without requiring domain-specific feature extraction.

Today, reinforcement learning is one of the most effective machine learning approaches in the tasks of automatically adapting computer systems to user needs. However, implementing this technology into a digital product requires addressing a key challenge: determining the reward model in the digital environment. This paper proposes a usability reward model in multi-agent reinforcement learning. Well-known mathematical formulas used for measuring usability metrics were analyzed in detail and incorporated into the usability reward model. In the usability reward model, any neural network-based multi-agent reinforcement learning algorithm can be used as the underlying learning algorithm. This paper presents a study using independent and actor-critic reinforcement learning algorithms to investigate their impact on the usability metrics of a mobile user interface. Computational experiments and usability tests were conducted in a specially designed multi-agent environment for mobile user interfaces, enabling the implementation of various usage scenarios and real-time adaptations.

Tomb murals are different from cave temple murals and temple murals, as they are underground cultural relics, their painting style is unique, solemn, and austere, and the performance image is characterised by simple colours, low contrast, and fewer survivors. During the digital restoration process, it is important to have sufficient reference samples to ensure the accuracy of the restoration. In addition, the style of mural paintings in the tombs varies greatly from other styles of murals and types of word paintings. Therefore, learning the unique artistic style of tomb murals, providing stylistically consistent training samples for digital restoration, and overcoming the problems of dim lighting and complex surface granularity of tomb murals are all necessary for research. This paper proposes a generative adversarial network algorithm that separates and fuses style features to enhance the generative network’s ability to acquire image information. The algorithm extracts underlying and surface style feature details of the image to be tested and conducts fusion generation experiments. The generative network’s parsing layer modifies the input noise tensor and optimises the corresponding weights to prevent misalignment between drawing lines and fresco cracks. Finally, to optimise the fresco generation effect, we add the corresponding loss function in the discriminator. The tomb murals dataset was established for experiments and tests, and quantitatively and qualitatively analysed with other style migration models, and SSIM, FID, LPIPS and NIQE were used as evaluation indexes. The results were 0.97, 269.579, 0.425 and 3.250, respectively, and the effect of style migration of this paper’s method was significantly higher than that of the control group model.

With the rapid development of digital core technology, the acquisition of high-resolution rock thin section images has become crucial. Due to the limitation of optical principles, thin section imaging involves a contradiction between resolution and field of view. In order to solve this problem, this paper proposes a lightweight, fully aggregated network with multi-branch structure for super resolution of rock thin section images. The experimental results on the rock thin section dataset demonstrate that the improved method, called OmniSR-M, achieves significant enhancement compared to the original OmniSR method and also surpasses other state-of-the-art methods. OmniSR-M effectively recovers image details while maintaining its lightweight nature. Specifically, OmniSR-M reduces the number of parameters by 26.56% and the computation by 27.66% compared to OmniSR. Moreover, this paper quantitatively analyzes both the facies porosity rate and grain size features in the application scenario. The results show that the images generated by OmniSR-M successfully recover key information about the rock thin section.

Evolutionary multi-objective clustering (EMOC) algorithms have gained popularity recently, as they can obtain a set of clustering solutions in a single run by optimizing multiple objectives. Particularly, in one type of EMOC algorithm, the number of clusters k is taken as one of the multiple objectives to obtain a set of clustering solutions with different k. However, the numbers of clusters k and other objectives are not always in conflict, so it is impossible to obtain the clustering solutions with all different k in a single run. Therefore, evolutionary multi-objective k-clustering (EMO-KC) has recently been proposed to ensure this conflict. However, EMO-KC could not obtain good clustering accuracy on high-dimensional datasets. Moreover, EMO-KC’s validity is not ensured as one of its objectives (SSDexp, which is transformed from the sum of squared distances (SSD)) could not be effectively optimized and it could not avoid invalid solutions in its initialization. In this paper, an improved evolutionary multi-objective clustering algorithm based on autoencoder (AE-IEMOKC) is proposed to improve the accuracy and ensure the validity of EMO-KC. The proposed AE-IEMOKC is established by combining an autoencoder with an improved version of EMO-KC (IEMO-KC) for better accuracy, where IEMO-KC is improved based on EMO-KC by proposing a scaling factor to help effectively optimize the objective of SSDexp and introducing a valid initialization to avoid the invalid solutions. Experimental results on several datasets demonstrate the accuracy and validity of AE-IEMOKC. The results of this paper may provide some useful information for other EMOC algorithms to improve accuracy and convergence.

This paper addresses the limitations of relying solely on facial expressions for emotion recognition by proposing an advanced approach that emphasizes continuous monitoring of electroencephalography (EEG) signals. Recognizing the potential for deception in facial expressions, our study leverages the growing interest in EEG signals, tapping into advancements in deep learning and machine learning. By optimizing the configuration of EEG electrodes, our approach enhances the accuracy of emotion classification systems, offering a streamlined solution. The proposed multi-input system refines EEG-based emotion recognition efficiency and integrates facial expression analysis to enhance overall system effectiveness. Through the application of brain heat map topographies and facial expression recognition, our system, employing just nine electrodes, outperforms basic emotion recognition setups. Experimental results validate that combining facial expression analysis with EEG signals provides a more comprehensive and accurate understanding of human emotions. This innovative approach holds significance across various sectors, including healthcare, psychology, and human–computer interaction. The paper introduces a novel multi-input system approach, collaboratively fusing two powerful deep learning algorithms: two Convolutional Neural Networks (CNNs). The proposed EEG-based CNN algorithm achieves an efficiency of 87.43%, rising to 91.21% when integrated with the DeepFace CNN. The seamless integration of facial expressions and brain topographies enables the system to efficiently harness abundant information from both modalities, ensuring a thorough comprehension of human emotions. By capitalizing on the combined advantages of analyzing facial expressions and EEG-derived brain topography, this avant-garde technique substantially improves both precision and efficiency in emotion recognition systems. This enhancement establishes a foundation for the introduction of innovative applications across a spectrum of fields.