Search

Seizure prediction are necessary for epileptic patients. The global spatial interactions among channels, and long-range temporal dependencies play a crucial role in seizure onset prediction. In addition, it is necessary to search for seizure prediction features in a vast space to learn new generalized feature representations. Many previous deep learning algorithms have achieved some results in automatic seizure prediction. However, most of them do not consider global spatial interactions among channels and long-range temporal dependencies together, and only learn the feature representation in the deep space. To tackle these issues, in this study, an novel bi-level programming seizure prediction model, B2-ViT Net, is proposed for learning the new generalized spatio-temporal long-range correlation features, which can characterize the global interactions among channels in spatial, and long-range dependencies in temporal required for seizure prediction. In addition, the proposed model can comprehensively learn generalized seizure prediction features in a vast space due to its strong deep and broad feature search capabilities. Sufficient experiments are conducted on two public datasets, CHB-MIT and Kaggle datasets. Compared with other existing methods, our proposed model has shown promising results in automatic seizure prediction tasks, and provides a certain degree of interpretability. [ABSTRACT FROM AUTHOR]

In actual industrial application scenarios, noise pollution makes it difficult to extract fault features accurately via conventional methods. A novel method for rolling bearing fault diagnosis combining a convolutional neural network (CNN), an attention mechanism for a squeeze-and-excitation network (SENet) module and a broad learning system (BLS) is proposed (SECNN–BLS). The one-dimensional bearing vibration signal is processed by using multiple short-time Fourier transforms (STFT); the two-dimensional image in the time-frequency domain is used as the model input. In the CNN fault feature extraction process, SENet is introduced to replace the CNN convolution layer, and global information is obtained through the squeeze operation. Excitation operation captures the importance of image channels, assigns weights adaptively to improve the attention on important information and eliminates the interference of irrelevant features without increasing the spatial and temporal complexity. The weighted feature representation is then transferred to the BLS input. The BLS has the characteristics of a flat structure and ridge regression to quickly solve the weights; as a fault classifier, it can save more computing resources and improve the accuracy of the fault classification. The SECNN–BLS fault diagnosis has achieved more than 98% accuracy on the Society for Machinery Failure Prevention Technology (MFPT) dataset. We also demonstrate the excellent performance of SECNN–BLS in a noisy environment. [ABSTRACT FROM AUTHOR]

With the vigorous development of Industry 4.0, industrial Big Data has turned into the core element of the Industrial Internet of Things. As one of the most fundamental and indispensable components in industrial cyber-physical systems (CPS), intelligent anomaly detection is still an essential and challenging issue. However, with the development of the network, there may exist unknown types of attacks, which are difficult to collect. Facing one-class industrial intrusion detection scenario that the collected training data only includes normal state, the one-class broad learning system (OCBLS) and the stacked OCBLS (ST-OCBLS) algorithms are developed. Benefiting from the characteristics of BLS, our proposed approaches retain the advantage of efficient training process. Moreover, the high-level hidden features of the network traffic data can be learned through the progressive encoding and decoding mechanism in ST-OCBLS. Extensive comparative experiments on several real-world intrusion detection tasks are carried out to demonstrate that our proposed methods have competitive performance and high efficiency in the face of complex network data and diversified types of intrusions. Overall, this article provides a new alternative solution for network intrusion detection in Industry 4.0. [ABSTRACT FROM AUTHOR]

The broad learning system (BLS) is an algorithm that facilitates feature representation learning and data classification. Although weights of BLS are obtained by analytical computation, which brings better generalization and higher efficiency, BLS suffers from two drawbacks: 1) the performance depends on the number of hidden nodes, which requires manual tuning, and 2) double random mappings bring about the uncertainty, which leads to poor resistance to noise data, as well as unpredictable effects on performance. To address these issues, a kernel-based BLS (KBLS) method is proposed by projecting feature nodes obtained from the first random mapping into kernel space. This manipulation reduces the uncertainty, which contributes to performance improvements with the fixed number of hidden nodes, and indicates that manually tuning is no longer needed. Moreover, to further improve the stability and noise resistance of KBLS, a progressive ensemble framework is proposed, in which the residual of the previous base classifiers is used to train the following base classifier. We conduct comparative experiments against the existing state-of-the-art hierarchical learning methods on multiple noisy real-world datasets. The experimental results indicate our approaches achieve the best or at least comparable performance in terms of accuracy. [ABSTRACT FROM AUTHOR]

Sentiment analysis uses a series of automated cognitive methods to determine the author’s or speaker’s attitudes toward an expressed object or text’s overall emotional tendencies. In recent years, the growing scale of opinionated text from social networks has brought significant challenges to humans’ sentimental tendency mining. The pretrained language model designed to learn contextual representation achieves better performance than traditional learning word vectors. However, the existing two basic approaches for applying pretrained language models to downstream tasks, feature-based and fine-tuning methods, are usually considered separately. What is more, different sentiment analysis tasks cannot be handled by the single task-specific contextual representation. In light of these pros and cons, we strive to propose a broad multitask transformer network (BMT-Net) to address these problems. BMT-Net takes advantage of both feature-based and fine-tuning methods. It was designed to explore the high-level information of robust and contextual representation. Primarily, our proposed structure can make the learned representations universal across tasks via multitask transformers. In addition, BMT-Net can roundly learn the robust contextual representation utilized by the broad learning system due to its powerful capacity to search for suitable features in deep and broad ways. The experiments were conducted on two popular datasets of binary Stanford Sentiment Treebank (SST-2) and SemEval Sentiment Analysis in Twitter (Twitter). Compared with other state-of-the-art methods, the improved representation with both deep and broad ways is shown to achieve a better $F1$ -score of 0.778 in Twitter and accuracy of 94.0% in the SST-2 dataset, respectively. These experimental results demonstrate the abilities of recognition in sentiment analysis and highlight the significance of previously overlooked design decisions about searching contextual features in deep and broad spaces. [ABSTRACT FROM AUTHOR]

Prognostics and health management (PHM) are gradually being applied to production management processes as industrial production is gradually undergoing a transformation, turning into intelligent production and leading to increased demands on the reliability of industrial equipment. Remaining useful life (RUL) prediction plays a pivotal role in this process. Accurate prediction results can effectively provide information about the condition of the equipment on which intelligent maintenance can be based, with many methods applied to this task. However, the current problems of inadequate feature extraction and poor correlation between prediction results and data still affect the prediction accuracy. To overcome these obstacles, we constructed a new fusion model that extracts data features based on a broad learning system (BLS) and embeds long short-term memory (LSTM) to process time-series information, named as the B-LSTM. First, the LSTM controls the transmission of information from the data to the gate mechanism, and the retained information generates the mapped features and forms the feature nodes. Then, the random feature nodes are supplemented by an activation function that generates enhancement nodes with greater expressive power, increasing the nonlinear factor in the network, and eventually the feature nodes and enhancement nodes are jointly connected to the output layer. The B-LSTM was experimentally used with the C-MAPSS dataset and the results of comparison with several mainstream methods showed that the new model achieved significant improvements. [ABSTRACT FROM AUTHOR]

The broad learning system (BLS) is an emerging flat network, which has demonstrated its outstanding performance in classification and regression problems. The regularization plays an important role in the performance of the BLS. In real applications, since the BLS network is usually expanded dynamically, a predetermined regularization parameter may reduce the performance of the network. Using a fixed regularization in some cases, the classification accuracy of the BLS decreases dramatically when we expand the network. To alleviate this problem, we propose a method that automatically finds appropriate regularization parameters for different datasets, which is based on the weighted generalized cross-validation (WGCV). The experimental results indicate that the WGCV method improves the performance of the BLS, and alleviates the accuracy decrease of the incremental learning algorithm. [ABSTRACT FROM AUTHOR]

The broad learning system (BLS) is designed based on the technology of compressed sensing and pseudo-inverse theory, and consists of feature nodes and enhancement nodes, has been proposed recently. Compared with the popular deep learning structures, such as deep neural networks, BLS has the ability of rapid incremental learning and can remodel the system without the usual tedious retraining process. However, given that BLS is still in its infancy, it still needs analysis, improvements, and verification. In this article, we first analyze the principle of fast incremental learning ability of BLS in depth. Second, in order to provide an in-depth analysis of the BLS structure, according to the novel structure design concept of deep neural networks, we present four brand-new BLS variant networks and their incremental realizations. Third, based on our analysis of the effect of feature nodes and enhancement nodes, a new BLS structure with a semantic feature extraction layer has been proposed, which is called SFEBLS. The experimental results show that SFEBLS and its variants can increase the accuracy rate on the NORB dataset 6.18%, Fashion-MNIST dataset by 3.15%, ORL data by 5.00%, street view house number dataset by 12.88%, and CIFAR-10 dataset by 18.42%, respectively, and the four brand-new BLS variant networks also obviously outperform the original BLS. [ABSTRACT FROM AUTHOR]

This article presents a new user-independent emotion classification method that classifies four distinct emotions using electroencephalograph (EEG) signals and the broad learning system (BLS). The public DEAP and MAHNOB-HCI databases are used. Just one EEG electrode channel is selected for the feature extraction process. Continuous wavelet transform (CWT) is then utilized to extract the proposed gray-scale image (GSI) feature which describes the EEG brain activation in both time and frequency domains. Finally, the new BLS is constructed for the emotion classification process, which successfully upgrades the efficiency of emotion classification based on EEG brain signals. The experiment results show that the proposed work produces a robust system with high accuracy of approximately 93.1% and training process time of approximately 0.7 s for the DEAP database, as well as, the high average accuracy of approximately 94.4% and training process time of approximately 0.6 s for MAHNOB-HCI database. [ABSTRACT FROM AUTHOR]

Brain–computer interface (BCI) systems based on electroencephalography (EEG) signals have been extensively used in medical practice. To enhance the BCI performance, improving the classification accuracy of EEG signals is the key, which has always been the focus of research and development. In this article, a novel method integrating complex network and broad learning system (BLS) is proposed for visual evoked potential (VEP)-based BCI research. First, systematic VEP-based brain experiments are conducted for obtaining EEG signals, including steady-state VEP (SSVEP) and steady-state motion VEP (SSMVEP). Then, limited penetrable visibility graph (LPVG) and its degree sequence are employed to implement the preliminary feature extraction. All these features are finally fed into a BLS to study and classify the SSVEP and SSMVEP signals, respectively. The classification results show that our LPVG-based BLS can effectively classify VEP-based EEG signals, with average classification accuracy 96.22% for SSVEP and 74.54% for SSMVEP. These results are significantly better than other comparison methods as well as traditional CCA-based methods. All these open up new venues for studying EEG-based BCI systems via the fusion of network science and BLS. [ABSTRACT FROM AUTHOR]

Feature processing is an important step for modeling and can improve the accuracy of machine learning models. Feature extraction methods can effectively extract features from high-dimensional data sets and enhance the accuracy of tasks. However, the performance of feature extraction methods is not stable in low-dimensional data sets. This article extends the broad learning system (BLS) to a framework for constructing robust representations in low-dimensional and small data sets. First, the BLS changed from a supervised prediction method to an ensemble feature extraction method. Second, feature extraction methods instead of random mapping are used to generate mapped features. Third, deep representations, called enhancement features, are learned from the ensemble mapped features. Fourth, data for generating mapped features and enhancement features can be randomly selected. The ensemble of mapped features and enhancement features can provide robust representations to enhance the performance of downstream tasks. A label-based autoencoder (LA) is embedded in the BLS framework as an example to show the effectiveness of the framework. A random LA (RLA) is presented to generate more different features. The experimental results show that the BLS framework can construct robust representations and significantly promote the performance of machine learning models. [ABSTRACT FROM AUTHOR]

In the era of Corona Virus Disease 2019 (COVID-19), wearing a mask can effectively protect people from infection risk and largely decrease the spread in public places, such as hospitals and airports. This brings a demand for the monitoring instruments that are required to detect people who are wearing masks. However, this is not the objective of existing face detection algorithms. In this article, we propose a two-stage approach to detect wearing masks using hybrid machine learning techniques. The first stage is designed to detect candidate wearing mask regions as many as possible, which is based on the transfer model of Faster_RCNN and InceptionV2 structure, while the second stage is designed to verify the real facial masks using a broad learning system. It is implemented by training a two-class model. Moreover, this article proposes a data set for wearing mask detection (WMD) that includes 7804 realistic images. The data set has 26403 wearing masks and covers multiple scenes, which is available at “ https://github.com/BingshuCV/WMD.” Experiments conducted on the data set demonstrate that the proposed approach achieves an overall accuracy of 97.32% for simple scene and an overall accuracy of 91.13% for the complex scene, outperforming the compared methods. [ABSTRACT FROM AUTHOR]

Prognostics and health management (PHM) are gradually being applied to production management processes as industrial production is gradually undergoing a transformation, turning into intelligent production and leading to increased demands on the reliability of industrial equipment. Remaining useful life (RUL) prediction plays a pivotal role in this process. Accurate prediction results can effectively provide information about the condition of the equipment on which intelligent maintenance can be based, with many methods applied to this task. However, the current problems of inadequate feature extraction and poor correlation between prediction results and data still affect the prediction accuracy. To overcome these obstacles, we constructed a new fusion model that extracts data features based on a broad learning system (BLS) and embeds long short-term memory (LSTM) to process time-series information, named as the B-LSTM. First, the LSTM controls the transmission of information from the data to the gate mechanism, and the retained information generates the mapped features and forms the feature nodes. Then, the random feature nodes are supplemented by an activation function that generates enhancement nodes with greater expressive power, increasing the nonlinear factor in the network, and eventually the feature nodes and enhancement nodes are jointly connected to the output layer. The B-LSTM was experimentally used with the C-MAPSS dataset and the results of comparison with several mainstream methods showed that the new model achieved significant improvements.

Illumination is a significant component of an image, and illumination estimation of an outdoor scene from given images is still challenging yet it has wide applications. Most of the traditional illumination estimating methods require prior knowledge or fixed objects within the scene, which makes them often limited by the scene of a given image. We propose an optimization approach that integrates the multiclass cues of the image(s) [a main input image and optional auxiliary input image(s)]. First, Sun visibility is estimated by the efficient broad learning system. And then for the scene with visible Sun, we classify the information in the image by the proposed classification algorithm, which combines the geometric information and shadow information to make the most of the information. And we apply a respective algorithm for every class to estimate the illumination parameters. Finally, our approach integrates all of the estimating results by the Markov random field. We make full use of the cues in the given image instead of an extra requirement for the scene, and the qualitative results are presented and show that our approach outperformed other methods with similar conditions. [ABSTRACT FROM AUTHOR]

• A new feature extraction method which introduces the correlation coefficient and the dominant variable into the stacked autoencoder has been developed. • An adaptive algorithm which effectively determines the number of nodes of the broad learning system has been developed. • Two examples are used to demonstrate the effectiveness of the proposed method. In the actual soft sensor project, the complex industrial process leads to a large number of monitoring variables that lead to obvious problems of high dimension and data redundancy. To solve these problems, an adaptive cascade enhancement broad learning system combined with stacked correlation information autoencoder, referred to as SCIAE-ACEBLS, is proposed in this study. The latter is based on the broad learning system (BLS) and it includes two parts: feature node and enhancement node. In the feature node part, the correlation coefficient and the dominant variable are introduced into the stacked autoencoder (SAE), and all the hidden nodes are used as feature nodes. Both the correlation coefficient and the dominant variable are introduced to ensure that the information of feature nodes not only include the relevant information of the dominant variable in the auxiliary variables, but also in the dominant variable, and thus all the information related to dominant variables can be effectively used. In the enhancement node part, an adaptive cascade enhancement node algorithm is used to reduce the redundancy of effective information and solve the problems of node information redundancy and node number uncertainty caused by the randomness of the node parameters in BLS. Finally, two industrial examples show that the proposed model is effective and outperforms existing methods. [ABSTRACT FROM AUTHOR]

With the global outbreak of COVID-19, there is an urgent need to develop an effective and automated detection approach as a faster diagnostic alternative to avoid the spread of COVID-19. Recently, broad learning system (BLS) has been viewed as an alternative method of deep learning which has been applied to many areas. Nevertheless, the sparse autoencoder in classical BLS just considers the representations to reconstruct the input data but ignores the relationship among the extracted features. In this paper, inspired by the effectiveness of the collaborative–competitive representation (CCR) mechanism, a novel collaborative–competitive representation-based autoencoder (CCRAE) is first proposed, and then collaborative–competitive broad learning system (CCBLS) is proposed based on CCRAE to effectively address the issues mentioned above. Moreover, an automated CCBLS-based approach is proposed for COVID-19 detection from radiology images such as CT scans and chest X-ray images. In the proposed approach, a feature extraction module is utilized to extract features from CT scans or chest X-ray images, then we use these features for COVID-19 detection with CCBLS. The experimental results demonstrated that our proposed approach can achieve superior or comparable performance in comparison with ten other state-of-the-art methods. [Display omitted] [ABSTRACT FROM AUTHOR]