Search

Advances in in vivo C a 2 + imaging using miniatured microscopes have enabled researchers to study single-neuron activity in freely moving animals. Tools such as MiniAN and CalmAn have been developed to convert C a 2 + visual signals to numerical information, collectively referred to as CalV2N. However, substantial challenges remain in analyzing the large datasets generated by CalV2N, particularly in integrating data streams, evaluating CalV2N output quality, and reliably and efficiently identifying Ca2+ transients. In this study, we introduce CalTrig, an open-source graphical user interface (GUI) tool designed to address these challenges at the post-CalV2N stage of data processing. CalTrig integrates multiple data streams, including C a 2 + imaging, neuronal footprints, C a 2 + traces, and behavioral tracking, and offers capabilities for evaluating the quality of CalV2N outputs. It enables synchronized visualization and efficient C a 2 + transient identification. We evaluated four machine learning models (i.e., GRU, LSTM, Transformer, and Local Transformer) for C a 2 + transient detection. Our results indicate that the GRU model offers the highest predictability and computational efficiency, achieving stable performance across training sessions, different animals and even among different brain regions. The integration of manual, parameter-based, and machine learning-based detection methods in CalTrig provides flexibility and accuracy for various research applications. The user-friendly interface and low computing demands of CalTrig make it accessible to neuroscientists without programming expertise. We further conclude that CalTrig enables deeper exploration of brain function, supports hypothesis generation about neuronal mechanisms, and opens new avenues for understanding neurological disorders and developing treatments.

Ammonia nitrogen (AN) pollution frequently occurs in urban rivers with the continuous acceleration of industrialization. Monitoring AN pollution levels and tracing its complex sources often require large-scale testing, which are time-consuming and costly. Due to the lack of reliable data samples, there were few studies investigating the feasibility of water quality prediction of AN concentration with a high fluctuation and non-stationary change through data-driven models. In this study, four deep-learning models based on neural network algorithms including artificial neural network (ANN), recurrent neural network (RNN), long short-term memory (LSTM), and gated recurrent unit (GRU) were employed to predict AN concentration through some easily monitored indicators such as pH, dissolved oxygen, and conductivity, in a real AN-polluted river. The results showed that the GRU model achieved optimal prediction performance with a mean absolute error (MAE) of 0.349 and coefficient of determination (R 2 ) of 0.792. Furthermore, it was found that data preprocessing by the VMD technique improved the prediction accuracy of the GRU model, resulting in an R 2 value of 0.822. The prediction model effectively detected and warned against abnormal AN pollution (> 2 mg/L), with a Recall rate of 93.6% and Precision rate of 72.4%. This data-driven method enables reliable monitoring of AN concentration with high-frequency fluctuations and has potential applications for urban river pollution management., (© 2024. The Author(s), under exclusive licence to The Japan Society for Analytical Chemistry.)

To quickly assess slope stability based on field displacement monitoring data, this paper constructs a hybrid optimization model that predicts surface displacement during tunnel excavation in base-overburden slopes. The model combines Wavelet Decomposition (WD) with a Gated Recurrent Unit (GRU), and the GRU's hyperparameters are optimized using an Improved Particle Swarm Optimization algorithm (IPSO). The specific steps are as follows: First, the Wavelet Decomposition (WD) technique is applied to decompose the raw displacement data, extracting features at different time-frequency scales. Next, the Dropout technique is incorporated into the GRU model to prevent overfitting. Additionally, nonlinear inertia weight ω improved cognitive factor c 1 , and social factor c 2 are introduced. The PSO algorithm is improved by integrating crossover and mutation concepts from genetic algorithms. Finally, the IPSO is used to optimize the number of neural units h N , H N , L N and dropout rates D 1 and D 2 in the GRU network architecture. After constructing the WD-IPSO-GRU model, a comprehensive comparison is made with various swarm intelligence algorithms and state-of-the-art models. The experimental results demonstrate that the WD-IPSO-GRU model significantly improves the prediction accuracy of surface displacement in slopes during tunnel excavation. Compared to directly using raw data for prediction, the introduction of the WD preprocessing technique improved the prediction accuracy at measurement points 01 and 02 by 28% and 45.9%, respectively. Additionally, with the model optimized by IPSO, the prediction accuracy at measurement points 01 and 02 increased by 76% and 56.7%, respectively. The WD-IPSO-GRU model effectively addresses the challenges of extracting features from univariate displacement time-series data and determining the parameters of the GRU network. It improves the prediction accuracy of surface displacement in base-overburden type slopes and demonstrates excellent generalization ability and reliability. The research results validate the potential application of the model in geotechnical engineering and provide strong support for assessing slope stability during tunnel excavation., (© 2024. The Author(s).)

Abnormal behavior recognition is an important technology used to detect and identify activities or events that deviate from normal behavior patterns. It has wide applications in various fields such as network security, financial fraud detection, and video surveillance. In recent years, Deep Convolution Networks (ConvNets) have been widely applied in abnormal behavior recognition algorithms and have achieved significant results. However, existing abnormal behavior detection algorithms mainly focus on improving the accuracy of the algorithms and have not explored the real-time nature of abnormal behavior recognition. This is crucial to quickly identify abnormal behavior in public places and improve urban public safety. Therefore, this paper proposes an abnormal behavior recognition algorithm based on three-dimensional (3D) dense connections. The proposed algorithm uses a multi-instance learning strategy to classify various types of abnormal behaviors, and employs dense connection modules and soft-threshold attention mechanisms to reduce the model's parameter count and enhance network computational efficiency. Finally, redundant information in the sequence is reduced by attention allocation to mitigate its negative impact on recognition results. Experimental verification shows that our method achieves a recognition accuracy of 95.61% on the UCF-crime dataset. Comparative experiments demonstrate that our model has strong performance in terms of recognition accuracy and speed.

Autism spectrum disorder (ASD) is a complex, severe disorder related to brain development. It impairs patient language communication and social behaviors. In recent years, ASD researches have focused on a single-modal neuroimaging data, neglecting the complementarity between multi-modal data. This omission may lead to poor classification. Therefore, it is important to study multi-modal data of ASD for revealing its pathogenesis. Furthermore, recurrent neural network (RNN) and gated recurrent unit (GRU) are effective for sequence data processing. In this paper, we introduce a novel framework for a Multi-Kernel Learning Fusion algorithm based on RNN and GRU (MKLF-RAG). The framework utilizes RNN and GRU to provide feature selection for data of different modalities. Then these features are fused by MKLF algorithm to detect the pathological mechanisms of ASD and extract the most relevant the Regions of Interest (ROIs) for the disease. The MKLF-RAG proposed in this paper has been tested in a variety of experiments with the Autism Brain Imaging Data Exchange (ABIDE) database. Experimental findings indicate that our framework notably enhances the classification accuracy for ASD. Compared with other methods, MKLF-RAG demonstrates superior efficacy across multiple evaluation metrics and could provide valuable insights into the early diagnosis of ASD., (© 2024. International Association of Scientists in the Interdisciplinary Areas.)

In coal mining areas, surface subsidence poses significant risks to human life and property. Fortunately, surface subsidence caused by coal mining can be monitored and predicted by using various methods, e.g., probability integral method and deep learning (DL) methods. Although DL methods show promise in predicting subsidence, they often lack accuracy due to insufficient consideration of spatial correlation and temporal nonlinearity. Considering this issue, we propose a novel DL-based approach for predicting mining surface subsidence. Our method employs K-means clustering to partition spatial data, allowing the application of a gate recurrent unit (GRU) model to capture nonlinear relationships in subsidence time series within each partition. Optimization using snake optimization (SO) further enhances model accuracy globally. Validation shows our method outperforms traditional Long Short-Term Memory (LSTM) and GRU models, achieving 99.1% of sample pixels with less than 8 mm absolute error., (© 2024. The Author(s).)

The Boolean satisfiability (SAT) problem exhibits different structural features in various domains. Neural network models can be used as more generalized algorithms that can be learned to solve specific problems based on different domain data than traditional rule-based approaches. How to accurately identify these structural features is crucial for neural networks to solve the SAT problem. Currently, learning-based SAT solvers, whether they are end-to-end models or enhancements to traditional heuristic algorithms, have achieved significant progress. In this article, we propose TG-SAT, an end-to-end framework based on Transformer and gated recurrent neural network (GRU) for predicting the satisfiability of SAT problems. TG-SAT can learn the structural features of SAT problems in a weakly supervised environment. To capture the structural information of the SAT problem, we encodes a SAT problem as an undirected graph and integrates GRU into the Transformer structure to update the node embeddings. By computing cross-attention scores between literals and clauses, a weighted representation of nodes is obtained. The model is eventually trained as a classifier to predict the satisfiability of the SAT problem. Experimental results demonstrate that TG-SAT achieves a 2%-5% improvement in accuracy on random 3-SAT problems compared to NeuroSAT. It also outperforms in SR(N), especially in handling more complex SAT problems, where our model achieves higher prediction accuracy., Competing Interests: The authors declare there are no competing interests., (©2024 Chang et al.)

Epilepsy is one of the most common brain diseases, characterised by repeated seizures that occur on a regular basis. During a seizure, a patient's muscles flex uncontrollably, causing a loss of mobility and balance, which can be harmful or even fatal. Developing an automatic approach for warning patients of oncoming seizures necessitates substantial research. Analyzing the electroencephalogram (EEG) output from the human brain's scalp region can help predict seizures. EEG data were analyzed to extract time domain features such as Hurst exponent (Hur), Tsallis entropy (TsEn), enhanced permutation entropy (impe), and amplitude-aware permutation entropy (AAPE). In order to automatically diagnose epileptic seizure in children from normal children, this study conducted two sessions. In the first session, the extracted features from the EEG dataset were classified using three machine learning (ML)-based models, including support vector machine (SVM), K nearest neighbor (KNN), or decision tree (DT), and in the second session, the dataset was classified using three deep learning (DL)-based recurrent neural network (RNN) classifiers in The EEG dataset was obtained from the Neurology Clinic of the Ibn Rushd Training Hospital. In this regard, extensive explanations and research from the time domain and entropy characteristics demonstrate that employing GRU, LSTM, and BiLSTM RNN deep learning classifiers on the All-time-entropy fusion feature improves the final classification results., Competing Interests: Declaration of Competing Interest The authors declare no conflict of interest., (Copyright © 2024 IPEM. Published by Elsevier Ltd. All rights reserved.)

In the contemporary digitalization landscape and technological advancement, the auction industry undergoes a metamorphosis, assuming a pivotal role as a transactional paradigm. Functioning as a mechanism for pricing commodities or services, the procedural intricacies and efficiency of auctions directly influence market dynamics and participant engagement. Harnessing the advancing capabilities of artificial intelligence (AI) technology, the auction sector proactively integrates AI methodologies to augment efficacy and enrich user interactions. This study delves into the intricacies of the price prediction challenge within the auction domain, introducing a sophisticated RL-GRU framework for price interval analysis. The framework commences by adeptly conducting quantitative feature extraction of commodities through GRU, subsequently orchestrating dynamic interactions within the model's environment via reinforcement learning techniques. Ultimately, it accomplishes the task of interval division and recognition of auction commodity prices through a discerning classification module. Demonstrating precision exceeding 90% across publicly available and internally curated datasets within five intervals and exhibiting superior performance within eight intervals, this framework contributes valuable technical insights for future endeavours in auction price interval prediction challenges., Competing Interests: The authors declare that they have no competing interests., (© 2024 Ke and Fan.)

In the realm of prognosticating the remaining useful life (RUL) of pivotal components, such as aircraft engines, a prevalent challenge persists where the available historical life data often proves insufficient. This insufficiency engenders obstacles such as impediments in performance degradation feature extraction, inadequacies in capturing temporal relationships comprehensively, and diminished predictive accuracy. To address this issue, a 1D CNN-GRU prediction model for few-shot conditions is proposed in this paper. In pursuit of more comprehensive data feature extraction and enhanced RUL prognostication precision, the Convolutional Neural Network (CNN) is selected for its capacity to discern high-dimensional features amid the intricate dynamics of the data. Concurrently, the Gated Recurrent Unit (GRU) network is leveraged for its robust capability in extracting temporal features inherent within the data. We combine the two to construct a CNN-GRU hybrid network. Moreover, the integration of data distribution alongside correlation and monotonicity indices is employed to winnow the input of multi-sensor monitoring parameters into the CNN-GRU network. Finally, the engine RULs are predicted by the trained model. In this paper, experiments are conducted on a sub-dataset of the National Aeronautics and Space Administration (NASA) C-MAPSS multi-constraint dataset to validate the effectiveness of the method. Experimental results have demonstrated that this method has high accuracy in RUL prediction tasks, which can powerfully demonstrate its effectiveness., (© 2024. The Author(s).)

Traditional magnetic levitation planar micromotors suffer from poor controllability, short travel range, low interference resistance, and low precision. To address these issues, a distributed coil magnetically levitated planar micromotor with a gated recurrent unit (GRU)-extended state observer (ESO) control strategy is proposed in this paper. First, the structural design of the distributed coil magnetically levitated planar micromotor employs a separation of levitation and displacement, reducing system coupling and increasing controllability and displacement range. Then, theoretical analysis and model establishment of the system are conducted based on the designed distributed coil magnetically levitated planar micromotor and its working principles, followed by simulation verification. Finally, based on the established system model, a GRU-ESO controller is designed. An ESO feedback control term is introduced to enhance the system's anti-interference capability, and the GRU feedforward compensation control term is used to improve the system's tracking control accuracy. The experimental results demonstrate the reliability of the designed distributed coil magnetic levitation planar micromotor and the effectiveness of the controller.

Emotion recognition plays an essential role in human-human interaction since it is a key to understanding the emotional states and reactions of human beings when they are subject to events and engagements in everyday life. Moving towards human-computer interaction, the study of emotions becomes fundamental because it is at the basis of the design of advanced systems to support a broad spectrum of application areas, including forensic, rehabilitative, educational, and many others. An effective method for discriminating emotions is based on ElectroEncephaloGraphy (EEG) data analysis, which is used as input for classification systems. Collecting brain signals on several channels and for a wide range of emotions produces cumbersome datasets that are hard to manage, transmit, and use in varied applications. In this context, the paper introduces the Empátheia system, which explores a different EEG representation by encoding EEG signals into images prior to their classification. In particular, the proposed system extracts spatio-temporal image encodings, or atlases, from EEG data through the Processing and transfeR of Interaction States and Mappings through Image-based eNcoding (PRISMIN) framework, thus obtaining a compact representation of the input signals. The atlases are then classified through the Empátheia architecture, which comprises branches based on convolutional, recurrent, and transformer models designed and tuned to capture the spatial and temporal aspects of emotions. Extensive experiments were conducted on the Shanghai Jiao Tong University (SJTU) Emotion EEG Dataset (SEED) public dataset, where the proposed system significantly reduced its size while retaining high performance. The results obtained highlight the effectiveness of the proposed approach and suggest new avenues for data representation in emotion recognition from EEG signals.

An intensive care unit (ICU) is a special ward in the hospital for patients who require intensive care. It is equipped with many instruments monitoring patients' vital signs and supported by the medical staff. However, continuous monitoring demands a massive workload of medical care. To ease the burden, we aim to develop an automatic detection model to monitor when brain anomalies occur. In this study, we focus on electroencephalography (EEG), which monitors the brain electroactivity of patients continuously. It is mainly for the diagnosis of brain malfunction. We propose the gated-recurrent-unit-based (GRU-based) model for detecting brain anomalies; it predicts whether the spike or sharp wave happens within a short time window. Based on the banana montage setting, the proposed model exploits characteristics of multiple channels simultaneously to detect anomalies. It is trained, validated, and tested on separated EEG data and achieves more than 90% testing performance on sensitivity, specificity, and balanced accuracy. The proposed anomaly detection model detects the existence of a spike or sharp wave precisely; it will notify the ICU medical staff, who can provide immediate follow-up treatment. Consequently, it can reduce the medical workload in the ICU significantly.

The human body's largest organ is the skin which covers the entire body. The facial skin is one area of the body that needs careful handling. It can cause several facial skin diseases like acne, eczema, moles, melanoma, rosacea, and many other fungal infections. Diagnosing these diseases has been difficult due to challenges like the high cost of medical equipment and the lack of medical competence. However, various existing systems are utilized to detect the type of facial skin disease, but those approaches are time-consuming and inaccurate to detect the disease at early stages. To address various issues, a deep learning-based gate recurrent unit (GRU) has been developed. Non-linear diffusion is used to acquire and pre-process raw pictures, adaptive histogram equalization (AHE) and high boost filtering (HBF). The image noise is removed by using non-linear diffusion. The contrast of the image is maximized using AHE. The image's edges are sharpened by using HBF. After pre-processing, textural and colour features are extracted by applying a grey level run-length matrix (GLRM) and chromatic co-occurrence local binary pattern (CCoLBP). Then, appropriate features are selected using horse herd optimization (HOA). Finally, selected features are classified using GRU to identify the types of facial skin disease. The proposed model is investigated using the Kaggle database that consists of different face skin disease images such as rosacea, eczema, basal cell carcinoma, acnitic keratosis, and acne. Further, the acquired dataset is split into training and testing. Considering the investigation's findings, the proposed method yields 98.2% accuracy, 1.8% error, 97.1% precision, and 95.5% f1-score. In comparison to other current techniques, the proposed technique performs better. The created model is, therefore, the best choice for classifying the various facial skin conditions., (© 2024. The Author(s) under exclusive licence to Society for Imaging Informatics in Medicine.)

MEMS accelerometers are significantly impacted by temperature and noise, leading to a considerable compromise in their accuracy. In response to this challenge, we propose a parallel denoising and temperature compensation fusion algorithm for MEMS accelerometers based on RLMD-SE-TFPF and GRU-attention. Firstly, we utilize robust local mean decomposition (RLMD) to decompose the output signal of the accelerometer into a series of product function (PF) signals and a residual signal. Secondly, we employ sample entropy (SE) to classify the decomposed signals, categorizing them into noise segments, mixed segments, and temperature drift segments. Next, we utilize the time-frequency peak filtering (TFPF) algorithm with varying window lengths to separately denoise the noise and mixed signal segments, enabling subsequent signal reconstruction and training. Considering the strong inertia of the temperature signal, we innovatively introduce the accelerometer's output time series as the model input when training the temperature compensation model. We incorporate gated recurrent unit (GRU) and attention modules, proposing a novel GRU-MLP-attention model (GMAN) architecture. Simulation experiments demonstrate the effectiveness of our proposed fusion algorithm. After processing the accelerometer output signal through the RLMD-SE-TFPF denoising algorithm and the GMAN temperature drift compensation model, the acceleration random walk is reduced by 96.11%, with values of 0.23032 g/h/Hz for the original accelerometer output signal and 0.00895695 g/h/Hz for the processed signal.

This study investigates the effectiveness of various deep learning and classical machine learning techniques in identifying instances of cyberbullying. The study compares the performance of five classical machine learning algorithms and three deep learning models. The data undergoes pre-processing, including text cleaning, tokenization, stemming, and stop word removal. The experiment uses accuracy, precision, recall, and F1 score metrics to evaluate the performance of the algorithms on the dataset. The results show that the proposed technique achieves high accuracy, precision, and F1 score values, with the Focal Loss algorithm achieving the highest accuracy of 99% and the highest precision of 86.72%. However, the recall values were relatively low for most algorithms, indicating that they struggled to identify all relevant data. Additionally, the study proposes a technique using a convolutional neural network with a bidirectional long short-term memory layer, trained on a pre-processed dataset of tweets using GloVe word embeddings and the focal loss function. The model achieved high accuracy, precision, and F1 score values, with the GRU algorithm achieving the highest accuracy of 97.0% and the NB algorithm achieving the highest precision of 96.6%., Competing Interests: The authors declare there are no competing interests., (©2024 El Koshiry et al.)

The network intrusion detection system (NIDS) plays a crucial role as a security measure in addressing the increasing number of network threats. The majority of current research relies on feature-ready datasets that heavily depend on feature engineering. Conversely, the increasing complexity of network traffic and the ongoing evolution of attack techniques lead to a diminishing distinction between benign and malicious network behaviors. In this paper, we propose a novel end-to-end intrusion detection framework based on a contrastive learning approach. We design a hierarchical Convolutional Neural Network (CNN) and Gated Recurrent Unit (GRU) model to facilitate the automated extraction of spatiotemporal features from raw traffic data. The integration of contrastive learning amplifies the distinction between benign and malicious network traffic in the representation space. The proposed method exhibits enhanced detection capabilities for unknown attacks in comparison to the approaches trained using the cross-entropy loss function. Experiments are carried out on the public datasets CIC-IDS2017 and CSE-CIC-IDS2018, demonstrating that our method can attain a detection accuracy of 99.9% for known attacks, thus achieving state-of-the-art performance. For unknown attacks, a weighted recall rate of 95% can be achieved.

Introduction: Epilepsy is a chronic neurological disorder characterized by abnormal electrical activity in the brain, often leading to recurrent seizures. With 50 million people worldwide affected by epilepsy, there is a pressing need for efficient and accurate methods to detect and diagnose seizures. Electroencephalogram (EEG) signals have emerged as a valuable tool in detecting epilepsy and other neurological disorders. Traditionally, the process of analyzing EEG signals for seizure detection has relied on manual inspection by experts, which is time-consuming, labor-intensive, and susceptible to human error. To address these limitations, researchers have turned to machine learning and deep learning techniques to automate the seizure detection process., Methods: In this work, we propose a novel method for epileptic seizure detection, leveraging the power of 1-D Convolutional layers in combination with Bidirectional Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) and Average pooling Layer as a single unit. This unit is repeatedly used in the proposed model to extract the features. The features are then passed to the Dense layers to predict the class of the EEG waveform. The performance of the proposed model is verified on the Bonn dataset. To assess the robustness and generalizability of our proposed architecture, we employ five-fold cross-validation. By dividing the dataset into five subsets and iteratively training and testing the model on different combinations of these subsets, we obtain robust performance measures, including accuracy, sensitivity, and specificity., Results: Our proposed model achieves an accuracy of 99-100% for binary classifications into seizure and normal waveforms, 97.2%-99.2% accuracy for classifications into normal-interictal-seizure waveforms, 96.2%-98.4% accuracy for four class classification and accuracy of 95.81%-98% for five class classification., Discussion: Our proposed models have achieved significant improvements in the performance metrics for the binary classifications and multiclass classifications. We demonstrate the effectiveness of the proposed architecture in accurately detecting epileptic seizures from EEG signals by using EEG signals of varying lengths. The results indicate its potential as a reliable and efficient tool for automated seizure detection, paving the way for improved diagnosis and management of epilepsy., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2024 Mallick and Baths.)

Due to the uncertainty of weather conditions and the nonlinearity of high-dimensional data, as well as the need for a continuous and stable power supply to the power system, traditional regression analysis and time series forecasting methods are no longer able to meet the high accuracy requirements of today's PV power forecasting. To significantly improve the prediction accuracy of short-term PV output power, this paper proposes a short-term PV power forecasting method based on a hybrid model of temporal convolutional networks and gated recurrent units with an efficient channel attention network (TCN-ECANet-GRU) using the generated data of an Australian PV power station as the research object. First, temporal convolutional networks (TCNs) are used as spatial feature extraction layers, and an efficient channel attention network (ECANet) is embedded to enhance the feature capture capability of the convolutional network. Then, the GRU is used to extract the timing information for the final prediction. Finally, based on the experimental validation, the TCN-ECANet-GRU method generally outperformed the other baseline models in all four seasons of the year according to three performance assessment metrics: the normalized root mean square error (RMSE), normalized mean absolute error (MAE) and coefficient of determination (R 2 ). The best RMSE, MAE and R 2 reached 0.0195, 0.0128 and 99.72%, respectively, with maximum improvements of 11.32%, 8.57% and 0.38%, respectively, over those of the suboptimal model. Therefore, the model proposed in this paper is effective at improving prediction accuracy. Using the proposed method, this paper concludes with multistep predictions of 3, 6, and 9 steps, which also indicates that the proposed method significantly outperforms the other models., (© 2024. The Author(s).)

The gated recurrent unit (GRU) network can effectively capture temporal information for 1D signals, such as electroencephalography and event-related brain potential, and it has been widely used in the field of EEG emotion recognition. However, multi-domain features, including the spatial, frequency, and temporal features of EEG signals, contribute to emotion recognition, while GRUs show some limitations in capturing frequency-spatial features. Thus, we proposed a hybrid architecture of convolutional neural networks and GRUs (CGRU) to effectively capture the complementary temporal features and spatial-frequency features hidden in signal channels. In addition, to investigate the interactions among different brain regions during emotional information processing, we considered the functional connectivity relationship of the brain by introducing a phase-locking value to calculate the phase difference between the EEG channels to gain spatial information based on functional connectivity. Then, in the classification module, we incorporated attention constraints to address the issue of the uneven recognition contribution of EEG signal features. Finally, we conducted experiments on the DEAP and DREAMER databases. The results demonstrated that our model outperforms the other models with remarkable recognition accuracy of 99.51%, 99.60%, and 99.59% (58.67%, 65.74%, and 67.05%) on DEAP and 98.63%, 98.7%, and 98.71% (75.65%, 75.89%, and 71.71%) on DREAMER in a subject-dependent experiment (subject-independent experiment) for arousal, valence, and dominance.

Temperature and humidity, along with concentrations of ammonia and hydrogen sulfide, are critical environmental factors that significantly influence the growth and health of pigs within porcine habitats. The ability to accurately predict these environmental variables in pig houses is pivotal, as it provides crucial decision-making support for the precise and targeted regulation of the internal environmental conditions. This approach ensures an optimal living environment, essential for the well-being and healthy development of the pigs. The existing methodologies for forecasting environmental factors in pig houses are currently hampered by issues of low predictive accuracy and significant fluctuations in environmental conditions. To address these challenges in this study, a hybrid model incorporating the improved dung beetle algorithm (DBO), temporal convolutional networks (TCNs), and gated recurrent units (GRUs) is proposed for the prediction and optimization of environmental factors in pig barns. The model enhances the global search capability of DBO by introducing the Osprey Eagle optimization algorithm (OOA). The hybrid model uses the optimization capability of DBO to initially fit the time-series data of environmental factors, and subsequently combines the long-term dependence capture capability of TCNs and the non-linear sequence processing capability of GRUs to accurately predict the residuals of the DBO fit. In the prediction of ammonia concentration, the OTDBO-TCN-GRU model shows excellent performance with mean absolute error (MAE), mean square error (MSE), and coefficient of determination ( R ) of 0.0474, 0.0039, and 0.9871, respectively. Compared with the DBO-TCN-GRU model, OTDBO-TCN-GRU achieves significant reductions of 37.2% and 66.7% in MAE and MSE, respectively, while the 2 value is improved by 2.5%. Compared with the OOA model, the OTDBO-TCN-GRU achieved 48.7% and 74.2% reductions in the MAE and MSE metrics, respectively, while the R value improved by 3.6%. In addition, the improved OTDBO-TCN-GRU model has a prediction error of less than 0.3 mg/m 2 for environmental gases compared with other algorithms, and has less influence on sudden environmental changes, which shows the robustness and adaptability of the model for environmental prediction. Therefore, the OTDBO-TCN-GRU model, as proposed in this study, optimizes the predictive performance of environmental factor time series and offers substantial decision support for environmental control in pig houses.R 2 value improved by 3.6%. In addition, the improved OTDBO-TCN-GRU model has a prediction error of less than 0.3 mg/m 3 for environmental gases compared with other algorithms, and has less influence on sudden environmental changes, which shows the robustness and adaptability of the model for environmental prediction. Therefore, the OTDBO-TCN-GRU model, as proposed in this study, optimizes the predictive performance of environmental factor time series and offers substantial decision support for environmental control in pig houses.

High damping rubber (HDR) bearings are extensively used in seismic design for bridges due to their remarkable energy dissipation capabilities, which is critical during earthquakes. A thorough assessment of crucial factors such as temperature, rate, experienced maximum amplitude, and the Mullins effect of HDR on the mechanics-based constitutive model of HDR is lacking. To address this issue, we propose a deep learning approach that integrates the Gate Recurrent Unit (GRU) and attention mechanism to identify time series characteristics from compression-shear test data of HDR specimens. It is shown that the combination of GRU and attention mechanism enables accurate prediction of the mechanical behavior of HDR specimens. Compared to the sole use of GRU, this suggested method significantly reduces model complexity and computation time while maintaining good prediction performance. Therefore, it offers a new approach to constructing the HDR constitutive model. Finally, the HDR constitutive model was used to analyze the impact of experienced maximum amplitudes and cycles on following processes. It was observed that maximum amplitudes directly influence the stress-strain relationship of HDR during subsequent processes. Consequently, a solid foundation is laid for evaluating the responses of HDR bearings under earthquakes.

Future UAV (unmanned aerial vehicle) operations in urban environments demand a PNT (position, navigation, and timing) solution that is both robust and resilient. While a GNSS (global navigation satellite system) can provide an accurate position under open-sky assumptions, the complexity of urban operations leads to NLOS (non-line-of-sight) and multipath effects, which in turn impact the accuracy of the PNT data. A key research question within the research community pertains to determining the appropriate hybrid fusion architecture that can ensure the resilience and continuity of UAV operations in urban environments, minimizing significant degradations of PNT data. In this context, we present a novel federated fusion architecture that integrates data from the GNSS, the IMU (inertial measurement unit), a monocular camera, and a barometer to cope with the GNSS multipath and positioning performance degradation. Within the federated fusion architecture, local filters are implemented using EKFs (extended Kalman filters), while a master filter is used in the form of a GRU (gated recurrent unit) block. Data collection is performed by setting up a virtual environment in AirSim for the visual odometry aid and barometer data, while Spirent GSS7000 hardware is used to collect the GNSS and IMU data. The hybrid fusion architecture is compared to a classic federated architecture (formed only by EKFs) and tested under different light and weather conditions to assess its resilience, including multipath and GNSS outages. The proposed solution demonstrates improved resilience and robustness in a range of degraded conditions while maintaining a good level of positioning performance with a 95th percentile error of 0.54 m for the square scenario and 1.72 m for the survey scenario.

The field of multimodal robotic musical performing arts has garnered significant interest due to its innovative potential. Conventional robots face limitations in understanding emotions and artistic expression in musical performances. Therefore, this paper explores the application of multimodal robots that integrate visual and auditory perception to enhance the quality and artistic expression in music performance. Our approach involves integrating GRU (Gated Recurrent Unit) and GoogLeNet models for sentiment analysis. The GRU model processes audio data and captures the temporal dynamics of musical elements, including long-term dependencies, to extract emotional information. The GoogLeNet model excels in image processing, extracting complex visual details and aesthetic features. This synergy deepens the understanding of musical and visual elements, aiming to produce more emotionally resonant and interactive robot performances. Experimental results demonstrate the effectiveness of our approach, showing significant improvements in music performance by multimodal robots. These robots, equipped with our method, deliver high-quality, artistic performances that effectively evoke emotional engagement from the audience. Multimodal robots that merge audio-visual perception in music performance enrich the art form and offer diverse human-machine interactions. This research demonstrates the potential of multimodal robots in music performance, promoting the integration of technology and art. It opens new realms in performing arts and human-robot interactions, offering a unique and innovative experience. Our findings provide valuable insights for the development of multimodal robots in the performing arts sector., Competing Interests: The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2024 Wang.)

Accurate classification of electromyographic (EMG) signals is vital in biomedical applications. This study evaluates different architectures of recurrent neural networks for the classification of EMG signals associated with five movements of the right upper extremity. A Butterworth filter was implemented for signal preprocessing, followed by segmentation into 250 ms windows, with an overlap of 190 ms. The resulting dataset was divided into training, validation, and testing subsets. The Grey Wolf Optimization algorithm was applied to the gated recurrent unit (GRU), long short-term memory (LSTM) architectures, and bidirectional recurrent neural networks. In parallel, a performance comparison with support vector machines (SVMs) was performed. The results obtained in the first experimental phase revealed that all the RNN networks evaluated reached a 100% accuracy, standing above the 93% achieved by the SVM. Regarding classification speed, LSTM ranked as the fastest architecture, recording a time of 0.12 ms, followed by GRU with 0.134 ms. Bidirectional recurrent neural networks showed a response time of 0.2 ms, while SVM had the longest time at 2.7 ms. In the second experimental phase, a slight decrease in the accuracy of the RNN models was observed, standing at 98.46% for LSTM, 96.38% for GRU, and 97.63% for the bidirectional network. The findings of this study highlight the effectiveness and speed of recurrent neural networks in the EMG signal classification task.

In a layer house, the CO 2 (carbon dioxide) concentration above the upper limit can cause the oxygen concentration to be below the lower limit suitable for poultry. This leads to chronic CO 2 poisoning in layers, which manifests as listlessness, reduced appetite, weak constitution, decreased production performance, and weakened resistance to disease. Regulating ventilation may ensure a suitable CO 2 concentration in layer houses. Predicting the changes in CO 2 concentration and regulating the CO 2 concentration in advance are key to ensuring healthy large-scale breeding of layers. In recent years, machine learning and deep learning methods have been increasingly applied to this field. A CO 2 prediction model for layer house is proposed based on a GRU (gated recurrent unit) and LSTM (long short-term memory). The temperature, humidity, and CO 2 were determined as inputs to the model by the correlation coefficient. The datasets of the experimental layer house were continuously measured during June-July 2023, using a self-developed environmental monitor, and the monitored data were used as samples for model inputs. There were 22,000 time series data in the datasets. In this study, multivariate time series data were standardized via data pre-processing to improve model training. GRU and LSTM models were constructed. The models were trained using a training set. Then, these trained models were used to provide predictions on a test set. The prediction errors were calculated using the true values of the test set and the predicted values provided by the models. To test the performance of the model and accuracy of the predictions, predictions were made for different numbers of datasets. The results demonstrated that the combined prediction model had good generalization, stability, and convergence with high prediction accuracy. Due to the structure of the model, the stability of the LSTM model was higher than that of the GRU model, and its prediction accuracy and speed were lower than those of the GRU model. When the datasets of the GRU model were 15,000 to 17,000, The MAE of the GRU was 70.8077 to 126.7029 ppm, and the prediction time of the GRU is 16 to 24 ms. When the LSTM model's datasets were 15,000-20,000, the MAE of LSTM was 78.8596 to 136.0896 ppm, and the prediction time of the GRU was 17 to 26 ms.

COVID-19 has a disease and health phenomenon and has sociological and economic adverse effects. Accurate prediction of the spread of the epidemic will help in the planning of health management and the development of economic and sociological action plans. In the literature, there are many studies to analyse and predict the spread of COVID-19 in cities and countries. However, there is no study to predict and analyse the cross-country spread in the world's most populous countries. In this study, it was aimed to predict the spread of the COVID-19 epidemic. The motivation of this study is to reduce the workload of health workers, take preventive measures and optimize health processes by predicting the spread of the COVID-19 epidemic. A hybrid deep learning model was developed to predict and analyse COVID-19 cross-country spread and a case study was carried out for the world's most populous countries. The developed model was tested extensively using RMSE, MAE and R 2 . The experimental results showed that the developed model was more successful in predicting and analysis of COVID-19 cross-country spread in the world's most populous countries than LR, RF, SVM, MLP, CNN, GRU, LSTM and base CNN-GRU. In the developed model, CNN performs convolution and pooling operations to extract spatial features from the input data. GRU provides learning of long-term and non-linear relationships inferred by CNN. The developed hybrid model was more successful than the other models compared, as it enabled the effective features of the CNN and GRU models to be used together. The prediction and analysis of the cross-country spread of COVID-19 in the world's most populated countries can be presented as a novelty of this study., Competing Interests: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (© 2023 Elsevier Ltd. All rights reserved.)

Nonlinear models of neural networks demonstrate the ability to autonomously extract significant attributes from a given target, thus facilitating automatic analysis of classroom emotions. This article introduces an online auxiliary tool for analyzing emotional states in virtual classrooms using the nonlinear vision algorithm Transformer. This research uses multimodal fusion, students' auditory input, facial expression and text data as the foundational elements of sentiment analysis. In addition, a modal feature extractor has been developed to extract multimodal emotions using convolutional and gated cycle unit (GRU) architectures. In addition, inspired by the Transformer algorithm, a cross-modal Transformer algorithm is proposed to enhance the processing of multimodal information. The experiments demonstrate that the training performance of the proposed model surpasses that of similar methods, with its recall, precision, accuracy, and F1 values achieving 0.8587, 0.8365, 0.8890, and 0.8754, respectively, which is superior accuracy in capturing students' emotional states, thus having important implications in assessing students' engagement in educational courses., Competing Interests: The author declares that they have no competing interests., (© 2023 Ding.)

Internet of Things (IoT) devices within smart cities, require innovative detection methods. This paper addresses this critical challenge by introducing a deep learning-based approach for the detection of network traffic attacks in IoT ecosystems. Leveraging the Kaggle dataset, our model integrates Convolutional Neural Networks (CNNs) and Gated Recurrent Units (GRUs) to capture both spatial and sequential features in network traffic data. We trained and evaluated our model over ten epochs, achieving an impressive overall accuracy rate of 99%. The classification report reveals the model's proficiency in distinguishing various attack categories, including 'Normal', 'DoS' (Denial of Service), 'Probe', 'U2R' (User to Root), and 'Sybil'. Additionally, the confusion matrix offers valuable insights into the model's performance across these attack types. In terms of overall accuracy, our model achieves an impressive accuracy rate of 99% across all attack categories. The weighted- average F1-score is also 99%, showcasing the model's robust performance in classifying network traffic attacks in IoT devices for smart cities. This advanced architecture exhibits the potential to fortify IoT device security in the complex landscape of smart cities, effectively contributing to the safeguarding of critical infrastructure.

Purpose: To propose a novel end-to-end deep learning model to quantify absolute metabolite concentrations from in vivo J-point resolved spectroscopy (JPRESS) without using spectral fitting., Methods: A novel encoder-decoder-style neural network was created, which was trained to predict metabolite concentrations and individual component signals concurrently from 3T JPRESS data in the time domain. The training data set contained 100 000 samples created by spin-density simulations using experimentally used RF pulses. Concentrations, phase, frequencies, linewidths, and T 2 relaxation times in the training data set were varied over a large range with uniform distributions. Random synthesized noise and extraneous signals were added to the data set. Two thousand validation samples were created similarly to the training data set but with mean concentrations close to in vivo values. An in vivo test was conducted with 20 samples acquired from the human brain., Results: Both validation and in vivo test results showed that the proposed model successfully predicted metabolite concentrations as well as individual metabolite signals without involving spectral fitting, while extraneous peaks or unregistered signals were filtered out. Compared with the short-TE spectral fitting by LCModel, the proposed method had the advantage that the undesired correlations between the estimated concentrations and noise levels and between metabolites were eliminated or substantially reduced., Conclusion: The proposed method provides a working deep learning model that directly maps in vivo JPRESS data to metabolite concentrations. Because spectral fitting is not used, the trained model does not depend on the assumptions associated with parameter tuning when applied to in vivo data., (Published 2023. This article is a U.S. Government work and is in the public domain in the USA. Magnetic Resonance in Medicine published by Wiley Periodicals LLC on behalf of International Society for Magnetic Resonance in Medicine.)

Multimodal sentiment analysis is an important area of artificial intelligence. It integrates multiple modalities such as text, audio, video and image into a compact multimodal representation and obtains sentiment information from them. In this paper, we improve two modules, i.e., feature extraction and feature fusion, to enhance multimodal sentiment analysis and finally propose an attention-based two-layer bidirectional GRU (AB-GRU, gated recurrent unit) multimodal sentiment analysis method. For the feature extraction module, we use a two-layer bidirectional GRU network and connect two layers of attention mechanisms to enhance the extraction of important information. The feature fusion part uses low-rank multimodal fusion, which can reduce the multimodal data dimensionality and improve the computational rate and accuracy. The experimental results demonstrate that the AB-GRU model can achieve 80.9% accuracy on the CMU-MOSI dataset, which exceeds the same model type by at least 2.5%. The AB-GRU model also possesses a strong generalization capability and solid robustness.

Runoff forecasting is extremely important for various activities of water pollution research and agricultural. Data-driven models have been proved an effective approach in predicting daily runoff when combining deep learning methods (DLM). However, predicting accuracy of daily runoff still need improved. Here, we firstly proposed a combined model of Gate Recurrent Unit (GRU) and Residual Network (ResNet) and compared with one shallow learning method (Back Propagation Neural Network, BPNN) and one deep learning method (GRU) with data from 2010 to 2020 in three stations in daily runoff forecasting in the Yiluo River watershed. The results showed that the combined model with precipitation data and runoff data as input has the highest prediction accuracy (NSE = 0.9325, 0.8735, 0.9186, respectively). Input data with precipitation have higher prediction accuracy than that without. The performance of the model was better in the dry season than the wet season. The topographic and geomorphic factors may also the main factors affecting runoff forecast. Those results of this study can provide useful strategies to predict short runoff and manage watershed scale water resources especially in the important agriculture region., (© 2023. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.)

Accurately predicting severe accident data in nuclear power plants is of utmost importance for ensuring their safety and reliability. However, existing methods often lack interpretability, thereby limiting their utility in decision making. In this paper, we present an interpretable framework, called GRUS, for forecasting severe accident data in nuclear power plants. Our approach combines the GRU model with SHAP analysis, enabling accurate predictions and offering valuable insights into the underlying mechanisms. To begin, we preprocess the data and extract temporal features. Subsequently, we employ the GRU model to generate preliminary predictions. To enhance the interpretability of our framework, we leverage SHAP analysis to assess the contributions of different features and develop a deeper understanding of their impact on the predictions. Finally, we retrain the GRU model using the selected dataset. Through extensive experimentation utilizing breach data from MSLB accidents and LOCAs, we demonstrate the superior performance of our GRUS framework compared to the mainstream GRU, LSTM, and ARIMAX models. Our framework effectively forecasts trends in core parameters during severe accidents, thereby bolstering decision-making capabilities and enabling more effective emergency response strategies in nuclear power plants.

Optimizing the performance of heating, ventilation, and air-conditioning (HVAC) systems is critical in today's energy-conscious world. Fan coil units (FCUs) play a critical role in providing comfort in various environments as an important component of HVAC systems. However, FCUs often experience failures that affect their efficiency and increase their energy consumption. In this context, deep learning (DL)-based fault detection offers a promising solution. By detecting faults early and preventing system failures, the efficiency of FCUs can be improved. This paper explores DL models as fault detectors for FCUs to enable smarter and more energy-efficient hotel buildings. We tested three contemporary DL modeling approaches: convolutional neural network (CNN), long short-term memory network (LSTM), and a combination of CNN and gated recurrent unit (GRU). The random forest model (RF) was additionally developed as a baseline benchmark. The fault detectors were tested on a real-world dataset obtained from the sensory measurement system installed in a hotel and additionally supplemented with simulated data via a physical model developed in TRNSYS. Three representative FCU faults, namely, a stuck valve, a reduction in airflow, and an FCU outage, were simulated with a much larger dataset than is typically utilized in similar studies. The results showed that the hybrid model, integrating CNN and GRU, performed best for all three observed faults. DL-based fault detectors outperformed the baseline RF model, confirming these solutions as viable components for energy-efficient hotels.

The diagnosis of bearing faults is an important guarantee for the healthy operation of mechanical equipment. Due to the time-varying working conditions of mechanical equipment, it is necessary to achieve bearing fault diagnosis under time-varying working conditions. However, the superposition of the two-dimensional working conditions of speed and acceleration brings great difficulties to diagnosis via data-driven models. The long short-term memory (LSTM) model based on the infinitesimal method is an effective method to solve this problem, but its performance still has certain limitations. On this basis, this article proposes a model for fault diagnosis under time-varying operating conditions that combines a residual network model (ResNet) and a gate recurrent unit (model) (GRU). Firstly, the samples were segmented, and feature extraction was performed using ResNet. We then used GRU to process the information. Finally, the classification results were output through the output network. This model could ignore the influence of acceleration and achieve high fault diagnosis accuracy under time-varying working conditions. In addition, we used t-SNE to reduce the dimensionality of the features and analyzed the role of each layer in the model. Experiments showed that this method had a better performance compared with existing bearing fault diagnosis methods.

Using the source-filter model of speech production, clean speech signals can be decomposed into an excitation component and an envelope component that is related to the phoneme being uttered. Therefore, restoring the envelope of degraded speech during speech enhancement can improve the intelligibility and quality of output. As the number of phonemes in spoken speech is limited, they can be adequately represented by a correspondingly limited number of envelopes. This can be exploited to improve the estimation of speech envelopes from a degraded signal in a data-driven manner. The improved envelopes are then used in a second stage to refine the final speech estimate. Envelopes are typically derived from the linear prediction coefficients (LPCs) or from the cepstral coefficients (CCs). The improved envelope is obtained either by mapping the degraded envelope onto pre-trained codebooks (classification approach) or by directly estimating it from the degraded envelope (regression approach). In this work, we first investigate the optimal features for envelope representation and codebook generation by a series of oracle tests. We demonstrate that CCs provide better envelope representation compared to using the LPCs. Further, we demonstrate that a unified speech codebook is advantageous compared to the typical codebook that manually splits speech and silence as separate entries. Next, we investigate low-complexity neural network architectures to map degraded envelopes to the optimal codebook entry in practical systems. We confirm that simple recurrent neural networks yield good performance with a low complexity and number of parameters. We also demonstrate that with a careful choice of the feature and architecture, a regression approach can further improve the performance at a lower computational cost. However, as also seen from the oracle tests, the benefit of the two-stage framework is now chiefly limited by the statistical noise floor estimate, leading to only a limited improvement in extremely adverse conditions. This highlights the need for further research on joint estimation of speech and noise for optimum enhancement.

Aiming at the problem of poor prediction accuracy of Channel State Information (CSI) caused by fast time-varying channels in wireless communication systems, this paper proposes a gated recurrent network based on experience replay and Snake Optimizer for real-time prediction in real-world non-stationary channels. Firstly, a two-channel prediction model is constructed by gated recurrent unit, which adapts to the real and imaginary parts of CSI. Secondly, we use the Snake Optimizer to find the optimal learning rate and the number of hidden layer elements to build the model. Finally, we utilize the experience pool to store recent historical CSI data for fast learning and complete learning. The simulation results show that, compared with LSTM, BiLSTM, and BiGRU, the gated recurrent network based on experience replay and Snake Optimizer has better performance in the optimization ability and convergence speed. The prediction accuracy of the model is also significantly improved under the dynamic non-stationary environment.

Sleep apnea (SLA) is a respiratory-related sleep disorder that affects a major proportion of the population. The gold standard in sleep testing, polysomnography, is costly, inconvenient, and unpleasant, and it requires a skilled professional to score. Multiple researchers have suggested and developed automated scoring processes with less detectors and automated classification algorithms to resolve these problems. An automatic detection system will allow for a high diagnosis rate and the analysis of additional patients. Deep learning (DL) is achieving high priority due to the availability of databases and recently developed methods. As the most up-and-coming technique for classification and generative tasks, DL has shown its significant potential in 2-dimensional clinical image processing studies. However, physiological information collected as 1-dimensional data has yet to be effectively extracted from this new approach to achieve the needed medical goals. So, in this study, we review the most recent studies in the field of DL applied to physiological data based on pulse oxygen saturation, electrocardiogram, airflow, and sound signal. A total of 47 articles from different journals and publishing houses that were published between 2012 and 2022 were identified. The primary objective of this work is to perform a comprehensive analysis to analyze, classify, and compare the main characteristics of deep-learning algorithms applied in physiological data processing for SLA detection. Overall, our analysis provides comprehensive and detailed information for researchers looking to add to this field. The data input source, objective, DL network, training framework, and database references are the critical factors of the DL approach examined. These are the most critical variables that influence system performance. We categorized the relevant research studies in physiological sensor data analysis using the DL approach based on (1) Physiological sensor data aspects, like signal types, sampling frequency, and window size; and (2) DL model perspectives, such as learning structure and input data types., Supplementary Information: The online version contains supplementary material available at 10.1007/s13534-023-00297-5., Competing Interests: Conflict of interestNone of the authors has any conflict of interest to declare., (© Korean Society of Medical and Biological Engineering 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.)

At present, China is moving towards the direction of "Industry 4.0". The development of the automobile industry, especially intelligent automobiles, is in full swing, which brings great convenience to people's life and travel. However, at the same time, urban traffic pressure is also increasingly prominent, and the situation of traffic congestion and traffic safety is not optimistic. In this context, the Internet of Vehicles (also known as "IoV") opens up a new way to relieve urban traffic pressure. Therefore, in order to further optimize the road network traffic conditions in the IoV environment, this research focuses on the traffic flow prediction algorithm on the basis of deep learning to enhance traffic efficiency and safety. First, the study investigates the short-time traffic flow prediction by combining the characteristics of the IoV environment. To address the issues that existing algorithms cannot automatically extract data features and the model expression capability is weak, the study chooses to build a deep neural network using GRU model in deep learning for short-time traffic flow prediction, thereby improving the prediction accuracy of algorithm. Secondly, a fine-grained traffic flow statistics approach suitable for the IoV situation is suggested in accordance with the deep learning model that was built. The algorithm sends the vehicle characteristic data obtained through GRU model training into the fine-grained traffic flow statistics algorithm, so as to realize the statistics of traffic information of various types of vehicles. The advantage of this algorithm is that it can well count the traffic flow of multiple lanes, so as to better predict the current traffic status and achieve traffic optimization. Finally, the IoV environment is constructed to confirm the effectiveness of the prediction model. The prediction results prove that the new algorithm has good performance in traffic flow statistics in different scenarios., Competing Interests: The authors declare there are no competing interests., (©2023 Wen et al.)

Sentiment Analysis (SA) is a domain- or topic-dependent task since polarity terms convey different sentiments in various domains. Hence, machine learning models trained on a specific domain cannot be employed in other domains, and existing domain-independent lexicons cannot correctly recognize the polarity of domain-specific polarity terms. Conventional approaches of Topic Sentiment Analysis perform Topic Modeling (TM) and SA sequentially, utilizing the previously trained models on irrelevant datasets for classifying sentiments that cannot provide acceptable accuracy. However, some researchers perform TM and SA simultaneously using topic-sentiment joint models, which require a list of seeds and their sentiments from widely used domain-independent lexicons. As a result, these methods cannot find the polarity of domain-specific terms correctly. This paper proposes a novel supervised hybrid TSA approach, called Embedding Topic Sentiment Analysis using Deep Neural Networks (ETSANet), that extracts the semantic relationships between the hidden topics and the training dataset using Semantically Topic-Related Documents Finder (STRDF). STRDF discovers those training documents in the same context as the topic based on the semantic relationships between the Semantic Topic Vector, a newly introduced concept that encompasses the semantic aspects of a topic, and the training dataset. Then, a hybrid CNN-GRU model is trained by these semantically topic-related documents. Moreover, a hybrid metaheuristic method utilizing Grey Wolf Optimization and Whale Optimization Algorithm is employed to fine-tune the hyperparameters of the CNN-GRU network. The evaluation results demonstrate that ETSANet increases the accuracy of the state-of-the-art methods by 1.92%., Competing Interests: Conflict of interestThe authors declare no conflicts of interest regarding the publication of this paper., (© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.)

Stress has an impact, not only on a person's physical health, but also on the ability to perform at the workplace in daily life. The well-established relation between psychological stress and its pathogeneses highlights the need for detecting psychological stress early, in order to prevent disease advancement and to save human lives. Electroencephalography (EEG) signal recording tools are widely used to collect these psychological signals/brain rhythms in the form of electric waves. The aim of the current research was to apply automatic feature extraction to decomposed multichannel EEG recordings, in order to efficiently detect psychological stress. The traditional deep learning techniques, namely the convolution neural network (CNN), long short-term memory (LSTM), bidirectional long short-term memory (BiLSTM), gated recurrent unit (GRU) and recurrent neural network (RNN) models, have been frequently used for stress detection. A hybrid combination of these techniques may provide improved performance, and can handle long-term dependencies in non-linear brain signals. Therefore, this study proposed an integration of deep learning models, called DWT-based CNN, BiLSTM, and two layers of a GRU network, to extract features and classify stress levels. Discrete wavelet transform (DWT) analysis was used to remove the non-linearity and non-stationarity from multi-channel (14 channel) EEG recordings, and to decompose them into different frequency bands. The decomposed signals were utilized for automatic feature extraction using the CNN, and the stress levels were classified using BiLSTM and two layers of GRU. This study compared five combinations of the CNN, LSTM, BiLSTM, GRU and RNN models with the proposed model. The proposed hybrid model performed better in classification accuracy compared to the other models. Therefore, hybrid combinations are appropriate for the clinical intervention and prevention of mental and physical problems.

Groundwater level (GWL) simulations allow the generation of reconstructions for exploring the past temporal variability of groundwater resources or provide the means for generating projections under climate change on decadal scales. In this context, analyzing GWLs affected by low-frequency variations is crucial. In this study, we assess the capabilities of three deep learning (DL) models (long short-term memory (LSTM), gated recurrent unit (GRU), and bidirectional LSTM (BiLSTM)) in simulating three types of GWLs affected by varying low-frequency behavior: inertial (dominated by low-frequency), annual (dominated by annual cyclicity) and mixed (in which both annual and low-frequency variations have high amplitude). We also tested if maximal overlap discrete wavelet transform pre-processing (MODWT) of input variables helps to better identify the frequency content most relevant for the models (MODWT-DL models). Only external variables (i.e., precipitation, air temperature as raw data, and effective precipitation (EP)) were used as input. Results indicate that for inertial-type GWLs, MODWT-DL models with raw data were notably more accurate than standalone models. However, DL models performed well for annual-type GWLs, while using EP as input, with MODWT-DL models exhibiting only minor improvements. Using raw data as input improved MODWT-DL models compared to standalone models; nevertheless, all models using EP performed better for annual-type GWLs. For mixed-type GWLs, while using EP as input, MODWT-DL models performed well, with substantial improvements over standalone models. Using raw data as input, improvement of MODWT-DL models is marginal compared to that of standalone models; nevertheless, they perform better than standalone models with EP. The Shapley Additive exPlanations (SHAP) approach used to interpret models highlighted that they preferentially learned from low-frequency in precipitation data to achieve the best simulations for inertial and mixed GWLs. This study showed that MODWT-based input pre-processing is highly suitable to better simulate low-frequency varying GWLs., Competing Interests: Declaration of competing interest Sivarama Krishna Reddy Chidepudi reports financial support was provided by Normandy Region., (Copyright © 2023 Elsevier B.V. All rights reserved.)

The tremendous growth in online activity and the Internet of Things (IoT) led to an increase in cyberattacks. Malware infiltrated at least one device in almost every household. Various malware detection methods that use shallow or deep IoT techniques were discovered in recent years. Deep learning models with a visualization method are the most commonly and popularly used strategy in most works. This method has the benefit of automatically extracting features, requiring less technical expertise, and using fewer resources during data processing. Training deep learning models that generalize effectively without overfitting is not feasible or appropriate with large datasets and complex architectures. In this paper, a novel ensemble model, Stacked Ensemble-autoencoder, GRU, and MLP or SE-AGM, composed of three light-weight neural network models-autoencoder, GRU, and MLP-that is trained on the 25 essential and encoded extracted features of the benchmark MalImg dataset for classification was proposed. The GRU model was tested for its suitability in malware detection due to its lesser usage in this domain. The proposed model used a concise set of malware features for training and classifying the malware classes, which reduced the time and resource consumption in comparison to other existing models. The novelty lies in the stacked ensemble method where the output of one intermediate model works as input for the next model, thereby refining the features as compared to the general notion of an ensemble approach. Inspiration was drawn from earlier image-based malware detection works and transfer learning ideas. To extract features from the MalImg dataset, a CNN-based transfer learning model that was trained from scratch on domain data was used. Data augmentation was an important step in the image processing stage to investigate its effect on classifying grayscale malware images in the MalImg dataset. SE-AGM outperformed existing approaches on the benchmark MalImg dataset with an average accuracy of 99.43%, demonstrating that our method was on par with or even surpassed them.

Objective: Dysphagia management relies on the evaluation of the temporospatial kinematic events of swallowing performed in videofluoroscopy (VF) by trained clinicians. The upper esophageal sphincter (UES) opening distension represents one of the important kinematic events that contribute to healthy swallowing. Insufficient distension of UES opening can lead to an accumulation of pharyngeal residue and subsequent aspiration which in turn can lead to adverse outcomes such as pneumonia. VF is usually used for the temporal and spatial evaluation of the UES opening; however, VF is not available in all clinical settings and may be inappropriate or undesirable for some patients. High resolution cervical auscultation (HRCA) is a noninvasive technology that uses neck-attached sensors and machine learning to characterize swallowing physiology by analyzing the swallow-induced vibrations/sounds in the anterior neck region. We investigated the ability of HRCA to noninvasively estimate the maximal distension of anterior-posterior (A-P) UES opening as accurately as the measurements performed by human judges from VF images., Methods and Procedures: Trained judges performed the kinematic measurement of UES opening duration and A-P UES opening maximal distension on 434 swallows collected from 133 patients. We used a hybrid convolutional recurrent neural network supported by attention mechanisms which takes HRCA raw signals as input and estimates the value of the A-P UES opening maximal distension as output., Results: The proposed network estimated the A-P UES opening maximal distension with an absolute percentage error of 30% or less for more than 64.14% of the swallows in the dataset., Conclusion: This study provides substantial evidence for the feasibility of using HRCA to estimate one of the key spatial kinematic measurements used for dysphagia characterization and management. Clinical and Translational Impact Statement: The findings in this study have a direct impact on dysphagia diagnosis and management through providing a non-invasive and cheap way to estimate one of the most important swallowing kinematics, the UES opening distension, that contributes to safe swallowing. This study, along with other studies that utilize HRCA for swallowing kinematic analysis, paves the way for developing a widely available and easy-to-use tool for dysphagia diagnosis and management.

Background and Objective: Prenatal fetal monitoring, which can monitor the growth and health of the fetus, is very vital for pregnant women before delivery. During pregnancy, it is crucial to judge whether the fetus is abnormal, which helps obstetricians carry out early intervention to avoid fetal hypoxia and even death. At present, clinical fetal monitoring widely used fetal heart rate monitoring equipment. Fetal heart rate and uterine contraction signals obtained by fetal heart monitoring equipment are important information to evaluate fetal health status., Methods: This paper is based on 1D-CNN (One Dimension Convolutional Neural Network) and GRU (Gate Recurrent Unit). We preprocess the obtained data and enhances them, to make the proportion of number of instances in different class in the training set is same., Results: In model performance evaluation, standard evaluation indicators are used, such as accuracy, sensitivity, specificity, and ROC (receiver operating characteristic). Finally, the accuracy of our model in the test set is 95.15%, the sensitivity is 96.20%, and the specificity is 94.09%., Conclusions: In fetal heart rate monitoring, this paper proposes a 1D-CNN and bidirectional GRU hybrid models, and the fetal heart rate and uterine contraction signals given by monitoring are used as input feature to classify the fetal health status. The results show that our approach is effective in evaluating fetal health status and can assists obstetricians in clinical decision-making. And provide a baseline for the introduction of 1D-CNN and bidirectional GRU hybrid models into the evaluation of fetal health status., Competing Interests: Declaration of Competing Interest We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work, there is no professional or other personal interest of any nature or kind in any product, service and/or company that could be construed as influencing the position presented in, or the review of, this manuscript., (Copyright © 2022 Elsevier B.V. All rights reserved.)

The environment and development are major issues of general concern. After much suffering from the harm of environmental pollution, human beings began to pay attention to environmental protection and started to carry out pollutant prediction research. A large number of air pollutant predictions have tried to predict pollutants by revealing their evolution patterns, emphasizing the fitting analysis of time series but ignoring the spatial transmission effect of adjacent areas, leading to low prediction accuracy. To solve this problem, we propose a time series prediction network with the self-optimization ability of a spatio-temporal graph neural network (BGGRU) to mine the changing pattern of the time series and the spatial propagation effect. The proposed network includes spatial and temporal modules. The spatial module uses a graph sampling and aggregation network (GraphSAGE) in order to extract the spatial information of the data. The temporal module uses a Bayesian graph gated recurrent unit (BGraphGRU), which applies a graph network to the gated recurrent unit (GRU) so as to fit the data's temporal information. In addition, this study used Bayesian optimization to solve the problem of the model's inaccuracy caused by inappropriate hyperparameters of the model. The high accuracy of the proposed method was verified by the actual PM2.5 data of Beijing, China, which provided an effective method for predicting the PM2.5 concentration.

Aiming at the problem that a single neural network model has difficulty in accurately predicting trends of the remaining useful life of a rolling bearing, a method of predicting the remaining useful life of rolling bearings using a gated recurrent unit-deep autoregressive model (GRU-DeepAR) with an adaptive failure threshold was proposed. First, time domain and frequency domain features were extracted from the rolling bearing vibration signal. Second, its operation process was divided into a smooth operation stage and degradation stage according to the trend of the accumulated root mean square of maximum. Then, the failure threshold for different bearings were determined adaptively by the maximum of the smooth operation data. The degradation dataset of a rolling bearing was subsequently obtained. In the meantime, a GRU-DeepAR model was built to obtain predictions of the failure time and failure probability. Appropriate model parameters were determined after a large number of tests to assure the effectiveness and prediction accuracy. Finally, the trend of time series and failure times were predicted by inputting the degradation dataset into the GRU-DeepAR model. Experiments showed that the proposed method can effectively improve the accuracy of the remaining useful life prediction of a rolling bearing with good stability.

Variations in rainfall negatively affect crop productivity and impose severe climatic conditions in developing regions. Studies that focus on climatic variations such as variability in rainfall and temperature are vital, particularly in predominant rainfed areas. Forecasting rainfall is very essential in the agriculture sector due to the dependence of many people, while it is very complex to accurately predict rainfall due to its dynamic nature. This study aims to present a deep forecasting model based on optimized (Gated Recurrent Unit) GRU neural network to predict rainfall in Pakistan based on the 30 years of climate data from 1991 to 2020. The climatic variables were first extracted and then fine-tuned by eliminating outliers and extreme values from the data set for precise forecasting. Data normalization strategies were further utilized to adjust numeric values into a standard scale without distorting divergences or losing useful information. The proposed model achieved high prediction accuracy by maintaining minimal Normalized Mean Absolute Error (NMAE) and Normalized Root Mean Squared Error (NRMSE) compared to state-of-the-art rainfall forecasting models. Climatic variables used in the forecasting were evaluated in terms of correlation and regression analysis. The correlation results showed that temperature has a negative association and air quality variables have a positive association with rainfall in each quarter of the year. The second and third quarters of the year showed a high association with rainfall, whereas the air quality variables showed a lesser or no association with rainfall during the first and second quarters of the year. The results further showed a strong association of climatic variables with rainfall for all months of the year. The minimal loss achieved by the proposed model also demonstrated the feasibility of selected variables in precise forecasting of rainfall regardless of volatile climatic conditions., Competing Interests: Declaration of competing interest I would like to declare on behalf of my co-authors that the work described is original research that has not been published previously, and not under consideration for publication elsewhere, in whole or in part. I confirmed that no conflict of interest exists in the submission of this manuscript, and is approved by all authors for publication in your journal., (Copyright © 2022 Elsevier B.V. All rights reserved.)

The novel human coronavirus disease COVID-19 has become the fifth documented pandemic since the 1918 flu pandemic. COVID-19 was first reported in Wuhan, China, and subsequently spread worldwide. Almost all of the countries of the world are facing this natural challenge. We present forecasting models to estimate and predict COVID-19 outbreak in Asia Pacific countries, particularly Pakistan, Afghanistan, India, and Bangladesh. We have utilized the latest deep learning techniques such as Long Short Term Memory networks (LSTM), Recurrent Neural Network (RNN), and Gated Recurrent Units (GRU) to quantify the intensity of pandemic for the near future. We consider the time variable and data non-linearity when employing neural networks. Each model's salient features have been evaluated to foresee the number of COVID-19 cases in the next 10 days. The forecasting performance of employed deep learning models shown up to July 01, 2020, is more than 90% accurate, which shows the reliability of the proposed study. We hope that the present comparative analysis will provide an accurate picture of pandemic spread to the government officials so that they can take appropriate mitigation measures., Competing Interests: Conflict of interestThe authors declare that they have no conflict of interest., (© Springer-Verlag London Ltd., part of Springer Nature 2021.)

In the discipline of hand gesture and dynamic sign language recognition, deep learning approaches with high computational complexity and a wide range of parameters have been an extremely remarkable success. However, the implementation of sign language recognition applications for mobile phones with restricted storage and computing capacities is usually greatly constrained by those limited resources. In light of this situation, we suggest lightweight deep neural networks with advanced processing for real-time dynamic sign language recognition (DSLR). This paper presents a DSLR application to minimize the gap between hearing-impaired communities and regular society. The DSLR application was developed using two robust deep learning models, the GRU and the 1D CNN, combined with the MediaPipe framework. In this paper, the authors implement advanced processes to solve most of the DSLR problems, especially in real-time detection, e.g., differences in depth and location. The solution method consists of three main parts. First, the input dataset is preprocessed with our algorithm to standardize the number of frames. Then, the MediaPipe framework extracts hands and poses landmarks (features) to detect and locate them. Finally, the features of the models are passed after processing the unification of the depth and location of the body to recognize the DSL accurately. To accomplish this, the authors built a new American video-based sign dataset and named it DSL-46. DSL-46 contains 46 daily used signs that were presented with all the needed details and properties for recording the new dataset. The results of the experiments show that the presented solution method can recognize dynamic signs extremely fast and accurately, even in real-time detection. The DSLR reaches an accuracy of 98.8%, 99.84%, and 88.40% on the DSL-46, LSA64, and LIBRAS-BSL datasets, respectively.