Search

Monitoring heart conditions through electrocardiography (ECG) has been the cornerstone of identifying cardiac irregularities. Cardiologists often rely on a detailed analysis of ECG recordings to pinpoint deviations that are indicative of heart anomalies. This traditional method, while effective, demands significant expertise and is susceptible to inaccuracies due to its manual nature. In the realm of computational analysis, Artificial Neural Networks (ANNs) have gained prominence across various domains, which can be attributed to their superior analytical capabilities. Conversely, Spiking Neural Networks (SNNs), which mimic the neural activity of the brain more closely through impulse-based processing, have not seen widespread adoption. The challenge lies primarily in the complexity of their training methodologies. Despite this, SNNs offer a promising avenue for energy-efficient computational models capable of displaying a high-level performance. This paper introduces an innovative approach employing SNNs augmented with an attention mechanism to enhance feature recognition in ECG signals. By leveraging the inherent efficiency of SNNs, coupled with the precision of attention modules, this model aims to refine the analysis of cardiac signals. The novel aspect of our methodology involves adapting the learned parameters from ANNs to SNNs using leaky integrate-and-fire (LIF) neurons. This transfer learning strategy not only capitalizes on the strengths of both neural network models but also addresses the training challenges associated with SNNs. The proposed method is evaluated through extensive experiments on two publicly available benchmark ECG datasets. The results show that our model achieves an overall accuracy of 93.8% on the MIT-BIH Arrhythmia dataset and 85.8% on the 2017 PhysioNet Challenge dataset. This advancement underscores the potential of SNNs in the field of medical diagnostics, offering a path towards more accurate, efficient, and less resource-intensive analyses of heart diseases. [ABSTRACT FROM AUTHOR]

Currently, many fault diagnosis methods for rolling bearings based on deep learning are facing two main challenges. Firstly, the deep learning model exhibits poor diagnostic performance and limited generalization ability in the presence of noise signals and varying loads. Secondly, there is incomplete utilization of fault information and inadequate extraction of fault features, leading to the low diagnostic accuracy of the model. To address these problems, this paper proposes an improved dual-branch convolutional capsule neural network for rolling bearing fault diagnosis. This method converts the collected bearing vibration signals into grayscale images to construct a grayscale image dataset. By fully considering the types of bearing faults and damage diameters, the data are labeled using a dual-label format. A multi-scale convolution module is introduced to extract features from the data and maximize feature information extraction. Additionally, a coordinate attention mechanism is incorporated into this module to better extract useful channel features and enhance feature extraction capability. Based on adaptive fusion between fault type (damage diameter) features and labels, a dual-branch convolutional capsule neural network model for rolling bearing fault diagnosis is established. The model was experimentally validated using both Case Western Reserve University's bearing dataset and self-made datasets. The experimental results demonstrate that the fault type branch of the model achieves an accuracy rate of 99.88%, while the damage diameter branch attains an accuracy rate of 99.72%. Both branches exhibit excellent classification performance and display robustness against noise interference and variable working conditions. In comparison with other algorithm models cited in the reference literature, the diagnostic capability of the model proposed in this study surpasses them. Furthermore, the generalization ability of the model is validated using a self-constructed laboratory dataset, yielding an average accuracy rate of 94.25% for both branches. [ABSTRACT FROM AUTHOR]

ANNs have become a cornerstone in efficiently managing building energy management systems (BEMSs) as they offer advanced capabilities for prediction, control, and optimization. This paper offers a detailed review of recent, significant research in this domain, highlighting the use of ANNs in optimizing key energy systems, such as HVAC systems, domestic water heating (DHW) systems, lighting systems (LSs), and renewable energy sources (RESs), which have been integrated into the building environment. After illustrating the conceptual background of the most common ANN architectures for controlling BEMSs, the current work dives deep into relative research applications, thereby exhibiting their methodology and outcomes. By summarizing the numerous impactful applications during 2015–2023, this paper categorizes the predominant ANN-based techniques according to their methodological approach, specific energy equipment, and experimental setups. Grounded in the different perspectives that the integrated studies illustrate, the primary focus of this paper is to evaluate the overall status of ANN-driven control in building energy management, as well as to offer a deep understanding of the prevailing trends at the building level. Leveraging detailed graphical depictions and comparisons between different concepts, future directions, and fruitful conclusions are drawn, and the upcoming innovations of ANN-based control frameworks in BEMSs are highlighted. [ABSTRACT FROM AUTHOR]

This paper discusses the problem of recognizing defective epoxy drop images for the purpose of performing vision-based die attachment inspection in integrated circuit (IC) manufacturing based on deep neural networks. Two supervised and two unsupervised recognition models are considered. The supervised models examined are an autoencoder (AE) network together with a multi-layer perceptron network (MLP) and a VGG16 network, while the unsupervised models examined are an autoencoder (AE) network together with k-means clustering and a VGG16 network together with k-means clustering. Since in practice very few defective epoxy drop images are available on an actual IC production line, the emphasis in this paper is placed on the impact of data augmentation on the recognition outcome. The data augmentation is achieved by generating synthesized defective epoxy drop images via our previously developed enhanced loss function CycleGAN generative network. The experimental results indicate that when using data augmentation, the supervised and unsupervised models of VGG16 generate perfect or near perfect accuracies for recognition of defective epoxy drop images for the dataset examined. More specifically, for the supervised models of AE+MLP and VGG16, the recognition accuracy is improved by 47% and 1%, respectively, and for the unsupervised models of AE+Kmeans and VGG+Kmeans, the recognition accuracy is improved by 37% and 15%, respectively, due to the data augmentation. [ABSTRACT FROM AUTHOR]

Fishing nets are dangerous obstacles for an underwater robot whose aim is to reach a goal in unknown underwater environments. This paper proposes how to make the robot reach its goal, while avoiding fishing nets that are detected using the robot's camera sensors. For the detection of underwater nets based on camera measurements of the robot, we can use deep neural networks. Passive camera sensors do not provide the distance information between the robot and a net. Camera sensors only provide the bearing angle of a net, with respect to the robot's camera pose. There may be trailing wires that extend from a net, and the wires can entangle the robot before the robot detects the net. Moreover, light, viewpoint, and sea floor condition can decrease the net detection probability in practice. Therefore, whenever a net is detected by the robot's camera, we make the robot avoid the detected net by moving away from the net abruptly. For moving away from the net, the robot uses the bounding box for the detected net in the camera image. After the robot moves backward for a certain distance, the robot makes a large circular turn to approach the goal, while avoiding the net. A large circular turn is used, since moving close to a net is too dangerous for the robot. As far as we know, our paper is unique in addressing reactive control laws for approaching the goal, while avoiding fishing nets detected using camera sensors. The effectiveness of the proposed net avoidance controls is verified using simulations. [ABSTRACT FROM AUTHOR]

Shadow removal for document images is an essential task for digitized document applications. Recent shadow removal models have been trained on pairs of shadow images and shadow-free images. However, obtaining a large, diverse dataset for document shadow removal takes time and effort. Thus, only small real datasets are available. Graphic renderers have been used to synthesize shadows to create relatively large datasets. However, the limited number of unique documents and the limited lighting environments adversely affect the network performance. This paper presents a large-scale, diverse dataset called the Synthetic Document with Diverse Shadows (SynDocDS) dataset. The SynDocDS comprises rendered images with diverse shadows augmented by a physics-based illumination model, which can be utilized to obtain a more robust and high-performance deep shadow removal network. In this paper, we further propose a Dual Shadow Fusion Network (DSFN). Unlike natural images, document images often have constant background colors requiring a high understanding of global color features for training a deep shadow removal network. The DSFN has a high global color comprehension and understanding of shadow regions and merges shadow attentions and features efficiently. We conduct experiments on three publicly available datasets, the OSR, Kligler's, and Jung's datasets, to validate our proposed method's effectiveness. In comparison to training on existing synthetic datasets, our model training on the SynDocDS dataset achieves an enhancement in the PSNR and SSIM, increasing them from 23.00 dB to 25.70 dB and 0.959 to 0.971 on average. In addition, the experiments demonstrated that our DSFN clearly outperformed other networks across multiple metrics, including the PSNR, the SSIM, and its impact on OCR performance. [ABSTRACT FROM AUTHOR]

Drying processes are among the most energy-intensive industrial processes. There is a need for development of the efficient methods needed for estimating, measuring, and reducing energy use. Different machine learning algorithms might provide some of the answers to these issues in a faster and less costly way, without the need for time-consuming and expensive experiments done at different scales of the dryers. The aim of this paper was to provide a comprehensive overview of machine learning applications for addressing energy-related challenges by exploration of different energy types and energy reduction opportunities. Also, the analysis of the applied algorithms, their specific applications and a critical evaluation of the obtained results are provided. The paper is based on the necessity of the improvements in energy use needed for drying related on the existing data. The overview of the ways for such achievements, and a general classification of machine learning algorithm are the background of the paper. The methods used are the machine learning techniques employed in different energy-related issues for drying processes. The paper focuses on the applications of artificial neural networks and other machine learning algorithms and models for different energy-related issues, including different energy types applications, challenges associated with energy consumption, and opportunities for energy reduction. Not only the applied algorithms, but also their specific applications, and the statistical analysis of the obtained results are also overviewed. Finally, a critical evaluation of the findings highlighting the potentials of machine learning algorithms in addressing energy-related challenges (such as estimation of energy consumption, opportunities for energy reduction, and use of different energy sources) is provided. The presented analysis underscored the effectiveness of machine learning applications for these purposes. [ABSTRACT FROM AUTHOR]

Electrical drive systems are commonly applied for the mechanisms of precise movement, where having a high-quality position and high-quality speed control is especially valuable. Very often, the mechanical part of these systems reveals resonant properties that are related to the limited stiffness of the interconnection between subsequent parts of the mechanism. In most cases, this sort of system may be described as a model of several linked masses. If only the structure of the mechanical part is known and the corresponding parameters are constant and identified, the demanded control quality may be obtained using a properly tuned ADRC or PID controller equipped with appropriate anti-resonance filtration. However, if the parameters of the mechanical part are variant, adaptive control may be considered as a solution. In this paper, artificial neural network (ANN) is considered to be a speed controller and its training method assures adaptation to the unknown mechanical parameters. The paper is particularly focused on a three-mass system, which possesses, due to its structure, two resonant frequencies. The unique property of the analyzed system is the application of drive units at both ends of the system, so that the controller has the ability to influence the resonant system from both sides. The coordination of the drive unit is performed by the aforementioned ANN, from which two outputs affect the drive units independently. The derivation of the mathematical model is followed by its implementation in a computer simulation and finally the evaluation in a dedicated laboratory setup, the construction of which is also presented in the paper. [ABSTRACT FROM AUTHOR]

At present, the packing method of "plastic bag–buffer packing–packing paper box" is adopted for bearing packaging. However, the common packing method has a poor packing effect and poor versatility. In this study, a new biomimetic cobweb cushion is proposed to solve the problem of insufficient cushioning capacity of high-precision bearing cushion packaging pads. First, according to the nature of cobweb form, the cobweb cushion structure configuration is determined. Next, based on the structure of the cushion and the relationship between the parameters of radial thread and spiral thread, a mechanical and target optimization model is established. The stress nephogram of bearing and the cobweb cushion are analyzed under three drop heights of 381, 610, and 700 mm, in the finite element simulation software to ensure that the maximum bearings stress is not beyond the material yield strength. Via the 3D printing technology, a cobweb cushion shell cast is made. Drop tests of the bearing were performed, and the results were verified with the finite element simulation analysis. This research can provide technical support for the protection of high-precision bearings from accidental drops during transportation. [ABSTRACT FROM AUTHOR]

The quality of Ti alloy casing is crucial for the safe and stable operation of aero engines. However, the fluctuation of key process parameters during the investment casting process of titanium alloy casings has a significant influence on the volume and number of porosity defects, and this influence cannot be effectively suppressed at present. Therefore, this paper proposes a strategy to control the influence of process parameters on shrinkage volume and number. This study constructed multiple regression prediction models and neural network prediction models of porosity volume and number for a ZTC4 casing by simulating the gravity investment casting process. The results show that the multiple regression prediction model and neural network prediction model of shrinkage cavity total volume have an accuracy of over 99%. The accuracy of the neural network prediction model is higher than that of the multiple regression model, and the neural network model realizes the accurate prediction of shrinkage defect volume and defect number through pouring temperature, pouring time, and mold shell temperature. The sensitivity degree of casing defects to key process parameters, from high to low, is as follows: pouring temperature, pouring time, and mold temperature. Further optimizing the key process parameter window reduces the influence of process parameter fluctuation on the volume and number of porosity defects in casing castings. This study provides a reference for actual production control process parameters to reduce shrinkage cavity and loose defects. [ABSTRACT FROM AUTHOR]

The accurate prediction of heavy precipitation in convective environments is crucial because such events, often occurring in Italy during the summer and fall seasons, can be a threat for people and properties. In this paper, we analyse the impact of satellite-derived surface-rainfall-rate data assimilation on the Weather Research and Forecasting (WRF) model's precipitation prediction, considering 15 days in summer 2022 and 17 days in fall 2022, where moderate to intense precipitation was observed over Italy. A 3DVar realised at CNR-ISAC (National Research Council of Italy, Institute of Atmospheric Sciences and Climate) is used to assimilate two different satellite-derived rain rate products, both exploiting geostationary (GEO), infrared (IR), and low-Earth-orbit (LEO) microwave (MW) measurements: One is based on an artificial neural network (NN), and the other one is the operational P-IN-SEVIRI-PMW product (H60), delivered in near-real time by the EUMETSAT HSAF (Satellite Application Facility in Support of Operational Hydrology and Water Management). The forecast is verified in two periods: the hours from 1 to 4 (1–4 h phase) and the hours from 3 to 6 (3–6 h phase) after the assimilation. The results show that the rain rate assimilation improves the precipitation forecast in both seasons and for both forecast phases, even if the improvement in the 3–6 h phase is found mainly in summer. The assimilation of H60 produces a high number of false alarms, which has a negative impact on the forecast, especially for intense events (30 mm/3 h). The assimilation of the NN rain rate gives more balanced predictions, improving the control forecast without significantly increasing false alarms. [ABSTRACT FROM AUTHOR]

Background and objectives: This review aims to delve into the role of artificial intelligence in medicine. Ulcerative colitis (UC) is a chronic, inflammatory bowel disease (IBD) characterized by superficial mucosal inflammation, rectal bleeding, diarrhoea and abdominal pain. By identifying the challenges inherent in UC diagnosis, we seek to highlight the potential impact of artificial intelligence on enhancing both diagnosis and treatment methodologies for this condition. Method: A targeted, non-systematic review of literature relating to ulcerative colitis was undertaken. The PubMed and Scopus databases were searched to categorize a well-rounded understanding of the field of artificial intelligence and its developing role in the diagnosis and treatment of ulcerative colitis. Articles that were thought to be relevant were included. This paper only included articles published in English. Results: Artificial intelligence (AI) refers to computer algorithms capable of learning, problem solving and decision-making. Throughout our review, we highlighted the role and importance of artificial intelligence in modern medicine, emphasizing its role in diagnosis through AI-assisted endoscopies and histology analysis and its enhancements in the treatment of ulcerative colitis. Despite these advances, AI is still hindered due to its current lack of adaptability to real-world scenarios and its difficulty in widespread data availability, which hinders the growth of AI-led data analysis. Conclusions: When considering the potential of artificial intelligence, its ability to enhance patient care from a diagnostic and therapeutic perspective shows signs of promise. For the true utilization of artificial intelligence, some roadblocks must be addressed. The datasets available to AI may not truly reflect the real-world, which would prevent its impact in all clinical scenarios when dealing with a spectrum of patients with different backgrounds and presenting factors. Considering this, the shift in medical diagnostics and therapeutics is coinciding with evolving technology. With a continuous advancement in artificial intelligence programming and a perpetual surge in patient datasets, these networks can be further enhanced and supplemented with a greater cohort, enabling better outcomes and prediction models for the future of modern medicine. [ABSTRACT FROM AUTHOR]

Patient-specific 3D models of the human mandible are finding increasing utility in medical fields such as oral and maxillofacial surgery, orthodontics, dentistry, and forensic sciences. The efficient creation of personalized 3D bone models poses a key challenge in these applications. Existing solutions often rely on 3D statistical models of human bone, offering advantages in rapid bone geometry adaptation and flexibility by capturing a range of anatomical variations, but also a disadvantage in terms of reduced precision in representing specific shapes. Considering this, the proposed parametric model allows for precise manipulation using morphometric parameters acquired from medical images. This paper highlights the significance of employing the parametric model in the creation of a personalized bone model, exemplified through a case study targeting mandibular prognathism reconstruction. A personalized model is described as 3D point cloud determined through the utilization of series of parametric functions, determined by the application of geometrical morphometrics, morphology properties, and artificial neural networks in the input dataset of human mandible samples. With 95.05% of the personalized model's surface area displaying deviations within −1.00–1.00 mm relative to the input polygonal model, and a maximum deviation of 2.52 mm, this research accentuates the benefits of the parametric approach, particularly in the preoperative planning of mandibular deformity surgeries. [ABSTRACT FROM AUTHOR]

Featured Application: The Deep Neural Network model employed in this work will help build a system for the pre-diagnosis of retinopathies that can lead to blindness. The main intention of this type of system is to support the work performed by ophthalmology specialists. Computer-based pre-diagnosis of diseases through medical imaging is a task worked on for many years. The so-called fundus images stand out since they do not have uniform illumination and are highly sensitive to noise. One of the diseases that can be pre-diagnosed through fundus images is age-related macular degeneration, which initially manifests as the appearance of lesions called drusen. Several ways of pre-diagnosing macular degeneration have been proposed, methods based entirely on the segmentation of drusen with prior image processing have been designed and applied, and methods based on image pre-processing and subsequent conversion to feature vectors, or patterns, to be classified by a Machine-Learning model have also been developed. Finally, in recent years, the use of Deep-Learning models, particularly Convolutional Networks, has been proposed and used in classification problems where the data are only images. The latter has allowed the so-called transfer learning, which consists of using the learning achieved in the solution of one problem to solve another. In this paper, we propose the use of transfer learning through the Xception Deep Convolutional Neural Network to detect age-related macular degeneration in fundus images. The performance of the Xception model was compared against six other state-of-the-art models with a dataset created from images available in public and private datasets, which were divided into training/validation and test; with the training/validation set, the training was made using 10-fold cross-validation. The results show that the Xception neural network obtained a validation accuracy that surpasses other models, such as the VGG-16 or VGG-19 networks, and had an accuracy higher than 80% in the test set. We consider that the contributions of this work include the use of a Convolutional Neural Network model for the detection of age-related macular degeneration through the classification of fundus images in those affected by AMD (drusen) and the images of healthy patients. The performance of this model is compared against other methods featured in the state-of-the-art approaches, and the best model is tested on a test set outside the training and validation set. [ABSTRACT FROM AUTHOR]

Interior permanent magnet synchronous machines (IPMSMs) driven with a square-wave control (i.e., six-step, block, or 120° control), known commonly as brushless direct current (BLDC) drives, are used widely due to their high power density and control simplicity. The advance firing (AF) angle is employed to achieve improved operation characteristics of the drive. The AF angle is, in general, applied to compensate for the commutation effects. In the case of an IPMSM, the AF angle can also be adjusted to exploit reluctance torque. In this paper, a detailed study was performed to understand its effect on the drive's performance in regard to reluctance torque. Furthermore, a multi-objective optimization of the machine's cross-section using neural network models was conducted to enhance performance at a constant AF angle. The reference and improved machine designs were evaluated in a system-level simulation, where the impact was considered of the commutation of currents. A significant improvement in the machine performance was achieved after optimizing the geometry and implementing a fixed AF angle of 10°. [ABSTRACT FROM AUTHOR]

Accurate quantification of uncertainty in solar photovoltaic (PV) generation forecasts is imperative for the efficient and reliable operation of the power grid. In this paper, a data-driven non-parametric probabilistic method based on the Naïve Bayes (NB) classification algorithm and Dempster–Shafer theory (DST) of evidence is proposed for day-ahead probabilistic PV power forecasting. This NB-DST method extends traditional deterministic solar PV forecasting methods by quantifying the uncertainty of their forecasts by estimating the cumulative distribution functions (CDFs) of their forecast errors and forecast variables. The statistical performance of this method is compared with the analog ensemble method and the persistence ensemble method under three different weather conditions using real-world data. The study results reveal that the proposed NB-DST method coupled with an artificial neural network model outperforms the other methods in that its estimated CDFs have lower spread, higher reliability, and sharper probabilistic forecasts with better accuracy. [ABSTRACT FROM AUTHOR]

Demand response management (DRM) plays a crucial role in the prospective development of smart grids. The precise estimation of electricity demand for individual houses is vital for optimizing the operation and planning of the power system. Accurate forecasting of the required components holds significance as it can substantially impact the final cost, mitigate risks, and support informed decision-making. In this paper, a forecasting approach employing neural networks for smart grid demand-side management is proposed. The study explores various enhanced artificial neural network (ANN) architectures for forecasting smart grid consumption. The performance of the ANN approach in predicting energy demands is evaluated through a comparison with three statistical models: a time series model, an auto-regressive model, and a hybrid model. Experimental results demonstrate the ability of the proposed neural network framework to deliver accurate and reliable energy demand forecasts. [ABSTRACT FROM AUTHOR]

Power quality improvement and Power quality disturbance (PQD) detection are two significant concerns that must be addressed to ensure an efficient power distribution within the utility grid. When the process to analyze PQD is migrated to real-time platforms, the possible occurrence of a phase mismatch can affect the algorithm's accuracy; this paper evaluates phase shifting as an additional stage in signal acquisition for detecting and classifying eight types of single power quality disturbances. According to their mathematical models, a set of disturbances was generated using an arbitrary waveform generator BK Precision 4064. The acquisition, detection, and classification stages were embedded into a BeagleBone Black. The detection stage was performed using multiresolution analysis. The feature vectors of the acquired signals were obtained from the combination of Shannon entropy and log-energy entropy. For classification purposes, four types of classifiers were trained: multilayer perceptron, K-nearest neighbors, probabilistic neural network, and decision tree. The results show that incorporating a phase-shifting stage as a preprocessing stage significantly improves the classification accuracy in all cases. [ABSTRACT FROM AUTHOR]

Photovoltaic (PV) panels are one of the popular green energy resources and PV panel parameter estimations are one of the popular research topics in PV panel technology. The PV panel parameters could be used for PV panel health monitoring and fault diagnosis. Recently, a PV panel parameters estimation method based in neural network and numerical current predictor methods has been developed. However, in order to further improve the estimation accuracies, a new approach of PV panel parameter estimation is proposed in this paper. The output current and voltage dynamic responses of a PV panel are measured, and the time series of the I–V vectors will be used as input to an artificial neural network (ANN)-based PV model parameter range classifier (MPRC). The MPRC is trained using an I–V dataset with large variations in PV model parameters. The results of MPRC are used to preset the initial particles' population for a particle swarm optimization (PSO) algorithm. The PSO algorithm is used to estimate the PV panel parameters and the results could be used for PV panel health monitoring and the derivation of maximum power point tracking (MMPT). Simulations results based on an experimental I–V dataset and an I–V dataset generated by simulation show that the proposed algorithms can achieve up to 3.5% accuracy and the speed of convergence was significantly improved as compared to a purely PSO approach. [ABSTRACT FROM AUTHOR]

Existing research in metasurface design was based on trial-and-error high-intensity iterations and requires deep acoustic expertise from the researcher, which severely hampered the development of the metasurface field. Using deep learning enabled the fast and accurate design of hypersurfaces. Based on this, in this paper, an integrated learning approach was first utilized to construct a model of the forward mapping relationship between the hypersurface physical structure parameters and the acoustic field, which was intended to be used for data enhancement. Then a dual-feature fusion model (DFCNN) based on a convolutional neural network was proposed, in which the first feature was the high-dimensional nonlinear features extracted using a data-driven approach, and the second feature was the physical feature information of the acoustic field mined using the model. A convolutional neural network was used for feature fusion. A genetic algorithm was used for network parameter optimization. Finally, generalization ability verification was performed to prove the validity of the network model. The results showed that 90% of the integrated learning models had an error of less than 3 dB between the real and predicted sound field data, and 93% of the DFCNN models could achieve an error of less than 5 dB in the local sound field intensity. [ABSTRACT FROM AUTHOR]

Learning in neural networks with locally-tuned neuron models such as radial Basis Function (RBF) networks is often seen as instable, in particular when multi-layered architectures are used. Furthermore, universal approximation theorems for single-layered RBF networks are very well established; therefore, deeper architectures are theoretically not required. Consequently, RBFs are mostly used in a single-layered manner. However, deep neural networks have proven their effectiveness on many different tasks. In this paper, we show that deeper RBF architectures with multiple radial basis function layers can be designed together with efficient learning schemes. We introduce an initialization scheme for deep RBF networks based on k-means clustering and covariance estimation. We further show how to make use of convolutions to speed up the calculation of the Mahalanobis distance in a partially connected way, which is similar to the convolutional neural networks (CNNs). Finally, we evaluate our approach on image classification as well as speech emotion recognition tasks. Our results show that deep RBF networks perform very well, with comparable results to other deep neural network types, such as CNNs. [ABSTRACT FROM AUTHOR]

Finding the most interesting areas of an image is the aim of saliency detection. Conventional methods based on low-level features rely on biological cues like texture and color. These methods, however, have trouble with processing complicated or low-contrast images. In this paper, we introduce a deep neural network-based saliency detection method. First, using semantic segmentation, we construct a pixel-level model that gives each pixel a saliency value depending on its semantic category. Next, we create a region feature model by combining both hand-crafted and deep features, which extracts and fuses the local and global information of each superpixel region. Third, we combine the results from the previous two steps, along with the over-segmented superpixel images and the original images, to construct a multi-level feature model. We feed the model into a deep convolutional network, which generates the final saliency map by learning to integrate the macro and micro information based on the pixels and superpixels. We assess our method on five benchmark datasets and contrast it against 14 state-of-the-art saliency detection algorithms. According to the experimental results, our method performs better than the other methods in terms of F-measure, precision, recall, and runtime. Additionally, we analyze the limitations of our method and propose potential future developments. [ABSTRACT FROM AUTHOR]

In this paper, we propose a method for efficient target classification based on the spatial features of the point cloud generated by using a high-resolution radar sensor. The frequency-modulated continuous wave radar sensor can estimate the distance and velocity of a target. In addition, the azimuth and elevation angle of the target can be estimated by using a multiple-input and multiple-output antenna system. Using the estimated distance, velocity, and angle, the 3D point cloud of target can be generated. From the generated point cloud, we extract the point cloud for each individual target using the density-based spatial clustering of application with noise method and a camera mounted on the radar sensor. Then, we define the convex hull boundaries that enclose these point clouds in both 3D and 2D spaces obtained by orthogonally projecting onto the x y , y z , and z x planes. Using the vertices of convex hull, we calculate the volume of the targets and the areas in 2D spaces. Several feature points, including the calculated spatial information, are numerized and configured into feature vectors. We design an uncomplicated deep neural network classifier based on minimal input information to achieve fast and efficient classification performance. As a result, the proposed method achieved an average accuracy of 97.1%, and the time required for training was reduced compared to the method using only point cloud data and the convolutional neural network-based method. [ABSTRACT FROM AUTHOR]

Water bodies can offer local microclimates that have the potential to attenuate the effects of urban heat islands by reducing local temperature. This capability is shaded when the river is channelized. In such cases, the river temperature rises during hot periods, leading to negative impacts on the water quality. The main aim of this paper is to develop a local simple model to predict the temperature of the Dâmbovița River at its exit from Bucharest City, the capital of Romania. The location is chosen based on the historical critical impacts, in terms of extreme heatwaves that took place during hot summers, as well as future possible risks due to climate change. The water temperature prediction model is based on an artificial neural network that uses the Levenberg–Marquardt algorithm, due to its stability and rapid convergence capabilities. The model forecasts, with an accuracy of ±1 °C, the water temperature in an ungauged, downstream location, as a function of measured air and upstream water temperatures. The proposed model represents a first attempt to provide water managers in Bucharest City with a useful tool that will allow them to take timely measures to counteract the unwanted effects that can be generated by high water temperatures. [ABSTRACT FROM AUTHOR]

In this paper, the fixed-time and preassigned-time synchronization issues of fully quaternion-valued fuzzy memristive neural networks are studied based on the dynamic event-triggered control mechanism. Initially, the fuzzy rules are defined within the quaternion domain and the relevant properties are established through rigorous analysis. Subsequently, to conserve resources and enhance the efficiency of the controller, a kind of dynamic event-triggered control mechanism is introduced for the fuzzy memristive neural networks. Based on the non-separation analysis, fixed-time and preassigned-time synchronization criteria are presented and the Zeno phenomenon under the event-triggered mechanism is excluded successfully. Finally, the effectiveness of the theoretical results is verified through numerical simulations. [ABSTRACT FROM AUTHOR]

This paper presents a new approach for the online estimation of stator and rotor resistance of induction motors for speed sensorless vector-controlled drives, using feed-forward artificial neural networks with advanced adaptive learning rates. For the rotor resistance estimation, a neural network model based on rotor speed and stator currents is developed. The rotor flux linkages acquired from the voltage model are compared with the neural network model. The feed-forward neural network employs an adaptive learning rate as the function of the obtained error during training for quick convergence with minimal estimation error. A two-layered neural network model based on the stator voltage and current equations is developed for the stator resistance estimation. The d-q axes stator currents obtained from the developed model are compared with the acquired d-q axes stator currents. For the fast convergence with minimal estimation error, an adaptive learning rate as the function of error is adopted during training. Furthermore, the neural network estimates the induction motor's speed. The simulation and experimental results justify that the developed algorithms track variation in the resistances quickly and precisely along with the speed as compared with the conventional constant learning rate algorithm, leading to reliable operation of the drive. [ABSTRACT FROM AUTHOR]

The investigation of the ignition delay of hydrocarbon fuel is highly valuable for enhancing combustion efficiency, optimizing fuel thermal efficiency, and mitigating pollutant emissions. This paper has developed a BP-MRPSO neural network model for studying hydrocarbon fuel ignition and clarified the novelty of this model compared to the traditional BP and ANN models from the literature. The model integrates the particle swarm optimization (PSO) algorithm with MapReduce-based parallel processing technology. This integration improves the prediction accuracy and processing efficiency of the model. Compared to the traditional BP model, the BP-MRPSO model can increase the average correlation coefficient, from 0.9745 to 0.9896. The R2 value for predicting fire characteristics using this model can exceed 90%. Meanwhile, when the two hidden layers of both the BP and BP-MRPSO models consist of 9 and 8 neurons, respectively, the accuracy of the BP-MRPSO model is increased by 38.89% compared to the BP model. This proved that the new BP-MRPSO model has the capacity to handle large datasets while achieving great precision and efficiency. The findings could provide a new perspective for examining the properties of fuel ignition, which is expected to contribute to the development and assessment of aviation fuel ignition characteristics in the future. [ABSTRACT FROM AUTHOR]

Intelligent compaction (IC) has emerged as a breakthrough technology that utilizes advanced sensing, data transmission, and control systems to optimize asphalt pavement compaction quality and efficiency. However, accurate assessment of compaction status remains challenging under real construction conditions. This paper reviewed recent progress and applications of smart sensors and machine learning (ML) to address existing limitations in IC. The principles and components of various advanced sensors deployed in IC systems were introduced, including SmartRock, fiber Bragg grating, and integrated circuit piezoelectric acceleration sensors. Case studies on utilizing these sensors for particle behavior monitoring, strain measurement, and impact data collection were reviewed. Meanwhile, common ML algorithms including regression, classification, clustering, and artificial neural networks were discussed. Practical examples of applying ML to estimate mechanical properties, evaluate overall compaction quality, and predict soil firmness through supervised and unsupervised models were examined. Results indicated smart sensors have enhanced compaction monitoring capabilities but require robustness improvements. ML provides a data-driven approach to complement traditional empirical methods but necessitates extensive field validation. Potential integration with digital construction technologies such as building information modeling and augmented reality was also explored. In conclusion, leveraging emerging sensing and artificial intelligence presents opportunities to optimize the IC process and address key challenges. However, cooperation across disciplines will be vital to test and refine technologies under real-world conditions. This study serves to advance understanding and highlight priority areas for future research toward the realization of IC's full potential. [ABSTRACT FROM AUTHOR]

Nowadays, trajectory control is a significant issue for unmanned micro aerial vehicles (MAVs) due to large disturbances such as wind and storms. Trajectory control is typically implemented using a proportional–integral–derivative (PID) controller. In order to achieve high accuracy in trajectory tracking, it is essential to set the PID gain parameters to optimum values. For this reason, separate gain values are set for roll, pitch and yaw movements before autonomous flight in quadrotor systems. Traditionally, this adjustment is performed manually or automatically in autotune mode. Given the constraints of narrow orchard corridors, the use of manual or autotune mode is neither practical nor effective, as the quadrotor system has to fly in narrow apple orchard corridors covered with hail nets. These reasons require the development of an innovative solution specific to quadrotor vehicles designed for constrained areas such as apple orchards. This paper recognizes the need for effective trajectory control in quadrotors and proposes a novel neural network-based approach to tuning the optimal PID control parameters. This new approach not only improves trajectory control efficiency but also addresses the unique challenges posed by environments with constrained locational characteristics. Flight simulations using the proposed neural network models have demonstrated successful trajectory tracking performance and highlighted the superiority of the feed-forward back propagation network (FFBPN), especially in latitude tracking within 7.52745 × 10−5 RMSE trajectory error. Simulation results support the high performance of the proposed approach for the development of automatic flight capabilities in challenging environments. [ABSTRACT FROM AUTHOR]

Shadow, a natural phenomenon resulting from the absence of light, plays a pivotal role in agriculture, particularly in processes such as photosynthesis in plants. Despite the availability of generic shadow datasets, many suffer from annotation errors and lack detailed representations of agricultural shadows with possible human activity inside, excluding those derived from satellite or drone views. In this paper, we present an evaluation of a synthetically generated top-down shadow segmentation dataset characterized by photorealistic rendering and accurate shadow masks. We aim to determine its efficacy compared to real-world datasets and assess how factors such as annotation quality and image domain influence neural network model training. To establish a baseline, we trained numerous baseline architectures and subsequently explored transfer learning using various freely available shadow datasets. We further evaluated the out-of-domain performance compared to the training set of other shadow datasets. Our findings suggest that AgroSegNet demonstrates competitive performance and is effective for transfer learning, particularly in domains similar to agriculture. [ABSTRACT FROM AUTHOR]

In this paper, a lightweight deep neural network (DNN) for direction of arrival (DOA) estimation is proposed, of which the input vector is designed to remove data redundancy as well as remaining DOA information. By exploring the Vandermonde property of the steering vector of a uniform linear array (ULA), the size of the newly designed input vector is greatly reduced. Furthermore, the DOA estimation is designed as a regression problem instead of a classification problem; that is, the lightweight DNN designs the output vector as the estimated DOAs of sources, of which the size is much shorter than that of the spatial spectrum used as the output vector in the conventional DNN. The reductions in the sizes of input and output vectors lead to a reduction in the sizes of hidden layers, achieving lightweightness of the neural network. The analysis illustrates that when the number of sensors is 22, the number of parameters in the lightweight DNN is three orders of magnitude less than that in the conventional DNN. The simulation results demonstrate the lightweight DNN can provide high DOA estimation accuracy with the shortest testing time. It performs better than the conventional DNN. Furthermore, it is superior to traditional solutions such as the multiple signal classification (MUSIC) method and conventional beamforming (CBF) method in harsh conditions like low signal-to-noise ratios (SNRs), closely spaced sources, and few snapshots. [ABSTRACT FROM AUTHOR]

Stagnation at local optima represents a significant challenge in bio-inspired optimization algorithms, often leading to suboptimal solutions. This paper addresses this issue by proposing a hybrid model that combines the Orca predator algorithm with deep Q-learning. The Orca predator algorithm is an optimization technique that mimics the hunting behavior of orcas. It solves complex optimization problems by exploring and exploiting search spaces efficiently. Deep Q-learning is a reinforcement learning technique that combines Q-learning with deep neural networks. This integration aims to turn the stagnation problem into an opportunity for more focused and effective exploitation, enhancing the optimization technique's performance and accuracy. The proposed hybrid model leverages the biomimetic strengths of the Orca predator algorithm to identify promising regions nearby in the search space, complemented by the fine-tuning capabilities of deep Q-learning to navigate these areas precisely. The practical application of this approach is evaluated using the high-dimensional Heartbeat Categorization Dataset, focusing on the feature selection problem. This dataset, comprising complex electrocardiogram signals, provided a robust platform for testing the feature selection capabilities of our hybrid model. Our experimental results are encouraging, showcasing the hybrid strategy's capability to identify relevant features without significantly compromising the performance metrics of machine learning models. This analysis was performed by comparing the improved method of the Orca predator algorithm against its native version and a set of state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

With the acceleration of urbanisation, urban areas are subject to the combined effects of the accumulation of various natural factors, such as changes in temperature leading to the thermal expansion or contraction of surface materials (rock, soil, etc.) and changes in precipitation and humidity leading to an increase in the self-weight of soil due to the infiltration of water along the cracks or pores in the ground. Therefore, the subsidence of urban areas has now become a serious geological disaster phenomenon. However, the use of traditional neural network prediction models has limitations when examining the causal relationships between time series surface deformation data and multiple influencing factors and when applying multiple influencing factors for predictive analyses. To this end, Sentinel-1A data from March 2017 to February 2023 were used as the data source in this paper, based on time series deformation data acquired using the small baseline subset interferometric synthetic aperture radar (SBAS-InSAR) technique. A sparrow search algorithm–convolutional neural network–long short-term memory (SSA-CNN-LSTM) neural network prediction model was built. The six factors of temperature, humidity, precipitation, and ground temperature at three different depths below the surface (5 cm, 10 cm, and 15 cm) were taken as the input of the model, and the surface deformation data were taken as the output of the neural network model. The correlation between the spatial and temporal evolution characteristics of the ground subsidence in urban areas and various influencing factors was analysed using grey correlation analysis, which proved that these six factors contribute to some extent to the deformation of the urban surface. The main urban area of Hohhot City, Inner Mongolia Autonomous Region, was used as the study area. In order to verify the efficacy of this neural network prediction model, the prediction effects of the multilayer perceptron (MLP), backpropagation (BP), and SSA-CNN-LSTM models were compared and analysed, with the values of the correlation coefficients of the feature points of A1, B1, and C1 being in the range of 0.92, 0.83, and 0.93, respectively. The results show that compared with the traditional MLP and BP neural network models, the SSA-CNN-LSTM model achieves a higher performance in predicting time series surface deformation data in urban areas, which provides new ideas and methods for this area of research. [ABSTRACT FROM AUTHOR]

This document provides summaries of various research papers published in the journal Sensors. The summaries cover a wide range of topics, including personalized medicine, laser ranging, memristive interfaces, face and person detection, IoT data visualization, monitoring elderly activities, auditory illusions, brain connectivity, corona discharges, thermal data analysis, vital signal detection, and eye-blink artifact removal. The document showcases the contributions and findings of each study, offering valuable insights for researchers and library patrons interested in these areas of study. [Extracted from the article]

This study aims to enhance diagnostic capabilities for optimising the performance of the anaerobic sewage treatment lagoon at Melbourne Water's Western Treatment Plant (WTP) through a novel machine learning (ML)-based monitoring strategy. This strategy employs ML to make accurate probabilistic predictions of biogas performance by leveraging diverse real-life operational and inspection sensor and other measurement data for asset management, decision making, and structural health monitoring (SHM). The paper commences with data analysis and preprocessing of complex irregular datasets to facilitate efficient learning in an artificial neural network. Subsequently, a Bayesian mixture density neural network model incorporating an attention-based mechanism in bidirectional long short-term memory (BiLSTM) was developed. This probabilistic approach uses a distribution output layer based on the Gaussian mixture model and Monte Carlo (MC) dropout technique in estimating data and model uncertainties, respectively. Furthermore, systematic hyperparameter optimisation revealed that the optimised model achieved a negative log-likelihood (NLL) of 0.074, significantly outperforming other configurations. It achieved an accuracy approximately 9 times greater than the average model performance (NLL = 0.753) and 22 times greater than the worst performing model (NLL = 1.677). Key factors influencing the model's accuracy, such as the input window size and the number of hidden units in the BiLSTM layer, were identified, while the number of neurons in the fully connected layer was found to have no significant impact on accuracy. Moreover, model calibration using the expected calibration error was performed to correct the model's predictive uncertainty. The findings suggest that the inherent data significantly contribute to the overall uncertainty of the model, highlighting the need for more high-quality data to enhance learning. This study lays the groundwork for applying ML in transforming high-value assets into intelligent structures and has broader implications for ML in asset management, SHM applications, and renewable energy sectors. [ABSTRACT FROM AUTHOR]

In cutting processes, tool condition affects the quality of the manufactured parts. As such, an essential component to prevent unplanned downtime and to assure machining quality is having information about the state of the cutting tool. The primary function of it is to alert the operator that the tool has reached or is reaching a level of wear beyond which behaviour is unreliable. In this paper, the tool condition is being monitored by analysing the electric current on the main spindle via an artificial intelligence model utilising an LSTM neural network. In the current study, the tool is monitored while working on a cylindrical raw piece made of AA6013 aluminium alloy with a custom polycrystalline diamond tool for the purposes of monitoring the wear of these tools. Spindle current characteristics were obtained using external measuring equipment to not influence the operation of the machine included in a larger production line. As a novel approach, an artificial intelligence model based on an LSTM neural network is utilised for the analysis of the spindle current obtained during a manufacturing cycle and assessing the tool wear range in real time. The neural network was designed and trained to notice significant characteristics of the captured current signal. The conducted research serves as a proof of concept for the use of an LSTM neural network-based model as a method of monitoring the condition of cutting tools. [ABSTRACT FROM AUTHOR]

The rapid development of deep neural networks has attracted significant attention in the infrared and visible image fusion field. However, most existing fusion models have many parameters and consume high computational and spatial resources. This paper proposes a fast and efficient recursive fusion neural network model to solve this complex problem that few people have touched. Specifically, we designed an attention module combining a traditional fusion knowledge prior with channel attention to extract modal-specific features efficiently. We used a shared attention layer to perform the early fusion of modal-shared features. Adopting parallel dilated convolution layers further reduces the network's parameter count. Our network is trained recursively, featuring minimal model parameters, and requires only a few training batches to achieve excellent fusion results. This significantly reduces the consumption of time, space, and computational resources during model training. We compared our method with nine SOTA methods on three public datasets, demonstrating our method's efficient training feature and good fusion results. [ABSTRACT FROM AUTHOR]

The maturity of fruits and vegetables such as tomatoes significantly impacts indicators of their quality, such as taste, nutritional value, and shelf life, making maturity determination vital in agricultural production and the food processing industry. Tomatoes mature from the inside out, leading to an uneven ripening process inside and outside, and these situations make it very challenging to judge their maturity with the help of a single modality. In this paper, we propose a deep learning-assisted multimodal data fusion technique combining color imaging, spectroscopy, and haptic sensing for the maturity assessment of tomatoes. The method uses feature fusion to integrate feature information from images, near-infrared spectra, and haptic modalities into a unified feature set and then classifies the maturity of tomatoes through deep learning. Each modality independently extracts features, capturing the tomatoes' exterior color from color images, internal and surface spectral features linked to chemical compositions in the visible and near-infrared spectra (350 nm to 1100 nm), and physical firmness using haptic sensing. By combining preprocessed and extracted features from multiple modalities, data fusion creates a comprehensive representation of information from all three modalities using an eigenvector in an eigenspace suitable for tomato maturity assessment. Then, a fully connected neural network is constructed to process these fused data. This neural network model achieves 99.4% accuracy in tomato maturity classification, surpassing single-modal methods (color imaging: 94.2%; spectroscopy: 87.8%; haptics: 87.2%). For internal and external maturity unevenness, the classification accuracy reaches 94.4%, demonstrating effective results. A comparative analysis of performance between multimodal fusion and single-modal methods validates the stability and applicability of the multimodal fusion technique. These findings demonstrate the key benefits of multimodal fusion in terms of improving the accuracy of tomato ripening classification and provide a strong theoretical and practical basis for applying multimodal fusion technology to classify the quality and maturity of other fruits and vegetables. Utilizing deep learning (a fully connected neural network) for processing multimodal data provides a new and efficient non-destructive approach for the massive classification of agricultural and food products. [ABSTRACT FROM AUTHOR]

The use of drones has recently gained popularity in a diverse range of applications, such as aerial photography, agriculture, search and rescue operations, the entertainment industry, and more. However, misuse of drone technology can potentially lead to military threats, terrorist acts, as well as privacy and safety breaches. This emphasizes the need for effective and fast remote detection of potentially threatening drones. In this study, we propose a novel approach for automatic drone detection utilizing the usage of both radio frequency communication signals and acoustic signals derived from UAV rotor sounds. In particular, we propose the use of classical and deep machine-learning techniques and the fusion of RF and acoustic features for efficient and accurate drone classification. Distinct types of ML-based classifiers have been examined, including CNN- and RNN-based networks and the classical SVM method. The proposed approach has been evaluated with both frequency and audio features using common drone datasets, demonstrating better accuracy than existing state-of-the-art methods, especially in low SNR scenarios. The results presented in this paper show a classification accuracy of approximately 91% at an SNR ratio of − 10 dB using the LSTM network and fused features. [ABSTRACT FROM AUTHOR]

To achieve successful prevention of fire incidents originating from human activities, it is imperative to possess a thorough understanding. This paper introduces a machine learning approach, specifically utilizing deep neural networks (DNN), to develop predictive models for fire occurrence in Keelung City, Taiwan. It investigates ten factors across demographic, architectural, and economic domains through spatial analysis and thematic maps generated from geographic information system data. These factors are then integrated as inputs for the DNN model. Through 50 iterations, performance indices including the coefficient of determination (R2), root mean square error (RMSE), variance accounted for (VAF), prediction interval (PI), mean absolute error (MAE), weighted index (WI), weighted mean absolute percentage error (WMAPE), Nash–Sutcliffe efficiency (NS), and the ratio of performance to deviation (RPD) are computed, with average values of 0.89, 7.30 × 10−2, 89.21, 1.63, 4.90 × 10−2, 0.97, 2.92 × 10−1, 0.88, and 4.84, respectively. The model's predictions, compared with historical data, demonstrate its efficacy. Additionally, this study explores the impact of various urban renewal strategies using the DNN model, highlighting the significant influence of economic factors on fire incidence. This underscores the importance of economic factors in mitigating fire incidents and emphasizes their consideration in urban renewal planning. [ABSTRACT FROM AUTHOR]

Oceanic targets, including ripples, islands, vessels, and coastlines, display distinct sparse characteristics, rendering the ocean a significant arena for sparse Synthetic Aperture Radar (SAR) imaging rooted in sparse signal processing. Deep neural networks (DNNs), a current research emphasis, have, when integrated with sparse SAR, attracted notable attention for their exceptional imaging capabilities and high computational efficiency. Yet, the efficiency of traditional unfolding techniques is impeded by their architecturally inefficient design, which curtails their information transmission capacity and consequently detracts from the quality of reconstruction. This paper unveils a novel Memory-Augmented Deep Unfolding Network (MADUN) for SAR imaging in marine environments. Our methodology harnesses the synergies between deep learning and algorithmic unfolding, enhanced with a memory component, to elevate SAR imaging's computational precision. At the heart of our investigation is the incorporation of High-Throughput Short-Term Memory (HSM) and Cross-Stage Long-Term Memory (CLM) within the MADUN framework, ensuring robust information flow across unfolding stages and solidifying the foundation for deep, long-term informational correlations. Our experimental results demonstrate that our strategy significantly surpasses existing methods in enhancing the reconstruction of sparse marine scenes. [ABSTRACT FROM AUTHOR]

During the development of the nervous system, neuronal cells extend axons and dendrites that form complex neuronal networks, which are essential for transmitting and processing information. Understanding the physical processes that underlie the formation of neuronal networks is essential for gaining a deeper insight into higher-order brain functions such as sensory processing, learning, and memory. In the process of creating networks, axons travel towards other recipient neurons, directed by a combination of internal and external cues that include genetic instructions, biochemical signals, as well as external mechanical and geometrical stimuli. Although there have been significant recent advances, the basic principles governing axonal growth, collective dynamics, and the development of neuronal networks remain poorly understood. In this paper, we present a detailed analysis of nonlinear dynamics for axonal growth on surfaces with periodic geometrical patterns. We show that axonal growth on these surfaces is described by nonlinear Langevin equations with speed-dependent deterministic terms and gaussian stochastic noise. This theoretical model yields a comprehensive description of axonal growth at both intermediate and long time scales (tens of hours after cell plating), and predicts key dynamical parameters, such as speed and angular correlation functions, axonal mean squared lengths, and diffusion (cell motility) coefficients. We use this model to perform simulations of axonal trajectories on the growth surfaces, in turn demonstrating very good agreement between simulated growth and the experimental results. These results provide important insights into the current understanding of the dynamical behavior of neurons, the self-wiring of the nervous system, as well as for designing innovative biomimetic neural network models. [ABSTRACT FROM AUTHOR]

Photocatalysts have made great contributions to the degradation of pollutants to achieve environmental purification. The traditional method of developing new photocatalysts is to design and perform a large number of experiments to continuously try to obtain efficient photocatalysts that can degrade pollutants, which is time-consuming, costly, and does not necessarily achieve the best performance of the photocatalyst. The rapid development of photocatalysis has been accelerated by the rapid development of artificial intelligence. Intelligent algorithms can be utilized to design photocatalysts and predict photocatalytic performance, resulting in a reduction in development time and the cost of new catalysts. In this paper, the intelligent algorithms for photocatalyst design and photocatalytic performance prediction are reviewed, especially the artificial neural network model and the model optimized by an intelligent algorithm. A detailed discussion is given on the advantages and disadvantages of the neural network model, as well as its application in photocatalysis optimized by intelligent algorithms. The use of intelligent algorithms in photocatalysis is challenging and long term due to the lack of suitable neural network models for predicting the photocatalytic performance of photocatalysts. The prediction of photocatalytic performance of photocatalysts can be aided by the combination of various intelligent optimization algorithms and neural network models, but it is only useful in the early stages. Intelligent algorithms can be used to design photocatalysts and predict their photocatalytic performance, which is a promising technology. [ABSTRACT FROM AUTHOR]

Deep neural networks (DNNs) have gained prominence in various applications, but remain vulnerable to adversarial attacks that manipulate data to mislead a DNN. This paper aims to challenge the efficacy and transferability of two contemporary defense mechanisms against adversarial attacks: (a) robust training and (b) adversarial training. The former suggests that training a DNN on a data set consisting solely of robust features should produce a model resistant to adversarial attacks. The latter creates an adversarially trained model that learns to minimise an expected training loss over a distribution of bounded adversarial perturbations. We reveal a significant lack in the transferability of these defense mechanisms and provide insight into the potential dangers posed by L ∞ -norm attacks previously underestimated by the research community. Such conclusions are based on extensive experiments involving (1) different model architectures, (2) the use of canonical correlation analysis, (3) visual and quantitative analysis of the neural network's latent representations, (4) an analysis of networks' decision boundaries and (5) the use of equivalence of L 2 and L ∞ perturbation norm theories. [ABSTRACT FROM AUTHOR]

Radiation therapy relies on quality assurance (QA) to verify dose delivery accuracy. However, current QA methods suffer from operation lag as well as inaccurate performance. Hence, to address these shortcomings, this paper proposes a QA neural network model based on branch architecture, which is based on the analysis of the category features of the QA complexity metrics. The designed branch network focuses on category features, which effectively improves the feature extraction capability for complexity metrics. The branch features extracted by the model are fused to predict the GPR for more accurate QA. The performance of the proposed method was validated on the collected dataset. The experiments show that the prediction performance of the model outperforms other QA methods; the average prediction errors for the test set are 2.12% (2%/2 mm), 1.69% (3%/2 mm), and 1.30% (3%/3 mm). Moreover, the results indicate that two-thirds of the validation samples' model predictions perform better than the clinical evaluation results, suggesting that the proposed model can assist physicists in the clinic. [ABSTRACT FROM AUTHOR]

This paper introduces a multidisciplinary conceptual perspective encompassing artificial intelligence (AI), artificial general intelligence (AGI), and cybernetics, framed within what we call the formalism of generalized neuromorphism. Drawing from recent advancements in computing, such as neuromorphic computing and spiking neural networks, as well as principles from the theory of open dynamical systems and stochastic classical and quantum dynamics, this formalism is tailored to model generic networks comprising abstract processing events. A pivotal aspect of our approach is the incorporation of the memory space and the intrinsic non-Markovian nature of the abstract generalized neuromorphic system. We envision future computations taking place within an expanded space (memory space) and leveraging memory states. Positioned at a high abstract level, generalized neuromorphism facilitates multidisciplinary applications across various approaches within the AI community. [ABSTRACT FROM AUTHOR]

Improving velocity forecasts of blood microflows could be useful in biomedical applications. We focus on estimating the velocity of the blood in capillaries. Modeling blood microflow in capillaries is a complex process. In this paper, we use artificial intelligence techniques for this modeling: more precisely, artificial neural networks (ANNs). The selected model is able to accurately forecast the velocity, with an  R 2  of 0.8992 comparing the forecast with the actual velocity. A key part of ANN model creation is selecting the appropriate parameters for the ANN, such as the number of neurons, the number of layers and the type of training algorithm used. A grid approach with 327,600 simulations was used. It is shown that there are substantial, statistically significant differences when different types of ANN structures are used. It is also shown that the proposed model is robust regarding the initial random initialization of weights in the ANN. Additionally, the sensitivity of the selected models to additional noise was also tested. [ABSTRACT FROM AUTHOR]

This paper presents a novel approach to estimating short-term production of wind farms, which are made up of numerous turbine generators. It harnesses the power of big data through a blend of data-driven and model-based methods. Specifically, it combines an Artificial Neural Network (ANN) for immediate future predictions of wind turbine power output with a stochastic model for dependability, using Hybrid Reliability Block Diagrams. A thorough state-of-the-art review has been conducted in order to demonstrate the applicability of an ANN for non-linear stochastic problems of energy or power forecast estimation. The study leverages an innovative cluster analysis to group wind turbines and reduce the computational effort of the ANN, with a dependability model that improves the accuracy of the data-driven output estimation. Therefore, the main novelty is the employment of a hybrid model that combines an ANN with a dependability stochastic model that accounts for the realistic operational scenarios of wind turbines, including their susceptibility to random shutdowns This approach marks a significant advancement in the field, introducing a methodology which can aid the design and the power production forecast. The research has been applied to a case study of a 24 MW wind farm located in the south of Italy, characterized by 28 turbines. The findings demonstrate that the integrated model significantly enhances short-term wind-energy production estimation, achieving a 480% improvement in accuracy over the solo-clustering approach. [ABSTRACT FROM AUTHOR]

NASA's Soil Moisture Active Passive (SMAP) was originally designed to combine high-resolution active (radar) and coarse-resolution but highly sensitive passive (radiometer) L-band observations to achieve unprecedented spatial resolution and accuracy for soil moisture retrievals. However, shortly after SMAP was put into orbit, the radar component failed, and the high-resolution capability was lost. In this paper, the integration of an alternative radar sensor with the SMAP radiometer is proposed to enhance soil moisture retrieval capabilities over vegetated areas in the absence of the original high-resolution radar in the SMAP mission. ESA's Sentinel-1A C-band radar was used in this study to enhance the spatial resolution of the SMAP L-band radiometer and to improve soil moisture retrieval accuracy. To achieve this purpose, we downscaled the 9 km radiometer data of the SMAP to 1 km utilizing the Smoothing Filter-based Intensity Modulation (SFIM) method. An Artificial Neural Network (ANN) was then trained to exploit the synergy between the Sentinel-1A radar, SMAP radiometer, and the in situ-measured soil moisture. An analysis of the data obtained for a plant growing season over the Mississippi Delta showed that the VH-polarized Sentinel-1A radar data can yield a coefficient of correlation of 0.81 and serve as a complimentary source to the SMAP radiometer for more accurate and enhanced soil moisture prediction over agricultural fields. [ABSTRACT FROM AUTHOR]

The rapid advancement in AI requires efficient accelerators for training on edge devices, which often face challenges related to the high hardware costs of floating-point arithmetic operations. To tackle these problems, efficient floating-point formats inspired by block floating-point (BFP), such as Microsoft Floating Point (MSFP) and FlexBlock (FB), are emerging. However, they have limited dynamic range and precision for the smaller magnitude values within a block due to the shared exponent. This limits the BFP's ability to train deep neural networks (DNNs) with diverse datasets. This paper introduces the hybrid precision (HPFP) selection algorithms, designed to systematically reduce precision and implement hybrid precision strategies, thereby balancing layer-wise arithmetic operations and data path precision to address the shortcomings of traditional floating-point formats. Reducing the data bit width with HPFP allows more read/write operations from memory per cycle, thereby decreasing off-chip data access and the size of on-chip memories. Unlike traditional reduced precision formats that use BFP for calculating partial sums and accumulating those partial sums in 32-bit Floating Point (FP32), HPFP leads to significant hardware savings by performing all multiply and accumulate operations in reduced floating-point format. For evaluation, two training accelerators for the YOLOv2-Tiny model were developed, employing distinct mixed precision strategies, and their performance was benchmarked against an accelerator utilizing a conventional brain floating point of 16 bits (Bfloat16). The HPFP selection, employing 10 bits for the data path of all layers and for the arithmetic of layers requiring low precision, along with 12 bits for layers requiring higher precision, results in a 49.4% reduction in energy consumption and a 37.5% decrease in memory access. This is achieved with only a marginal mean Average Precision (mAP) degradation of 0.8% when compared to an accelerator based on Bfloat16. This comparison demonstrates that the proposed accelerator based on HPFP can be an efficient approach to designing compact and low-power accelerators without sacrificing accuracy. [ABSTRACT FROM AUTHOR]