Search

In this study, we propose the use of artificial synaptic transistors with coplanar-gate structures fabricated on paper substrates comprising biocompatible and low-cost potato-starch electrolyte and indium–gallium–zinc oxide (IGZO) channels. The electrical double layer (EDL) gating effect of potato-starch electrolytes enabled the emulation of biological synaptic plasticity. Frequency dependence measurements of capacitance using a metal-insulator-metal capacitor configuration showed a 1.27 μF/cm2 at a frequency of 10 Hz. Therefore, strong capacitive coupling was confirmed within the potato-starch electrolyte/IGZO channel interface owing to EDL formation because of internal proton migration. An electrical characteristics evaluation of the potato-starch EDL transistors through transfer and output curve resulted in counterclockwise hysteresis caused by proton migration in the electrolyte; the hysteresis window linearly increased with maximum gate voltage. A synaptic functionality evaluation with single-spike excitatory post-synaptic current (EPSC), paired-pulse facilitation (PPF), and multi-spike EPSC resulted in mimicking short-term synaptic plasticity and signal transmission in the biological neural network. Further, channel conductance modulation by repetitive presynaptic stimuli, comprising potentiation and depression pulses, enabled stable modulation of synaptic weights, thereby validating the long-term plasticity. Finally, recognition simulations on the Modified National Institute of Standards and Technology (MNIST) handwritten digit database yielded a 92% recognition rate, thereby demonstrating the applicability of the proposed synaptic device to the neuromorphic system. [ABSTRACT FROM AUTHOR]

This paper presents a neural network predictive control scheme for studying the coagulation process of wastewater treatment in a paper mill. A multi-layer back-propagation neural network is employed to model the nonlinear relationships between the removal rates of pollutants and the chemical dosages, in order to adapt the system to a variety of operating conditions and acquire a more flexible learning ability. The system includes a neural network emulator of the reaction process, a neural network controller, and an optimization procedure based on a performance function that is used to identify desired control inputs. The gradient descent algorithm method is used to realize the optimization procedure. The results indicate that reasonable forecasting and control performances have been achieved through the developed system. [Copyright &y& Elsevier]

In the last decade, combined transcranial magnetic stimulation (TMS)-neuroimaging studies have greatly stimulated research in the field of TMS and neuroimaging. Here, we review how TMS can be combined with various neuroimaging techniques to investigate human brain function. When applied during neuroimaging (online approach), TMS can be used to test how focal cortex stimulation acutely modifies the activity and connectivity in the stimulated neuronal circuits. TMS and neuroimaging can also be separated in time (offline approach). A conditioning session of repetitive TMS (rTMS) may be used to induce rapid reorganization in functional brain networks. The temporospatial patterns of TMS-induced reorganization can be subsequently mapped by using neuroimaging methods. Alternatively, neuroimaging may be performed first to localize brain areas that are involved in a given task. The temporospatial information obtained by neuroimaging can be used to define the optimal site and time point of stimulation in a subsequent experiment in which TMS is used to probe the functional contribution of the stimulated area to a specific task. In this review, we first address some general methodologic issues that need to be taken into account when using TMS in the context of neuroimaging. We then discuss the use of specific brain mapping techniques in conjunction with TMS. We emphasize that the various neuroimaging techniques offer complementary information and have different methodologic strengths and weaknesses. [Copyright &y& Elsevier]

The brain, an exceedingly intricate information processing system, poses a constant challenge to memory research, particularly in comprehending how it encodes, stores, and retrieves information. Cognitive psychology studies memory mechanism from behavioral experiment level and fMRI level, and neurobiology studies memory mechanism from anatomy and electrophysiology level. Current research findings are insufficient to provide a comprehensive, detailed explanation of memory processes within the brain. Numerous unknown details must be addressed to establish a complete information processingmechanismconnecting micro molecular cellular levels with macro cognitive behavioral levels. Key issues include characterizing and distributing content within biological neural networks, coexisting information with varying content, and sharing limited resources and storage capacity. Compared with the hard disk of computer mass storage, it is very clear from the polarity of magnetic particles in the bottom layer, the division of tracks and sectors in the middle layer, to the directory tree and file management system in the high layer, but the understanding of memory is not sufficient. Biological neural networks are abstracted as directed graphs, and the encoding, storage, and retrieval of information within directed graphs at the cellular level are explored. A memory computational model based on active directed graphs and node-adaptive learning is proposed. First, based on neuronal local perspectives, autonomous initiative, limited resource competition, and other neurobiological characteristics, a resource-based adaptive learning algorithm for directed graph nodes is designed. To minimize resource consumption of memory content in directed graphs, two resource-occupancy optimization strategies--lateral inhibition and path pruning--are proposed. Second, this paper introduces a novel memory mechanism grounded in graph theory, which considers connected subgraphs as the physical manifestation of memory content in directed graphs. The encoding, storage, consolidation, and retrieval of the brain's memory system correspond to specific operations such as forming subgraphs, accommodating multiple subgraphs, strengthening connections and connectivity of subgraphs, and activating subgraphs. Lastly, a series of experiments were designed to simulate cognitive processes and evaluate the performance of the directed graph model. Experimental results reveal that the proposed adaptive connectivity learning algorithm for directed graphs in this paper possesses the following four features: (1) Demonstrating distributed, self-organizing, and self-adaptive properties, the algorithm achieves global-level functions through local node interactions; (2) Enabling incremental storage and supporting continuous learning capabilities; (3) Displaying stable memory performance, it surpasses the Hopfield network in memory accuracy, capacity, and diversity, as demonstrated in experimental comparisons. Moreover, itmaintains highmemory performance with large-scale datasets; (4) Exhibiting a degree of generalization ability, the algorithm's macroscopic performance remains unaffected by the topological structure of the directed graph. Large-scale, decentralized, and node-autonomous directed graphs are suitable simulation methods. Examining storage problems within directed graphs can reveal the essence of phenomena and uncover fundamental storage rules hidden within complex neuronal mechanisms, such as synaptic plasticity, ion channels, neurotransmitters, and electrochemical activities. [ABSTRACT FROM AUTHOR]

Biomimetic neuromorphic sensing systems, inspired by the structure and function of biological neural networks, represent a major advancement in the field of sensing technology and artificial intelligence. This review paper focuses on the development and application of electrolyte gated transistors (EGTs) as the core components (synapses and neuros) of these neuromorphic systems. EGTs offer unique advantages, including low operating voltage, high transconductance, and biocompatibility, making them ideal for integrating with sensors, interfacing with biological tissues, and mimicking neural processes. Major advances in the use of EGTs for neuromorphic sensory applications such as tactile sensors, visual neuromorphic systems, chemical neuromorphic systems, and multimode neuromorphic systems are carefully discussed. Furthermore, the challenges and future directions of the field are explored, highlighting the potential of EGT-based biomimetic systems to revolutionize neuromorphic prosthetics, robotics, and human–machine interfaces. Through a comprehensive analysis of the latest research, this review is intended to provide a detailed understanding of the current status and future prospects of biomimetic neuromorphic sensory systems via EGT sensing and integrated technologies. [ABSTRACT FROM AUTHOR]

Reinforcement, extinction, generalization and differentiation are all basic principles of Pavlov associative memory. Most memristive neural networks that simulate associative memory only consider reinforcement and extinction, while ignoring differentiation and generalization. In this paper, a memristive circuit of associative memory with generalization and differentiation is proposed to solve the above problem. It implements the functions of learning, forgetting, long-term memory, generalization and differentiation. Learning and forgetting correspond to reinforcement and extinction in associative memory respectively. Spontaneous recovery, in which forgotten reflexes can reappear in the absence of an unconditional stimulus, is also discussed here. Besides, a special differentiation method that takes into account the time delay is designed and demonstrated. The proposed memristive circuit of associative memory provides a reference for the theoretical research and application of artificial neural networks. [ABSTRACT FROM AUTHOR]

Recurrent neural networks (RNNs) transmit information over time through recurrent connections. In contrast, biological neural networks use many other temporal processing mechanisms. One of these mechanisms is the inter-neuron delays caused by varying axon properties. Recently, this feature was implemented in echo state networks (ESNs), a type of RNN, by assigning spatial locations to neurons and introducing distance-dependent inter-neuron delays. These delays were shown to significantly improve ESN task performance. However, thus far, it is still unclear why distance-based delay networks (DDNs) perform better than ESNs. In this paper, we show that by optimizing inter-node delays, the memory capacity of the network matches the memory requirements of the task. As such, networks concentrate their memory capabilities to the points in the past which contain the most information for the task at hand. Moreover, we show that DDNs have a greater total linear memory capacity, with the same amount of non-linear processing power. [ABSTRACT FROM AUTHOR]

Effective spraying is essential for modern agricultural production, to ensure a high-quality and abundant harvest. Simultaneously, it is crucial to minimise the negative impact of crop protection products on the environment. To achieve this, it is necessary to implement the appropriate technical and technological parameters for the treatment and to consider the conditions under which the treatment is carried out. The aim of this study was to determine the relationship between the speed of the sprayer, the pressure of the liquid, and the type of nozzles, as well as air temperature and wind speed, in terms of the degree of coverage of the sprayed surfaces. The degree of coverage was analysed by spraying water-sensitive papers placed on the artificial plant, positioned to obtain horizontal and vertical surfaces. The study found that standard single flat fan nozzles provided greater coverage on upper horizontal surfaces, while standard nozzles were more effective for vertical transverse approach surfaces at lower fluid pressures and travel speeds. Neural networks were used to develop models of the relationships studied. Models with high accuracy for the validation data set were obtained in the case of the coverage of the vertical transverse leaving surface and the upper level surface (R = 0.93 and R = 0.86). These models were used to determine the optimum values of the technical parameters of the spraying process under the selected weather conditions. The maximum spray coverage (41.49%) was predicted for the XR nozzle under the following conditions: pressure = 200 kPa, driving speed = 1.4 m·s−1, temperature = 21.73 °C and wind speed = 0.32 m·s−1. Based on the sensitivity analysis of the neural models it was found that the greatest effect on the coverage of the vertical transverse leaving surface was observed for temperature and the coverage of the upper level surface was mostly influenced by driving speed. [ABSTRACT FROM AUTHOR]

Owing to the highly parallel network structure of the biological neural network and its triggered processing mode, tactile sensory neurons can realize the perception of external signals and the functions of perception, memory, and data processing by adjusting the synaptic weight. In this paper, a piezoresistive pressure sensor is combined with a memristor to design an artificial tactile sensory neuron. The polyurethane sponge sensor has excellent sensitivity and can convert physical stimuli into electrical signals, and the chitosan‐based memristor has stable bipolar resistive switching characteristics, allowing further information to be memorized and processed. The neuron can respond to tactile stimuli of different degrees, durations, and frequencies; realize potentiation/depression modulation, paired‐pulse facilitation, and spike‐timing‐dependent plasticity; exhibit spike‐rate‐dependent plasticity; and store and erase tactile information through memistor state switching, which has great application potential in biological sensing systems. [ABSTRACT FROM AUTHOR]

This paper surveys research on applying neuroevolution (NE) to games. In neuroevolution, artificial neural networks are trained through evolutionary algorithms, taking inspiration from the way biological brains evolved. We analyze the application of NE in games along five different axes, which are the role NE is chosen to play in a game, the different types of neural networks used, the way these networks are evolved, how the fitness is determined and what type of input the network receives. The paper also highlights important open research challenges in the field. [ABSTRACT FROM PUBLISHER]

Traditional biological neural networks cannot simulate the real situation of the abrupt synaptic connections between neurons while modeling associative memory of human brains. In this paper, the memristive multidirectional associative memory neural networks (MAMNNs) with mixed time-varying delays are investigated in the sense of Filippov solution. First, three steps are given to prove the existence of the almost periodic solution. Two new lemmas are proposed to prove the boundness of the solution and the asymptotical almost periodicity of the solution by constructing Lyapunov function. Second, the uniqueness and global exponential stability of the almost periodic solution of memristive MAMNNs are investigated by a new Lyapunov function. The sufficient conditions guaranteeing the properties of almost periodic solution are derived based on the relevant definitions, Halanay inequality and Lyapunov function. The investigation is an extension of the research on the periodic solution and almost periodic solution of bidirectional associative memory neural networks. Finally, numerical examples with simulations are presented to show the validity of the main results. [ABSTRACT FROM AUTHOR]

Tongue and its movements can be used for several medical-related tasks, such as identifying a disease and tracking a rehabilitation. To be able to focus on a tongue region, the tongue segmentation is needed to compute a region of interest for a further analysis. This paper proposes an encoder-decoder CNN-based architecture for segmenting a tongue in an image. The encoder module is mainly used for the tongue feature extraction, while the decoder module is used to reconstruct a segmented tongue from the extracted features based on training images. In addition, the residual multi-kernel pooling (RMP) is also applied into the proposed network to help in encoding multiple scales of the features. The proposed method is evaluated on two publicly available datasets under a scenario of front view and one tongue posture. It is then tested on a newly collected dataset of five tongue postures. The reported performances show that the proposed method outperforms existing methods in the literature. In addition, the re-training process could improve applying the trained model on unseen dataset, which would be a necessary step of applying the trained model on the real-world scenario. [ABSTRACT FROM AUTHOR]

Ms. Pac-Man is a challenging video game in which multiple modes of behavior are required: Ms. Pac-Man must escape ghosts when they are threats and catch them when they are edible, in addition to eating all pills in each level. Past approaches to learning behavior in Ms. Pac-Man have treated the game as a single task to be learned using monolithic policy representations. In contrast, this paper uses a framework called Modular Multiobjective NEAT (MM-NEAT) to evolve modular neural networks. Each module defines a separate behavior. The modules are used at different times according to a policy that can be human-designed (i.e., multitask) or discovered automatically by evolution. The appropriate number of modules can be fixed or discovered using a genetic operator called module mutation. Several versions of module mutation are evaluated in this paper. Both fixed modular networks and Module Mutation networks outperform monolithic networks and multitask networks. Interestingly, the best networks dedicate modules to critical behaviors (such as escaping when surrounded after luring ghosts near a power pill) that do not follow the customary division of the game into chasing edible and escaping threat ghosts. The results demonstrate that MM-NEAT can discover interesting and effective behavior for agents in challenging games. [ABSTRACT FROM PUBLISHER]

In this paper, robust exponential synchronization of memristor-based neural networks (MNNs) with nonidentical characteristics is investigated. Coefficient mismatch, time-varying delay mismatch, and activation function mismatch are considered between the drive and the response MNNs. Pinning control strategy is developed to realize robust exponential synchronization and the stability criteria is established by using the Lyapunov function method and differential inclusion theory. Furthermore, the stable region of controller parameters is computed to guarantee that the synchronization errors enter a predetermined error bound within given settling time. Finally, the effectiveness of the proposed methods is verified by the numerical simulations. The methods presented in this paper offer novel schemes for robust exponential synchronization of nonidentical MNNs. [ABSTRACT FROM AUTHOR]

This paper focuses on the shingled magnetic recording (SMR) as the recording system for further high-density hard disk drives. Previously, we applied a log-likelihood ratio (LLR) modulator to the low-density parity check coding and iterative decoding system in SMR to improve the decoding performance. In this paper, we propose a new LLR modulator using neural network. Furthermore, we clarify that the proposed LLR modulator using neural network realizes effective iterative decoding in a read/write channel with pattern-dependent medium noise. [ABSTRACT FROM AUTHOR]

Consider observing a collection of discrete events within a network that reflect how network nodes influence one another. Such data are common in spike trains recorded from biological neural networks, interactions within a social network, and a variety of other settings. Data of this form may be modeled as self-exciting point processes, in which the likelihood of future events depends on the past events. This paper addresses the problem of estimating self-excitation parameters and inferring the underlying functional network structure from self-exciting point process data. Past work in this area was limited by strong assumptions which are addressed by the novel approach here. Specifically, in this paper we 1) incorporate saturation in a point process model which both ensures stability and models non-linear thresholding effects; 2) impose general low-dimensional structural assumptions that include sparsity, group sparsity, and low-rankness that allows bounds to be developed in the high-dimensional setting; and 3) incorporate long-range memory effects through moving average and higher-order auto-regressive components. Using our general framework, we provide a number of novel theoretical guarantees for high-dimensional self-exciting point processes that reflect the role played by the underlying network structure and long-term memory. We also provide simulations and real data examples to support our methodology and main results. [ABSTRACT FROM AUTHOR]

With the rapid development of economy and the increasing improvement of agricultural production level, people's demand for fruits is also increasing year by year. China is the largest fruit production and consumption country in the world. According to relevant statistics reported for China, by the end of 2019, the total amount of various fruits sold had reached about 270 million tons, with apples accounting for 48% of the global output and pears accounting for 69% of the national total output. However, China's fruit picking is still dominated by manual picking process, which takes a lot of manpower and time to complete, therefore resulting in low fruit picking efficiency. Some farmers are unable to complete fruit picking in a short time, resulting in a large number of fruits unable to be listed, resulting in huge losses. To solve this problem, this paper focuses on the visual recognition and path planning for intelligent fruit-picking robot. Using robot to complete fruit picking is the best way at present. This paper establishes a picking robot recognition and positioning system based on stereo vision, which is used to identify and locate the fruits planted in the orchard area. The coordinate error of the target point of the intelligent fruit-picking robot coordinate system is less than 10 mm, which has high accuracy. Then, the path of intelligent fruit-picking robot is planned based on visual feedback algorithm and biological stimulation neural network. Our empirical evaluations suggest that the proposed robot walks in the planting park in the shape of "zigzag" and realizes full-coverage path planning after 6 turns. The results show the efficiency of the intelligent method. [ABSTRACT FROM AUTHOR]

The performance of the recently proposed orientational beamforming (OBF) system for ultra-wideband (UWB) signals degrades seriously in multiuser situation. Although various techniques have been proposed in the literature to suppress multiuser interference in the time-hopping UWB system, there has been no research on interference suppression in the OBF UWB system. In this paper, we propose a nonlinear OBF system via a modified radial basis function (RBF) neural network, named the RBF-OBF system, to reject orientational UWB interferences caused by multiuser transmission in the OBF system. The RBF neural network is selected mainly because of its simple structure, convenient training process, and fast convergence speed. However, the conventional Euclidean-distance-based RBF neural network is not suitable for the training process used in this work, as the training samples are noiseless orientational steering vectors in frequency domain. Therefore, a modified RBF neural network is proposed in this paper, which evaluates the similarity between an input vector and the center vector of a hidden layer neuron by their signed complex correlation coefficient. Numerous simulations demonstrate that compared to the conventional OBF system, the proposed RBF-OBF system can significantly reduce the bit error rates (BERs) under different noise and interference situations. The BER reduction rate of the proposed RBF-OBF system is higher than 92% in additive white Gaussian noise channel and higher than 89% in line-of-sight multipath channel. [ABSTRACT FROM AUTHOR]

The article reports on the result of a research conducted by doctor Tali Sharot regarding the relationship between emotion and memory. As part of the study, she asked volunteers to rate each of 80 events as positive, negative or neutral in which the next step included an imaging component called magnetic resonance imaging (MRI) scanner to capture their brain's activity. According to Sharot, the images showed that the same parts of the brain that were involved in processing memory and emotion had a role in anticipating and rating the events that would happen in the future.

This paper aims to investigate how adequate cognitive functions for recognizing, predicting, and generating a variety of actions can be developed through iterative learning of action-caused dynamic perceptual patterns. Particularly, we examined the capabilities of mental simulation of one’s own actions as well as the inference of others’ intention because they play a crucial role, especially in social cognition. We propose a dynamic neural network model based on predictive coding which can generate and recognize dynamic visuo-proprioceptive patterns. The proposed model was examined by conducting a set of robotic simulation experiments in which a robot was trained to imitate visually perceived gesture patterns of human subjects in a simulation environment. The experimental results showed that the proposed model was able to develop a predictive model of imitative interaction through iterative learning of large-scale spatio-temporal patterns in visuo-proprioceptive input streams. Also, the experiment verified that the model was able to generate mental imagery of dynamic visuo-proprioceptive patterns without feeding the external inputs. Furthermore, the model was able to recognize the intention of others by minimizing prediction error in the observations of the others’ action patterns in an online manner. These findings suggest that the error minimization principle in predictive coding could provide a primal account for the mirror neuron functions for generating actions as well as recognizing those generated by others in a social cognitive context. [ABSTRACT FROM AUTHOR]

This paper presents a new method for modeling the nonideal conductance response (CR) of synaptic devices. Unlike previous studies, which utilize physical device properties for modeling, this paper only uses the measured CR data. This allows the proposed modeling method to be easily applied to various types of synaptic devices without considering the unique physical properties of each device. An efficient piecewise linear approximation method which offers a tradeoff between computational complexity and simulation accuracy of neural networks is also presented to generate a linear device model out of nonlinear CR data. In addition, model parameters, which reflect the nonideal characteristics of the CR such as abrupt and asymmetric conductance changes, conductance variation, and limited conductance dynamic range, are introduced to evaluate the network performances in the presence of the nonidealities. By adjusting the model parameters, the desired CR satisfying the network performance requirements can be derived for device development. A three-layer neural network employing the device model has been designed and trained for the MNIST data set in order to demonstrate the application of the model to system-level simulations and verify the effectiveness of the modeling method. [ABSTRACT FROM AUTHOR]

In this paper, we propose a training framework for an inverter-based memristive neuromorphic hardware. The framework, which is called PHAX, is a physical characteristics aware one relying on an ex-situ training approach. The considered neuromorphic circuit is highly energy efficient hybrid CMOS-memristive implementation of neuromorphic circuits. To solve the problem of high sensitivity of the training to the mismatches between the high-level mathematical modeling of the neurons and the corresponding physical characteristics, an approach for analytical yet accurate modeling of the memristive crossbar and neuron circuits is suggested. The approach, which is based on SPICE simulations, models the inverter-based neurons using a hyperbolic tangent function. To increase the training efficacy, the backpropagation training algorithm is modified by considering some constraints based on the physical characteristics of the memristive circuit. This modification along with the accurate back-annotation of the physical characteristics considerably improve the effectiveness of the ex-situ training method of the neuromorphic circuit. The results of this paper show an average reduction of $1805{\times }$ in the training runtime compared to that of the in-situ training approach. Furthermore, the results of applying the approach on the kernels of some applications such as image recognition, image processing, and financial analysis reveal that the designed neuromorphic circuits provide an average power saving (speed up) of $1478{\times }$ ( $5.2{\times }$ ) over the ASIC implementation in a 90-nm CMOS technology. [ABSTRACT FROM AUTHOR]

In order to enrich the dynamic behaviors of discrete neuron models and more effectively mimic biological neural networks, this paper proposes a bistable locally active discrete memristor (LADM) model to mimic synapses. We explored the dynamic behaviors of neural networks by introducing the LADM into two identical Rulkov neurons. Based on numerical simulation, the neural network manifested multistability and new firing behaviors under different system parameters and initial values. In addition, the phase synchronization between the neurons was explored. Additionally, it is worth mentioning that the Rulkov neurons showed synchronization transition behavior; that is, anti-phase synchronization changed to in-phase synchronization with the change in the coupling strength. In particular, the anti-phase synchronization of different firing patterns in the neural network was investigated. This can characterize the different firing behaviors of coupled homogeneous neurons in the different functional areas of the brain, which is helpful to understand the formation of functional areas. This paper has a potential research value and lays the foundation for biological neuron experiments and neuron-based engineering applications. [ABSTRACT FROM AUTHOR]

In recent years, the Remaining Useful Life (RUL) prediction has become a hot spot in Prognostics and Health Management (PHM) research. High-accuracy RUL prediction can reduce the probability of accident occurrence and improve the reliability of the mechanical system. This paper proposes a novel two-channel hybrid model for RUL prediction based on a Capsule Neural Network and a Long Short-Term Memory Network (Cap-LSTM). Conventional Convolutional Neural Networks (CNN) are widely used in RUL prediction. However, the pooling layer of the conventional CNN only extracts the most active part of the multivariate time-series sensor data. Moreover, conventional CNN is not sensitive to the direction and spatial position of features and thus the feature information may not be fully used. To overcome these shortcomings, this paper uses the capsule neural network to directly extract the highly correlated spatial feature information, from the multivariate time-series sensor data, thus avoiding the loss of the spatial position relationship between local features and reducing the complexity of the model. In order to obtain the training and test samples, this paper uses the sliding time window method to preprocess the data. Meanwhile, the piece-wise linear function is used to represent the actual performance degradation of the engine. The NASA C-MAPSS dataset is used to verify the prediction effectiveness of the Cap-LSTM model. The state-of-the-art RUL prediction models are also introduced and compared to the proposed approach, providing results that show the superiority of the presented method. [ABSTRACT FROM AUTHOR]

System identification of a Two-Wheeled Robot (TWR) through nonlinear dynamics is carried out in this paper using a data-driven approach. An Artificial Neural Network (ANN) is used as a kinematic estimator for predicting the TWR's degree of movement in the directions of x and y and the angle of rotation Ψ along the z-axis by giving a set of input vectors in terms of linear velocity 'V' (i.e., generated through the angular velocity 'ω' of a DC motor). The DC motor rotates the TWR's wheels that have a wheel radius of 'r'. Training datasets are achieved via simulating nonlinear kinematics of the TWR in a MATLAB Simulink environment by varying the linear scale sets of 'V' and '(r ± ∆r)'. Perturbation of the TWR's wheel radius at ∆r = 10% is introduced to cater to the robustness of the TWR wheel kinematics. A trained ANN accurately modeled the kinematics of the TWR. The performance indicators are regression analysis and mean square value, whose achieved values met the targeted values of 1 and 0.01, respectively. [ABSTRACT FROM AUTHOR]

Most memristor-based neural networks only consider a single mode of memory or emotion, but ignore the relationship between emotion and memory. In this paper, a memristor-based neural network circuit of emotion congruent memory is proposed and verified by the simulation results. The designed circuit consists of a memory module, an emotion module and an association neuron module. Varieties of memory and emotion functions are considered. The functions such as learning, forgetting, variable rate and emotion generation are implemented by the circuit. Furthermore, mental fatigue and emotion inhibition which are two important self-protective measures of the brain are realized in this paper on the basis of emotion congruent memory. Finally, the paper also considers the congruence between emotion and memory materials and the regulation of emotion on memory. The neural network circuit of emotion congruent memory can provide more references for the application of memristor. [ABSTRACT FROM AUTHOR]

In this paper, we propose a novel class of networks named as quaternion-valued inertial memristor-based neural networks (QVIMNNs) by introducing inertial term and memristor into traditional quaternion-valued neural networks (QVNNs). The problem of fixed-time synchronization of the QVIMNNs is investigated based on the variable transformation and Lyapunov functional method. It is shown that two types of activation functions are considered and a novel criteria guaranteeing fixed-time synchronization for each cases are then achieved by designing different types of controllers. This paper attempts to pave a new way to investigate neural networks classes with numerical simulations support to demonstrate the correctness of the obtained results. [ABSTRACT FROM AUTHOR]

Big data is a massive and diverse form of unstructured data, which needs proper analysis and management. It is another great technological revolution after the Internet, the Internet of Things, and cloud computing. This paper firstly studies the related concepts and basic theories as the origin of research. Secondly, it analyzes in depth the problems and challenges faced by Chinese government management under the impact of big data. Again, we explore the opportunities that big data brings to government management in terms of management efficiency, administrative capacity, and public services and believe that governments should seize opportunities to make changes. Brainlike computing attempts to simulate the structure and information processing process of biological neural network. This paper firstly analyzes the development status of e-government at home and abroad, studies the service-oriented architecture (SOA) and web services technology, deeply studies the e-government and SOA theory, and discusses this based on the development status of e-government in a certain region. Then, the deep learning algorithm is used to construct the monitoring platform to monitor the government behavior in real time, and the deep learning algorithm is used to conduct in-depth mining to analyze the government's intention behavior. [ABSTRACT FROM AUTHOR]

National music is a treasure of Chinese traditional culture. It contains the cultural characteristics of various regions and reflects the core value of Chinese traditional culture. Classification technology classifies a large number of unorganized drama documents, which are not labeled, and to some extent, it helps folk music better enter the lives of ordinary people. Simulate folk music of different spectrum and record corresponding music audio under laboratory conditions Through Fourier transform and other methods, music audio is converted into spectrogram, and a total of 2608 two-dimensional spectrogram images are obtained as datasets. The sonogram dataset is imported into the deep convolution neural network GoogLeNet for music type recognition, and the test accuracy is 99.6%. In addition, the parallel GoogLeNet technology based on inverse autoregressive flow is used. The unique improvement is that acoustic features can be quickly converted into corresponding speech time-domain waveforms, reaching the real-time level, improving the efficiency of model training and loading, and outputting speech with higher naturalness. In order to further prove the reliability of the experimental results, the spectrogram datasets are imported into Resnet18 and Shufflenet for training, and the test accuracy of 99.2% is obtained. The results show that this method can effectively classify and recognize music. The experimental results show that this scheme can achieve more accurate classification. The research realizes the recognition of national music through deep learning spectrogram classification for the first time, which is an intelligent and fast new method of classification and recognition. [ABSTRACT FROM AUTHOR]

A wearable electrocardiogram (ECG) device is an effective tool for managing cardiovascular diseases. This paper presents a low power clinician-like cardiac arrhythmia watchdog (CAW) for wearable ECG devices. The CAW is based on a novel P-QRS-T detection algorithm that makes use of clinical features to identify abnormalities. Implemented in 0.18 μm CMOS process, the CAW consumes 2.66 µW for 80 bpm heart rate at 1.2 V supply with an area of 0.578 mm2. Verified on QT database, the average sensitivity/positive predictivity for P-wave, QRS complex and T-wave are over 93.39%/88.55%, 99.69%/99.48%, and 97.13%/93.18% respectively, across over 190000 beats. It shows over 99.8% arrhythmia detection accuracy for 43 subjects evaluated on MIT-BIH database. [ABSTRACT FROM AUTHOR]

Currently, livestock and poultry farming is gradually developing towards modernization and scale, and closed livestock and poultry farms are widely used for poultry feeding management, but at the same time, the farming risks of large-scale farms are increasing. In this paper, based on the study of wireless sensor networks and biological neural network models, the environmental factors that mainly affect the growth of domestic rabbits are analyzed as an example, and the technology is used to design and implement an environmental monitoring system for modern farms. The design of the system is divided into three main parts: hardware design of each node, software design, and upper computer monitoring software design. The hardware part of the system uses coordinator nodes, router nodes, sensor nodes, and control nodes to form a wireless sensor network in the farm, carries out the hardware circuit design of each node, and based on the protocol stack, designs the software program of each node to realize the collection, transmission, and regulation of environmental information in the farm. In the upper computer part, the design and development of the upper computer monitoring software interface are used to complete the real-time display of environmental data, historical query, database storage, and curve drawing, and to design a remote client data query system based on the architecture to realize the query of environmental data of the farm by remote users and to carry out monitoring fault intelligent identification alarm. At the same time, the paper investigates the optimal deployment of wireless sensor network nodes and searches for the optimal location of sensor nodes through an improved biological neural network algorithm to maximize the network coverage and reduce the coverage of blind areas, and conducts simulation experiments with the coverage rate of a rabbit farm as the optimization target. [ABSTRACT FROM AUTHOR]

Most deep learning models for temporal regression directly output the estimation based on single input images, ignoring the relationships between different images. In this paper, we propose deep relation learning for regression, aiming to learn different relations between a pair of input images. Four non-linear relations are considered: “cumulative relation,” “relative relation,” “maximal relation” and “minimal relation.” These four relations are learned simultaneously from one deep neural network which has two parts: feature extraction and relation regression. We use an efficient convolutional neural network to extract deep features from the pair of input images and apply a Transformer for relation learning. The proposed method is evaluated on a merged dataset with 6,049 subjects with ages of 0–97 years using 5-fold cross-validation for the task of brain age estimation. The experimental results have shown that the proposed method achieved a mean absolute error (MAE) of 2.38 years, which is lower than the MAEs of 8 other state-of-the-art algorithms with statistical significance (p<0.05) in paired T-test (two-side). [ABSTRACT FROM AUTHOR]

In this paper, a comprehensive quantitative and biological neural network optimization model of sports industry structure is thoroughly studied and analyzed using knowledge graphs. To address the problems of poor performance interpretability deficiency of knowledge graph-based recommendation methods in the face of relational sparse graphs, a pretraining-based implicit characterization algorithm strategy is proposed for the recall stage, which can solve the problems of difficulty in going online and high delay in the recall stage of the recommendation system while improving the accuracy, and not only this can be applied in the recall stage, but also the sorting and postsorting modules can be used as features. To study the relationship between signaling activity and energy metabolism of pyramidal neurons, an empirical model of the synaptic vesicle cycle is proposed to simulate the synaptic transmission process, the role played by energy metabolism in synaptic transmission is studied from the perspective of feedback control, and the quantitative relationship between neuronal pulse discharge frequency, energy consumption, and information quantity in dendritic integration is analyzed using the cable theory and atrial chamber model. It was found that, when 0 ≤ ε ≤ 0.6 , the chaotic region shrinks and eventually disappears with the increase of the memory factor ε ; however, when 0.6 ≤ ε ≤ 1 is used, chaos is recreated and the chaotic area gradually increases with the increase of the memory factor ε. This paper conducts comparative experiments on data sets in the recommendation domain and verifies that the proposed model and the feature intersection module can effectively perform feature interaction between items and entities, thus enhancing the recommendation effect. [ABSTRACT FROM AUTHOR]

Accurate prediction of the remaining useful life (RUL) of mechanical equipment has brought benefits of the company’s reasonable maintenance. However, in real industrial applications, owing to the change of working conditions and the interference of environment noise, it is of great difficulty to extract useful features from the collected signals, making it quite challenging to achieve high-precision RUL prediction of mechanical equipment. In order to overcome these issues, a new high-precision prediction method based on improved convolutional neural network (ICNN), residual attention mechanism with soft thresholding and gated recurrent unit (GRU) is proposed in this paper. To begin with, this method solves the limitations of manual feature extraction and makes the extracted feature representation more obvious by integrating one-dimensional depth separable convolution neural network and two-dimensional transpose convolution neural network. Then, soft thresholding and residual connection is inserted into the attention mechanism to help improve the prediction performance of RUL in noisy environment, making the prediction model adaptively set different thresholds for each sample according to its conditions and characteristics. Finally, the effectiveness of the proposed approach is verified by simulating turbofan engine and IEEE phm2010 data set, indicating that our proposed method has better performance than other approaches of literatures in prediction accuracy and time cost. [ABSTRACT FROM AUTHOR]

Vector autoregressive models characterize a variety of time series in which linear combinations of current and past observations can be used to accurately predict future observations. For instance, each element of an observation vector could correspond to a different node in a network, and the parameters of an autoregressive model would correspond to the impact of the network structure on the time series evolution. Often, these models are used successfully in practice to learn the structure of social, epidemiological, financial, or biological neural networks. However, little is known about statistical guarantees on the estimates of such models in non-Gaussian settings. This paper addresses the inference of the autoregressive parameters and associated network structure within a generalized linear model framework that includes Poisson and Bernoulli autoregressive processes. At the heart of this analysis is a sparsity-regularized maximum likelihood estimator. While sparsity-regularization is well-studied in the statistics and machine learning communities, those analysis methods cannot be applied to autoregressive generalized linear models because of the correlations and potential heteroscedasticity inherent in the observations. Sample complexity bounds are derived using a combination of martingale concentration inequalities and modern empirical process techniques for dependent random variables. These bounds, which are supported by several simulation studies, characterize the impact of various network parameters on the estimator performance. [ABSTRACT FROM AUTHOR]

Neuromorphic photonics has experienced a recent surge of interest over the last few years, promising orders of magnitude improvements in both speed and energy efficiency over digital electronics. This paper provides a tutorial overview of neuromorphic photonic systems and their application to optimization and machine learning problems. We discuss the physical advantages of photonic processing systems, and we describe underlying device models that allow practical systems to be constructed. We also describe several real-world applications for control and deep learning inference. Finally, we discuss scalability in the context of designing a full-scale neuromorphic photonic processing system, considering aspects such as signal integrity, noise, and hardware fabrication platforms. The paper is intended for a wide audience and teaches how theory, research, and device concepts from neuromorphic photonics could be applied in practical machine learning systems. [ABSTRACT FROM AUTHOR]

This paper presents an appliance identification algorithm for use with a non-intrusive home energy monitor based on a cogent confabulation neural network. As a cogent confabulation neural network does not require multiplications during the identification phase, it is an effective choice for systems with low-computational capability. A non-intrusive home energy monitor needs to learn not only the energy patterns of individual appliances but also those of combinations of appliances. To relieve the burden of learning power patterns of the combinations, this paper proposes a parameter-building scheme based on the parameters of individual appliances. The proposed algorithm is evaluated on datasets prepared by the reference energy disaggregation dataset and the authors. The average success rate was 83.8% for up to eight appliances and showed better performance than the combinatorial optimization and artificial neural network approaches. [ABSTRACT FROM AUTHOR]

An introduction is presented in which editor discusses various articles within the issue on topics including multi-scale convolutional neural networks, image segmentation method for mitosis and detection of stenosis through automated support vector machine (SVM).

This paper presents the module–phase synchronization for a class of neural networks with weights identification and time delays. In module–phase synchronization, complex-valued node states are taken into consideration. The topology weights considered here are uncertain and the time delays are bounded. By constructing a Lyapunov–Krasovskii functional and employing adaptive feedback control, sufficient conditions for module–phase synchronization are derived. After the general synchronization theory, the synchronization with topology identification is discussed. Finally, pertinent examples are given to demonstrate the effectiveness of the obtained results. [ABSTRACT FROM PUBLISHER]

Leaky Integrator Echo State Network (Leaky-ESN) is a useful training method for handling time series prediction problems. However, the singular coupling of all neurons in the reservoir makes Leaky-ESN less effective for sophisticated learning tasks. In this paper, we propose a new improvement to the Leaky-ESN model called the Multiple-Reservoir Hierarchical Echo State Network (MH-ESN). By introducing a new mechanism for constructing the reservoir, the efficiency of the network in handling training tasks is improved. The hierarchical structure is used in the process of constructing the reservoir mechanism of MH-ESN. The MH-ESN consists of multiple layers, each comprising a multi-reservoir echo state network model. The sub-reservoirs within each layer are linked via principal neurons, which mimics the functioning of a biological neural network. As a result, the coupling among neurons in the reservoir is decreased, and the internal dynamics of the reservoir are improved. Based on the analysis results, the MH-ESN exhibits significantly better prediction accuracy than Leaky-ESN for complex time series prediction. [ABSTRACT FROM AUTHOR]

In this paper we present computational simulations of a mathematical model describing the time evolution of membrane potentials in a GABAergic neural network. This model, with stochastic and evolutionary characteristics, is an application of the version introduced previously where the authors present the continuous time version of a new class of stochastic models for biological neural networks. The goal is to computationally simulate the model (with the interaction conditions of a GABAergic network) and make biological inferences. More specifically, the computational simulations of the model that describe spiking neurons with electrophysiological characteristics of a brain region called substantia nigra pars reticulata, emphasize changes in desynchronized firing activity and how changes in individual activity propagate through the network. [ABSTRACT FROM AUTHOR]

Influenza affects millions of people every year. It causes a considerable amount of medical visits and hospitalisations as well as hundreds of thousands of deaths. Forecasting influenza prevalence with good accuracy can significantly help public health agencies to timely react to seasonal or novel strain epidemics. Although significant progress has been made, influenza forecasting remains a challenging modelling task. In this paper, we propose a methodological framework that improves over the state-of-the-art forecasting accuracy of influenza-like illness (ILI) rates in the United States. We achieve this by using Web search activity time series in conjunction with historical ILI rates as observations for training neural network (NN) architectures. The proposed models incorporate Bayesian layers to produce associated uncertainty intervals to their forecast estimates, positioning themselves as legitimate complementary solutions to more conventional approaches. The best performing NN, referred to as the iterative recurrent neural network (IRNN) architecture, reduces mean absolute error by 10.3% and improves skill by 17.1% on average in nowcasting and forecasting tasks across 4 consecutive flu seasons. Author summary: Modelling the prevalence of an infectious disease enables public health organisations to prepare for and minimise its impact. However, traditional disease indicators are often quite restrictive as they provide information with a significant delay. Recent research efforts have provided evidence of the value of alternative information sources such as Web search activity trends. Our work incorporates this information into influenza forecasting models to achieve state-of-the-art accuracy. In addition, the proposed Bayesian neural network architectures also provide associated uncertainty estimates for the forecasts, positioning our methodology as a practical complementary tool for disease surveillance and policy making. [ABSTRACT FROM AUTHOR]

The real-time performance and accuracy of traffic flow prediction directly affect the efficiency of traffic flow guidance systems, and traffic flow prediction is a hotspot in the field of intelligent transportation. To further improve the accuracy of short-term traffic flow prediction, a short-term traffic flow prediction model based on traffic flow time series analysis, and an improved long short-term memory network (LSTM) is proposed. First, perform time series analysis on traffic flow data and perform smoothing and standardization processing to obtain a stable time series as model input data, which can improve the accuracy of model training and eliminate the impact of a wide range of feature values. Then, an improved LSTM model based on LSTM and bidirectional LSTM networks are established. Combining the advantages of sequential data and the long-term dependence of forwarding LSTM and reverse LSTM, the bidirectional long-term memory network (BILSTM) is integrated into the prediction model. The first layer of the LSTM network learns and predicts the input time series and further learns and trains through the bidirectional LSTM network to effectively overcome the large prediction errors. Finally, the performance of the proposed method is evaluated by comparing the predicted results with actual traffic data. The model that is proposed in this paper is compared with the long short-term memory network (LSTM) model and the bidirectional long-term memory network (BILSTM) model. The results demonstrate that the proposed method outperforms both compared methods in terms of accuracy and stability. [ABSTRACT FROM AUTHOR]

This paper investigates the synchronization problem of Takagi–Sugeno fuzzy memristive neural networks (FMNNs) with mixed delays, in which the bounded distributed and unbounded discrete time-varying delays are involved. Then, under the nonsmooth analysis and Lyapunov stability theory, several easily verified algebraic criteria are established to guarantee the global synchronization of FMNNs via a designed fuzzy feedback controller. Moreover, to show the superiority of the theoretical results, several discussions and comparisons with existing work are provided, indicating that derived results in this paper are general and include several existing ones as special cases. Finally, two numerical examples and two applications in psuedorandom number generation and image encryption are presented to show the validity and practicability of the theoretical results. [ABSTRACT FROM AUTHOR]

This paper is concerned with quasi-synchronization of delayed memristive neural networks (MNNs) with switching jumps mismatches via aperiodically intermittent control. The issue is presented for three reasons: 1) the existing controllers for synchronization may be too complicated and not economical; 2) under the influence of switching jumps mismatches, synchronization of MNNs may fail to achieve; and 3) matrix measure method is less conservative but cannot be applied directly to synchronization of MNNs. To overcome these difficulties, the concept of asynchronously switching time interval is proposed to describe the phenomenon when the drive-response MNNs switch their connection weights asynchronously. Then, aperiodically intermittent control is designed and quasi-synchronization analysis is carried out based on a combined method that compromises the merits of interval matrix method and matrix measure method. A quasi-synchronization criterion, expressed in terms of the mixture of ${p}$ -norm and matrix measure of the memristive connection weights, is established. Meanwhile, the fundamental reason for the failure of complete synchronization is revealed. Moreover, an explicit expression of the error level is obtained and the design of the controller under a predetermined error level is presented. The obtained results in this paper reduce the conservativeness and provide a novel insight into the research of synchronization of MNNs. [ABSTRACT FROM AUTHOR]

Spiking neural P systems (SNP systems) are parallel and non-deterministic models of computation, inspired by the neural system of the brain. A variant of SNP systems known as SNP systems with structural plasticity (SNPSP systems) includes the feature of adding or removing synapses among neurons. This feature is inspired by plasticity from neuroscience during cognition and learning. Despite the reductionist framework of SNP and SNPSP systems, such as brain-like systems are capable of computational universality. In particular, we use SNPSP systems in this paper to compute some classes of languages from the Chomsky hierarchy:FIN,REG, andRE. The computations of such classes continue a research direction established in the previous paper. We also emphasize the (dis)advantages of synapse plasticity in the neural system, compared with existing features of SNP systems, when generating languages. [ABSTRACT FROM AUTHOR]

In this paper, the behavior of a grid-connected hybrid ac/dc microgrid has been investigated. Different renewable energy sources—photovoltaics modules and a wind turbine generator—have been considered together with a solid oxide fuel cell and a battery energy storage system. The main contribution of this paper is the design and the validation of an innovative online-trained artificial neural network-based control system for a hybrid microgrid. Adaptive neural networks are used to track the maximum power point of renewable energy generators and to control the power exchanged between the front-end converter and the electrical grid. Moreover, a fuzzy logic-based power management system is proposed in order to minimize the energy purchased from the electrical grid. The operation of the hybrid microgrid has been tested in the MATLAB/Simulink environment under different operating conditions. The obtained results demonstrate the effectiveness, the high robustness and the self-adaptation ability of the proposed control system. [ABSTRACT FROM PUBLISHER]

In this paper, we experimentally and analytically evaluate the reliability of two state-of-the-art neural networks for linear regression and pattern recognition (multilayer perceptron and single-layer perceptron) implemented in a system-on-chip composed of a field-programmable gate array (FPGA) and a microprocessor. We have considered, for each neural network, three different activation function complexities, to evaluate how the implementation affects FPGAs reliability. As we show in this paper, higher complexity increases the exposed area but reduces the probability of one failure to impact the network output. In addition, we propose to distinguish between critical and tolerable errors in artificial neural networks. Experiments using a controlled heavy-ions beam show that, for both networks, only about 30% of the observed output errors actually affect the outputs correctness. We identify the causes of critical errors through fault injection, and found that faults in initial layers are more likely to significantly affect the output. [ABSTRACT FROM PUBLISHER]

This paper proposes a novel control method of using the surface electromyogram (sEMG) signals to predict the kinematics of hand and wrist, which will be applied in the prosthetic hand control. Prediction of movement in 3 degree-of-freedoms' (DoFs') (wrist flexion/extension (WFE), lateral abduction/adduction (LAA), and hand open/close (HOC)) is investigated in this paper. The proposed control method contains a time-delay recurrent neural network (TDRNN), adopting the previous prediction of the joint angles and the time-delay sEMG signals as the system input. This proposed method uses a batch training based on Levenberg-Marquardt (LM) algorithm to learn the weights of the TDRNN. The trained TDRNN is aimed to achieve simultaneous and proportional regression from human movements of the 3 DoFs to those of the prosthetic hand. Three able-bodied subjects are chosen to participate in the test and demonstrate its feasibility and performance. The offline test result R2 ranges between 0.81 and 0.94. The online test results show that TDRNN reacts faster, which verifies that the method proposed in this paper will be feasible and effective in prosthetic hand control. [ABSTRACT FROM AUTHOR]

Using deep neural networks (DNNs) to explore spatial patterns and temporal dynamics of human brain activities has been an important yet challenging problem because the artificial neural networks are hard to be designed manually. There have been several promising deep learning methods, e.g., deep belief network (DBN), convolutional neural network (CNN), and deep sparse recurrent auto-encoder (DSRAE), that can decompose neuroscientific and meaningful spatiotemporal patterns from 4D functional Magnetic Resonance Imaging (fMRI) data. However, those previous studies still depend on hand-crafted neural network architectures and hyperparameters, which are not optimal in various senses. In this paper, we employ the evolutionary algorithms (EA) to optimize the deep neural architecture of DSRAE by minimizing the expected loss of initialized models, named eNAS-DSRAE (evolutionary Neural Architecture Search on Deep Sparse Recurrent Auto-Encoder). Also, validation experiments are designed and performed on the publicly available human connectome project (HCP) 900 datasets, and the results achieved by the optimized eNAS-DSRAE suggested that our framework can successfully identify the spatiotemporal features and perform better than the hand-crafted neural network models. To our best knowledge, the proposed eNAS-DSRAE is not only among the earliest NAS models that can extract connectome-scale meaningful spatiotemporal brain networks from 4D fMRI data, but also is an effective framework to optimize the RNN-based models. [ABSTRACT FROM AUTHOR]