Search

The colorimetric method is usually used to test the concentration of substances. However, this method has a big error since different people have different sensitivities to colors. In this paper, in order to solve the identification problem of the color and the concentration of the test paper, firstly, we found out that the concentration of substance is correlated with the color reading by using the Pearson's Chi-squared test method. And by the concentration coefficient of Pearson correlation analysis, the concentration of substance and color reading is highly correlated. Secondly, according to the RGB value of the paper image, the color moments of the image are calculated as the characteristics of the image, and the Levenberg–Marquardt (LM) neural network is established to classify the concentration of the substance. The accuracy of the training set model is 94.5%, and the accuracy of the test set model is 87.5%. The model precision is high, and the model has stronger generalization ability. Therefore, according to the RGB value of the test paper image, it is effective to establish the LM neural network model to identify the substance concentration. [ABSTRACT FROM AUTHOR]

Digital technologies sustain today's world. Every part of the world is working towards digital technologies, which none of us can eliminate. Enormous growth is achieved only by unexpected acceleration by digital technologies, including the Internet of Everything (IoE), Artificial Neural Networks (ANN), Machine Learning (ML), Internet of Things (IoT), Artificial Intelligence (AI), Deep Learning (DL), and many more. These technologies started occupying all the engineering sectors, including manufacturing. This paper focuses on tribology analysis related to manufacturing concerning various digital manufacturing technologies. The paper narration includes Tribology using digital technologies wherein the journals and patent landscape analysis abet them. In trend, Tribology utilizes all these technologies today and envisages its growth with the predominant technological invention in the border view. The survey of various literature reveals that only three digital technologies, including AI, ML, and ANN, are used by tribologists around the globe. Other Technologies like Evolutionary Algorithm (EA), Support Vector Machine (SVM), and Adaptive Neuro-Fuzzy Interference Systems (ANFIS) are not used predominantly. [ABSTRACT FROM AUTHOR]

The Π -shaped open section girder is a very common section, which has been widely used in the construction of modern bridges. However, compared with a streamlined box girder, it is easy to cause vortex-induced vibration (VIV) in bridges due to its bluff section shape and poor aerodynamic stability. In this paper, a typical open section with a height–width ratio of 10:1 is taken as the research object. Through wind tunnel tests and numerical simulation technology, the time-history data of VIV of the Π -shaped section are obtained. By selecting three different neural network models to establish the relationship between external parameters (wind attack angle, wind speed, turbulence) and structural response parameters (the onset wind speed of VIV, the length of the lock-in interval). After comparing different machine learning methods, the most suitable machine learning model is selected to predict the VIV response characteristics of the main girder. The research results show that the typical open section has a serious VIV phenomenon. The BP neural network model has the best performance in predicting the VIV performance of the open section in terms of calculation speed, prediction accuracy and solving nonlinear adaptability. At the same time, it is found that different characteristic parameters of the incoming wind field have different influences on the prediction results of the VIV response. Among them, the wind attack angle is the key parameter that affects the onset wind speed of VIV, but the turbulence intensity has a greater impact on the maximum amplitude of VIV. At the same time, the optimized BP model can predict the characteristic parameters of VIV response under unknown wind fields. This paper provides a new idea to study the effect of different incoming flow parameters on the performance of section VIV and further improves people's understanding of VIV system. [ABSTRACT FROM AUTHOR]

This document serves as a preface to a special issue of the International Journal on Artificial Intelligence Tools (IJAIT). The articles in this issue build upon papers presented at the 36th International Florida AI Research Society Conferences in May 2023. The lead article introduces the theme of the special issue, which is explainable, fair, and Trustworthy AI. Other articles in the issue cover topics such as improving the bounds of a neuron's Boolean function, ethical explanations and transparency in AI systems, fairness measurement and mitigation in deep learning systems, and the dynamics of human-agent collaboration in ad hoc teams. The paper emphasizes the importance of positive and negative contrastive explanations in enhancing motivation and performance. It also addresses the challenges of fairness and reliability in predictive policing systems, with a focus on reducing bias related to race, age, and sex. The authors propose tailoring predictive models to specific causal queries and utilizing causal structure instead of relying solely on pre-trained models. The paper also explores how machine learning models can balance accuracy and understandability, as well as ensure fairness. The findings indicate that more complex models tend to outperform current guidelines, but fair models have lower complexity. The paper concludes by expressing gratitude to the reviewers for their contributions and support. [Extracted from the article]

A variant of membrane computing models called Spiking Neural P systems (SNP systems) closely mimics the structure and behavior of biological neurons. As third-generation neural networks, SNP systems have flexible architectures allowing the design of bio-inspired machine learning algorithms. This paper proposes Modular Spiking Neural P (MSNP) systems to solve image classification problems, a novel SNP system to be applied in scenarios where hundreds or even thousands of different classes are considered. A main issue to face in such situations is related to the structural complexity of the network. MSNP systems devised in this work allow to approach the general classification problem by dividing it in smaller parts, that are then faced by single entities of the network. As a benchmark dataset, the Oxford Flowers 102 dataset is considered, consisting of more than 8000 pictures of flowers belonging to the 102 species commonly found in the UK. These classes sometimes present large variations within them, may be also very similar to one another, and different images of the same subject may differ a lot. The work describes the architecture of the MSNP system, based on modules focusing on a specific class, their training phase, and the evaluation of the model both concerning result accuracy as well as energy consumption. Experimental results on image classification problems show that the model achieves good results, but is strongly connected to image quality, mainly depending on the frequency of images, remarkable changes of pose, images not centered, and subject mostly not shown. [ABSTRACT FROM AUTHOR]

Keeping in view the design of short to medium-span bridges in critical locations such as road/river crossings under the action of oppositely moving high-speed loads, this paper presents a hybrid model for the prediction of dynamic displacement employing a theoretical non-dimensional framework aided by an artificial neural network (ANN). The introduction of such a hybrid model reduces parametric space and time. The feed-forward ANN is implemented to train the comprehensive data set obtained from the non-dimensional theoretical scheme. The dimensionless input to ANN comprises the bridge and load parameters, whereas maximum dynamic displacement is the output parameter. The robustness and efficiency of the proposed surrogate ANN framework in terms of computational efficiency are compared with the conventional mode-superposition method formulated in dimensionless form. The training of test and validated data sets results in best-fit models with optimistic statistical metrics and accuracy ≤ 6%. Moreover, the sensitivity of different parameters to the displacement response is highlighted using Pearson's correlation and Quantile–Quantile plots. To incorporate the best-fit models into the design by bypassing the high-fidelity model, a user-friendly interface is developed, confirming the standards of the high-speed rating code (TZY2014-232 2014). Such interfaces have the potential for wide application in the preliminary design of short-to medium-span bridges under opposite moving loads in critical locations such as crossing valleys, rivers, and railroads. [ABSTRACT FROM AUTHOR]

The price of carbon emission rights in the market fluctuates greatly due to various factors from economy, finance, and climate. For an enterprise that needs to conduct carbon trading activities, it is extremely necessary to fully grasp the price of carbon trading in the future period. Thus in this paper, a deep neural network-based assistive decision model for financial risk prediction in carbon trading market is proposed for this purpose. Specifically, the dynamic risk spillover effects of domestic and international carbon trading markets are studied, and a frontier time-varying model is utilized to measure the risk spillover effects. Then, the deep neural network is used for quantitative research and to construct an intelligent decision scheme that outputs financial risk prediction results. Four perspectives, energy price, climate environment, carbon market price, and macroeconomics, are selected as the input to analyze the influence factors of carbon emission rights price. Finally, several linear regression models are adopted as the baseline methods for comparison, and experimental results show that the proposed method can achieve better prediction performance compared with baseline methods. [ABSTRACT FROM AUTHOR]

Several hardware Trojan (HT) detection techniques are available today to ensure the security of hardware systems. However, the existing pre-silicon HT detection techniques have problems such as difficulties in capturing HT path features and poor applicability. To address these challenges, this paper proposes a gate-level HT detection scheme based on a deep learning model. We parse the circuit gate-level netlist and develop an algorithm to extract circuit path sentences based on the signal propagation rule. Path sentences consisting of gate names are extracted as experimental datasets. We apply the theory of natural language processing (NLP) to the task of HT detection and use three neural networks to filter the length of path sentences. Then, based on the deep learning model text convolutional neural network (TextCNN), we propose PS-TextCNN for HT detection. Our approach is verified on seven benchmark circuits of the RS232-series and eight benchmark circuits of the s-series. We achieve an average true positive rate (TPR) of 88.9%. The TPR of the RS232-series reaches a high score of 99.5%. The TPR of the s-series is 79.5%, which is significantly higher than that of the existing gate-level HT detection techniques. [ABSTRACT FROM AUTHOR]

The credit risk assessment acts as an important part in daily affairs for financial institutions. But in the era of big data, the growing business volume makes it an urgent demand to develop digital ways of credit risk assessment. Currently, the machine learning is universally employed to establish various data-driven models for this purpose. However, machine learning models generally suffer from limited ability of feature representation and robustness, and cannot deal with more complex financial security scenarios. To deal with this issue, this work introduces ensemble learning to construct a stronger credit risk prediction model via integration of several basic machine learning models. Thus, an ensemble learning-enhanced smart prediction model for financial credit risk is proposed in this paper. Three classification-based machine learning models (support vector machine, artificial neural network and radial basis function) are selected as the basic classifiers, and "voting" strategy is utilized to integrate them into a novel strong classifier. A real-world financial credit dataset released by a Chinese commercial bank was selected as the experimental scenario. The obtained results show that the proposal has better prediction accuracy compared with basic machine learning models without ensemble learning. [ABSTRACT FROM AUTHOR]

Deep neural network has made surprising achievements in natural language processing, image pattern classification recognition, and other domains in the last few years. It is still tough to apply to hardware-constrained or mobile equipment because of the huge number of parameters, high storage as well as computing costs. In this paper, a new sparse iteration neural network architecture is proposed. First, the pruning method is used to compress the model size and make the network sparse. Then the architecture is iterated on the sparse network model, and the network performance is improved without adding additional parameters. Finally, the hybrid deep learning model was carried out on CV tasks and NLP tasks on ANN, CNN, and Transformer. Compared with the sparse network architecture, we finally found that the accuracy of the MINST, CIFAR10, PASCAL VOC 2012, and SQuAD datasets is improved by 0.47%, 0.64%, 3.75%, and 15.06%, respectively. [ABSTRACT FROM AUTHOR]

This paper presents a novel discrete memristor model that incorporates exponential and absolute value functions. A discrete coupled memristor neural network model is constructed based on this memristor design. The periodic and chaotic regions of the discrete neural network model are determined using bifurcation and Lyapunov exponent spectrum. Furthermore, by varying the initial values of the discrete memristive neural network, we observe the coexistence of chaos and periodic attractors, as well as periodic attractors. Additionally, an application to color image encryption based on the discrete system model is given. Security analysis is conducted in the aspects of key space, histogram analysis, correlation analysis, sensitivity analysis, Peak Signal-to-Noise Ratio (PSNR), and information entropy analysis. The analysis results show that the algorithm has a key space size of 2 2 5 8 , and the information entropy of baboon graph is 7.9993, which is very close to the ideal value of 8. It shows that the image encryption algorithm is feasible and effective. Finally, the implementation of the discrete memristive neural network model is realized using Field Programmable Gate Array (FPGA). The experimental implementation is conducted using the Verilog language on the Vivado 2018.3 platform, and the obtained results align with the numerical simulation results obtained through MATLAB. [ABSTRACT FROM AUTHOR]

This paper proposes a methodology for the diagnosis of electrical system conditions using fractional-order integral transforms for feature extraction. This work proposes three feature extraction algorithms using the Fractional Fourier Transform (FRFT), the Fourier Transform combined with the Mittag-Leffler function, and the Wavelet Transform (WT). Each algorithm extracts data from an electrical system to obtain a set of features that are classified by an Artificial Neural Network to determine the system's condition. The algorithms are utilized in diagnosing two types of electrical machine faults, one in a photovoltaic system, and another in classifying the power quality disturbances (PQDs). An optimization algorithm is suggested to find the optimal orders of integral transforms. The obtained results demonstrate the system's effective diagnosis, displaying superior performance in classifying the faults and PQDs with complex signals. [ABSTRACT FROM AUTHOR]

In recent years, deep learning has revolutionized natural language processing (NLP) by enabling the development of models that can learn complex representations of language data, leading to significant improvements in performance across a wide range of NLP tasks. Deep learning models for NLP typically use large amounts of data to train deep neural networks, allowing them to learn the patterns and relationships in language data. This is in contrast to traditional NLP approaches, which rely on hand-engineered features and rules to perform NLP tasks. The ability of deep neural networks to learn hierarchical representations of language data, handle variable-length input sequences, and perform well on large datasets makes them well-suited for NLP applications. Driven by the exponential growth of textual data and the increasing demand for condensed, coherent, and informative summaries, text summarization has been a critical research area in the field of NLP. Applying deep learning to text summarization refers to the use of deep neural networks to perform text summarization tasks. In this survey, we begin with a review of fashionable text summarization tasks in recent years, including extractive, abstractive, multi-document, and so on. Next, we discuss most deep learning-based models and their experimental results on these tasks. The paper also covers datasets and data representation for summarization tasks. Finally, we delve into the opportunities and challenges associated with summarization tasks and their corresponding methodologies, aiming to inspire future research efforts to advance the field further. A goal of our survey is to explain how these methods differ in their requirements as understanding them is essential for choosing a technique suited for a specific setting. This survey aims to provide a comprehensive review of existing techniques, evaluation methodologies, and practical applications of automatic text summarization. [ABSTRACT FROM AUTHOR]

Prediction of the stock market can play a vital role in everyone's life to attain sustainable growth. This can also lead to an attractive profit by making the proper choices in the financial stock market. The stock market prediction is a big challenge which requires extensive advanced tools and techniques to analyze the future and present data. The modern stock market institutions provide better self-trading and investment options, enabling regular people and traders to enter the market through numerous online applications and websites that are available via smart devices. Financial institutions are investing more and more in talent development so that investors may make the maximum money. There are a multitude of reasons for this, including volatility of market and a collection of other interrelated and independent parameters that control the market value of a different stock. Because of these factors, it is excessively difficult for any specialist in financial markets to accurately predict the market's rise and collapse. This research paper proposed an artificial neural network (ANN) technique which combines with fuzzy logic to predict the stock market for short duration with high accuracy. First, historical and real-time data are used to classify and gather information for prediction. Then the short-duration prediction is done with a high accuracy of 96% and the error margin for a small instance is 2.3%. Through training, testing and validation it is clear that for sustainable short duration prediction, ANN integrated with fuzzy is a good choice. [ABSTRACT FROM AUTHOR]

This document is a guest editorial for a special issue of the journal "Fluctuation & Noise Letters" on the topic of economic policy uncertainty and the energy stock market. The editorial highlights the importance of stable economic policies for consistent economic growth and discusses the negative correlation between economic policy uncertainty and the energy stock market. It also explores the integration of machine learning and artificial intelligence in finance and their potential to reduce economic policy uncertainty. The special issue includes 14 peer-reviewed papers that cover various aspects of energy economics, energy materials, energy stock market prediction, green energy commercialization, and renewable energy dynamics in society. [Extracted from the article]

Deep learning based on deep neural networks has been very successful in many practical applications, but it lacks enough theoretical understanding due to the network architectures and structures. In this paper, we establish some analysis for linear feature extraction by a deep multi-channel convolutional neural networks (CNNs), which demonstrates the power of deep learning over traditional linear transformations, like Fourier, wavelets, redundant dictionary coding methods. Moreover, we give an exact construction presenting how linear features extraction can be conducted efficiently with multi-channel CNNs. It can be applied to lower the essential dimension for approximating a high-dimensional function. Rates of function approximation by such deep networks implemented with channels and followed by fully connected layers are investigated as well. Harmonic analysis for factorizing linear features into multi-resolution convolutions plays an essential role in our work. Nevertheless, a dedicate vectorization of matrices is constructed, which bridges 1D CNN and 2D CNN and allows us to have corresponding 2D analysis. [ABSTRACT FROM AUTHOR]

This paper examines the activation energy influence in third-grade nanoparticle flow model (TG-NPFM), which is nonlinear mixed convective flow over a spinning disk under the influence of heat sink/source as well as viscous dissipation by utilizing Bayesian Regulation Method with backpropagated Artificial Neural Networks (BRM-BPANN). Nonlinear thermal radiation is also involved in the considered flow dynamics to obtain the approximated numerical solutions. The nonlinear PDEs of TG-NPFM are then transformed into nonlinear ODEs by implementing the corresponding transformation. We solved these ODEs by Optimal Homotopy Analysis Method (OHAM) to explain the dataset used as a reference for BRM-BPANN for different scenarios of TG-NPFM. This reference dataset is then exported to MATLAB to compute the results. The outcomes of TG-NPFM are figured by adopting the procedures of testing, validation and training. Moreover, approximated solution is compared with standard solution and the efficacy examination of TG-NPFM is authenticated by the studies of MSE, error histogram and regression plots. These soft computation frameworks provide incentive to use an efficient and dependable alternative paradigm built on soft computing environments to solve problems by doing a descriptive analysis to mitigate the impacts of different physical features. It is a new implementation of intelligent computational system of artificial intelligence introduced by incorporating the solver BRM-BPANN for interpreting the TG-NPFM. The absolute error values lie between 10 − 8 to 10 − 5 , 10 − 1 0 to 10 − 5 , 10 − 8 to 10 − 4 , 10 − 9 to 10 − 3 , 10 − 9 to 10 − 5 , 10 − 9 to 10 − 3 , 10 − 9 to 10 − 3 and 10 − 9 to 10 − 3 , which show the reliability and accuracy of the technique. The convergence and precision of the algorithm can easily be seen through the results of performance, training state and fitness plot, along with the regression value of R = 1. [ABSTRACT FROM AUTHOR]

To improve the recognition ability of clinical named entity recognition (CNER) in a limited number of Chinese electronic medical records, it provides meaningful support for clinical advanced knowledge extraction. In this paper, using CCKS2019 Chinese electronic medical record as an experimental data source, a fusion model enhanced by knowledge graph (KG) is proposed, and the model is applied to specific Chinese CNER tasks. This study consists of three main parts: single-mode model construction and comparison experiment, KG enhancement experiment, and model fusion experiment. The model has achieved good performance in CNER from the results. The accuracy rate, recall rate, and F1 value are 83.825%, 84.705%, and 84.263%, respectively, which is the global optimal, which proves the effectiveness of the model. This provides a good help for further research of medical information. [ABSTRACT FROM AUTHOR]

Deep Neural Networks (DNNs) have been successfully applied to investigations of numerical dynamics of finite-dimensional nonlinear systems such as ODEs instead of finding numerical solutions to ODEs via the traditional Runge–Kutta method and its variants. To show the advantages of DNNs, in this paper, we demonstrate that the DNNs are more efficient in finding topological horseshoes in chaotic dynamical systems. [ABSTRACT FROM AUTHOR]

The recognition of steel microstructure images plays a crucial role in the metallographic analysis process. Although some progress has been made through the application of artificial intelligence algorithms, several challenges remain. First, existing algorithms exhibit weak nonlinear feature extraction capabilities and noticeable limitations. Second, they overlook the intrinsic noise and redundant interference present in microscopic images. To address these issues, this paper investigates the automatic recognition of metallographic tissues by leveraging residual structures in deep neural networks. An enhanced residual network model based on transfer learning is proposed, which utilizes the pre-trained weights from the ImageNet dataset to facilitate learning with small sample data. This network offers higher classification accuracy and higher F1 scores. In addition, a deep residual shrinkage network model based on an attention mechanism is proposed. This model incorporates an attention sub-network into the original residual module and employs a soft threshold function to eliminate redundant features, including noise. The proposed algorithms are evaluated against various convolutional neural networks using 20 types of metallographic test sets. The experimental results showed that both methods have high accuracy rates of 95% and 94.44%, respectively, and F1 scores of 0.9464 and 0.9419. While maintaining the complexity of the model, there has been a significant improvement in accuracy, and the models exhibit strong generalization capabilities. Our research contributes to enhancing production efficiency, strengthening quality control, and improving material performance through computer vision technology. [ABSTRACT FROM AUTHOR]

The vibration-based identification method has long been used as an alternative to mechanical tests for material characterization. Its non-destructive nature, high efficiency in parameter identification of anisotropic materials and its ability to achieve structure-level homogenization make it very attractive for both academic community and industry. Due to the absence of explicit mapping from the result of vibration test to elastic constants, conventional vibration-based identification approaches generally rely on the minimization of a cost function built on modal properties or Frequency Response Function (FRF) curve. In this paper, a direct relation from FRFs to mechanical properties is established by deep neural network, which offers a new perspective to solve the inverse identification problem. Specifically, this mapping is approximately built with Multilayer Perceptrons (MLPs) and the network's weights are learned from massive training data. The training data-i.e., the FRF curves, is generated by a finite element model whose input parameters are selected by Latin Hypercube Sampling (LHS). After training, the obtained model is validated by dataset unseen during training process and will be further used to predict mechanical properties of materials from FRFs obtained by vibration test. The effectiveness and efficiency of the developed method are demonstrated on the case study of an aluminum plate. Both the Young's modulus and Poisson's ratio are retrieved with high accuracy. [ABSTRACT FROM AUTHOR]

The recognition of steel microstructure images plays a crucial role in the metallographic analysis process. Although some progress has been made through the application of artificial intelligence algorithms, several challenges remain. First, existing algorithms exhibit weak nonlinear feature extraction capabilities and noticeable limitations. Second, they overlook the intrinsic noise and redundant interference present in microscopic images. To address these issues, this paper investigates the automatic recognition of metallographic tissues by leveraging residual structures in deep neural networks. An enhanced residual network model based on transfer learning is proposed, which utilizes the pre-trained weights from the ImageNet dataset to facilitate learning with small sample data. This network offers higher classification accuracy and higher F1 scores. In addition, a deep residual shrinkage network model based on an attention mechanism is proposed. This model incorporates an attention sub-network into the original residual module and employs a soft threshold function to eliminate redundant features, including noise. The proposed algorithms are evaluated against various convolutional neural networks using 20 types of metallographic test sets. The experimental results showed that both methods have high accuracy rates of 95% and 94.44%, respectively, and F1 scores of 0.9464 and 0.9419. While maintaining the complexity of the model, there has been a significant improvement in accuracy, and the models exhibit strong generalization capabilities. Our research contributes to enhancing production efficiency, strengthening quality control, and improving material performance through computer vision technology. [ABSTRACT FROM AUTHOR]

Variable selection is one of the most important contents of machine learning research and a large number of variable selection methods have been proposed at present. From deep learning perspective, we propose a new variable selection method based on multi-layer artificial neural networks in this paper. The method propagates errors gained form a trained network model through the network from output layer to input layer and the values gained by input layer give information about the relative contribution. The variables with big contribution value are selected, which we call neural inverse propagation (NIP). Specifically, after training a neural network, the gained errors between the actual network outputs and the desired outputs go through the network from top to down and arrive at the input layer. The absolute values gained by input units provide information about the relative importance (contribution) of input units, which is that the larger the value is, the more important the corresponding input variable is. We remove k variables corresponding to the first k minimum absolute value gained by input units to the predictive variables, to perform variable selection. The efficiency of the proposed method is illustrated through its application to classification and regression tasks on a number of synthetic datasets and a real-world image classification dataset. [ABSTRACT FROM AUTHOR]

The article discusses the use of model predictive control (MPC) for drone flight control in unknown dynamic environments. MPC is a practical method for drone flight control due to its robustness against modeling errors and uncertainties. However, it can degrade in performance when faced with unknown environmental dynamics. The paper introduces a parameterized MPC approach called hyMPC that adapts to uncertain environmental conditions. It uses a novel policy search framework to train a high-level Gaussian policy and neural network policies to provide real-time decision variables. The effectiveness of hyMPC is validated through numerical simulations, achieving a 100% success rate in drone flight tests. The text discusses a framework for maneuvering drones through swinging gates using reinforcement learning (RL) and model predictive control (MPC). The framework utilizes episode-based policy search methods to acquire parameterized motor primitives and skills for controlling the drone. The RL-driven MPC framework incorporates a multi-layer perceptron to predict the gate's future state and a hybrid MPC cost function for trajectory optimization. The policy parameters are updated using a reward function that evaluates the quality of sampled trajectories. The proposed framework is validated through numerical simulations. This document presents a novel framework for navigating drones through swinging gates with unknown dynamics. The framework combines real-time Model Predictive Control (MPC) and offline Reinforcement Learning (RL) techniques. The approach involves training a neural network to predict gate motions and using an MLP to guide trajectory planning. The framework divides the traversal task into gate-following and gate-traversing [Extracted from the article]

Recent advances in speaker embeddings promote a great development of speaker diarization. However, determining 'who spoke when' in the meeting scenarios is still challenging due to similar speaker voices and unknown speaker quantity. In this paper, this research proposes enhanced discriminative features for speaker diarization, including discriminative speaker-specific features based on Siamese networks, and a speaker re-verification method. With Siamese architecture, SiamTDNN, this research first explores latent representations which is capable of modeling intra-class and inter-class differences between speakers, by training with audio pairs. Then, the re-verification method is introduced with a local-global strategy to identify speakers in a multi-person talking scene. Our method provides a novel speaker embedding with enhanced discriminative power for disambiguated speakers and achieves an elevated upper bound on the number of speakers. The proposed speaker embedding achieved an EER of 1.1% and a minDCF of 0.1192 on VoxCeleb1 for the speaker verification task. Extensive experiments on AiShell-4, ICSI, AMI and VoxConverse demonstrate the effectiveness of the proposed method with an average DER reduction of 3% and an RTF of 0.0792. [ABSTRACT FROM AUTHOR]

This paper aims to propose an improved image classification model to reduce the cost of model construction. Aiming at the problem that network training usually requires the support of a large number of labeled samples, an image classification model based on semi-supervised deep learning is proposed, which uses labeled samples to guide the network to learn unlabeled samples. A convolutional neural network model for simultaneous processing of labeled and unlabeled data is constructed. The tagged data is used to train the Softmax classifier and provide the initial K-means clustering center for the untagged data. The nonsubsampling contourlet layer is used to replace the first convolutional layer of the full convolutional neural network to extract multi-scale depth features, and the nonsubsampling contourlet full convolutional neural network is constructed. The network can extract multi-scale information of the images to be classified, and extract more discriminative deep image features. In addition, the parameters of the nonsubsampled contourlet layers are pre-set and do not require network training. The proposed method has higher classification accuracy than the contrast method on polarimetric SAR images using the nonsubsampled contourlet full convolutional neural network. [ABSTRACT FROM AUTHOR]

Using deep neural networks to solve partial differential equations (PDEs) has attracted a lot of attention recently. However, why the deep learning method works is falling far behind its empirical success. In this paper, we provide a rigorous numerical analysis on the deep Ritz method (DRM) for second-order elliptic equations with Dirichlet, Neumann and Robin boundary conditions, respectively. We establish the first nonasymptotic convergence rate in H 1 norm for DRM using deep neural networks with smooth activation functions including logistic and hyperbolic tangent functions. Our results show how to set the hyper-parameter of depth and width to achieve the desired convergence rate in terms of the number of training samples. [ABSTRACT FROM AUTHOR]

The paper considers a class of discrete-time cellular neural networks (DT-CNNs) obtained by applying Euler's discretization scheme to standard CNNs. Let T be the DT-CNN interconnection matrix which is defined by the feedback cloning template. The paper shows that a DT-CNN is convergent, i.e. each solution tends to an equilibrium point, when T is symmetric and, in the case where T + E n is not positive-semidefinite, the step size of Euler's discretization scheme does not exceed a given bound ( E n is the n × n unit matrix). It is shown that two relevant properties hold as a consequence of the local and space-invariant interconnecting structure of a DT-CNN, namely: (1) the bound on the step size can be easily estimated via the elements of the DT-CNN feedback cloning template only; (2) the bound is independent of the DT-CNN dimension. These two properties make DT-CNNs very effective in view of computer simulations and for the practical applications to high-dimensional processing tasks. The obtained results are proved via Lyapunov approach and LaSalle's Invariance Principle in combination with some fundamental inequalities enjoyed by the projection operator on a convex set. The results are compared with previous ones in the literature on the convergence of DT-CNNs and also with those obtained for different neural network models as the Brain-State-in-a-Box model. Finally, the results on convergence are illustrated via the application to some relevant 2D and 1D DT-CNNs for image processing tasks. [ABSTRACT FROM AUTHOR]

In this paper, the projective synchronization problem of nonautonomous neural networks with time delay and Caputo derivative is researched. First, by introducing time delay and variable coefficient into the known neural network model, the neural network that can more accurately describe the interaction between neurons is given. Second, based on the improved neural network model, two global synchronization schemes are achieved, respectively. Finally, by constructing two novel Lyapunov functions and utilizing the properties of delay fractional-order differential inequalities, the asymptotic stability of the zero equilibrium point of the error system obtained from the master–slave systems is proved by some new developing analysis methods, respectively, and some criteria for global projective synchronization of delayed nonautonomous neural networks with Caputo derivatives are obtained, respectively, under two new synchronous controllers. In addition, the correctness of the theoretical results obtained in this paper is verified by some numerical simulation. [ABSTRACT FROM AUTHOR]

The neural network activation functions enable neural networks to have stronger fitting abilities and richer dynamical behaviors. In this paper, an improved fractional-order discrete tabu learning neuron (FODTLN) model map with a nonlinear periodic function as the activation function is proposed. The fixed points of the map are discussed. Then, the rich and complex dynamical behaviors of the map under different parameters and order conditions are investigated by using some common nonlinear dynamical analysis methods combined with the fractional-order approximate entropy method. Furthermore, it is found that fractional-order differential operators affect the generation of multiscrolls, and the model has infinitely many coexisting attractors obtained by changing the initial conditions. Interestingly, attractor growth and state transition are found. Finally, the map is implemented on the DSP hardware platforms to verify the realizability. The results show that the map exhibits complex and interesting dynamical behaviors. It provides a fundamental theory for the research of artificial neural networks. [ABSTRACT FROM AUTHOR]

Deep neural networks are vulnerable to adversarial examples. While there are many methods for generating adversarial examples using neural networks, creating such examples with high perceptual quality and improved training remains an area of active research. In this paper, we propose the Iterative Training Attack (ITA), a black-box attack based on a perturbation generative network for generating adversarial examples. ITA generates such examples by randomly initializing the perturbation generative network multiple times, iteratively training and optimizing a refined loss function. Compared to other neural network-based attacks, our proposed method generates adversarial examples with higher attack rates and within a small perturbation range even when the advanced defense is employed. Despite being a black-box attack, ITA outperforms gradient-based white-box attacks even under basic standards. The authors evaluated their method on a TRADES robust model trained with the MNIST dataset and achieved a robust accuracy of 92.46%, the highest among the evaluated methods. [ABSTRACT FROM AUTHOR]

Deep neural networks (DNNs) have emerged as a prominent model in medical image segmentation, achieving remarkable advancements in clinical practice. Despite the promising results reported in the literature, the effectiveness of DNNs necessitates substantial quantities of high-quality annotated training data. During experiments, we observe a significant decline in the performance of DNNs on the test set when there exists disruption in the labels of the training dataset, revealing inherent limitations in the robustness of DNNs. In this paper, we find that the neural memory ordinary differential equation (nmODE), a recently proposed model based on ordinary differential equations (ODEs), not only addresses the robustness limitation but also enhances performance when trained by the clean training dataset. However, it is acknowledged that the ODE-based model tends to be less computationally efficient compared to the conventional discrete models due to the multiple function evaluations required by the ODE solver. Recognizing the efficiency limitation of the ODE-based model, we propose a novel approach called the nmODE-based knowledge distillation (nmODE-KD). The proposed method aims to transfer knowledge from the continuous nmODE to a discrete layer, simultaneously enhancing the model's robustness and efficiency. The core concept of nmODE-KD revolves around enforcing the discrete layer to mimic the continuous nmODE by minimizing the KL divergence between them. Experimental results on 18 organs-at-risk segmentation tasks demonstrate that nmODE-KD exhibits improved robustness compared to ODE-based models while also mitigating the efficiency limitation. [ABSTRACT FROM AUTHOR]

With the advent of deep neural networks, medical image analysis is able to predict results in advance in early detection and diagnosis of diseases found in the human body. Several deep neural network methodologies have been implemented for a quick and efficient analysis of medical images that detect and diagnose cancerous cell growth in any part of the human body. For improving the segmentation and classification accuracy, the paper has proposed a framework comprising modified DoubleU-Net for image segmentation and PolyNet architecture for image classification. The modified DoubleU-Net is composed of two U-Net architectures, in which U-Net1 makes use of ResNet-50 as an encoder in the place of VGG-16 (existing) and Atrous Spatial Pyramid Pooling (ASPP) is replaced by Waterfall Atrous Spatial Pooling (WASP) architecture in both U-Nets to improve the semantic image segmentation. For classifying the segmented medical images as benign or malignant, PolyNet architecture is implemented in the research. The research involves experiments on the brain tumor dataset and lung cancer dataset to analyze the performance of the proposed approach. The processing of the DoubleU-Net and modified DoubleU-Net is evaluated based on precision, Recall, Intersection over Union (IoU), and Dice Score as the performance metrics. Experimental findings indicate that the modified DoubleU-Net design outperformed the existing DoubleU-Net architecture in terms of performance parameters for segmentation. The efficiency of the PolyNet classifier has been evaluated against VGG-16 and Inception-V3 classifiers, in terms of accuracy, specificity, sensitivity, error rate, and computation time as the performance metrics. From the experimental results, it has been proved that the PolyNet classifier performs better than VGG-16 and Inception-V3 with improved accuracy, specificity, sensitivity, and computation time. [ABSTRACT FROM AUTHOR]

Spiking Neural Networks (SNNs) help achieve brain-like efficiency and functionality by building neurons and synapses that mimic the human brain's transmission of electrical signals. However, optimal SNN implementation requires a precise balance of parametric values. To design such ubiquitous neural networks, a graphical tool for visualizing, analyzing, and explaining the internal behavior of spikes is crucial. Although some popular SNN simulators are available, these tools do not allow users to interact with the neural network during simulation. To this end, we have introduced the first runtime interactive simulator, called Runtime Analyzing and Visualization Simulator (RAVSim), developed to analyze and dynamically visualize the behavior of SNNs, allowing end-users to interact, observe output concentration reactions, and make changes directly during the simulation. In this paper, we present RAVSim with the current implementation of runtime interaction using the LIF neural model with different connectivity schemes, an image classification model using SNNs, and a dataset creation feature. Our main objective is to primarily investigate binary classification using SNNs with RGB images. We created a feed-forward network using the LIF neural model for an image classification algorithm and evaluated it by using RAVSim. The algorithm classifies faces with and without masks, achieving an accuracy of 91.8% using 1000 neurons in a hidden layer, 0.0758 MSE, and an execution time of ∼10 min on the CPU. The experimental results show that using RAVSim not only increases network design speed but also accelerates user learning capability. [ABSTRACT FROM AUTHOR]

Desynchronization attacks proved to be the greatest challenge to audio watermarking systems as they introduce misalignment between the signal carrier and the watermark. This paper proposes a DNN-based speech watermarking system with two adversarial networks jointly trained on a set of desynchronization attacks to embed a randomly generated watermark. The detector neural network is expanded with spatial pyramid pooling layers to be able to handle signals affected by these attacks. A detailed training procedure of the aforementioned DNN system with gradual attack introduction is proposed in order to achieve robustness. Experiments performed on a speech dataset show that the system achieves satisfactory results according to all the benchmarks it was tested against. The system preserves signal quality after watermark embedding. Most importantly, the system achieved resistance to all considered desynchronization attacks. The majority of the attacks cause less than 1. 7 0 % of incorrectly detected watermarked bits on average, which outperforms comparative techniques in this regard. [ABSTRACT FROM AUTHOR]

The neuristor based on memristors can be used to mimic synapse and neurons of biological neural systems, and it is the key unit of spiking neural networks. However, the resistance states of realistic memristors are nonvolatile, which is not conducive to mimicking the forgetting function of the brain. Given that the resistance states of memristor emulators are volatile after power down, this paper exhibits a scalable neuristor built with a half-wave memristor emulator. The proposed neuristor demonstrates four critical features for action-potential-based computing: the all-or-nothing spiking of an action potential, threshold-driven spiking, diverse periodic spiking and symmetric anti-Hebbian learning rule of spike-timing-dependent plasticity. Particularly, there are no complex shape and duration constraints on pre- and post-spikes for implementing the symmetric anti-Hebbian learning rule. [ABSTRACT FROM AUTHOR]

With the development of emerging information technology, the traditional management methods of marine fishes are slowly replaced by new methods due to high cost, time-consumption and inaccurate management. The update of marine fishes management technology is also a great help for the creation of smart cities. However, some new methods have been studied that are too specific, which are not applicable for the other marine fishes, and the accuracy of identification is generally low. Therefore, this paper proposes an ecological Internet of Things (IoT) framework, in which a lightweight Deep Neural Networks model is implemented as a image recognition model for marine fishes, which is recorded as Fish-CNN. In this study, multi-training and evaluation of Fish-CNN is accomplished, and the accuracy of the final classification can be fixed to 89.89%–99.83%. Moreover, the final evaluation compared with Rem-CNN, Linear Regression and Multilayer Perceptron also verify the stability and advantage of our method. [ABSTRACT FROM AUTHOR]

In this paper, we present a new method for Lane Detection (LD) to reduce the impact of some issues associated with Autonomous Driving Cars (ADCs). It relies on the fact that self-driving will be the getaway of the transportation future. The ADC technology has expanded as it does not require human assistance. For ACD to be fully utilized, Machine Learning (ML) tools, such as Deep Neural Networks (DNNs), are required. However, ACD technology uses tools like a camera, GPS, Ultrasonic Sensor (US), and others, which work together to produce accurate ACDs. While adopting ACD, several issues need to be addressed such as carves, blurry, unclean, shadow, sunlight, pedestrians, and weather conditions. The paper proposes a new method to detect when a portion of a road line is missing due to weather conditions or old marking, protecting pedestrians and cars. For lane detection, the DNN model and Hough transform are used. CULane datasets including training and testing samples were used in the experiments. The results show high accuracy levels of 92%, indicating the ability to detect road lanes. [ABSTRACT FROM AUTHOR]

Model pruning is one of the main methods of deep neural network model compression. However, the existing model pruning methods are inefficient, there is still a lot of redundancy in the network, and the pruning has a great impact on the accuracy. In addition, the traditional pruning process usually needs to fine-tune the network to restore accuracy, and fine-tuning has a limited effect on accuracy recovery, so it is difficult to achieve a high level of accuracy. In this paper, we propose a new neural network pruning framework: the channel sparsity is realized by introducing a scale factor, and the sparse network is pruned by setting a global threshold, which greatly improves the efficiency of pruning. After pruning, this paper proposes a rewind method to restore the accuracy, that is, save the weight after training, and then reload it on the network for training to restore the accuracy. In addition, we also study the best rewind point of the three networks. The experimental results show that our method significantly reduces the number of parameters and FLOPs without affecting or even improving the accuracy, and the rewind method proposed by us achieves a better accuracy recovery effect than fine-tuning. At the same time, we find that the epoch with the highest accuracy is the best rewind point, and the accuracy is the highest after saving its corresponding weight and retraining the model. [ABSTRACT FROM AUTHOR]

In this paper, we analyzed the deep neural network (DNN) model and proposed a DNN-based method to build the training model for professional farmers. This paper aims to construct the vocational farmer cultivation model and seek a better path for transforming farmers into new experienced farmers by analyzing each training body involved in the cultivation of vocational farmers and studying their respective problems and reasons. The conceptual and logical structures of the system database were designed, and MySQL was selected for database implementation to complete the information of professional farmers. The system network topology and logical architecture are created, and the functions of view, control, business logic and data access layers are divided. This paper combines the DNN with the vocational farmer training enhancement decision tree. The experimental results of this model are most intuitive and accurate. This paper reconstructs the neural network model using the global average pooling layer to better model the vocational farmer training model to replace the fully connected layer in the original convolutional neural network. At the same time, to make the network model produce a lower probability of overfitting, a dropout layer is added to the layer after the fully connected layer to improve the efficiency of the neural network further to enhance vocational farmer training. The experimental content of this paper provides a new research direction for the estimation of vocational farmer cultivation. The above modeling is used to improve the vocational farmer cultivation model and accelerate the process of vocational farmer cultivation. [ABSTRACT FROM AUTHOR]

This paper constructs a neural machine translation model for Chinese and English using encoder feature extraction with migration learning, allowing the machine to automatically perform feature migration learning, transforming Chinese and English data into word vectors using a centralized representation, and using neural networks to achieve a direct mapping between Chinese and English languages. In this paper, we study the construction of a neural machine translation model by the neural network structure. Firstly, the neural machine translation model is constructed using the neural network structure, which is simplified based on the neural network structure and achieves good performance while reducing the training complexity. To address the problem that neural machine translation cannot make good use of linguistic knowledge, a neural machine translation model with lexical sequence information is proposed. Based on the translation model of a bidirectional neural network incorporating attention mechanism, syntactic analysis is performed to obtain lexical sequence information, and then it is incorporated into the encoder part of the translation model in the form of bidirectional encoding, and the background vector is formed together by vector splicing. To address the problem that the Chinese-English language sequences of any length in the encoder part are encoded into a fixed dimensional background vector, an attention mechanism is introduced to dynamically adjust the degree of influence of the context at the source language end on the target language sequences to improve the translation model's ability to deal with long-distance dependencies. To better reflect the contextual information, this paper further proposes a machine translation model based on migration learning and neural network and conducts a comparative analysis for various translation models to verify the effectiveness of the model performance improvement. [ABSTRACT FROM AUTHOR]

This paper introduces the use of an extra X current conveyor (EXCCII) for realizing logic operations, suited for mixed signal design, without necessitating separate digital blocks. The NOR and OR logic functions are thus shown to be realized using the current-mode analog building block operable at a low voltage. The use of ± 0. 7 5 V supply makes the new circuits operable at low voltage. The EXCCII bias current used in the design is 25 μ A. The input currents for defining logic 0 and logic 1 are, respectively, taken as 0 mA and 0.5 mA. The proposed circuits' delay is found to be 10 ns for low-to-high transition, while 2 ns for high-to-low transition for NOR gate under capacitive loading conditions. The use of the current-mode approach makes the new proposed circuit apt for current-mode signal processing. The new proposed logic function circuits are compatible with analog circuits, thus providing an easy merger for mixed signal systems design, paving the way to a modular design approach. As an extended application in artificial neural networks, the proposed circuit is shown to generate a sigmoid activation function with convincing results. Several results are included by varying the reference current, and the circuit's robustness aspect is also tested in the presence of fluctuation in the bias current of EXCCII. The novel approach of utilizing an analog building block for realizing digital functions is, therefore, verified with promising future applications. [ABSTRACT FROM AUTHOR]

In this paper problem of offline signature verification has been discussed with a novel high-performance convolution Siamese network. The paper proposes modifications in the already existing convolution Siamese network. The proposed method makes use of the Batch Normalization technique instead of Local Response Normalization to achieve better accuracy. The regularization factor has been added in the fully connected layers of the convolution neural network to deal with the problem of overfitting. Apart from this, a wide range of learning rates are provided during the training of the model and optimal one having the least validation loss is used. To evaluate the proposed changes and compare the results with the existing solution, our model is validated on three benchmarks datasets viz. CEDAR, BHSig260, and GPDS Synthetic Signature Corpus. The evaluation is done via two methods firstly by Test-Train validation and then by K-fold cross-validation (K = 5), to test the skill of our model. We show that the proposed modified Siamese network outperforms all the prior results for offline signature verification. One of the major advantages of our system is its capability of handling an unlimited number of new users which is the drawback of many research works done in the past. [ABSTRACT FROM AUTHOR]

This paper focuses on the Hopf bifurcation of a fractional tri-neuron network with both leakage delay and communication delay under different fractional orders. By applying fractional Laplace transform, the stability theorem of linear autonomous system and Hopf bifurcation theorem, we obtain a class of asymptotic stability criterion of zero solution as well as delay-induced Hopf bifurcation conditions for the considered system. Simultaneously, the stability and Hopf bifurcation for tri-neuron network with single fractional order are also discussed as a special case of our proposed neural network model. Finally, a simulation example is given to illustrate the efficiency of the presented theoretical results in this paper. [ABSTRACT FROM AUTHOR]

This paper investigates the possibility for implementing machine learning-aided prediction in analyzing the buckling phenomena of ballasted railway tracks induced by extreme temperature. In this study, artificial neural networks (ANNs) have been developed to identify the relationship between various ballasted track conditions and outputs, namely safe temperature and buckling temperature. The variables included in the objective function of the optimization problems are the lateral resistance of ballasted track provided by ballast-sleeper interaction, torsional resistance provided by fastening systems, and misalignment of the track. Due to its complexity in parameter combinations, the objective of this study is to create predictive models with the aim of minimizing the usage of scarce resources. Thus, this paper is the first to develop a novel machine learning-aided prediction of railway track buckling due to extreme temperature. Comprehensively, all 353 datasets of the safe and buckling temperatures derived from previous finite element (FE) simulation results have been collected and trained. Note that the mean squared error (MSE) and the coefficient of determination ( R 2) are considered to quantify the performance of the ANN architectures. The optimal ANN architecture with a very high rate of accuracy has been determined and highlighted. Thus, the suggested neural network model can be applied conveniently to help estimate safe and buckling temperatures of the complex track models in order to improve track conditions and thus prevent track buckling in summer. [ABSTRACT FROM AUTHOR]

During the last years, computer vision-based diagnosis systems have been widely used in several hospitals and dermatology clinics, aiming mostly at the early detection of malignant melanoma tumor, which is among the most frequent types of skin cancer, versus other types of nonmalignant cutaneous diseases. They grow in melanocytes, the cells responsible for pigmentation. This type of cancer is increasing rapidly and its related mortality rate is increasing more modestly, and inversely proportional to the tumor's thickness. The mortality rate can be decreased by earlier detection of suspicious lesions and better prevention. In this work, we are interested in extracting all specific attributes which can be used for computer-aided diagnosis of melanoma. In the first step of the proposed work, we applied the Dull Razor [Lee T et al., Dullrazor: A software approach to hair removal from images, Cancer Control Research, British Columbia Cancer Agency, Vancouver, Canada, Vol. 21, No. 6, pp. 533–543, 1997] technique to images to reduce the influence of small structures, hairs, bubbles, light reflection. In the second step, a new fuzzy level set algorithm is proposed in order to facilitate the medical image segmentation task. It is able to directly evolve from the initial segmentation proposed that uses a spatial fuzzy clustering approach. The controlling parameters of the level set evolution are also estimated from the results of the fuzzy clustering step. This step is essential to characterize the shape of the lesion and also to locate the tumor to be analyzed. In this paper, we have also treated the necessity to extract all the specific attributes used to develop a characterization methodology that enables specialists to take the best possible diagnosis. For this purpose, our proposal relies largely on visual observation of the tumor while dealing with some characteristics as color, texture or form. The method used in this paper is called ABCD. It requires calculating four factors: Asymmetry (A) , Border (B) , Color (C) , and Diversity (D). Finally, these parameters are used to construct a classification module based on artificial neural network for the recognition of malignant melanoma. [ABSTRACT FROM AUTHOR]

Situational awareness is the ability of pilots to master flight status, which is of great significance to aviation flight safety and flight effect. According to the information processing model, the pilot's main steps of processing information are feeling, perception and execution. There are many problems in situation awareness analysis guided by visual gaze, such as large analysis deviation and high delay due to various influencing factors and complex characteristics. In order to solve this problem, this paper proposes a situation awareness assessment method based on artificial intelligence neural network and integrating visual gaze and flight control. First, this paper carries out simulated flight training experiments for flight cadets, and collects the data of eye movement, line of sight tracking, flight control and flight parameters of pilot cadets. Then, aiming at the flight subjects, a situation awareness analysis method based on events is established, and the situation awareness state in the experiment is evaluated and analyzed through the flight parameter data. Then, the visual gaze and flight control data are sliced in the unit of situational awareness events, and the data set is constructed. Finally, this paper designs a multi-channel sequence data classification and analysis model based on transformer, in which the situation awareness characteristics of visual gaze and operation behavior are analyzed through the attention mechanism. The experimental results show that the accuracy of situation awareness classification of the designed neural network model to the experimental data set is 96%, and can classify and evaluate the pilot's situation awareness state in 5 s. [ABSTRACT FROM AUTHOR]

Aiming to solve the problem of tracking drift during movement, which was caused by the lack of discriminability of the feature information and the failure of a fixed template to adapt to the change of object appearance, the paper proposes an object tracking algorithm combining attention mechanism and correlation filter theory based on the framework of full convolutional Siamese neural networks. Firstly, the apparent information is processed by using the attention mechanism thought, where the object and search area features are optimized according to the spatial attention and channel attention module. At the same time, the cross-attention module is introduced to process the template branch and search area branch, respectively, which makes full use of the diversified context information of the search area. Then, the background perception correlation filter model with scale adaptation and learning rate adjustment is adopted into the model construction, using as a layer in the network model to realize the object template update. Finally, the optimal object location is determined according to the confidence map with similarity calculation. Experimental results show that the designed method in the paper can promote the object tracking performance under various challenging environments effectively; the success rate increases by 16.2%, and the accuracy rate increases by 16%. [ABSTRACT FROM AUTHOR]

It is important for functional neurons of animals or human beings to adapt to external stimuli, such as sound, pressure, and light. Regarding this aspect, autaptic neuron enables itself to utilize historical information to modulate its instant dynamics, such that it may be able to behave adaptively. In this paper, a FitzHugh–Nagumo based autaptic neuron is employed to investigate the capability of a sound-sensitive neural circuit's adaptation and filtering to analog acoustic signals. Extensive simulations are performed for excitatory and inhibitory types of autaptic neurons. The results show that the time-delayed feedback of the excitatory chemical autapse can be tuned to play the role of a narrow-band filter in response to a broadband acoustic signal. While the excitatory chemical autaptic neuron cannot saturate its response amplitude due to its positive feedback gain, the inhibitory chemical autapse can drive the neuron's amplitude to converge as the intensity of external drive increases, which reveals the capability of adaptation. What's more, the inhibitory chemical autaptic neuron can also exhibit a novel bursting adaptation, in which the number of spikings contained in one bursting changes as the electrical activity evolves. For electrical autaptic neurons, it is also found that both time-delay feedback gains can effectively modulate the response of neuron to acoustic signal. While the variation of time-lags mainly changes the spiking rates of the excitatory electrical autaptic neuron, the feedback gain alters its response amplitude. Lastly, by carefully tuning the time-lags, the expected subthreshold dynamics for larger inhibitory feedback gains can be switched to nearby quasi-periodic firings, which implies a competing relation between the time-delays and the feedback gains in the spiking dynamics of the inhibitory electrical autaptic neurons. The diverse emerging phenomena are expected to facilitate the design of online or interactive learning artificial neural networks with these functional autaptic neurons. [ABSTRACT FROM AUTHOR]

Visualization is primarily utilized as a training method to enhance athletic movement quality, increase concentration power, and minimize competition stress on the player while building firm confidence. Physical literacy (PL) provides a valuable lens for analyzing physical activity (PA) movement in more significant social and affective learning processes. This paper presents an Interactive Visualization positioning in physical education (IVPPE) to deal with the signal fluctuations and positioning techniques in visualizing Deep Neural Network (DNN). To ensure the success of their game, athletes are always looking for new ways to improve their health and performance. Using sensors to keep tabs on training and recovery has become more popular among athletes. Currently, sports teams are using sensors to track both the players' internal and external workloads. It illustrates the multilayer localizer (MLL) based on transfer learning to improve the positioning accuracy and physical literacy positioning model (PLPM) as a health determinant. A variety of data augmentation techniques are used to combat signal fluctuations. As a result, the combined effects of motivation-promoting physical activity-based visualization improve the accuracy ratio to 96.7%, prediction ratio to 96.2%, efficiency ratio to 96.8%, and reduce the error rate to 18.7%, stress level (52.8%) compared to other conventional models and have a positive impact on the localizer and positioning, making a difference in physical activity (PA) levels. [ABSTRACT FROM AUTHOR]