Search

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future. [ABSTRACT FROM AUTHOR]

As such, entropy in an economic system is a sum of the entropy production in the system itself and the exchange of entropy with the environment. Entropy economics has also laid the groundwork for new avenues of economic research, such as econophysics, complexity economics, and quantum economics. The Role of Entropy in the Development of Economics [[2]] B Aleksander Jakimowicz b B I Entropy i 2020, 22(4), 452; b https://doi.org/10.3390/e22040452 Graph Economics and physics have been feeding into each other for at least 170 years. A new field of study has also appeared - thermoeconomics - which applies the analogues of thermodynamic entropy in economics, as best exemplified by money entropy. [Extracted from the article]

Almost two decades ago, Ernesto P. Borges and Bruce M. Boghosian embarked on the intricate task of composing a manuscript to honor the profound contributions of Constantino Tsallis to the realm of statistical physics, coupled with a concise exploration of q-Statistics. Fast-forward to Constantino Tsallis' illustrious 80th birthday celebration in 2023, where Deniz Eroglu and Ugur Tirnakli delved into Constantino's collaborative network, injecting renewed vitality into the project. With hearts brimming with appreciation for Tsallis' enduring inspiration, Eroglu, Boghosian, Borges, and Tirnakli proudly present this meticulously crafted manuscript as a token of their gratitude. [ABSTRACT FROM AUTHOR]

The papers range from the theoretical ones, the paper applying the models, to the papers providing software tools for causal inference. B Instrumental variable in causal inference. b Papers [[1], [3]] investigate models using instrumental variable in causal inference. The present Special Issue of Entropy, entitled "Causal Inference for Heterogeneous Data and Information Theory", covers various aspects of causal inference. In the first step, the treatment and outcome are modeled to incorporate the potential confounders, and in the second step, the predictions are inserted into the ATE estimators such as the Augmented Inverse Probability Weighting (AIPW) estimator, based on neural networks (NN). [Extracted from the article]

In his groundbreaking 1905 paper on special relativity, Einstein distinguished between local and global time in inertial systems, introducing his famous definition of distant simultaneity to give physical content to the notion of global time. Over the following decade, Einstein attempted to generalize this analysis of relativistic time to include accelerated frames of reference, which, according to the principle of equivalence, should also account for time in the presence of gravity. Characteristically, Einstein's methodology during this period focused on simple, intuitively accessible physical situations, exhibiting a high degree of symmetry. However, in the final general theory of relativity, the a priori existence of such global symmetries cannot be assumed. Despite this, Einstein repeated some of his early reasoning patterns even in his 1916 review paper on general relativity and in later writings. Modern commentators have criticized these arguments as confused, invalid, and inconsistent. Here, we defend Einstein in the specific context of his use of global time and his derivations of the gravitational redshift formula. We argue that a detailed examination of Einstein's early work clarifies his later reasoning and demonstrates its consistency and validity. [ABSTRACT FROM AUTHOR]

In insecure communication environments where the communication bandwidth is limited, important image data must be compressed and encrypted for transmission. However, existing image compression and encryption algorithms suffer from poor image reconstruction quality and insufficient image encryption security. To address these problems, this paper proposes an image-compression and encryption scheme based on a newly designed hyperchaotic system and two-dimensional compressed sensing (2DCS) technique. In this paper, the chaotic performance of this hyperchaotic system is verified by bifurcation diagrams, Lyapunov diagrams, approximate entropy, and permutation entropy, which have certain advantages over the traditional 2D chaotic system. The new 2D chaotic system as a pseudo-random number generator can completely pass all the test items of NIST. Meanwhile, this paper improves on the existing 2D projected gradient (2DPG) algorithm, which improves the quality of image compression and reconstruction, and can effectively reduce the transmission pressure of image data confidential communication. In addition, a new image encryption algorithm is designed for the new 2D chaotic system, and the security of the algorithm is verified by experiments such as key space size analysis and encrypted image information entropy. [ABSTRACT FROM AUTHOR]

Translation of the seminal 1877 paper by Ludwig Boltzmann which for the first time established the probabilistic basis of entropy. Includes a scientific commentary. [ABSTRACT FROM AUTHOR]

Domestic and international risk shocks have greatly increased the demand for systemic risk management in China. This paper estimates China's multi-layer financial network based on multiple financial relationships among banks, assets, and firms, using China's banking system data in 2021. An improved PageRank algorithm is proposed to identify systemically important banks and other economic sectors, and a stress test is conducted. This study finds that China's multi-layer financial network is sparse, and the distribution of transactions across financial markets is uneven. Regulatory authorities should support economic recovery and adjust the money supply, while banks should differentiate competition and manage risks better. Based on the PageRank index, this paper assesses the systemic importance of large commercial banks from the perspective of network structure, emphasizing the role of banks' transaction behavior and market participation. Different industries and asset classes are also assessed, suggesting that increased attention should be paid to industry risks and regulatory oversight of bank investments. Finally, stress tests confirm that the improved PageRank algorithm is applicable within the multi-layer financial network, reinforcing the need for prudential supervision of the banking system and revealing that the degree of transaction concentration will affect the systemic importance of financial institutions. [ABSTRACT FROM AUTHOR]

The Gaussian wiretap channel with noncausal state interference available at the transmitter, which is also called the dirty paper wiretap channel (DP-WTC), has been extensively studied in the literature. Recently, it has been shown that taking actions on the corrupted state interference of the DP-WTC (also called the action-dependent DP-WTC) helps to increase the secrecy capacity of the DP-WTC. Subsequently, it has been shown that channel feedback further increases the secrecy capacity of the action-dependent DP-WTC (AD-DP-WTC), and a sub-optimal feedback scheme is proposed for this feedback model. In this paper, a two-step hybrid scheme and a corresponding new lower bound on the secrecy capacity of the AD-DP-WTC with noiseless feedback are proposed. The proposed new lower bound is shown to be optimal (achieving the secrecy capacity) and tighter than the existing one in the literature for some cases, and the results of this paper are further explained via numerical examples. [ABSTRACT FROM AUTHOR]

Computer vision in sports analytics is gaining in popularity. Monitoring players' performance using cameras is more flexible and does not interfere with player equipment compared to systems using sensors. This provides a wide set of opportunities for computer vision systems that help coaches, reporters, and audiences. This paper provides an introduction to the problem of measuring boxers' performance, with a comprehensive survey of approaches in current science. The main goal of the paper is to provide a system to automatically detect punches in Olympic boxing using a single static camera. The authors use Euclidean distance to measure the distance between boxers and convolutional neural networks to classify footage frames. In order to improve classification performance, we provide and test three approaches to manipulating the images prior to fitting the classifier. The proposed solution achieves 95% balanced accuracy, 49% F1 score for frames with punches, and 97% for frames without punches. Finally, we present a working system for analyses of a boxing scene that marks boxers and labelled frames with detected clashes and punches. [ABSTRACT FROM AUTHOR]

The article presents information on the recipients of the Entropy Best Paper Award that been have selected by Editor-in-Chief and designated Editorial Board Members from all research papers published in 2011. Topics discussed include an article on amines in Earth's atmosphere by Alexey B. Nadykto that won the third prize in Article Award category, a review paper "Thermodynamics of Thermoelectric Phenomena and Applications and periodical's editor-in-chief Prof. Dr. Kevin H. Knuth.

Joint communications and sensing functionalities integrated into the same communication network have become increasingly relevant due to the large bandwidth requirements of next-generation wireless communication systems and the impending spectral shortage. While there exist system-level guidelines and waveform design specifications for such systems, an information-theoretic analysis of the absolute performance capabilities of joint sensing and communication systems that take into account practical limitations such as fading has not been addressed in the literature. Motivated by this, we undertake a network information-theoretic analysis of a typical joint communications and sensing system in this paper. Towards this end, we consider a state-dependent fading Gaussian multiple access channel (GMAC) setup with an additive state. The state process is assumed to be independent and identically distributed (i.i.d.) Gaussian, and non-causally available to all the transmitting nodes. The fading gains on the respective links are assumed to be stationary and ergodic and available only at the receiver. In this setting, with no knowledge of fading gains at the transmitters, we are interested in joint message communication and estimation of the state at the receiver to meet a target distortion in the mean-squared error sense. Our main contribution here is a complete characterization of the distortion-rate trade-off region between the communication rates and the state estimation distortion for a two-sender GMAC. Our results show that the optimal strategy is based on static power allocation and involves uncoded transmissions to amplify the state, along with the superposition of the digital message streams using appropriate Gaussian codebooks and dirty paper coding (DPC). This acts as a design directive for realistic systems using joint sensing and transmission in next-generation wireless standards and points to the relative benefits of uncoded communications and joint source-channel coding in such systems. [ABSTRACT FROM AUTHOR]

Granger causality provides a framework that uses predictability to identify causation between time series variables. This is important to policymakers for effective policy management and recommendations. Granger causality is recognized as the primary advance on the causation problem. The objective of this paper is to conduct a bibliometric analysis of Granger causality publications indexed in the Web of Science database. Harzing's Publish or Perish and VOSviewer were used for performance analysis and science mapping. The first paper indexed was published in 1981 and there has been an upward trend in the annual publication of Granger causality studies which are shifting towards the areas of environmental science, energy, and economics. Most of the publications are articles and proceeding papers under the areas of business economics, environmental science ecology, and neurosciences/neurology. China has the highest number of publications while the United States has the highest number of citations. England has the highest citation impact. This paper also constructed country co-authorship, co-analysis of cited references, cited sources, and cited authors, keyword co-occurrence, and keyword overlay visualization maps. [ABSTRACT FROM AUTHOR]

We explore the different notions of completeness applied in the EPR discussion following and amending the thorough analysis of Arthur Fine. To this aim, we propose a classification scheme for scientific theories that provides a methodology for analyzing the different levels at which interpretive approaches come into play. This allows us to contrast several concepts of completeness that operate on specific levels of the theory. We introduce the notion of theory completeness and compare it with the established notions of Born completeness, Schrödinger completeness and bijective completeness. We relate these notions to the recent concept of ψ -completeness and predictable completeness. The paper shows that the EPR argument contains conflicting versions of completeness. The confusion of these notions led to misunderstandings in the EPR debate and hindered its progress. Their clarification will thus contribute to recent debates on interpretational issues of quantum mechanics. Finally, we discuss the connection between the EPR paper and the Einstein–Rosen paper with regard to the question of completeness. [ABSTRACT FROM AUTHOR]

The article announces recipients of the "Entropy Best Paper Award" for 2014 including Alexander N. Gorban, Andrzej Cichocki and Katherine L. Brown for articles related to Markov process, Alpha, Beta and Gamma divergences and quantum computers, published in the 2010 issue of the journal.

The analysis of research paper collections is an interesting topic that can give insights on whether a research area is stalled in the same problems, or there is a great amount of novelty every year. Previous research has addressed similar tasks by the analysis of keywords or reference lists, with different degrees of human intervention. In this paper, we demonstrate how, with the use of Normalized Relative Compression, together with a set of automated data-processing tasks, we can successfully visually compare research articles and document collections. We also achieve very similar results with Normalized Conditional Compression that can be applied with a regular compressor. With our approach, we can group papers of different disciplines, analyze how a conference evolves throughout the different editions, or how the profile of a researcher changes through the time. We provide a set of tests that validate our technique, and show that it behaves better for these tasks than other techniques previously proposed. [ABSTRACT FROM AUTHOR]

Coreference resolution is a key task in Natural Language Processing. It is difficult to evaluate the similarity of long-span texts, which makes text-level encoding somewhat challenging. This paper first compares the impact of commonly used methods to improve the global information collection ability of the model on the BERT encoding performance. Based on this, a multi-scale context information module is designed to improve the applicability of the BERT encoding model under different text spans. In addition, improving linear separability through dimension expansion. Finally, cross-entropy loss is used as the loss function. After adding BERT and span BERT to the module designed in this article, F1 increased by 0.5% and 0.2%, respectively. [ABSTRACT FROM AUTHOR]

Based on authorized patents of China's artificial intelligence industry from 2013 to 2022, this paper constructs an Industry–University–Research institution (IUR) collaboration network and an Inter-Firm (IF) collaboration network and used the entropy weight method to take both the quantity and quality of patents into account to calculate the innovation performance of firms. Through the hierarchical clustering algorithm and classification and regression trees (CART) algorithm, in-depth analysis has been conducted on the intricate non-linear influence mechanisms between multiple variables and a firm's innovation performance. The findings indicate the following: (1) Based on the network centrality (NC), structural hole (SH), collaboration breadth (CB), and collaboration depth (CD) of both IUR and IF collaboration networks, two types of focal firms are identified. (2) For different types of focal firms, the combinations of network characteristics affecting their innovation performance are various. (3) In the IUR collaboration network, focal firms with a wide range of heterogeneous collaborative partners can obtain high innovation performance. However, focal firms in the IF collaboration network can achieve the same aim by maintaining deep collaboration with other focal firms. This paper not only helps firms make scientific decisions for development but also provides valuable suggestions for government policymakers. [ABSTRACT FROM AUTHOR]

We feature papers on recent developments in the areas of adaptive signal processing, machine learning, and deep learning using information theory and entropy to improve performance in widespread and popular problems, and also to provide effective solutions to emerging problems. Our goal is to publish recent developments in the areas of adaptive signal processing, machine learning, and deep learning using information theory and entropy to improve performance in widespread and popular problems, and also to provide effective solutions to emerging problems. This Special Issue on "Adaptive Signal Processing and Machine Learning Using Entropy and Information Theory" was birthed from observations of the recent trend in the literature. Entropy-based cost functions have replaced mean-square-error (MSE)-based ones and have been widely used in adaptive signal processing and machine learning to improve performance by designing and optimizing effective and specific models that fit the data, even in noisy and adverse conditions. [Extracted from the article]

The diagnosis of faults in wind turbine gearboxes based on signal processing represents a significant area of research within the field of wind power generation. This paper presents an intelligent fault diagnosis method based on ensemble-refined composite multiscale fluctuation-based reverse dispersion entropy (ERCMFRDE) for a wind turbine gearbox vibration signal that is nonstationary and nonlinear and for noise problems. Firstly, improved complete ensemble empirical mode decomposition with adaptive noise (ICEEMDAN) and stationary wavelet transform (SWT) are adopted for signal decomposition, noise reduction, and restructuring of gearbox signals. Secondly, we extend the single coarse-graining processing method of refined composite multiscale fluctuation-based reverse dispersion entropy (RCMFRDE) to the multiorder moment coarse-grained processing method, extracting mixed fault feature sets for denoised signals. Finally, the diagnostic results are obtained based on the least squares support vector machine (LSSVM). The dataset collected during the gearbox fault simulation on the experimental platform is employed as the research object, and the experiments are conducted using the method proposed in this paper. The experimental results demonstrate that the proposed method is an effective and reliable approach for accurately diagnosing gearbox faults, exhibiting high diagnostic accuracy and a robust performance. [ABSTRACT FROM AUTHOR]

Relay channels capture the essence of several important communication scenarios such as sensor network and satellite communication. In this paper, first, we propose an efficient coding scheme for an additive white Gaussian noise (AWGN) relay channel in the presence of AWGN feedback, which generalizes the conventional scheme for the AWGN relay channel with noiseless feedback by introducing a lattice-based strategy to eliminate the impact of the feedback channel noise on the performance of the original scheme. Next, we further extend the proposed scheme to the multi-input single-output (MISO) fading relay channel (FRC) with noisy feedback. The key to this extension is to use a pre-coding strategy to transform the MISO channel into a single-input single-output (SISO) channel and applying a two-dimensional lattice coding strategy to deal with the feedback fading channel noise. Finally, we analyze the security performance of our proposed scheme in several cases, and the results of this paper are further illustrated by numerical examples. [ABSTRACT FROM AUTHOR]

With the popularity of the Internet and the increase in the level of information technology, cyber attacks have become an increasingly serious problem. They pose a great threat to the security of individuals, enterprises, and the state. This has made network intrusion detection technology critically important. In this paper, a malicious traffic detection model is constructed based on a decision tree classifier of entropy and a proximal policy optimisation algorithm (PPO) of deep reinforcement learning. Firstly, the decision tree idea in machine learning is used to make a preliminary classification judgement on the dataset based on the information entropy. The importance score of each feature in the classification work is calculated and the features with lower contributions are removed. Then, it is handed over to the PPO algorithm model for detection. An entropy regularity term is introduced in the process of the PPO algorithm update. Finally, the deep reinforcement learning algorithm is used to continuously train and update the parameters during the detection process, and finally, the detection model with higher accuracy is obtained. Experiments show that the binary classification accuracy of the malicious traffic detection model based on the deep reinforcement learning PPO algorithm can reach 99.17% under the CIC-IDS2017 dataset used in this paper. [ABSTRACT FROM AUTHOR]

In a recent paper, Nicolas Gisin suggests that by conducting physics with intuitionistic rather than classical mathematics, rich temporality—that is, passage and tense, and specifically the future's openness—can be incorporated into physics. Physics based on classical mathematics is tenseless and deterministic, and that, so he holds, renders it incongruent with experience. According to Gisin, physics ought to represent the indeterminate nature of reality, and he proposes that intuitionistic mathematics is the key to succeeding in doing so. While I share his insistence on the reality of passage and tense and on the future being real and open, I argue that the amendment he offers does not work. I show that, its attunement to time notwithstanding, intuitionistic mathematics is as tenseless as classical mathematics and that physics is bound to remain tenseless regardless of the math it employs. There is much to learn about tensed time, but the task belongs to phenomenology and not to physics. [ABSTRACT FROM AUTHOR]

The multi-particle Arnol'd cat is a generalization of the Hamiltonian system, both classical and quantum, whose period evolution operator is the renowned map that bears its name. It is obtained following the Joos–Zeh prescription for decoherence by adding a number of scattering particles in the configuration space of the cat. Quantization follows swiftly if the Hamiltonian approach, rather than the semiclassical approach, is adopted. The author has studied this system in a series of previous works, focusing on the problem of quantum–classical correspondence. In this paper, the dynamics of this system are tested by two related yet different indicators: the time autocorrelation function of the canonical position and the out-of-time correlator of position and momentum. [ABSTRACT FROM AUTHOR]

Investigating the significant "roles" within financial complex networks and their stability is of great importance for preventing financial risks. On one hand, this paper initially constructs a complex network model of the stock market based on mutual information theory and threshold methods, combined with the closing price returns of stocks. It then analyzes the basic topological characteristics of this network and examines its stability under random and targeted attacks by varying the threshold values. On the other hand, using systemic risk entropy as a metric to quantify the stability of the stock market, this paper validates the impact of the COVID-19 pandemic as a widespread, unexpected event on network stability. The research results indicate that this complex network exhibits small-world characteristics but cannot be strictly classified as a scale-free network. In this network, key roles are played by the industrial sector, media and information services, pharmaceuticals and healthcare, transportation, and utilities. Upon reducing the threshold, the network's resilience to random attacks is correspondingly strengthened. Dynamically, from 2000 to 2022, systemic risk in significant industrial share markets significantly increased. From a static perspective, the period around 2019, affected by the COVID-19 pandemic, experienced the most drastic fluctuations. Compared to the year 2000, systemic risk entropy in 2022 increased nearly sixtyfold, further indicating an increasing instability within this complex network. [ABSTRACT FROM AUTHOR]

This paper establishes a general framework for measuring statistical divergence. Namely, with regard to a pair of random variables that share a common range of values: quantifying the distance of the statistical distribution of one random variable from that of the other. The general framework is then applied to the topics of socioeconomic inequality and renewal processes. The general framework and its applications are shown to yield and to relate to the following: f-divergence, Hellinger divergence, Renyi divergence, and Kullback–Leibler divergence (also known as relative entropy); the Lorenz curve and socioeconomic inequality indices; the Gini index and its generalizations; the divergence of renewal processes from the Poisson process; and the divergence of anomalous relaxation from regular relaxation. Presenting a 'fresh' perspective on statistical divergence, this paper offers its readers a simple and transparent construction of statistical-divergence gauges, as well as novel paths that lead from statistical divergence to the aforementioned topics. [ABSTRACT FROM AUTHOR]

Partial discharge (PD) fault diagnosis is of great importance for ensuring the safe and stable operation of power transformers. To address the issues of low accuracy in traditional PD fault diagnostic methods, this paper proposes a novel method for the power transformer PD fault diagnosis. It incorporates the approximate entropy (ApEn) of symplectic geometry mode decomposition (SGMD) into the optimized bidirectional long short-term memory (BILSTM) neural network. This method extracts dominant PD features employing SGMD and ApEn. Meanwhile, it improves the diagnostic accuracy with the optimized BILSTM by introducing the golden jackal optimization (GJO). Simulation studies evaluate the performance of FFT, EMD, VMD, and SGMD. The results show that SGMD–ApEn outperforms other methods in extracting dominant PD features. Experimental results verify the effectiveness and superiority of the proposed method by comparing different traditional methods. The proposed method improves PD fault recognition accuracy and provides a diagnostic rate of 98.6%, with lower noise sensitivity. [ABSTRACT FROM AUTHOR]

Accurate prediction of air quality is crucial for assessing the state of the atmospheric environment, especially considering the nonlinearity, volatility, and abrupt changes in air quality data. This paper introduces an air quality index (AQI) prediction model based on the Dung Beetle Algorithm (DBO) aimed at overcoming limitations in traditional prediction models, such as inadequate access to data features, challenges in parameter setting, and accuracy constraints. The proposed model optimizes the parameters of Variational Mode Decomposition (VMD) and integrates the Informer adaptive sequential prediction model with the Convolutional Neural Network-Long Short Term Memory (CNN-LSTM). Initially, the correlation coefficient method is utilized to identify key impact features from multivariate weather and meteorological data. Subsequently, penalty factors and the number of variational modes in the VMD are optimized using DBO. The optimized parameters are utilized to develop a variationally constrained model to decompose the air quality sequence. The data are categorized based on approximate entropy, and high-frequency data are fed into the Informer model, while low-frequency data are fed into the CNN-LSTM model. The predicted values of the subsystems are then combined and reconstructed to obtain the AQI prediction results. Evaluation using actual monitoring data from Beijing demonstrates that the proposed coupling prediction model of the air quality index in this paper is superior to other parameter optimization models. The Mean Absolute Error (MAE) decreases by 13.59%, the Root-Mean-Square Error (RMSE) decreases by 7.04%, and the R-square (R2) increases by 1.39%. This model surpasses 11 other models in terms of lower error rates and enhances prediction accuracy. Compared with the mainstream swarm intelligence optimization algorithm, DBO, as an optimization algorithm, demonstrates higher computational efficiency and is closer to the actual value. The proposed coupling model provides a new method for air quality index prediction. [ABSTRACT FROM AUTHOR]

In order to solve the problem of great difficulty in detecting the internal damage of wire rope, this paper proposes a method to improve the VGG model to identify the internal damage of wire rope. The short-time Fourier transform method is used to transform the wire rope damage signal into a time-frequency spectrogram as the model input, and then the traditional VGG model is improved from three aspects: firstly, the attention mechanism module is introduced to increase the effective feature weights, which effectively improves the recognition accuracy; and then, the batch normalization layer is added to carry out a uniform normalization of the data, so as to make the model easier to converge. At the same time, the pooling layer and the fully connected layer are improved to solve the redundancy problem of the traditional VGG network model, which makes the model structure more lightweight, greatly saves the computational cost, shortens the training time, and finally adopts the joint-sample uniformly distributed cross-entropy as the loss function to solve the overfitting problem and further improve the recognition rate. The experimental results show that the improved VGG model has an identification accuracy of up to 98.84% for the internal damage spectrogram of the wire rope, which shows a good identification ability. Not only that, but the model is also superior, with less time-consuming training and stronger generalization ability. [ABSTRACT FROM AUTHOR]

Recently, many password guessing algorithms have been proposed, seriously threatening cyber security. In this paper, we systematically review over thirty methods for password guessing published between 2016 and 2023. First, we introduce a taxonomy for classifying the existing methods into trawling guessing and targeted guessing. Second, we present an extensive benchmark dataset that can assist researchers and practitioners in successive works. Third, we conduct a bibliometric analysis to present trends in this field and cross-citation between reviewed papers. Further, we discuss the open challenges of password guessing in terms of diverse application scenarios, guessing efficiency, and the combination of traditional and deep learning methods. Finally, this review presents future research directions to guide successive research and development of password guessing. [ABSTRACT FROM AUTHOR]

Managed pressure drilling (MPD) is the most effective means to ensure drilling safety, and MPD is able to avoid further deterioration of complex working conditions through precise control of the wellhead back pressure. The key to the success of MPD is the well control strategy, which currently relies heavily on manual experience, hindering the automation and intelligence process of well control. In response to this issue, an MPD knowledge graph is constructed in this paper that extracts knowledge from published papers and drilling reports to guide well control. In order to improve the performance of entity extraction in the knowledge graph, a few-shot Chinese entity recognition model CEntLM-KL is extended from the EntLM model, in which the KL entropy is built to improve the accuracy of entity recognition. Through experiments on benchmark datasets, it has been shown that the proposed model has a significant improvement compared to the state-of-the-art methods. On the few-shot drilling datasets, the F-1 score of entity recognition reaches 33%. Finally, the knowledge graph is stored in Neo4J and applied for knowledge inference. [ABSTRACT FROM AUTHOR]

This paper presents a novel method for finding features in the analysis of variable distributions stemming from time series. We apply the methodology to the case of submitted and accepted papers in peer-reviewed journals. We provide a comparative study of editorial decisions for papers submitted to two peer-reviewed journals: the Journal of the Serbian Chemical Society (JSCS) and this MDPI Entropy journal. We cover three recent years for which the fate of submitted papers—about 600 papers to JSCS and 2500 to Entropy—is completely determined. Instead of comparing the number distributions of these papers as a function of time with respect to a uniform distribution, we analyze the relevant probabilities, from which we derive the information entropy. It is argued that such probabilities are indeed more relevant for authors than the actual number of submissions. We tie this entropy analysis to the so called diversity of the variable distributions. Furthermore, we emphasize the correspondence between the entropy and the diversity with inequality measures, like the Herfindahl-Hirschman index and the Theil index, itself being in the class of entropy measures; the Gini coefficient which also measures the diversity in ranking is calculated for further discussion. In this sample, the seasonal aspects of the peer review process are outlined. It is found that the use of such indices, non linear transformations of the data distributions, allow us to distinguish features and evolutions of the peer review process as a function of time as well as comparing the non-uniformity of distributions. Furthermore, t- and z-statistical tests are applied in order to measure the significance (p-level) of the findings, that is, whether papers are more likely to be accepted if they are submitted during a few specific months or during a particular "season"; the predictability strength depends on the journal. [ABSTRACT FROM AUTHOR]

Statistical information theory is a method for quantifying the amount of stochastic uncertainty in a system. This theory originated in communication theory. The application of information theoretic approaches has been extended to different fields. This paper aims to perform a bibliometric analysis of information theoretic publications listed on the Scopus database. The data of 3701 documents were extracted from the Scopus database. The software used for analysis includes Harzing's Publish or Perish and VOSviewer. Results including publication growth, subject areas, geographical contributions, country co-authorship, most cited publications, keyword co-occurrence analysis, and citation metrics are presented in this paper. Publication growth has been steady since 2003. The United States has the highest number of publications and received more than half of the total citations from all 3701 publications. Most of the publications are in computer science, engineering, and mathematics. The United States, the United Kingdom, and China have the highest collaboration across countries. The focus on information theoretic is slowly shifting from mathematical models to technology-driven applications such as machine learning and robotics. This study highlights the trends and developments of information theoretic publications, which helps researchers to understand the state of the art of information theoretic approaches for future contributions in this research domain. [ABSTRACT FROM AUTHOR]

Vibration monitoring and analysis are important methods in wind turbine gearbox fault diagnosis, and determining how to extract fault characteristics from the vibration signal is of primary importance. This paper presents a fault diagnosis approach based on modified hierarchical fluctuation dispersion entropy of tan-sigmoid mapping (MHFDE_TANSIG) and northern goshawk optimization–support vector machine (NGO–SVM) for wind turbine gearboxes. The tan-sigmoid (TANSIG) mapping function replaces the normal cumulative distribution function (NCDF) of the hierarchical fluctuation dispersion entropy (HFDE) method. Additionally, the hierarchical decomposition of the HFDE method is improved, resulting in the proposed MHFDE_TANSIG method. The vibration signals of wind turbine gearboxes are analyzed using the MHFDE_TANSIG method to extract fault features. The constructed fault feature set is used to intelligently recognize and classify the fault type of the gearboxes with the NGO–SVM classifier. The fault diagnosis methods based on MHFDE_TANSIG and NGO–SVM are applied to the experimental data analysis of gearboxes with different operating conditions. The results show that the fault diagnosis model proposed in this paper has the best performance with an average accuracy rate of 97.25%. [ABSTRACT FROM AUTHOR]

Autonomous search is an ongoing cycle of sensing, statistical estimation, and motion control with the objective to find and localise targets in a designated search area. Traditionally, the theoretical framework for autonomous search combines sequential Bayesian estimation with information theoretic motion control. This paper formulates autonomous search in the framework of possibility theory. Although the possibilistic formulation is slightly more involved than the traditional method, it provides a means for quantitative modelling and reasoning in the presence of epistemic uncertainty. This feature is demonstrated in the paper in the context of partially known probability of detection, expressed as an interval value. The paper presents an elegant Bayes-like solution to sequential estimation, with the reward function for motion control defined to take into account the epistemic uncertainty. The advantages of the proposed search algorithm are demonstrated by numerical simulations. [ABSTRACT FROM AUTHOR]

Mainstream research on information theory within the field of living systems involves the application of analytical tools to understand a broad range of life processes. This paper is dedicated to an opposite problem: it explores the information theory and communication engineering methods that have counterparts in the data transmission process by way of DNA structures and neural fibers. Considering the requirements of modern multimedia, transmission methods chosen by nature may be different, suboptimal, or even far from optimal. However, nature is known for rational resource usage, so its methods have a significant advantage: they are proven to be sustainable. Perhaps understanding the engineering aspects of methods of nature can inspire a design of alternative green, stable, and low-cost transmission. [ABSTRACT FROM AUTHOR]

Medical image diagnosis using deep learning has shown significant promise in clinical medicine. However, it often encounters two major difficulties in real-world applications: (1) domain shift, which invalidates the trained model on new datasets, and (2) class imbalance problems leading to model biases towards majority classes. To address these challenges, this paper proposes a transfer learning solution, named Dynamic Weighting Translation Transfer Learning (DTTL), for imbalanced medical image classification. The approach is grounded in information and entropy theory and comprises three modules: Cross-domain Discriminability Adaptation (CDA), Dynamic Domain Translation (DDT), and Balanced Target Learning (BTL). CDA connects discriminative feature learning between source and target domains using a synthetic discriminability loss and a domain-invariant feature learning loss. The DDT unit develops a dynamic translation process for imbalanced classes between two domains, utilizing a confidence-based selection approach to select the most useful synthesized images to create a pseudo-labeled balanced target domain. Finally, the BTL unit performs supervised learning on the reassembled target set to obtain the final diagnostic model. This paper delves into maximizing the entropy of class distributions, while simultaneously minimizing the cross-entropy between the source and target domains to reduce domain discrepancies. By incorporating entropy concepts into our framework, our method not only significantly enhances medical image classification in practical settings but also innovates the application of entropy and information theory within deep learning and medical image processing realms. Extensive experiments demonstrate that DTTL achieves the best performance compared to existing state-of-the-art methods for imbalanced medical image classification tasks. [ABSTRACT FROM AUTHOR]

Underwriters play a pivotal role in the IPO process. Information entropy, a tool for measuring the uncertainty and complexity of information, has been widely applied to various issues in complex networks. Information entropy can quantify the uncertainty and complexity of nodes in the network, providing a unique analytical perspective and methodological support for this study. This paper employs a bipartite network analysis method to construct the relationship network between underwriters and accounting firms, using the centrality of underwriters in the network as a measure of their influence to explore the impact of underwriters' influence on the distribution of interests and audit outcomes. The findings indicate that a more pronounced influence of underwriters significantly increases the ratio of underwriting fees to audit fees. Higher influence often accompanies an increase in abnormal underwriting fees. Further research reveals that companies underwritten by more influential underwriters experience a decline in audit quality. Finally, the study reveals that a well-structured audit committee governance and the rationalization of market sentiments can mitigate the negative impacts of underwriters' influence. The innovation of this paper is that it enriches the content related to underwriters by constructing the relationship network between underwriters and accounting firms for the first time using a bipartite network through the lens of information entropy. This conclusion provides new directions for thinking about the motives and possibilities behind financial institutions' cooperation, offering insights for market regulation and policy formulation. [ABSTRACT FROM AUTHOR]

Traffic state classification and relevance calculation at intersections are both difficult problems in traffic control. In this paper, we propose an intersection relevance model based on a temporal graph attention network, which can solve the above two problems at the same time. First, the intersection features and interaction time of the intersections are regarded as input quantities together with the initial labels of the traffic data. Then, they are inputted into the temporal graph attention (TGAT) model to obtain the classification accuracy of the target intersections in four states—free, stable, slow moving, and congested—and the obtained neighbouring intersection weights are used as the correlation between the intersections. Finally, it is validated by VISSIM simulation experiments. In terms of classification accuracy, the TGAT model has a higher classification accuracy than the three traditional classification models and can cope well with the uneven distribution of the number of samples. The information gain algorithm from the information entropy theory was used to derive the average delay as the most influential factor on intersection status. The correlation from the TGAT model positively correlates with traffic flow, making it interpretable. Using this correlation to control the division of subareas improves the road network's operational efficiency more than the traditional correlation model does. This demonstrates the effectiveness of the TGAT model's correlation. [ABSTRACT FROM AUTHOR]

Categorical data analysis of 2 × 2 contingency tables is extremely common, not least because they provide risk difference, risk ratio, odds ratio, and log odds statistics in medical research. A χ 2 test analysis is most often used, although some researchers use likelihood ratio test (LRT) analysis. Does it matter which test is used? A review of the literature, examination of the theoretical foundations, and analyses of simulations and empirical data are used by this paper to argue that only the LRT should be used when we are interested in testing whether the binomial proportions are equal. This so-called test of independence is by far the most popular, meaning the χ 2 test is widely misused. By contrast, the χ 2 test should be reserved for where the data appear to match too closely a particular hypothesis (e.g., the null hypothesis), where the variance is of interest, and is less than expected. Low variance can be of interest in various scenarios, particularly in investigations of data integrity. Finally, it is argued that the evidential approach provides a consistent and coherent method that avoids the difficulties posed by significance testing. The approach facilitates the calculation of appropriate log likelihood ratios to suit our research aims, whether this is to test the proportions or to test the variance. The conclusions from this paper apply to larger contingency tables, including multi-way tables. [ABSTRACT FROM AUTHOR]

Linear complementary dual (LCD) codes, which are a class of linear codes introduced by Massey, have been extensively studied in the literature recently. It has been shown that LCD codes play a role in measures to counter passive and active side-channel analyses on embedded cryptosystems. In this paper, tables are presented of good quaternary Hermitian LCD codes and they are used in the construction of puncturing, shortening and combination codes. The results of this, including three tables of the best-known quaternary Hermitian LCD codes of any length n ≤ 25 with corresponding dimension k, are presented. In addition, many of these quaternary Hermitian LCD codes given in this paper are optimal and saturate the lower or upper bound of Grassl's code table, and some of them are nearly optimal. [ABSTRACT FROM AUTHOR]

New insights into intractable industrial challenges can be revealed by framing them in terms of natural science. One intractable industrial challenge is that creative production can be much more financially expensive and time consuming than standardized production. Creative products include a wide range of goods that have one or more original characteristics. The scaling up of creative production is hindered by high financial production costs and long production durations. In this paper, creative production is framed in terms of interactions between entropy and complexity during progressions from emergent pragmatics to action semantics. An analysis of interactions between entropy and complexity is provided that relates established practice in creative production to organizational survival in changing environments. The analysis in this paper is related to assembly theory, which is a recent theoretical development in natural science that addresses how open-ended generation of complex physical objects can emerge from selection in biology. Parallels between assembly practice in industrial production and assembly theory in natural science are explained through constructs that are common to both, such as assembly index. Overall, analyses reported in the paper reveal that interactions between entropy and complexity underlie intractable challenges in creative production, from the production of individual products to the survival of companies. [ABSTRACT FROM AUTHOR]

The quiet-time solar wind electrons feature non-thermal characteristics when viewed from the perspective of their velocity distribution functions. They typically have an appearance of being composed of a denser thermal "core" population plus a tenuous energetic "halo" population. At first, such a feature was empirically fitted with the kappa velocity space distribution function, but ever since the ground-breaking work by Tsallis, the space physics community has embraced the potential implication of the kappa distribution as reflecting the non-extensive nature of the space plasma. From the viewpoint of microscopic plasma theory, the formation of the non-thermal electron velocity distribution function can be interpreted in terms of the plasma being in a state of turbulent quasi-equilibrium. Such a finding brings forth the possible existence of a profound inter-relationship between the non-extensive statistical state and the turbulent quasi-equilibrium state. The present paper further develops the idea of solar wind electrons being in the turbulent equilibrium, but, unlike the previous model, which involves the electrostatic turbulence near the plasma oscillation frequency (i.e., Langmuir turbulence), the present paper considers the impact of transverse electromagnetic turbulence, particularly, the turbulence in the whistler-mode frequency range. It is found that the coupling of spontaneously emitted thermal fluctuations and the background turbulence leads to the formation of a non-thermal electron velocity distribution function of the type observed in the solar wind during quiet times. This demonstrates that the whistler-range turbulence represents an alternative mechanism for producing the kappa-like non-thermal distribution, especially close to the Sun and in the near-Earth space environment. [ABSTRACT FROM AUTHOR]

This paper shows that the empirical distribution of cross-sectional analyst coverage in China's stock markets follows an exponential law in a given month from 2011 to 2020. The findings hold in both the emerging (Shanghai) and the developed market (Hong Kong). Moreover, the unique distribution parameter (i.e., mean) is directly related to the amount of market-wide information. Average analyst coverage exhibits a significant negative predictive power for stock-market uncertainty, highlighting the role of security analysts in diminishing the total uncertainty. The exponential law can be derived from the maximum entropy principle (MEP). When analysts, who are constrained by average ability in generating information (i.e., the first-order moment), strive to maximize the amount of market-wide information, this objective yields the exponential distribution. Contrary to the conventional wisdom that security analysts specialize in the generation of firm-specific information, empirical findings suggest that analysts primarily produce market-wide information for 25 countries. Nevertheless, it remains unclear why cross-sectional analyst coverage reflects market-wide information, this paper provides an entropy-based explanation. [ABSTRACT FROM AUTHOR]

Network attack and defence games are gradually becoming a new approach through which to study the protection of infrastructure networks such as power grids and transportation networks. Uncertainty factors, such as the subjective decision preferences of attackers and defenders, are not considered in existing attack and defence game studies for infrastructure networks. In this paper, we introduce, respectively, the attacker's and defender's expectation value, rejection value, and hesitation degree of the target, as well as construct an intuitionistic fuzzy goal-based attack and defence game model for infrastructure networks that are based on the maximum connectivity slice size, which is a network performance index. The intuitionistic fuzzy two-player, zero-sum game model is converted into a linear programming problem for solving, and the results are analysed to verify the applicability and feasibility of the model proposed in this paper. Furthermore, different situations, such as single-round games and multi-round repeated games, are also considered. The experimental results show that, when attacking the network, the attacker rarely attacks the nodes with higher importance in the network, but instead pays more attention to the nodes that are not prominent in the network neutrality and median; meanwhile, the defender is more inclined to protect the more important nodes in the network to ensure the normal performance of the network. [ABSTRACT FROM AUTHOR]

Federated learning, as one of the three main technical routes for privacy computing, has been widely studied and applied in both academia and industry. However, malicious nodes may tamper with the algorithm execution process or submit false learning results, which directly affects the performance of federated learning. In addition, learning nodes can easily obtain the global model. In practical applications, we would like to obtain the federated learning results only by the demand side. Unfortunately, no discussion on protecting the privacy of the global model is found in the existing research. As emerging cryptographic tools, the zero-knowledge virtual machine (ZKVM) and homomorphic encryption provide new ideas for the design of federated learning frameworks. We have introduced ZKVM for the first time, creating learning nodes as local computing provers. This provides execution integrity proofs for multi-class machine learning algorithms. Meanwhile, we discuss how to generate verifiable proofs for large-scale machine learning tasks under resource constraints. In addition, we implement the fully homomorphic encryption (FHE) scheme in ZKVM. We encrypt the model weights so that the federated learning nodes always collaborate in the ciphertext space. The real results can be obtained only after the demand side decrypts them using the private key. The innovativeness of this paper is demonstrated in the following aspects: 1. We introduce the ZKVM for the first time, which achieves zero-knowledge proofs (ZKP) for machine learning tasks with multiple classes and arbitrary scales. 2. We encrypt the global model, which protects the model privacy during local computation and transmission. 3. We propose and implement a new federated learning framework. We measure the verification costs under different federated learning rounds on the IRIS dataset. Despite the impact of homomorphic encryption on computational accuracy, the framework proposed in this paper achieves a satisfactory 90% model accuracy. Our framework is highly secure and is expected to further improve the overall efficiency as cryptographic tools continue to evolve. [ABSTRACT FROM AUTHOR]

The underground pressure disaster caused by the exploitation of deep mineral resources has become a major hidden danger restricting the safe production of mines. Microseismic monitoring technology is a universally recognized means of underground pressure monitoring and early warning. In this paper, the wavelet coefficient threshold denoising method in the time–frequency domain, STA/LTA method, AIC method, and skew and kurtosis method are studied, and the automatic P-phase-onset-time-picking model based on noise reduction and multiple detection indexes is established. Through the effect analysis of microseismic signals collected by microseismic monitoring system of coral Tungsten Mine in Guangxi, automatic P-phase onset time picking is realized, the reliability of the P-phase-onset-time-picking method proposed in this paper based on noise reduction and multiple detection indexes is verified. The picking accuracy can still be guaranteed under the severe signal interference of background noise, power frequency interference and manual activity in the underground mine, which is of great significance to the data processing and analysis of microseismic monitoring. [ABSTRACT FROM AUTHOR]