10,517 results on '"Principle of maximum entropy"'
Search Results
2. Method of Expansion of Mathematical Tools of the Reliability Theory Due to the Properties of Stochastic Theory of Similarity
- Author
-
Efimenko, Sergei, Smetankin, Anatolii, Liashenko, Aleksandr, Arutiunian, Melania, Chernorutsky, Igor, Kolesnichenko, Sergei, Kacprzyk, Janusz, Series Editor, Gomide, Fernando, Advisory Editor, Kaynak, Okyay, Advisory Editor, Liu, Derong, Advisory Editor, Pedrycz, Witold, Advisory Editor, Polycarpou, Marios M., Advisory Editor, Rudas, Imre J., Advisory Editor, Wang, Jun, Advisory Editor, Arseniev, Dmitry G., editor, and Aouf, Nabil, editor
- Published
- 2023
- Full Text
- View/download PDF
3. Parameter Estimation of the Dirichlet Distribution Based on Entropy.
- Author
-
Şahin, Büşra, Evren, Atıf Ahmet, Tuna, Elif, Şahinbaşoğlu, Zehra Zeynep, and Ustaoğlu, Erhan
- Subjects
- *
PARAMETER estimation , *ENTROPY , *CONTINGENCY tables , *MAXIMUM likelihood statistics , *MOMENTS method (Statistics) , *MULTINOMIAL distribution , *MAXIMUM entropy method - Abstract
The Dirichlet distribution as a multivariate generalization of the beta distribution is especially important for modeling categorical distributions. Hence, its applications vary within a wide range from modeling cell probabilities of contingency tables to modeling income inequalities. Thus, it is commonly used as the conjugate prior of the multinomial distribution in Bayesian statistics. In this study, the parameters of a bivariate Dirichlet distribution are estimated by entropy formalism. As an alternative to maximum likelihood and the method of moments, two methods based on the principle of maximum entropy are used, namely the ordinary entropy method and the parameter space expansion method. It is shown that in estimating the parameters of the bivariate Dirichlet distribution, the ordinary entropy method and the parameter space expansion method give the same results as the method of maximum likelihood. Thus, we emphasize that these two methods can be used alternatively in modeling bivariate and multinomial Dirichlet distributions. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
4. Application of generalised equivalent extreme-value event in structural system reliability analysis.
- Author
-
Wang, Tao, Fan, Wenliang, Ang, Alfredo H.-S., and Li, Zhengliang
- Subjects
- *
STRUCTURAL reliability , *MAXIMUM entropy method , *SYSTEM failures , *FIX-point estimation , *RELIABILITY in engineering , *MATHEMATICAL transformations , *FAILURE analysis , *MAXIMUM principles (Mathematics) - Abstract
To alleviate the difficulty of combination explosion, in this work, a generalised equivalent extreme-value event is presented to the problem of multi-component simultaneous failure in system reliability analysis, where m components in total l components are failed simultaneously. Firstly, the generalised equivalent extreme-value event is formulated with rigorous mathematical derivation for single boundary problem. Secondly, based on a mathematical transformation, the generalised equivalent extreme-value event is extended to double boundaries problem. Thirdly, by introducing the point estimation method (PEM) and the principle of maximum entropy to calculate the first four-order statistical moments and the failure probability of the equivalent performance function, an easy-to-implement method is proposed, which is capable of solving the multi-component simultaneous failure problem of static and dynamic systems. Finally, the feasibility of the proposed method is verified through a mathematical example and two engineering examples. The comparison to the Monte Carlo simulation shows that the proposed method is of high precision and high efficiency. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
5. An entropy and copula-based framework for streamflow prediction and spatio-temporal identification of drought.
- Author
-
Ju, Xiaopei, Wang, Dong, Wang, Yuankun, Singh, Vijay P., Xu, Pengcheng, Zhang, Along, Wu, Jichun, Ma, Tao, Liu, Jiufu, and Zhang, Jianyun
- Subjects
- *
MAXIMUM entropy method , *MARGINAL distributions , *STREAMFLOW , *DROUGHTS , *PERSONAL computer performance , *TROPICAL cyclones - Abstract
Reliable and easy-to-implement predictions of hydrometeorological variables are important for policymaking and public security. In this study, we developed a probabilistic framework for the description of hydrometeorological high-dimensional dependence and prediction by first-time coupling the principle of maximum entropy (POME) with C-vine copulas (PC). Two case studies with different emphases were investigated to evaluate the application of the PC framework. In the first case, we tested the PC framework based on a one-month-ahead streamflow forecast at the outlet station of the Jinsha River Basin. Results indicated that: (1) the marginal probability distributions or margins derived from optimal-moment-based POME best represented the current state of knowledge compared with those from traditional parametric distributions, and (2) the PC framework produced more skillful forecasts than did the traditional parametric C-vine (TC) and three data-driven models. The second case verified the performance of the PC framework in nationwide summer drought identification. Results of visual comparison of two typical historical summer drought events indicated that the PC framework captured the spatio-temporal characteristics of droughts. The PC framework combines the respective advantages of POME and C-vine copulas, ensuring its potential in higher-dimensional hydrometeorological modeling and flexibility in extending to other fields. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
6. 基于Bootstrap 方法最大熵优化过采样算法.
- Author
-
雷天纲 and 陈刚
- Abstract
Copyright of Journal of Data Acquisition & Processing / Shu Ju Cai Ji Yu Chu Li is the property of Editorial Department of Journal of Nanjing University of Aeronautics & Astronautics and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
- Published
- 2023
- Full Text
- View/download PDF
7. NaRnEA: An Information Theoretic Framework for Gene Set Analysis.
- Author
-
Griffin, Aaron T., Vlahos, Lukas J., Chiuzan, Codruta, and Califano, Andrea
- Subjects
- *
MAXIMUM entropy method , *STATISTICAL accuracy , *GENES , *PROTEIN expression , *MASS spectrometry - Abstract
Gene sets are being increasingly leveraged to make high-level biological inferences from transcriptomic data; however, existing gene set analysis methods rely on overly conservative, heuristic approaches for quantifying the statistical significance of gene set enrichment. We created Nonparametric analytical-Rank-based Enrichment Analysis (NaRnEA) to facilitate accurate and robust gene set analysis with an optimal null model derived using the information theoretic Principle of Maximum Entropy. By measuring the differential activity of ~2500 transcriptional regulatory proteins based on the differential expression of each protein's transcriptional targets between primary tumors and normal tissue samples in three cohorts from The Cancer Genome Atlas (TCGA), we demonstrate that NaRnEA critically improves in two widely used gene set analysis methods: Gene Set Enrichment Analysis (GSEA) and analytical-Rank-based Enrichment Analysis (aREA). We show that the NaRnEA-inferred differential protein activity is significantly correlated with differential protein abundance inferred from independent, phenotype-matched mass spectrometry data in the Clinical Proteomic Tumor Analysis Consortium (CPTAC), confirming the statistical and biological accuracy of our approach. Additionally, our analysis crucially demonstrates that the sample-shuffling empirical null models leveraged by GSEA and aREA for gene set analysis are overly conservative, a shortcoming that is avoided by the newly developed Maximum Entropy analytical null model employed by NaRnEA. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
8. A principle of maximum entropy for the Navier–Stokes equations.
- Author
-
Chen, Gui-Qiang G., Glimm, James, and Said, Hamid
- Subjects
- *
MAXIMUM entropy method , *NAVIER-Stokes equations , *VISCOUS flow , *THERMODYNAMIC equilibrium , *BOUSSINESQ equations - Abstract
A principle of maximum entropy is proposed in the context of viscous incompressible flow in Eulerian coordinates. The relative entropy functional, defined over the space of L 2 divergence-free velocity fields, is maximized relative to alternate measures supported over the energy–enstrophy surface. Since thermodynamic equilibrium distributions are characterized by maximum entropy, connections are drawn with stationary statistical solutions of the incompressible Navier–Stokes equations. Special emphasis is on the correspondence with the final statistics described by Kolmogorov's theory of fully developed turbulence. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
9. Parameter Estimation of the Dirichlet Distribution Based on Entropy
- Author
-
Büşra Şahin, Atıf Ahmet Evren, Elif Tuna, Zehra Zeynep Şahinbaşoğlu, and Erhan Ustaoğlu
- Subjects
Dirichlet distribution ,principle of maximum entropy ,ordinary entropy method ,parameter space expansion method ,method of moments ,maximum likelihood estimation ,Mathematics ,QA1-939 - Abstract
The Dirichlet distribution as a multivariate generalization of the beta distribution is especially important for modeling categorical distributions. Hence, its applications vary within a wide range from modeling cell probabilities of contingency tables to modeling income inequalities. Thus, it is commonly used as the conjugate prior of the multinomial distribution in Bayesian statistics. In this study, the parameters of a bivariate Dirichlet distribution are estimated by entropy formalism. As an alternative to maximum likelihood and the method of moments, two methods based on the principle of maximum entropy are used, namely the ordinary entropy method and the parameter space expansion method. It is shown that in estimating the parameters of the bivariate Dirichlet distribution, the ordinary entropy method and the parameter space expansion method give the same results as the method of maximum likelihood. Thus, we emphasize that these two methods can be used alternatively in modeling bivariate and multinomial Dirichlet distributions.
- Published
- 2023
- Full Text
- View/download PDF
10. The M/G/1 retrial queue: An information theoretic approach
- Author
-
Conesa, David V., Artalejo Rodríguez, Jesús Manuel, López Herrero, María Jesús, Conesa, David V., Artalejo Rodríguez, Jesús Manuel, and López Herrero, María Jesús
- Abstract
In this paper, we give a survey of the use of information theoretic techniques for the estimation of the main performance characteristics of the M/G/1 retrial queue. We focus on the limiting distribution of the system state, the length of a busy period and the waiting time. Numerical examples are given to illustrate the accuracy of the maximum entropy estimations when they are compared versus the classical solutions., Depto. de Estadística y Ciencia de los Datos, Fac. de Estudios Estadísticos, TRUE, pub
- Published
- 2024
11. The entropy approach to adjusting the life table, case study: Iran\'s life table
- Author
-
Rezvan Rezaei and Gholamhossein Yari
- Subjects
survival analysis ,information theory ,principle of maximum entropy ,principle of minimum kullback-liebler ,life table. ,Mathematics ,QA1-939 - Abstract
Survival analysis, and in particular survival distribution estimation, are important issues in the statistical sciences. Various parametric and nonparametric methods have been proposed to estimate the survival distribution. In this respect, the theoretical survival distributions are specified and their parameters are obtained by methods such as the maximum likelihood estimator and the Bayesian estimator and we can mention to nonparametric methods such as the Kaplan-Meier method, Cox regression and the life table. In addition, another important issue in survival analysis, especially in actuarial and biostatistics, is graduation of data for which smoothness and goodness of fit are two fundamental requirements.On the other hand, in the probability theory, there are two basic approaches to estimate probability distributions by using the concept of entropy: Maximum Entropy Principle (ME) and Minimum Kullback-Leibler Principle (MKL) or Minimum Cross Entropy Principle. In this paper, we examine the approach of the above two optimization models to estimate survival and probability distributions, especially for the classification of the data. In these studies, in addition to investigating parametric models, in order to achieve a compromise between the conditions of smoothness and goodness of fit, we apply a new entropy optimization model by defining an objective function combined from both of the two above principles and adjusting a coefficient that is used to ensure the degree of goodness of fitting and smoothing the estimates, as well as to show their priority in the classification of the data. We use this model to estimate the mortality probability distribution, particularly the column related to the mortality probability of a certain age ( qx) in life table. Finally, with the help of this method, we set the life table for Iranian women and men in 2011../files/site1/files/72/8Abstract.pdf
- Published
- 2021
12. A computational probabilistic procedure to quantify the time of breast cancer recurrence after chemotherapy administration.
- Author
-
Burgos, Clara, Cortés, Juan Carlos, Díez-Domingo, Sergio., López-Navarro, Elena, Villanueva-Tarazona, Jose, and Villanueva, Rafael Jacinto
- Subjects
- *
MAXIMUM entropy method , *LINEAR differential equations , *CANCER chemotherapy , *ADJUVANT chemotherapy , *PROBABILITY density function - Abstract
We propose a random linear differential equation with jumps to model the dynamics of breast tumor growth using real patients' data. The model considers the effect of chemotherapy administration and tumor resection. Also, the inherent randomness of the data and the model are taken into account. The model is probabilistically solved by combining two main methods belonging to Uncertainty Quantification: the principle of maximum entropy (PME) and the random variable transformation technique (RVT). The PME is applied to assign proper probability distributions to model parameters. The RVT technique is used to determine the probability density function (PDF) of the solution of the random differential equation, which is a stochastic process. We apply computational optimization techniques to determine the PDF of model parameters so that the PDF of the solution matches the ones assigned to real patients' data. Once random tumor dynamics has been modeled, we simulate, after surgery, different adjuvant chemotherapy strategies with the aim of delaying tumor recurrence as long as possible. Results are in concordance with medical literature, and tumor relapse is delayed as more cycles of chemotherapy are administered. Although the proposed model has a common general structure, it is shown how it can be customized to patients in order to construct projections about the tumor's growth. To better illustrate the applicability of the proposed approach, we carefully show how our model can be tailored to two real patients treated at the Hospital Clínico de Valencia (Spain). The obtained results have been overseen by doctors from this hospital. • Breast tumor growth is modeled via random differential equation with jumps. • Chemotherapy administrations and tumor resection are included in the model. • Random variable transformation technique and principle of maximum entropy are combined. • Real patient data of tumor volume are used to calibrate random model parameters. • Adjuvant chemotherapy strategies are simulated to delay tumor relapse. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
13. Probabilistic analysis of the steady state of weakly perturbed linear oscillators subject to a class of Gaussian inputs.
- Author
-
Cortés, J.-C., Romero, J.-V., Roselló, M.-D., and Valencia Sullca, J.F.
- Subjects
- *
NONLINEAR oscillators , *HARMONIC oscillators , *PROBABILITY density function , *DUFFING equations , *GAUSSIAN processes - Abstract
This paper aims to probabilistically study a class of nonlinear oscillator subject to weak perturbations and driven by stationary zero-mean Gaussian stochastic processes. For the sake of generality in the analysis, we assume that the perturbed term is a polynomial of arbitrary degree in the spatial position, that contains, as a particular case, the important case of the Duffing equation. We then take advantage of the so-called stochastic equivalent linearization technique to construct an equivalent linear model so that its behavior consistently approximates, in the mean-square sense, that of the nonlinear oscillator. This approximation allows us to take extensive advantage of the probabilistic properties of the solution of the linear model and its first mean-square derivative to construct reliable approximations of the main statistical moments of the steady state. From this key information, we then apply the principle of maximum entropy to construct approximations of the probability density function of the steady state. We illustrate the superiority of the equivalent linearization technique over the perturbation method through some examples. • A family of nonlinear stochastic oscillators is studied. • Stochastic equivalent linearization and maximum entropy methods are combined. • Mean, variance and all higher moments of the solution are calculated. • An approximation of the stationary probability density function is computed. • Gaussian excitations are considered in examples. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
14. NaRnEA: An Information Theoretic Framework for Gene Set Analysis
- Author
-
Aaron T. Griffin, Lukas J. Vlahos, Codruta Chiuzan, and Andrea Califano
- Subjects
gene set analysis ,principle of maximum entropy ,nonparametric statistics ,protein activity ,regulatory networks ,Science ,Astrophysics ,QB460-466 ,Physics ,QC1-999 - Abstract
Gene sets are being increasingly leveraged to make high-level biological inferences from transcriptomic data; however, existing gene set analysis methods rely on overly conservative, heuristic approaches for quantifying the statistical significance of gene set enrichment. We created Nonparametric analytical-Rank-based Enrichment Analysis (NaRnEA) to facilitate accurate and robust gene set analysis with an optimal null model derived using the information theoretic Principle of Maximum Entropy. By measuring the differential activity of ~2500 transcriptional regulatory proteins based on the differential expression of each protein’s transcriptional targets between primary tumors and normal tissue samples in three cohorts from The Cancer Genome Atlas (TCGA), we demonstrate that NaRnEA critically improves in two widely used gene set analysis methods: Gene Set Enrichment Analysis (GSEA) and analytical-Rank-based Enrichment Analysis (aREA). We show that the NaRnEA-inferred differential protein activity is significantly correlated with differential protein abundance inferred from independent, phenotype-matched mass spectrometry data in the Clinical Proteomic Tumor Analysis Consortium (CPTAC), confirming the statistical and biological accuracy of our approach. Additionally, our analysis crucially demonstrates that the sample-shuffling empirical null models leveraged by GSEA and aREA for gene set analysis are overly conservative, a shortcoming that is avoided by the newly developed Maximum Entropy analytical null model employed by NaRnEA.
- Published
- 2023
- Full Text
- View/download PDF
15. Parameters Estimation of Extended Burr XII Distribution Using Principle of Maximum Entropy based on K-Records.
- Author
-
Salmasi, M. Rajaei
- Subjects
- *
MAXIMUM entropy method , *MONTE Carlo method , *PARAMETER estimation , *KALMAN filtering - Abstract
In this paper a new method of parameter estimation was employed for extended Burr XII parameters using the principle of maximum entropy (POME) based on k-record values. Exact solutions for expectations were obtained. Monte Carlo simulation method were applied to assess the performance of this method. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
16. 基于改进统计矩点估计法和最大熵原理的 结构整体可靠度分析.
- Author
-
王 涛, 李正良, and 范文亮
- Abstract
Copyright of Engineering Mechanics / Gongcheng Lixue is the property of Engineering Mechanics Editorial Department and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
- Published
- 2022
- Full Text
- View/download PDF
17. Maximum Entropy Calculations for the Probabilistic Description Logic
- Author
-
Wilhelm, Marco, Kern-Isberner, Gabriele, Hutchison, David, Editorial Board Member, Kanade, Takeo, Editorial Board Member, Kittler, Josef, Editorial Board Member, Kleinberg, Jon M., Editorial Board Member, Mattern, Friedemann, Editorial Board Member, Mitchell, John C., Editorial Board Member, Naor, Moni, Editorial Board Member, Pandu Rangan, C., Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Terzopoulos, Demetri, Editorial Board Member, Tygar, Doug, Editorial Board Member, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Lutz, Carsten, editor, Sattler, Uli, editor, Tinelli, Cesare, editor, Turhan, Anni-Yasmin, editor, and Wolter, Frank, editor
- Published
- 2019
- Full Text
- View/download PDF
18. Counting Strategies for the Probabilistic Description Logic Under the Principle of Maximum Entropy
- Author
-
Wilhelm, Marco, Kern-Isberner, Gabriele, Ecke, Andreas, Baader, Franz, Hutchison, David, Editorial Board Member, Kanade, Takeo, Editorial Board Member, Kittler, Josef, Editorial Board Member, Kleinberg, Jon M., Editorial Board Member, Mattern, Friedemann, Editorial Board Member, Mitchell, John C., Editorial Board Member, Naor, Moni, Editorial Board Member, Pandu Rangan, C., Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Terzopoulos, Demetri, Editorial Board Member, Tygar, Doug, Editorial Board Member, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Calimeri, Francesco, editor, Leone, Nicola, editor, and Manna, Marco, editor
- Published
- 2019
- Full Text
- View/download PDF
19. A equivalencia entre o Princípio de Maximização de Entropia e o Principio de Minimização de Energia.
- Author
-
Willig Lima, Nathan and Duarte, Sergio
- Subjects
- *
THERMODYNAMIC laws , *THERMODYNAMICS , *ENTROPY , *PROBLEM solving , *EQUILIBRIUM , *TEXTBOOKS , *MAXIMUM entropy method , *THERMODYNAMIC functions - Abstract
In this paper, we present Gibbs' original discussion on the equivalence between equilibrium conditions, i.e., a maximum entropy condition for a given energy and the minimum energy condition for a given entropy - which are presented as theorems by the author. Next, we show how such a discussion appears in contemporary textbooks that present Thermodynamics from its laws (law zero plus the three laws). We compare this presentation with the discussion made by Callen, in his postulational approach to Thermodynamics. We show that part of Gibbs' discussion has been lost even in textbooks dealing with the laws. Furthermore, we argue that Callen's approach does not emphasize the fact that although the principles are the same, thermalizing a system composed of distinct processes (one with constant energy and the other with constant temperature) leads to different temperature values. In addition to solving the problem analytically, we present a graphical analysis of the problem. At the end, we discuss implications for thermodynamics teaching. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF
20. Automatic Image Thresholding Based on Shannon Entropy Difference and Dynamic Synergic Entropy
- Author
-
Yaobin Zou, Jinyu Zhang, Manish Upadhyay, Shuifa Sun, and Tingyao Jiang
- Subjects
Automatic thresholding ,principle of maximum entropy ,Shannon entropy difference ,dynamic synergic entropy ,Electrical engineering. Electronics. Nuclear engineering ,TK1-9971 - Abstract
An automatic thresholding method based on Shannon entropy difference and dynamic synergic entropy is proposed to select a reasonable threshold from the gray level image with a unimodal, bimodal, multimodal, or peakless gray level histogram. Firstly, a new concept called Shannon entropy difference is proposed, and the stopping condition of a multi-scale multiplication transformation is automatically controlled by maximizing Shannon entropy difference to produce edge images. Secondly, the gray level image is thresholded by the gray levels in order from smallest to largest to generate a series of binary images, followed by extracting contour images from the binary images. Then, a series of gray level histograms that can dynamically reflect gray level distributions and pixel positions are constructed using the edge images and the contour images synergically. Finally, dynamic synergic Shannon entropy is calculated from this series of gray level histograms, and the threshold corresponding to maximum dynamic synergic entropy is taken as the final segmentation threshold. The experimental results on 40 synthetic images and 50 real-world images show that, although the proposed method is not superior to 8 automatic segmentation methods in computational efficiency, it has more flexible adaptivity of selecting threshold and better segmentation accuracy.
- Published
- 2020
- Full Text
- View/download PDF
21. Correcting false discovery rates for their bias toward false positives.
- Author
-
Bickel, David R. and Rahal, Abbas
- Subjects
- *
FALSE discovery rate , *MAXIMUM entropy method , *ERROR rates - Abstract
The way false discovery rates (FDRs) are used in the analysis of genomics data leads to excessive false positive rates. In this sense, FDRs overcorrect for the excessive conservatism (bias toward false negatives) of methods of adjusting p values that control a family-wise error rate. Estimators of the local FDR (LFDR) are much less biased but have not been widely adopted due to their high variance and lack of availability in software. To address both issues, we propose estimating the LFDR by correcting an estimated FDR or the level at which an FDR is controlled. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
22. Adaptive Maximum Entropy Graph-Guided Fast Locality Discriminant Analysis
- Author
-
Rong Wang, Feiping Nie, Xuelong Li, and Xiaowei Zhao
- Subjects
Computer science ,Principle of maximum entropy ,Dimensionality reduction ,Linear discriminant analysis ,Synthetic data ,Computer Science Applications ,Human-Computer Interaction ,Data point ,Control and Systems Engineering ,Robustness (computer science) ,Bipartite graph ,Electrical and Electronic Engineering ,Algorithm ,Software ,Subspace topology ,Information Systems - Abstract
Linear discriminant analysis (LDA) aims to find a low-dimensional space in which data points in the same class are to be close to each other while keeping data points from different classes apart. To improve the robustness of LDA to non-Gaussian distribution data, most existing discriminant analysis methods extend LDA by approximating the underlying manifold of data. However, these methods suffer from the following problems: 1) local affinity or reconstruction coefficients are learned on the basis of the relationships of all data pairs, which would lead to a sharp increase in the amount of computation and 2) they learn the manifold information in the original space, ignoring the interference of the noise and redundant features. Motivated by these challenges, this article represents a novel discriminant analysis model, called fast and adaptive locality discriminant analysis (FALDA), to improve the efficiency and robustness. First, with the anchor-based strategy, a bipartite graph of each class is constructed to characterize the local structure of data. Since the number of anchor points is far less than that of data points, learning of fuzzy membership relationships between data points and anchor points within each class can save training time. Second, a maximum entropy regularization is introduced to control the uniformity of the weights of graphs and avoid the trivial solution. Third, the above relationships are updated adaptively in the process of dimensionality reduction, which can suppress the interference of the noise and redundant features. Fourth, the whitening constraint is imposed on the projection matrix to remove the relevance between features and restrict the total scatter of data in the subspace. Last but not the least, data with complex distribution can be explicitly divided into sub-blocks according to the learned anchor points (or subclass center points). We test our proposed method on synthetic data, benchmark datasets, and imbalanced datasets. Promising experimental results demonstrate the success of this novel model.
- Published
- 2023
23. Energy landscape analysis elucidates the multistability of ecological communities across environmental gradients.
- Author
-
Suzuki, Kenta, Nakaoka, Shinji, Fukuda, Shinji, and Masuya, Hiroshi
- Subjects
- *
BIOLOGICAL extinction , *ECOSYSTEMS , *BIOTIC communities , *GUT microbiome , *MAXIMUM entropy method - Abstract
Compositional multistability is widely observed in multispecies ecological communities. Since differences in community composition often lead to differences in community function, understanding compositional multistability is essential to comprehend the role of biodiversity in maintaining ecosystems. In community assembly studies, it has long been recognized that the order and timing of species migration and extinction influence structure and function of communities. The study of multistability in ecology has focused on the change in dynamical stability across environmental gradients, and was developed mainly for low‐dimensional systems. As a result, methodologies for studying the compositional stability of empirical multispecies communities are not well developed. Here, we show that models previously used in ecology can be analyzed from a new perspective, the energy landscape, to unveil compositional stability in observational data. To show that our method can be applicable to real‐world ecological communities, we simulated assembly dynamics driven by population‐level processes, and show that results were mostly robust to different simulation assumptions. Our method reliably captured the change in the overall compositional stability of multispecies communities over environmental change, and indicated a small fraction of community compositions that may be channels for transitions between stable states. When applied to murine gut microbiota, our method showed the presence of two alternative states whose relationship changes with age, and suggested mechanisms by which aging affects the compositional stability of the murine gut microbiota. Our method provides a practical tool to study the compositional stability of communities in a changing world, and will facilitate empirical studies that integrate the concept of multistability from different fields. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
24. Geometrical assessment of internal instability potential of granular soils based on grading entropy.
- Author
-
Israr, Jahanzaib and Zhang, Gang
- Subjects
- *
SOIL granularity , *MAXIMUM entropy method , *ENTROPY , *PARTICLE size distribution , *PARTICULATE matter , *PARTICLE size determination - Abstract
Internal instability of a soil is closely related to its particle size distribution (PSD) that occurs when its coarser particles cannot protect the finer particles from erosion, thereby inducing permanent changes in its original PSD. This study proposes a new criterion based on grading entropy theory for prompt assessment of internal stability. PSD is discretized into several fractions to extract particle grading information through statistical analysis. Two normalized variables: base entropy ( h 0 ) and entropy increment ( Δ h ) are determined directly from the PSD curve, and the principle of maximum entropy is used to obtain a semi-ellipse within plane formed by h 0 and Δ h , wherein a PSD can be simply expressed as a point. A clear boundary between stable and unstable soils is visualized at maximum Δ h line, which is used to correctly evaluate a large published experimental dataset and its performance is compared with the existing criteria. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
25. Uncertainty Quantification of Random Microbial Growth in a Competitive Environment via Probability Density Functions.
- Author
-
Bevia, Vicente José, Simón, Clara Burgos, Cortés, Juan Carlos, and Micó, Rafael J. Villanueva
- Subjects
- *
VOLUMETRIC analysis , *CELL populations , *MICROBIAL growth , *MICROBIAL development , *DENSITY functionals - Abstract
The Baranyi--Roberts model describes the dynamics of the volumetric densities of two interacting cell populations. We randomize this model by considering that the initial conditions are random variables whose distributions are determined by using sample data and the principle of maximum entropy. Subsequenly, we obtain the Liouville--Gibbs partial differential equation for the probability density function of the two-dimensional solution stochastic process. Because the exact solution of this equation is unaffordable, we use a finite volume scheme to numerically approximate the aforementioned probability density function. From this key information, we design an optimization procedure in order to determine the best growth rates of the Baranyi--Roberts model, so that the expectation of the numerical solution is as close as possible to the sample data. The results evidence good fitting that allows for performing reliable predictions. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
26. A full probabilistic analysis of a randomized kinetic model for reaction–deactivation of hydrogen peroxide decomposition with applications to real data.
- Author
-
Cortés, J.-C., Navarro-Quiles, A., Romero, J.-V., and Roselló, M.-D.
- Subjects
- *
HYDROGEN peroxide , *MAXIMUM entropy method , *PROBABILITY density function , *RANDOM variables , *NONLINEAR differential equations - Abstract
The classical kinetic equation has been broadly used to describe reaction and deactivation processes in chemistry. The mathematical formulation of this deterministic nonlinear differential equation depends on reaction and deactivation rate constants. In practice, these rates must be calculated via laboratory experiments, hence involving measurement errors. Therefore, it is more realistic to treat these rates as random variables rather than deterministic constants. This leads to the randomization of the kinetic equation, and hence its solution becomes a stochastic process. In this paper we address the probabilistic analysis of a randomized kinetic model to describe reaction and deactivation by catalase of hydrogen peroxide decomposition at a given initial concentration. In the first part of the paper, we determine closed-form expressions for the probability density functions of important quantities of the aforementioned chemical process (the fractional conversion of hydrogen peroxide, the time until a fixed quantity of this fractional conversion is reached and the activity of the catalase). These expressions are obtained by taking extensive advantage of the so called Random Variable Transformation technique. In the second part, we apply the theoretical results obtained in the first part together with the principle of maximum entropy to model the hydrogen peroxide decomposition and aspergillus niger catalase deactivation using real data excerpted from the recent literature. Our results show full agreement with previous reported analysis but having as additional benefit that they provide a more complete description of both model inputs and outputs since we take into account the intrinsic uncertainties involved in modelling process. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
27. Region growing segmentation optimized by evolutionary approach and Maximum Entropy.
- Author
-
Merzougui, Mohammed and Allaoui, Ahmad El
- Subjects
MAXIMUM entropy method ,EVOLUTIONARY algorithms ,ENTROPY (Information theory) ,QUALITY control - Abstract
In this paper, we propose a segmentation method based on region growing and evolutionary algorithms. Before segmentation, the number of classes is determined by the principle of maximum entropy. The proposed approach is validated on some synthetic and real images and, it shows to be very interesting as decision support in quality control. [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF
28. New General Maximum Entropy Model for Flow Through Porous Media.
- Author
-
Lofrano, Fábio Cunha, Morita, Dione Mari, Kurokawa, Fernando Akira, and de Souza, Podalyro Amaral
- Subjects
POROUS materials ,MAXIMUM entropy method ,ENTROPY ,NAVIER-Stokes equations ,FLOW velocity ,FLOW visualization ,DISTRIBUTION (Probability theory) - Abstract
New experimental and numerical techniques constitute the major recent advancements in the study of flow through porous media. However, a model that duly links the micro- and macroscales of this phenomenon is still lacking. Therefore, the present work describes a new, analytical model suitable for both Darcian and post-Darcian flow. Unlike its predecessors, most of which are based on empirical assessments or on some derivation of the Navier–Stokes equations, the presented model employed the principle of maximum entropy, along with a reduced number of premises. Nevertheless, it is compatible with classic expressions, such as Darcy's and Forchheimer's laws. Also, great adherence to previously published experimental results was observed. Moreover, the developed model allows for the delimitation of Darcian and post-Darcian regimes. It enabled the determination of a probabilistic distribution function of flow velocities within the pore space. Further, it bestowed richer interpretations of the physical meanings of principal flow parameters. Finally, through a new quantity called the entropy parameter, the proposed model may serve as a bridge between experimental and numerical findings both at the micro- and macroscales. Therefore, the present research yielded an analytical, entropy-based model for flow through porous media that is sufficiently general and robust to be applied in several fields of knowledge. [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF
29. EntropyDB: a probabilistic approach to approximate query processing.
- Author
-
Orr, Laurel, Balazinska, Magdalena, and Suciu, Dan
- Abstract
We present, an interactive data exploration system that uses a probabilistic approach to generate a small, query-able summary of a dataset. Departing from traditional summarization techniques, we use the Principle of Maximum Entropy to generate a probabilistic representation of the data that can be used to give approximate query answers. We develop the theoretical framework and formulation of our probabilistic representation and show how to use it to answer queries. We then present solving techniques, give two critical optimizations to improve preprocessing time and query execution time, and explore methods to reduce query error. Lastly, we experimentally evaluate our work using a 5 GB dataset of flights within the USA and a 210 GB dataset from an astronomy particle simulation. While our current work only supports linear queries, we show that our technique can successfully answer queries faster than sampling while introducing, on average, no more error than sampling and can better distinguish between rare and nonexistent values. We also discuss extensions that can allow for data updates and linear queries over joins. [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF
30. Entropy and Wealth
- Author
-
Demetris Koutsoyiannis and G.-Fivos Sargentis
- Subjects
entropy ,wealth ,income distribution ,options ,potentiality ,principle of maximum entropy ,Science ,Astrophysics ,QB460-466 ,Physics ,QC1-999 - Abstract
While entropy was introduced in the second half of the 19th century in the international vocabulary as a scientific term, in the 20th century it became common in colloquial use. Popular imagination has loaded “entropy” with almost every negative quality in the universe, in life and in society, with a dominant meaning of disorder and disorganization. Exploring the history of the term and many different approaches to it, we show that entropy has a universal stochastic definition, which is not disorder. Hence, we contend that entropy should be used as a mathematical (stochastic) concept as rigorously as possible, free of metaphoric meanings. The accompanying principle of maximum entropy, which lies behind the Second Law, gives explanatory and inferential power to the concept, and promotes entropy as the mother of creativity and evolution. As the social sciences are often contaminated by subjectivity and ideological influences, we try to explore whether maximum entropy, applied to the distribution of a wealth-related variable, namely annual income, can give an objective description. Using publicly available income data, we show that income distribution is consistent with the principle of maximum entropy. The increase in entropy is associated to increases in society’s wealth, yet a standardized form of entropy can be used to quantify inequality. Historically, technology has played a major role in the development of and increase in the entropy of income. Such findings are contrary to the theory of ecological economics and other theories that use the term entropy in a Malthusian perspective.
- Published
- 2021
- Full Text
- View/download PDF
31. Uncertainty Quantification of Random Microbial Growth in a Competitive Environment via Probability Density Functions
- Author
-
Vicente José Bevia, Clara Burgos Simón, Juan Carlos Cortés, and Rafael J. Villanueva Micó
- Subjects
uncertainty quantification ,competitive stochastic model ,model simulation ,model prediction ,principle of maximum entropy ,optimization ,Thermodynamics ,QC310.15-319 ,Mathematics ,QA1-939 ,Analysis ,QA299.6-433 - Abstract
The Baranyi–Roberts model describes the dynamics of the volumetric densities of two interacting cell populations. We randomize this model by considering that the initial conditions are random variables whose distributions are determined by using sample data and the principle of maximum entropy. Subsequenly, we obtain the Liouville–Gibbs partial differential equation for the probability density function of the two-dimensional solution stochastic process. Because the exact solution of this equation is unaffordable, we use a finite volume scheme to numerically approximate the aforementioned probability density function. From this key information, we design an optimization procedure in order to determine the best growth rates of the Baranyi–Roberts model, so that the expectation of the numerical solution is as close as possible to the sample data. The results evidence good fitting that allows for performing reliable predictions.
- Published
- 2021
- Full Text
- View/download PDF
32. Constructing networks by filtering correlation matrices: a null model approach.
- Author
-
Sadamori Kojaku and Naoki Masuda
- Subjects
- *
THRESHOLDING algorithms , *MATRICES (Mathematics) , *MAXIMUM entropy method - Abstract
Network analysis has been applied to various correlation matrix data. Thresholding on the value of the pairwise correlation is probably the most straightforward and common method to create a network from a correlation matrix. However, there have been criticisms on this thresholding approach such as an inability to filter out spurious correlations, which have led to proposals of alternative methods to overcome some of the problems. We propose a method to create networks from correlation matrices based on optimization with regularization, where we lay an edge between each pair of nodes if and only if the edge is unexpected from a null model. The proposed algorithm is advantageous in that it can be combined with different types of null models. Moreover, the algorithm can select the most plausible null model from a set of candidate null models using a model selection criterion. For three economic datasets, we find that the configuration model for correlation matrices is often preferred to standard null models. For country-level product export data, the present method better predicts main products exported from countries than sample correlation matrices do. [ABSTRACT FROM AUTHOR]
- Published
- 2019
- Full Text
- View/download PDF
33. The luminosity function of quasars by the Principle of Maximum Entropy.
- Author
-
Andrei, Alexandre, Coelho, Bruno, Guedes, Leandro L S, and Lyra, Alexandre
- Abstract
We propose a different way to obtain the distribution of the luminosity function of quasars by using the Principle of Maximum Entropy. The input data come from Richard et al 2006 quasar counts, extending up to redshift 5 and limited from apparent magnitude i = 15–19.1 at z ≲ 3 to i = 20.2 for z ≳ 3. Using only few initial data points, the principle allows us to estimate probabilities and hence that luminosity curve. We carry out statistical tests to evaluate our results. The resulting luminosity function compares well to earlier determinations, and our results remain consistent either when the amount or choice of sampled sources is unbiasedly altered. Besides this, we estimate the distribution of the luminosity function for redshifts in which there is only observational data in the vicinity. [ABSTRACT FROM AUTHOR]
- Published
- 2019
- Full Text
- View/download PDF
34. Random fractional generalized Airy differential equations: A probabilistic analysis using mean square calculus.
- Author
-
Burgos, C., Cortés, J.-C., Debbouche, A., Villafuerte, L., and Villanueva, R.-J.
- Subjects
- *
DIFFERENTIAL equations , *CALCULUS , *RANDOM variables , *POWER series , *APPROXIMATION theory - Abstract
Abstract The aim of this paper is to study a generalization of fractional Airy differential equations whose input data (coefficient and initial conditions) are random variables. Under appropriate hypotheses assumed upon the input data, we construct a random generalized power series solution of the problem and then we prove its convergence in the mean square stochastic sense. Afterwards, we provide reliable explicit approximations for the main statistical information of the solution process (mean, variance and covariance). Further, we show a set of numerical examples where our obtained theory is illustrated. More precisely, we show that our results for the random fractional Airy equation are in full agreement with the corresponding to classical random Airy differential equation available in the extant literature. Finally, we illustrate how to construct reliable approximations of the probability density function of the solution stochastic process to the random fractional Airy differential equation by combining the knowledge of the mean and the variance and the Principle of Maximum Entropy. [ABSTRACT FROM AUTHOR]
- Published
- 2019
- Full Text
- View/download PDF
35. 基于自适应点估计和最大熵原理的 结构体系多构件可靠度分析.
- Author
-
李正良, 祖云飞, 范文亮, and 周擎宇
- Abstract
Copyright of Engineering Mechanics / Gongcheng Lixue is the property of Engineering Mechanics Editorial Department and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
- Published
- 2019
- Full Text
- View/download PDF
36. Region growing segmentation optimized by evolutionary approach and Maximum Entropy.
- Author
-
Merzougui, Mohammed and Allaoui, Ahmad El
- Subjects
EVOLUTIONARY algorithms ,ENTROPY (Information theory) ,QUALITY control ,MAXIMUM entropy method - Abstract
In this paper, we propose a segmentation method based on region growing and evolutionary algorithms. Before segmentation, the number of classes is determined by the principle of maximum entropy. The proposed approach is validated on some synthetic and real images and, it shows to be very interesting as decision support in quality control. [ABSTRACT FROM AUTHOR]
- Published
- 2019
- Full Text
- View/download PDF
37. Principle of maximum entropy for reliability analysis in the design of machine components.
- Author
-
Zhang, Yimin
- Abstract
We studied the reliability of machine components with parameters that follow an arbitrary statistical distribution using the principle of maximum entropy (PME). We used PME to select the statistical distribution that best fits the available information. We also established a probability density function (PDF) and a failure probability model for the parameters of mechanical components using the concept of entropy and the PME. We obtained the first four moments of the state function for reliability analysis and design. Furthermore, we attained an estimate of the PDF with the fewest human bias factors using the PME. This function was used to calculate the reliability of the machine components, including a connecting rod, a vehicle half-shaft, a front axle, a rear axle housing, and a leaf spring, which have parameters that typically follow a non-normal distribution. Simulations were conducted for comparison. This study provides a design methodology for the reliability of mechanical components for practical engineering projects. [ABSTRACT FROM AUTHOR]
- Published
- 2019
- Full Text
- View/download PDF
38. Reliability computation via a transformed mixed-degree cubature rule and maximum entropy
- Author
-
Shuang He, Yu Zhang, and Jun Xu
- Subjects
Moment (mathematics) ,Dimension (vector space) ,Applied Mathematics ,Modeling and Simulation ,Principle of maximum entropy ,Computation ,Applied mathematics ,Probability density function ,Divergence (statistics) ,Standard deviation ,Mathematics::Numerical Analysis ,Mathematics ,Exponential function - Abstract
Based on the maximum entropy method with fractional exponential moments, a new method is proposed for deriving the probability density function of the limit state function for reliability calculation. Since numerical evaluation of fractional exponential moments is of critical significance, a novel transformed mixed-degree cubature rule is developed. First, the integral related to fractional exponential moment evaluation is transformed over the standard normal space, where the cubature rule can be employed for the numerical evaluation. Then, the spherical and radial rules with different degrees are combined to formulate a novel mixed-degree cubature rule, where the sample size only increases linearly with the dimension. To further enhance and improve the precision, a rotational transformation is performed over the samples produced by the mixed-degree cubature rule to obtain a transformed cubature rule, in which a proper angle needs to be specified. A two-step strategy is then put forward to specify the appropriate angle in the transformed mixed-degree cubature rule, where the standard deviations of input variables and KullbackLeibler divergence are used to formulate the objective functions. The proposed approach is verified via a set of numerical examples involving different types of problems.
- Published
- 2022
39. Extending the analysis of the Euler–Bernoulli model for a stochastic static cantilever beam: Theory and simulations.
- Author
-
Cortés, Juan-Carlos, López-Navarro, Elena, Martínez-Rodríguez, Pablo, Romero, José-Vicente, and Roselló, María-Dolores
- Subjects
- *
PROBABILITY density function , *MONTE Carlo method , *MAXIMUM entropy method , *STOCHASTIC models , *RANDOM variables - Abstract
In this paper, we present a comprehensive probabilistic analysis of the deflection of a static cantilever beam based on Euler–Bernoulli's theory. For the sake of generality in our stochastic study, we assume that all model parameters (Young's modulus and the beam moment of inertia) are random variables with arbitrary probability densities, while the loads applied on the beam are described via a delta-correlated process. The probabilistic study is based on the calculation of the first probability density function of the solution and the probability density of other key quantities of interest, such as the shear force, and the bending moment, which are treated as random variables too. To conduct our study, we will first calculate the first moments of the solution, which is a stochastic process, and we then will take advantage of the Principle of Maximum Entropy. Furthermore, we will present an algorithm, based on Monte Carlo simulations, that allows us to simulate our analytical development computationally. The theoretical findings will be illustrated with numerical examples where different realistic probability distributions are assumed for each model random parameter. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
40. Maximum entropy copula for bivariate drought analysis.
- Author
-
Shekari, Marzieh, Zamani, Hossein, Bazrafshan, Ommolbanin, and Singh, Vijay P.
- Subjects
- *
DROUGHT management , *MAXIMUM entropy method , *MARGINAL distributions , *BIVARIATE analysis , *DISTRIBUTION (Probability theory) , *ENTROPY , *DROUGHTS - Abstract
Copula functions are widely used to derive multivariate probability distributions in hydrometeorology. One of the key steps in the copula method is the derivation of marginal distributions of individual variables which can be accomplished using the principle of maximum entropy where the distribution parameters are estimated from the specified constraints. This study, investigated two drought variables (severity and duration) by coupling the principle of maximum entropy with parametric and empirical copulas. So, homogeneous climatic zones were first identified by applying the fuzzy clustering method to data from 39 synoptic stations in Iran and then drought severity and duration were determined with the standardized precipitation index. These two variables were scaled and their marginal probability distribution functions were derived using the principle of maximum entropy as well as empirically. Then, the joint probability distribution of drought severity and duration was determined using maximum entropy-copula, and parametric and empirical copulas. Thereafter, bivariate conditional return periods were determined for each homogeneous region. Results showed that 1) univariate and bivariate distributions can be obtained by maximizing entropy; 2) the dependence structure via Spearman's rho, which directly affects the Lagrange parameters of entropy copula, was a controlling factor to optimize the objective function; 3) for a given set of constraints, the maximum entropy copula is independent of the types of marginals; 4)The entropy-entropy copula (with entropy marginals) is considered a better method than alternatives, because it has a similar result to the parametric methods while it only needs to fit a single model. • A Maximum entropy copula method is developed for bivariate drought analysis at homogenous regions of Iran. • The integration of maximum entropy and copula provides a useful method for modeling the dependence structure. • Conditional return period graphs are generated for four homogenous regions using severity and duration drought. • Conditional return period in region I, are significantly greater than other regions. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
41. Granulized Z-VIKOR Model for Failure Mode and Effect Analysis
- Author
-
Sankar K. Pal, Jhareswar Maiti, Ashish Garg, and Souvik Das
- Subjects
Mathematical optimization ,Applied Mathematics ,Principle of maximum entropy ,Risk measure ,Probabilistic logic ,Rough number ,02 engineering and technology ,Measure (mathematics) ,Computational Theory and Mathematics ,Similarity (network science) ,Artificial Intelligence ,Control and Systems Engineering ,Robustness (computer science) ,0202 electrical engineering, electronic engineering, information engineering ,020201 artificial intelligence & image processing ,Failure mode and effects analysis ,Mathematics - Abstract
In this study, we have developed an improved failure mode and effect analysis (FMEA) model by leveraging the concepts of Z-number, rough number (RN), and probabilistic distance measure. Two new concepts, namely, double upper approximated rough number (DUARN) and granulized Z-number (gZN), a new scheme for measuring distance between two gZNs using weighted similarity and average linkage method, a new risk prioritization model, named, granulized Z-VIKOR, and a scheme for uncertainty assessment using box-plot are proposed. DUARN embodies the notion of double sided upper approximation of an ordinal decision class. gZN is developed using Z-number and DUARN. The distance between two gZNs is computed using the maximum entropy principle that captures the relationship between the A (opinion) and B (reliability of A) parts of gZN. The granulized Z-VIKOR involves synergistic integration of gZN and VIKOR. Both objective and subjective risk measures are computed and a combined risk measure is defined, which considers the interactions among the risk criteria using λ-Shapley index. Two case studies are conducted. Sensitivity & comparative analysis is carried out to demonstrate the applicability, effectiveness and robustness of the proposed model, as well as its superiority to existing models.
- Published
- 2022
42. Band Sampling for Hyperspectral Imagery
- Author
-
Chein-I Chang
- Subjects
Signal processing ,Uniform distribution (continuous) ,Contextual image classification ,Computer science ,business.industry ,Principle of maximum entropy ,Sampling (statistics) ,Hyperspectral imaging ,Pattern recognition ,Information theory ,Compressed sensing ,General Earth and Planetary Sciences ,Artificial intelligence ,Electrical and Electronic Engineering ,business - Abstract
Band sampling (BSam) is an innovative concept for hyperspectral imaging, which is derived from signal sampling in communications/signal processing as well as sampling theory in information theory. It is quite different from band selection (BSel) in several aspects. First of all, BSam ``samples'' bands with a given fixed BSam rate (BSamR) as opposed to BSel, which ``selects'' appropriate bands according to the number of bands to be selected. Second, BSam requires no specific means of sampling bands compared to BSel, which requires a specific rule to select bands such as band prioritization (BP) criteria or band search strategies. Third, BSam samples bands without prior band knowledge or specific applications in contrast to BSel, which considers certain bands more significant than other bands according to various applications. Two strategies are developed for BSam. One is from information theory. Under a completely blind and unknown environment, the maximum entropy is achieved by the uniform distribution. This suggests that one best strategy for BSam is uniform band sampling (UBSam). Another strategy is random BSam (RBSam) analogous to random signal sampling in compressive sensing (CS) where the bands sampled by RBSam are random but are not deterministic like the bands selected by BSel. Interestingly, UBSam and RBSam generally perform better than custom-designed BSel methods. To illustrate its potential utility of BSam in various applications, target detection, anomaly detection, and image classification are studied through extensive experiments for demonstration.
- Published
- 2022
43. Unraveling Amazon tree community assembly using Maximum Information Entropy: a quantitative analysis of tropical forest ecology
- Author
-
Bruno Garcia Luize, Milton Tirado, Veridiana Vizoni Scudeller, Marcelo Brilhante de Medeiros, Toby Pennington, Juliana Schietti, Aurora Levesley, Bianca Weiss Albuquerque, Lourens Poorter, Hirma Ramírez-Angulo, Juan David Cardenas Revilla, Egleé L. Zent, Domingos de Jesus Rodrigues, Everton José Almeida, Pascal Petronelli, Maria Aparecida Lopes, Diego Correa, William Milliken, Daniel Praia Portela de Aguiar, James A. Comiskey, Ben Hur Marimon-Junior, Italo Mesones, Eurídice N. Honorio Coronado, Edelcilio Marques Barbosa, Joost F. Duivenvoorden, Susan G. Laurance, Marcos Silveira, Ires Paula de Andrade Miranda, Corine Vriesendorp, Doug Daly, Katia Regina Casula, Luisa Fernanda Casas, Erika Berenguer, Dário Dantas do Amaral, Rafael L. Assis, Jens Kattge, Juliana Stropp, Edwin Pos, Henrik Balslev, Paul J. M. Maas, Ophelia Wang, José Ferreira Ramos, Jon Lloyd, Marcelino Carneiro Guedes, Geertje M. F. van der Heijden, Fernanda Coelho de Souza, Walter Palacios Cuenca, Vitor Hugo Freitas Gomes, Timothy R. Baker, Leandro Valle Ferreira, Nicolás Castaño Arboleda, Jérôme Chave, Carolina V. Castilho, María Natalia Umaña, Roosevelt García-Villacorta, George Pepe Gallardo Gonzales, Luis Valenzuela Gamarra, Hilda Paulette Dávila Doza, José Renan da Silva Guimarães, Raquel Thomas-Caesar, Hans ter Steege, Hernán Castellanos, Nállarett Dávila, Lionel Hernández, Yuri Oliveira Feitosa, Julien Engel, Olaf Bánki, Ángela Cano, Luiz de Souza Coelho, Gerhard Boenisch, Priscila Souza, André Braga Junqueira, Jochen Schöngart, Juan Fernando Phillips, Cid Ferreira, Gonzalo Rivas-Torres, Kenneth R. Young, Agustín Rudas, Ademir Roberto Ruschel, Elvis H. Valderrama Sandoval, Cláudia Baider, Mariana Victória Irume, Terry W. Henkel, Márcia Cléia Vilela dos Santos, Marcelo Petratti Pansonato, Timothy J. Killeen, Daniel Villarroel, Neidiane Farias Costa Reis, Stanford Zent, Rafael de Paiva Salomão, Georgia Pickavance, Daniela Pauletto, Karina Garcia-Cabrera, Rainiellen de Sá Carpanedo, Émile Fonty, Daniel Sabatier, Ima Célia Guimarães Vieira, Janaina Barbosa Pedrosa Costa, Emilio Vilanova Torre, Maíra da Rocha, William E. Magnusson, Manuel Augusto Ahuite Reategui, Ricardo Zárate Gómez, Renato R. Hilário, Juan Ernesto Guevara, Alfredo F. Fuentes, Charles E. Zartman, Karina Melgaço, Layon Oreste Demarchi, Marcelo Trindade Nascimento, Diogenes de Andrade Lima Filho, Joseph E. Hawes, Janaina da Costa de Noronha, Maria Pires Martins, Larissa Cavalheiro, Miles R. Silman, Francisco Dallmeier, Evlyn Márcia Moraes de Leão Novo, Freddy Ramirez Arevalo, Luiz Carlos de Matos Bonates, Jos Barlow, Milena Holmgren, Carlos A. Peres, William F. Laurance, Casimiro Mendoza, Roderick Zagt, Percy Núñez Vargas, Juan Carlos Licona, Sasha Cárdenas, John Terborgh, Isau Huamantupa-Chuquimaco, Susamar Pansini, Ligia Estela Urrego Giraldo, Maria Teresa Fernandez Piedade, Ted R. Feldpausch, César I.A. Vela, Oliver L. Phillips, Marcelo de Jesus Veiga Carim, José Julio de Toledo, Therany Gonzales, Kenneth J. Feeley, Ana Andrade, Patricio von Hildebrand, Bonifacio Mostacedo, Henrique E. M. Nascimento, Linder Felipe Mozombite Pinto, Reynaldo Linares-Palomino, Joice Ferreira, Jean-François Molino, Adriana Prieto, Christopher Baraloto, Jean-Louis Guillaumet, Luzmila Arroyo, Alvaro Duque, Alfonso Alonso, Yadvinder Malhi, Carlos Cerón, Anthony Di Fiore, J. Sebastián Tello, Luciane Ferreira Barbosa, Fernando Cornejo Valverde, José Leonardo Lima Magalhães, Carolina Levis, Rodrigo Sierra, Nigel C. A. Pitman, Iêda Leão do Amaral, William Farfan-Rios, Flávia Rodrigues Barbosa, C Gerardo Aymard, Natalino Silva, Hugo Mogollón, Francisca Dionízia de Almeida Matos, Paul V. A. Fine, Bruno Barçante Ladvocat Cintra, Adriano Costa Quaresma, Florian Wittmann, Vincent A. Vos, José Luís Camargo, Fernanda Carvalho, Tinde van Andel, Rogério Gribel, Beatriz Schwantes Marimon, Roel J. W. Brienen, Juan Carlos Montero, Alberto Vicentini, Freddie Draper, Marcos Ríos Paredes, Abel Monteagudo Mendoza, Angelo Gilberto Manzatto, Adeilza Felipe Sampaio, Boris Eduardo Villa Zegarra, Armando Torres-Lezama, David A. Neill, E. M. Jimenez, Rodolfo Vasquez, Bruce Hoffman, Dairon Cárdenas López, Alejandro Araujo-Murakami, Eduardo Martins Venticinque, Thiago Sanna Freire Silva, Helder Lima de Queiroz, John Ethan Householder, Gabriel Damasco, Bernardo M. Flores, Kyle G. Dexter, Pablo R. Stevenson, Miguel Alexiades, Aline Lopes, Alexandre S. Oliveira, Nathan J. B. Kraft, Flávia R. C. Costa, Maria Cristina Peñuela Mora, Emanuelle de Sousa Farias, Jose L. Pena, Marcelo F. Simon, Thaise Emilio, Apollo - University of Cambridge Repository, Oliveira, Alexandre A [0000-0001-5526-8109], University of St Andrews. School of Geography & Sustainable Development, Utrecht University [Utrecht], Instituto Nacional de Pesquisas da Amazônia (INPA), EMBRAPA Amazônia Oriental, Botanique et Modélisation de l'Architecture des Plantes et des Végétations (UMR AMAP), Centre de Coopération Internationale en Recherche Agronomique pour le Développement (Cirad)-Centre National de la Recherche Scientifique (CNRS)-Institut de Recherche pour le Développement (IRD [France-Sud])-Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement (INRAE)-Université de Montpellier (UM), ONF - Direction régionale de la Guyane [Cayenne], and Office national des forêts (ONF)
- Subjects
0106 biological sciences ,Geography & travel ,Bioinformatics ,Ecology (disciplines) ,Entropy ,Forests ,Information theory ,010603 evolutionary biology ,01 natural sciences ,Computational biology ,thermodynamics and nonlinear dynamics ,Econometrics ,Life Science ,Bosecologie en Bosbeheer ,Stabilizing selection ,Relative abundance distribution ,Ecosystem ,ddc:910 ,Mathematics ,MCC ,Tropical Climate ,Multidisciplinary ,GE ,Ecology ,Principle of maximum entropy ,3rd-DAS ,Biodiversity ,15. Life on land ,Plants ,PE&RC ,Forest Ecology and Forest Management ,Biosystematiek ,Computational biology and bioinformatics ,Complex dynamics ,Quantitative analysis (finance) ,Wildlife Ecology and Conservation ,FOS: Biological sciences ,[SDE]Environmental Sciences ,Biosystematics ,Probability distribution ,Statistical physics ,GE Environmental Sciences ,010606 plant biology & botany - Abstract
Funding: Floristic identification in plots in the RAINFOR forest monitoring network have been supported by the Natural Environment Research Council (grants NE/B503384/1, NE/ D01025X/1, NE/I02982X/1, NE/F005806/1, NE/D005590/1 and NE/I028122/1) and the Gordon and Betty Moore Foundation. In a time of rapid global change, the question of what determines patterns in species abundance distribution remains a priority for understanding the complex dynamics of ecosystems. The constrained maximization of information entropy provides a framework for the understanding of such complex systems dynamics by a quantitative analysis of important constraints via predictions using least biased probability distributions. We apply it to over two thousand hectares of Amazonian tree inventories across seven forest types and thirteen functional traits, representing major global axes of plant strategies. Results show that constraints formed by regional relative abundances of genera explain eight times more of local relative abundances than constraints based on directional selection for specific functional traits, although the latter does show clear signals of environmental dependency. These results provide a quantitative insight by inference from large-scale data using cross-disciplinary methods, furthering our understanding of ecological dynamics. Publisher PDF
- Published
- 2023
44. Ridge-GME estimation in linear mixed models
- Author
-
B. Babadi, Fariba Janamiri, Alireza Chaji, and Abdolrahman Rasekh
- Subjects
Statistics and Probability ,Multicollinearity ,Principle of maximum entropy ,Estimator ,Applied mathematics ,Ridge (differential geometry) ,Generalized linear mixed model ,Mathematics - Abstract
In this paper, we concentrate on the generalized maximum entropy (GME) estimators. The aim is to improve the problem of multicollinearity in the linear mixed models (LMMs). Then the asymptotic prop...
- Published
- 2021
45. Batch quadratic programming network with maximum entropy constraint for anomaly detection
- Author
-
Weigang Chen, Mark Zhang, Di Zhou, and Chunsheng Guo
- Subjects
Constraint (information theory) ,Mathematical optimization ,Pattern clustering ,business.industry ,Computer science ,Principle of maximum entropy ,Anomaly detection ,Computer Vision and Pattern Recognition ,Artificial intelligence ,Quadratic programming ,Information theory ,business ,Software - Published
- 2021
46. A maximum-entropy-based method for alarm flood prediction
- Author
-
Yizhou Xu and Jiandong Wang
- Subjects
Optimization problem ,Flood myth ,Computer science ,Principle of maximum entropy ,Probabilistic logic ,Process (computing) ,computer.software_genre ,Industrial and Manufacturing Engineering ,Computer Science Applications ,ALARM ,Control and Systems Engineering ,Modeling and Simulation ,Prediction methods ,Benchmark (computing) ,Data mining ,computer - Abstract
Alarm floods are the phenomena of presenting too many alarms in a short time period to exceed abilities of industrial plant operators in making proper responses. This paper proposes a maximum-entropy-based method to predict upcoming alarms for an occurring alarm flood. The proposed method has two important features: all currently-occurred alarms are exploited for prediction, and upcoming alarms are given with quantitative probabilities. By contrast, existing alarm prediction methods either use most-recent (not all) occurred alarms in prediction, or cannot predict specific alarms with quantitative probabilistic values. The proposed method takes all historical alarm flood sequences into account to establish relationships between currently-occurred alarms and upcoming alarms, and formulates an optimization problem to maximize conditional entropies of upcoming alarms. The effectiveness of the proposed method is validated by numerical examples, one of which is on the well-accepted benchmark of Tennessee Eastman process.
- Published
- 2021
47. On the Maximum Entropy Negation of a Complex-Valued Distribution
- Author
-
Fuyuan Xiao
- Subjects
Discrete mathematics ,Distribution (number theory) ,Applied Mathematics ,Principle of maximum entropy ,Context (language use) ,Function (mathematics) ,Measure (mathematics) ,Computational Theory and Mathematics ,Negation ,Artificial Intelligence ,Control and Systems Engineering ,Entropy (information theory) ,Probability distribution ,Mathematics - Abstract
In real applications of artificial and intelligent decision-making systems, how to represent the knowledge involved with uncertain information is still an open issue. The negation method has great significance to address this issue from another perspective. However, it has the limitation that can be used only for the negation of the probability distribution. In this article, therefore, we propose a generalized model of the traditional one, so that it can have more powerful capability to represent the knowledge, and uncertainty measure. In particular, we first define a vector representation of complex-valued distribution. Then, an entropy measure is proposed for the complex-valued distribution, called $\mathcal {X}$ entropy. In this context, a transformation function to acquire the negation of the complex-valued distribution is exploited on the basis of the newly defined $\mathcal {X}$ entropy. Afterward, the properties of this negation function are analyzed, and investigated, as well as some special cases. Finally, we study the negation function on the view from the $\mathcal {X}$ entropy. It is verified that the proposed negation method for the complex-valued distribution is a scheme with a maximal entropy.
- Published
- 2021
48. Predicting the current and future distributions of major food crop designated geographical indications (GIs) in China under climate change
- Author
-
Guilin Liu, Huizong Yao, and Yuyang Xian
- Subjects
Current (stream) ,Crop ,Geography ,Principle of maximum entropy ,Geography, Planning and Development ,Common spatial pattern ,Climate change ,Physical geography ,China ,Water Science and Technology - Abstract
We first predicted the potential climate suitability of food crops with geographical indications (GIs) using the maximum entropy (MaxEnt) model and eight bioclimatic predicators under three shared ...
- Published
- 2021
49. Predicting aquatic invasions in a megadiverse region: Maximum‐entropy‐based modelling of six alien fish species in Malaysia
- Author
-
M. A. Motalib Hossain, Lavanya Malini Vythalingam, Rajeev Raghavan, and Subha Bhassu
- Subjects
Geography ,Ecology ,biology ,Principle of maximum entropy ,Freshwater fish ,Fish species ,Introduced species ,Alien ,Aquatic Science ,biology.organism_classification ,Nature and Landscape Conservation - Published
- 2021
50. Reduced order multirate schemes for coupled differential-algebraic systems
- Author
-
Michael Günther, Angelo Ciccazzo, and M. W. F. M. Bannenberg
- Subjects
Model order reduction ,Numerical Analysis ,Basis (linear algebra) ,Applied Mathematics ,Principle of maximum entropy ,Context (language use) ,010103 numerical & computational mathematics ,Integrated circuit ,01 natural sciences ,law.invention ,010101 applied mathematics ,Reduction (complexity) ,Computational Mathematics ,law ,Control theory ,Convergence (routing) ,0101 mathematics ,Differential (infinitesimal) ,Mathematics - Abstract
In the context of time-domain simulation of integrated circuits, one often encounters large systems of coupled differential-algebraic equations. Simulation costs of these systems can become prohibitively large as the number of components keeps increasing. In an effort to reduce these simulation costs a twofold approach is presented in this paper. We combine maximum entropy snapshot sampling method and a nonlinear model order reduction technique, with multirate time integration. The obtained model order reduction basis is applied using the Gaus-Newton method with approximated tensors reduction. This reduction framework is then integrated using a coupled-slowest-first multirate integration scheme. The convergence of this combined method is verified numerically. Lastly it is shown that the new method results in a reduction of the computational effort without significant loss of accuracy.
- Published
- 2021
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.