5 results on '"information quality ratio"'
Search Results
2. Quantifying Total Influence between Variables with Information Theoretic and Machine Learning Techniques
- Author
-
Andrea Murari, Riccardo Rossi, Michele Lungaroni, Pasquale Gaudio, and Michela Gelfusa
- Subjects
machine learning tools ,information theory ,information quality ratio ,total correlations ,encoders ,autoencoders ,Science ,Astrophysics ,QB460-466 ,Physics ,QC1-999 - Abstract
The increasingly sophisticated investigations of complex systems require more robust estimates of the correlations between the measured quantities. The traditional Pearson correlation coefficient is easy to calculate but sensitive only to linear correlations. The total influence between quantities is, therefore, often expressed in terms of the mutual information, which also takes into account the nonlinear effects but is not normalized. To compare data from different experiments, the information quality ratio is, therefore, in many cases, of easier interpretation. On the other hand, both mutual information and information quality ratio are always positive and, therefore, cannot provide information about the sign of the influence between quantities. Moreover, they require an accurate determination of the probability distribution functions of the variables involved. As the quality and amount of data available are not always sufficient to grant an accurate estimation of the probability distribution functions, it has been investigated whether neural computational tools can help and complement the aforementioned indicators. Specific encoders and autoencoders have been developed for the task of determining the total correlation between quantities related by a functional dependence, including information about the sign of their mutual influence. Both their accuracy and computational efficiencies have been addressed in detail, with extensive numerical tests using synthetic data. A careful analysis of the robustness against noise has also been performed. The neural computational tools typically outperform the traditional indicators in practically every respect.
- Published
- 2020
- Full Text
- View/download PDF
3. Information Quality Ratio as a novel metric for mother wavelet selection.
- Author
-
Wijaya, Dedy Rahman, Sarno, Riyanarto, and Zulaika, Enny
- Subjects
- *
INFORMATION theory , *MATHEMATICAL decomposition , *WAVELETS (Mathematics) , *SIGNAL-to-noise ratio , *PROBLEM solving - Abstract
This study proposes Information Quality Ratio (IQR) as a new metric for mother wavelet selection in real-world applications. In mother wavelet selection, common metrics such as MSE and correlation coefficient highlight the morphological similarity as well as SNR focuses on enlarging signal power against noise power. Instead, IQR emphasizes that the reconstructed signal has to keep essential information from the original signal. Regarding mother wavelet selection problem, we also demonstrate the effect of wavelet transform at various decomposition levels to make a clear foundation of wavelet decomposition. In this study, IQR was used to determine the best-suited mother wavelet for electronic nose signals in beef quality classification. The experimental results show that IQR based mother wavelets have better capability to keep essential information from original signals than SNR, MSE, and correlation coefficient based mother wavelets. Moreover, it has better sensitivity to quantify the changes of signal structure than MSE and correlation coefficient. [ABSTRACT FROM AUTHOR]
- Published
- 2017
- Full Text
- View/download PDF
4. The Reciprocal Influence Criterion: An Upgrade of the Information Quality Ratio
- Author
-
Filippo De Masi, Michela Gelfusa, Riccardo Rossi, Matteo Ossidi, and A. Murari
- Subjects
Multidisciplinary ,Information Quality Ratio ,General Computer Science ,Article Subject ,Computer science ,Settore ING-IND/18 - Fisica dei Reattori Nucleari ,Information quality ,Mutual information ,QA75.5-76.95 ,Stability (probability) ,Pearson product-moment correlation coefficient ,Nonlinear system ,symbols.namesake ,Noise ,Electronic computers. Computer science ,Econometrics ,symbols ,Reciprocal Influence Criterion ,Probability distribution ,Reciprocal - Abstract
Understanding and quantifying the mutual influence between systems remain crucial but challenging tasks in any scientific enterprise. The Pearson correlation coefficient, the mutual information, and the information quality ratio are the most widely used indicators, only the last two being valid for nonlinear interactions. Given their limitations, a new criterion is proposed, the reciprocal influence criterion, which is very simple conceptually and does not make any assumption about the statistics of the stochastic variables involved. In addition to being normalised as the information quality ratio, it provides a much better resilience to noise and much higher stability to the issues related to the determination of the involved probability distribution functions. A conditional version, to counteract the effects of confounding variables, has also been developed, showing the same advantages compared to the more traditional indicators. A series of systematic tests with numerical examples is reported, to compare the properties of the new indicator with the more traditional ones, proving its clear superiority in practically all respects.
- Published
- 2021
- Full Text
- View/download PDF
5. Quantifying Total Influence between Variables with Information Theoretic and Machine Learning Techniques.
- Author
-
Murari, Andrea, Rossi, Riccardo, Lungaroni, Michele, Gaudio, Pasquale, and Gelfusa, Michela
- Subjects
MACHINE learning ,DISTRIBUTION (Probability theory) ,PEARSON correlation (Statistics) ,INFLUENCE ,INFORMATION theory - Abstract
The increasingly sophisticated investigations of complex systems require more robust estimates of the correlations between the measured quantities. The traditional Pearson correlation coefficient is easy to calculate but sensitive only to linear correlations. The total influence between quantities is, therefore, often expressed in terms of the mutual information, which also takes into account the nonlinear effects but is not normalized. To compare data from different experiments, the information quality ratio is, therefore, in many cases, of easier interpretation. On the other hand, both mutual information and information quality ratio are always positive and, therefore, cannot provide information about the sign of the influence between quantities. Moreover, they require an accurate determination of the probability distribution functions of the variables involved. As the quality and amount of data available are not always sufficient to grant an accurate estimation of the probability distribution functions, it has been investigated whether neural computational tools can help and complement the aforementioned indicators. Specific encoders and autoencoders have been developed for the task of determining the total correlation between quantities related by a functional dependence, including information about the sign of their mutual influence. Both their accuracy and computational efficiencies have been addressed in detail, with extensive numerical tests using synthetic data. A careful analysis of the robustness against noise has also been performed. The neural computational tools typically outperform the traditional indicators in practically every respect. [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.