Search

Minimizing the divergence between two probability distributions offers an alternative parameter estimation method. The current literature mainly focuses on minimizing the Kullback-Leibler (K-L) divergence between the true and the proposed models in which the true model is assumed to be known or fixed. In this paper, we propose a parameter estimation method that minimizes the $f$ -divergence between two probability distributions. The method is suitable for different situations, no matter the true distribution is known or not. The statistical properties of the estimator, including consistency and asymptotic normality, are established. As an illustration, our method is employed to estimate the degradation model, which is a model frequently used to assess the lifetime of highly reliable products. A simulation study and a real degradation data analysis are presented to illustrate the effectiveness of the proposed estimation method. [ABSTRACT FROM AUTHOR]

Suppose that we are given a time series where consecutive samples are believed to come from a probabilistic source, that the source changes from time to time and that the total number of sources is fixed. Our objective is to estimate the distributions of the sources. A standard approach to this problem is to model the data as a hidden Markov model (HMM). However, since the data often lacks the Markov or the stationarity properties of an HMM, one can ask whether this approach is still suitable or perhaps another approach is required. In this paper, we show that a maximum likelihood HMM estimator can be used to approximate the source distributions in a much larger class of models than HMMs. Specifically, we propose a natural and fairly general non-stationary model of the data, where the only restriction is that the sources do not change too often. Our main result shows that for this model, a maximum-likelihood HMM estimator produces the correct second moment of the data, and the results can be extended to higher moments. [ABSTRACT FROM AUTHOR]