Search

Abstract: This paper develops numerical methods for finding optimal dividend pay-out and reinsurance policies. A generalized singular control formulation of surplus and discounted payoff function is introduced, where the surplus is modeled by a regime-switching process subject to both regular and singular controls. To approximate the value function and optimal controls, Markov chain approximation techniques are used to construct a discrete-time controlled Markov chain. The proofs of the convergence of the approximation sequence to the surplus process and the value function are given. Examples of proportional and excess-of-loss reinsurance are presented to illustrate the applicability of numerical methods. [Copyright &y& Elsevier]

Abstract: This paper is concerned with asymptotic properties of consensus-type algorithms for networked systems whose topologies switch randomly. The regime-switching process is modeled as a discrete-time Markov chain with a finite state space. The consensus control is achieved by using stochastic approximation methods. In the setup, the regime-switching process (the Markov chain) contains a rate parameter in the transition probability matrix that characterizes how frequently the topology switches. On the other hand, the consensus control algorithm uses a stepsize that defines how fast the network states are updated. Depending on their relative values, three distinct scenarios emerge. Under suitable conditions, we show that when , a continuous-time interpolation of the iterates converges weakly to a system of randomly switching ordinary differential equations modulated by a continuous-time Markov chain. In this case a scaled sequence of tracking errors converges to a system of switching diffusion. When , the network topology is almost non-switching during consensus control transient intervals, and hence the limit dynamic system is simply an autonomous differential equation. When , the Markov chain acts as a fast varying noise, and only its averaged network matrices are relevant, resulting in a limit differential equation that is an average with respect to the stationary measure of the Markov chain. Simulation results are presented to demonstrate these findings. [Copyright &y& Elsevier]

This work develops an approximation procedure to find optimal annuity-purchasing strategies for minimizing the probability of lifetime ruin. The wealth is modelled as a regime-switching diffusion modulated by a continuous-time Markov chain. Based on Markov chain approximation techniques, a discrete-time controlled Markov chain with two components is constructed. Under simple conditions, the convergence of the approximation sequence to the wealth process is obtained. The convergence of the approximation to the value function is also established. Several examples are provided to demonstrate the performance of the algorithms. [ABSTRACT FROM AUTHOR]

Abstract: This work develops an approximation procedure for portfolio selection with bounded constraints. Based on the Markov chain approximation techniques, numerical procedures are constructed for the utility optimization task. Under simple conditions, the convergence of the approximation sequences to the wealth process and the optimal utility function is established. Numerical examples are provided to illustrate the performance of the algorithms. [Copyright &y& Elsevier]

Stochastic optimization/approximation algorithms are widely used to recursively estimate the optimum of a suitable function or its root under noisy observations when this optimum or root is a constant or evolves randomly according to slowly time-varying continuous sample paths. In comparison, this paper analyzes the asymptotic properties of stochastic optimization/approximation algorithms for recursively estimating the optimum or root when it evolves rapidly with nonsmooth (jump-changing) sample paths. The resulting problem falls into the category of regime-switching stochastic approximation algorithms with two-time scales. Motivated by emerging applications in wireless communications, and system identification, we analyze asymptotic behavior of such algorithms. Our analysis assumes that the noisy observations contain a (nonsmooth) jump process modeled by a discrete-time Markov chain whose transition frequency varies much faster than the adaptation rate of the stochastic optimization algorithm. Using stochastic averaging, we prove convergence of the algorithm. Rate of convergence of the algorithm is obtained via bounds on the estimation errors and diffusion approximations. Remarks on improving the convergence rates through iterate averaging, and limit mean dynamics represented by differential inclusions are also presented. [ABSTRACT FROM AUTHOR]

This article is concerned with a numerical method using stochastic approximation approach for an optimal trading (buy and sell) strategy. The underlying asset price is governed by a mean-reverting stochastic process. The objective is to buy and sell the asset so as to maximize an overall expected return. One of the advantages of our approach is that the underlying asset is model free. Only mean reversion is required. Slippage cost is imposed on each transaction. Convergence of the algorithms is provided. Numerical examples are reported to demonstrate the results. [ABSTRACT FROM AUTHOR]

Abstract: This work develops numerical approximation methods for quantile hedging involving mortality components for contingent claims in incomplete markets, in which guaranteed minimum death benefits (GMDBs) could not be perfectly hedged. A regime-switching jump-diffusion model is used to delineate the dynamic system and the hedging function for GMDBs, where the switching is represented by a continuous-time Markov chain. Using Markov chain approximation techniques, a discrete-time controlled Markov chain with two component is constructed. Under simple conditions, the convergence of the approximation to the value function is established. Examples of quantile hedging model for guaranteed minimum death benefits under linear jumps and general jumps are also presented. [ABSTRACT FROM AUTHOR]