Search

This paper studies the issue of coordinating equipment maintenance operations with capital investment strategy in the presence of random equipment failures. The traditional approach, developed by Kamien and Schwartz (KS) in their celebrated paper published in 1971, is to formulate the problem as a deterministic optimal control problem with the probability of machine failure as the state variable. With this approach, the optimal policy is deterministic. As a major departure from the KS approach, we explicitly model the underlying stochastic process of machine failures. Our analysis of the stochastic dynamic programming model offers new insights into the problem. Under a long planning horizon with a limited replacement opportunity, each individual machine serves as a revenue generator and contributes a significant amount to the profit of the system. In contrast, when the replacement budget is quite generous over a relatively short planning horizon, adding one extra machine only helps as a backup for unexpected failures of the machines purchased before it. An interesting result derived from this comparison is that a deterministic policy turns out to be optimal for the former, while a state-contingent policy must be applied to the latter. In other words, the deterministic KS approach does not work in general when a chain of machine replacement is considered. We further characterize the effects of the discount rate, productivity deterioration, learning, decision delay, and technology advancement on the optimal policy. [ABSTRACT FROM AUTHOR]

This paper studies the order-fulfillment process of a supplier producing multiple customized capital goods. The times when orders are confirmed by customers are random. The supplier can only work on one product at any time due to capacity constraints. The supplier must determine the optimal time to start the process for each order so that the total expected cost of having the goods ready before or after their orders are confirmed is minimized. We formulate this problem as a discrete time Markov decision process. The optimal policy is complex in general. It has a threshold-type structure and can be fully characterized only for some special cases. Based on our formulation, we compute the optimal policy and quantify the value of jointly managing the order fulfillment processes of multiple orders and the value of taking into account demand arrival time uncertainty. [ABSTRACT FROM AUTHOR]

This paper deals with minimization of the variances of the total discounted costs for constrained Continuous-Time Markov Decision Processes (CTMDPs). The costs consist of cumulative costs incurred between jumps and instant costs incurred at jump epochs. We interpret discounting as an exponentially distributed stopping time. According to existing theory, for the expected total discounted costs optimal policies exist in the forms of randomized stationary and switching stationary policies. While the former is typically unique, the latter forms a finite set whose number of elements grows exponentially with the number of constraints. This paper investigates the problem when the process stops immediately after the first jump. For costs up to the first jump we provide an index for selection of actions by switching stationary policies and show that the indexed switching policy achieves a smaller variance than the randomized stationary policy. For problems without instant costs, the indexed switching policy achieves the minimum variance of costs up to the first jump among all the equivalent switching policies. [ABSTRACT FROM AUTHOR]

The paper analyzes the implications of extreme events on the proper choice of discounting. Any discounting with constant or declining rates can be linked to random “stopping time” events, which define the internal discount-related horizons of evaluations. Conversely, any stopping time induces a discounting, in particular, with the standard discount rates. The expected duration of the stopping time horizon for discount rates obtained from capital markets does not exceed a few decades and, as such, these rates may significantly underestimate the net benefits of long-term decisions. The alternative undiscounted stopping time criterion allows to induce social discounting focusing on arrival times of potential extreme events rather then horizons of market interests. Induced discount rates are conditional on the degree of social commitment to mitigate risk. In general, extreme events affect these rates, which alter the optimal mitigation efforts that, in turn, change events. The use of undiscounted stopping time criteria requires stochastic optimisation methods. [ABSTRACT FROM AUTHOR]

Glazebrook [1] has given an account of improved procedures for strategy evaluation for resource allocation in a stochastic environment. These methods are extended in the paper in such a way that they can be applied to problems which, for example, have precedence constraints and/or an arrivals process of new jobs. Theoretical results, backed up by numerical studies, show that quasi-myopic heuristics often perform well. [ABSTRACT FROM AUTHOR]