Increasing the Frequency of Regeneration for Markov Processes

S. Andradóttir, J. Calvin, and P. W. Glynn

Proceedings of the 1994 Winter Simulation Conference, 320-323 (1994)

We present and compare two ways of applying the regenerative method of simulation output analysis to simulate the steady-state behavior of irreducle discrete time Markov chains having a finite state space. The "standard" approach involves defining the regenerative cycles based on the times a particular "return" state is visited. The alternative approach involves using "splitting" to define the regenerative cycles. We present a way of selecting the splitting distribution that guarantees that the splitting cycles are shorter than the standard cycles, and that the variance estimates produced by the splitting approach are less variable than the variance estimates produced by the standard approach.