Ergodicity of Markov Processes via Nonstandard Analysis

Haosui Duanmu,Jeffrey S. Rosenthal,William Weiss

Ergodicity of Markov Processes via Nonstandard Analysis
Format
Paperback
Publisher
American Mathematical Society
Country
United States
Published
1 May 2022
ISBN
9781470450021

Ergodicity of Markov Processes via Nonstandard Analysis

Haosui Duanmu,Jeffrey S. Rosenthal,William Weiss

The Markov chain ergodic theorem is well-understood if either the time-line or the state space is discrete. However, there does not exist a very clear result for general state space continuous-time Markov processes. Using methods from mathematical logic and nonstandard analysis, we introduce a class of hyperfinite Markov processes-namely, general Markov processes which behave like finite state space discrete-time Markov processes. We show that, under moderate conditions, the transition probability of hyperfinite Markov processes align with the transition probability of standard Markov processes. The Markov chain ergodic theorem for hyperfinite Markov processes will then imply the Markov chain ergodic theorem for general state space continuous-time Markov processes.

This item is not currently in-stock. It can be ordered online and is expected to ship in approx 4 weeks

Our stock data is updated periodically, and availability may change throughout the day for in-demand items. Please call the relevant shop for the most current stock information. Prices are subject to change without notice.

Sign in or become a Readings Member to add this title to a wishlist.