Characterization of the conditional stationary distribution in Markov chains via systems of linear inequalities
Characterization of the conditional stationary distribution in Markov chains via systems of linear inequalities
复制标题
通过线性不等式系统表征马尔可夫链中的条件平稳分布
DOI:
10.1017/apr.2020.40
复制
发表时间:
2020
影响因子:
1.2
通讯作者:
Masatoshi Kimura and Tetsuya Takine
中科院分区:
文献类型:
--
作者:
車塚 彩菜;矢島 萌子;三好 直人;三好 直人;三好 直人;豊泉 洋,三好 直人;T. Takine;Masatoshi Kimura and Tetsuya Takine;Masatoshi Kimura and Tetsuya Takine
This paper considers ergodic, continuous-time Markov chains on . For an arbitrarily fixed , we study the conditional stationary distribution given the Markov chain being in . We first characterize via systems of linear inequalities and identify simplices that contain , by examining the northwest corner block of the infinitesimal generator and the subset of the first states whose members are directly reachable from at least one state in . These results are closely related to the augmented truncation approximation (ATA), and we provide some practical implications for the ATA. Next we consider an extension of the above results, using the ( ) northwest corner block of and the subset of the first states whose members are directly reachable from at least one state in . Furthermore, we introduce new state transition structures called (K, N)-skip-free sets, using which we obtain the minimum convex polytope that contains .