Research Article

Computing Hitting Probabilities of Markov Chains: Structural Results with regard to the Solution Space of the Corresponding System of Equations

Table 1

Forward computation applied to the gambler’s ruin problem.

k

0011
1101
231
371
4151
1010231
2010485751
3010737418231
401099511627774.9998780.999634
501125899906842622.8750.625
75
100