Re: Question about absorbing Markov chains ...

From: Bill Taylor (w.taylor_at_math.canterbury.ac.nz)
Date: 07/01/04


Date: 30 Jun 2004 21:52:43 -0700

Fabian195@hotmail.com (Fabian) wrote
>
> this might be a rather simple problem..

Homework?

> I've come up with a Markov
> chain with one absorbing state and 9 transient ones. Starting from a
> given state, I want to calculate the probability that I reach a
> specific transient state N times before reaching the absorbing state.

Rewrite the chain with the specific state also being absorbing.
Calculate the prob p of being aborbed there rather than in the original one.

Then your answer is just p^N(1-p). (That's the geometric thingy.)

------------------------------------------------------------------------------
             Bill Taylor W.Taylor@math.canterbury.ac.nz
------------------------------------------------------------------------------
             Experimental psychology: pulling habits out of rats.
------------------------------------------------------------------------------



Relevant Pages

  • Re: Question about absorbing Markov chains ...
    ... > specific transient state N times before reaching the absorbing state. ... > amount of times spent in each state before absorption, ... Maybe one of the Markov Chain applets here would help you: ...
    (sci.math)
  • Re: Question about absorbing Markov chains ...
    ... >specific transient state N times before reaching the absorbing state. ... Let q_i be the probability that the chain visits the fixed transient ...
    (sci.math)
  • Question about absorbing Markov chains ...
    ... chain with one absorbing state and 9 transient ones. ... specific transient state N times before reaching the absorbing state. ... amount of times spent in each state before absorption, ...
    (sci.math)

Quantcast