Intuition on Harris recurrence
up vote
9
down vote
favorite
I am trying to get some intuition on Harris recurrence in Markov chains. Define state space $mathcal S$ comprising a single communication class, $f_{ii}^{(n)}=P(X_n=i, X_{n-1}ne i,ldots X_1ne imid X_0=i)$, $f_{ii}=sum_n f_{ii}^{(n)}$, $T_{ii}=inf_n {X_n=imid X_0=i}$ and $E(T_{ii})=sum_n nf_{ii}^{(n)}$ and $V_i=sum_nmathbb 1_{X_n=i}$, we have the following.
Transience: $f_{ii}<1$
Null recurrence:$f_{ii}=1$, $E(T_{ii})=infty$
Positive recurrence: $f_{ii}=1$, $E(T_{ii})<infty$, $E(V_i)=infty forall iin mathcal S$
Harris recurrence: $f_{ii}=1$, $P(omega:V_i(omega)=infty)=1 forall iin mathcal S$
Are the above relations correct? I do not see how the last bullet relates to the definition in Wikipedia. Are there any examples of finite Markov chains that are positive but not Harris recurrent?
probability stochastic-processes markov-chains
add a comment |
up vote
9
down vote
favorite
I am trying to get some intuition on Harris recurrence in Markov chains. Define state space $mathcal S$ comprising a single communication class, $f_{ii}^{(n)}=P(X_n=i, X_{n-1}ne i,ldots X_1ne imid X_0=i)$, $f_{ii}=sum_n f_{ii}^{(n)}$, $T_{ii}=inf_n {X_n=imid X_0=i}$ and $E(T_{ii})=sum_n nf_{ii}^{(n)}$ and $V_i=sum_nmathbb 1_{X_n=i}$, we have the following.
Transience: $f_{ii}<1$
Null recurrence:$f_{ii}=1$, $E(T_{ii})=infty$
Positive recurrence: $f_{ii}=1$, $E(T_{ii})<infty$, $E(V_i)=infty forall iin mathcal S$
Harris recurrence: $f_{ii}=1$, $P(omega:V_i(omega)=infty)=1 forall iin mathcal S$
Are the above relations correct? I do not see how the last bullet relates to the definition in Wikipedia. Are there any examples of finite Markov chains that are positive but not Harris recurrent?
probability stochastic-processes markov-chains
First question: what is the state space of your Markov Chain? I am assuming countable, because you are using summation over i. why don't you check out en.wikipedia.org/wiki/Harris_chain? Also what you have written as defintion of harris recurrence seem to be the same as null recurrence to me. Correct me if I am wrong. If $f_{ii}=infty$, this implies that $P(T_{ii}<infty)=1$, right?
– Lost1
Mar 26 '13 at 13:24
@Lost1: made some changes... The wiki article was not helpful to my intuition and it has already been referred to in the question.
– Bravo
Mar 26 '13 at 13:37
add a comment |
up vote
9
down vote
favorite
up vote
9
down vote
favorite
I am trying to get some intuition on Harris recurrence in Markov chains. Define state space $mathcal S$ comprising a single communication class, $f_{ii}^{(n)}=P(X_n=i, X_{n-1}ne i,ldots X_1ne imid X_0=i)$, $f_{ii}=sum_n f_{ii}^{(n)}$, $T_{ii}=inf_n {X_n=imid X_0=i}$ and $E(T_{ii})=sum_n nf_{ii}^{(n)}$ and $V_i=sum_nmathbb 1_{X_n=i}$, we have the following.
Transience: $f_{ii}<1$
Null recurrence:$f_{ii}=1$, $E(T_{ii})=infty$
Positive recurrence: $f_{ii}=1$, $E(T_{ii})<infty$, $E(V_i)=infty forall iin mathcal S$
Harris recurrence: $f_{ii}=1$, $P(omega:V_i(omega)=infty)=1 forall iin mathcal S$
Are the above relations correct? I do not see how the last bullet relates to the definition in Wikipedia. Are there any examples of finite Markov chains that are positive but not Harris recurrent?
probability stochastic-processes markov-chains
I am trying to get some intuition on Harris recurrence in Markov chains. Define state space $mathcal S$ comprising a single communication class, $f_{ii}^{(n)}=P(X_n=i, X_{n-1}ne i,ldots X_1ne imid X_0=i)$, $f_{ii}=sum_n f_{ii}^{(n)}$, $T_{ii}=inf_n {X_n=imid X_0=i}$ and $E(T_{ii})=sum_n nf_{ii}^{(n)}$ and $V_i=sum_nmathbb 1_{X_n=i}$, we have the following.
Transience: $f_{ii}<1$
Null recurrence:$f_{ii}=1$, $E(T_{ii})=infty$
Positive recurrence: $f_{ii}=1$, $E(T_{ii})<infty$, $E(V_i)=infty forall iin mathcal S$
Harris recurrence: $f_{ii}=1$, $P(omega:V_i(omega)=infty)=1 forall iin mathcal S$
Are the above relations correct? I do not see how the last bullet relates to the definition in Wikipedia. Are there any examples of finite Markov chains that are positive but not Harris recurrent?
probability stochastic-processes markov-chains
probability stochastic-processes markov-chains
edited Mar 26 '13 at 13:36
asked Mar 26 '13 at 12:42
Bravo
2,5201635
2,5201635
First question: what is the state space of your Markov Chain? I am assuming countable, because you are using summation over i. why don't you check out en.wikipedia.org/wiki/Harris_chain? Also what you have written as defintion of harris recurrence seem to be the same as null recurrence to me. Correct me if I am wrong. If $f_{ii}=infty$, this implies that $P(T_{ii}<infty)=1$, right?
– Lost1
Mar 26 '13 at 13:24
@Lost1: made some changes... The wiki article was not helpful to my intuition and it has already been referred to in the question.
– Bravo
Mar 26 '13 at 13:37
add a comment |
First question: what is the state space of your Markov Chain? I am assuming countable, because you are using summation over i. why don't you check out en.wikipedia.org/wiki/Harris_chain? Also what you have written as defintion of harris recurrence seem to be the same as null recurrence to me. Correct me if I am wrong. If $f_{ii}=infty$, this implies that $P(T_{ii}<infty)=1$, right?
– Lost1
Mar 26 '13 at 13:24
@Lost1: made some changes... The wiki article was not helpful to my intuition and it has already been referred to in the question.
– Bravo
Mar 26 '13 at 13:37
First question: what is the state space of your Markov Chain? I am assuming countable, because you are using summation over i. why don't you check out en.wikipedia.org/wiki/Harris_chain? Also what you have written as defintion of harris recurrence seem to be the same as null recurrence to me. Correct me if I am wrong. If $f_{ii}=infty$, this implies that $P(T_{ii}<infty)=1$, right?
– Lost1
Mar 26 '13 at 13:24
First question: what is the state space of your Markov Chain? I am assuming countable, because you are using summation over i. why don't you check out en.wikipedia.org/wiki/Harris_chain? Also what you have written as defintion of harris recurrence seem to be the same as null recurrence to me. Correct me if I am wrong. If $f_{ii}=infty$, this implies that $P(T_{ii}<infty)=1$, right?
– Lost1
Mar 26 '13 at 13:24
@Lost1: made some changes... The wiki article was not helpful to my intuition and it has already been referred to in the question.
– Bravo
Mar 26 '13 at 13:37
@Lost1: made some changes... The wiki article was not helpful to my intuition and it has already been referred to in the question.
– Bravo
Mar 26 '13 at 13:37
add a comment |
1 Answer
1
active
oldest
votes
up vote
0
down vote
This answer may be wrong, but I think it is worth posting and if it is wrong, someone can point it out and I can learn something too.
I think you do not mean a finite Markov Chain, because for a finite state chain, assuming it is irreducible, every state will be visited infinitely often, there is no question.
I think there is only a difference if the state space is uncountable.
This is because the event $V_i=infty$ is the same as the event "state i is visited infinitely often". This has probability 1 or 0, by Levy's zero-one law.
So, suppose a positive definite chain is not Harris recurrent. This means the expected number of visits to $i$ is infinite, but the number visits to $i$ is finite, almost surely, but doesn't this mean it is transient?
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
0
down vote
This answer may be wrong, but I think it is worth posting and if it is wrong, someone can point it out and I can learn something too.
I think you do not mean a finite Markov Chain, because for a finite state chain, assuming it is irreducible, every state will be visited infinitely often, there is no question.
I think there is only a difference if the state space is uncountable.
This is because the event $V_i=infty$ is the same as the event "state i is visited infinitely often". This has probability 1 or 0, by Levy's zero-one law.
So, suppose a positive definite chain is not Harris recurrent. This means the expected number of visits to $i$ is infinite, but the number visits to $i$ is finite, almost surely, but doesn't this mean it is transient?
add a comment |
up vote
0
down vote
This answer may be wrong, but I think it is worth posting and if it is wrong, someone can point it out and I can learn something too.
I think you do not mean a finite Markov Chain, because for a finite state chain, assuming it is irreducible, every state will be visited infinitely often, there is no question.
I think there is only a difference if the state space is uncountable.
This is because the event $V_i=infty$ is the same as the event "state i is visited infinitely often". This has probability 1 or 0, by Levy's zero-one law.
So, suppose a positive definite chain is not Harris recurrent. This means the expected number of visits to $i$ is infinite, but the number visits to $i$ is finite, almost surely, but doesn't this mean it is transient?
add a comment |
up vote
0
down vote
up vote
0
down vote
This answer may be wrong, but I think it is worth posting and if it is wrong, someone can point it out and I can learn something too.
I think you do not mean a finite Markov Chain, because for a finite state chain, assuming it is irreducible, every state will be visited infinitely often, there is no question.
I think there is only a difference if the state space is uncountable.
This is because the event $V_i=infty$ is the same as the event "state i is visited infinitely often". This has probability 1 or 0, by Levy's zero-one law.
So, suppose a positive definite chain is not Harris recurrent. This means the expected number of visits to $i$ is infinite, but the number visits to $i$ is finite, almost surely, but doesn't this mean it is transient?
This answer may be wrong, but I think it is worth posting and if it is wrong, someone can point it out and I can learn something too.
I think you do not mean a finite Markov Chain, because for a finite state chain, assuming it is irreducible, every state will be visited infinitely often, there is no question.
I think there is only a difference if the state space is uncountable.
This is because the event $V_i=infty$ is the same as the event "state i is visited infinitely often". This has probability 1 or 0, by Levy's zero-one law.
So, suppose a positive definite chain is not Harris recurrent. This means the expected number of visits to $i$ is infinite, but the number visits to $i$ is finite, almost surely, but doesn't this mean it is transient?
edited Mar 26 '13 at 14:10
user940
answered Mar 26 '13 at 13:59
Lost1
5,54933369
5,54933369
add a comment |
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f341696%2fintuition-on-harris-recurrence%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
First question: what is the state space of your Markov Chain? I am assuming countable, because you are using summation over i. why don't you check out en.wikipedia.org/wiki/Harris_chain? Also what you have written as defintion of harris recurrence seem to be the same as null recurrence to me. Correct me if I am wrong. If $f_{ii}=infty$, this implies that $P(T_{ii}<infty)=1$, right?
– Lost1
Mar 26 '13 at 13:24
@Lost1: made some changes... The wiki article was not helpful to my intuition and it has already been referred to in the question.
– Bravo
Mar 26 '13 at 13:37