This course is an introduction to the theory of stochastic processes. Informally, a stochastic process is a random quantity that evolves over time, like a gambler’s net fortune and the price fluctuations of a stock on any stock exchange, for instance. The main aims of this course are: 1) to provide a thorough account of basic probability theory: 2) to introduce the ideas and tools of the theory of stochastic processes; and 3) to discuss in depth important classes of stochastic processes, including Markov Chains (both in discrete and continuous time), Poisson processes, the Brownian motion and Martingales. The course will also cover other important but less routine topies, like Markov decision processes and some elements of queucing theory.
这是一份unsw新南威尔斯大学MATH3801的成功案例
Suppose the claim is wrong and that
$$
\mathrm{P}\left[A_{\infty}=\infty, \sup {n}\left|X{n}\right|<\infty\right]>0 .
$$
Then,
$$
\mathrm{P}\left[T(c)=\infty ; A_{\infty}=\infty\right]>0
$$
where $T(c)$ is the stopping time
$$
T(c)=\inf \left{n|| X_{n} \mid>c\right} .
$$
Now
$$
\mathrm{E}\left[X_{T(c) \wedge n}^{2}-A_{T(c) \wedge n}\right]=0
$$
and $X^{T(c)}$ is bounded by $c+K$. Thus
$$
\mathrm{E}\left[A_{T(c) \wedge n}\right] \leq(c+K)^{2}
$$
for all $n$. This is a contradiction to $\mathrm{P}\left[A_{\infty}=\infty, \sup {n}\left|X{n}\right|<\infty\right]>0$.
MATH3801 COURSE NOTES ：
it is seen that the rate into the box around Node 0 is $\mu p_{1}$; the rate out of the box around Node 0 is $\lambda p_{0}$; thus, “rate in” = “rate out” yields
$$
\mu p_{1}=\lambda p_{0}
$$
The rate into the box around Node 1 is $\lambda p_{0}+\mu p_{2}$; the rate out of the box around Node 1 is $(\mu+\lambda) p_{1}$; thus
$$
\lambda p_{0}+\mu p_{2}=(\mu+\lambda) p_{1}
$$
Continuing in a similar fashion and rearranging, we obtain the system
$$
\begin{aligned}
p_{1} &=\frac{\lambda}{\mu} p_{0} \text { and } \
p_{n+1} &=\frac{\lambda+\mu}{\mu} p_{n}-\frac{\lambda}{\mu} p_{n-1} \text { for } n=1,2, \cdots .
\end{aligned}
$$