Thamognya's Blogmy personal blog about cs, ml and mathZola2022-08-03T00:00:00+00:00https://blog.thamognya.com/atom.xmlMarkov Chains2022-08-03T00:00:00+00:002022-08-03T00:00:00+00:00https://blog.thamognya.com/markov-chains/<h3 id="markov-chains">Markov Chains</h3>
<p>Markov chain is a mathematical system and also a stochastic process, but differs as the general stochastic process have memory of previous steps while markov chains are made to not have any form of memory. This is easily visualized by the following:</p>
<ul>
<li>A general stochastic process is a bag of balls (with various) where you take out 1 ball each time <em><strong>without</strong></em> replacement</li>
<li>Markov Chains <em><strong>with</strong></em> replacement
<ul>
<li>This allows markov chains to not depend on the previous change as if it were not replaced the chance of another ball of the same color the probabilty of balls of different colors will change.</li>
</ul>
</li>
</ul>
Sample Article2022-08-03T00:00:00+00:002022-08-03T00:00:00+00:00https://blog.thamognya.com/sample-article/<h3 id="lorem-ipsum">Lorem Ipsum</h3>
<p>$ e^{i\pi}+1=0 $</p>
<p>$$
f(x) = \int_{-\infty}^\infty\hat f(\xi),e^{2 \pi i \xi x},d\xi
$$</p>
<p>==></p>
<hr>
<p>lorem ipsum</p>