Notes

Formulation & Proof's Notes

This is the section is for putting the hand written script of what I might put it into an article later.

• Bellman Update: Convergence To Single Reality
  Written by Apr 22 2024: all "realities" converge to a single reality in MDP

• Q's Search: Incremental Optimal Leads To Global Optimality
  Written by May 22 2024: How Q constructs the world

• Expectation Maximization: Creating Something From Nothing
  written by Dec 13 2024: creating "something" arbitrary, then gradually make it real

Computation Demos:

Here are some computational demos that I created/adapted from different courses and think that would be useful for providing intuitions into different topics.

• Statistical Inference Pipeline
  written by Mar 16 2025: some intuition towards SIP and what traditional inference care about