Notes
Formulation & Proof's Notes¶
This is the section is for putting the hand written script of what I might put it into an article later.
-
Bellman Update: Convergence To Single Reality
Written by Apr 22 2024: all "realities" converge to a single reality in MDP -
Q's Search: Incremental Optimal Leads To Global Optimality
Written by May 22 2024: How Q constructs the world -
Expectation Maximization: Creating Something From Nothing
written by Dec 13 2024: creating "something" arbitrary, then gradually make it real
Computation Demos:¶
Here are some computational demos that I created/adapted from different courses and think that would be useful for providing intuitions into different topics.
- Statistical Inference Pipeline
written by Mar 16 2025: some intuition towards SIP and what traditional inference care about