Dynamic Programming
A fundamental algorithm used to compute closed-loop optimal policies, derived here for discrete time and extended to continuous time.
Save the 4 videos on Dynamic Programming to your own pod.
Sign up free to keep building your knowledge base on Dynamic Programming as more episodes are added.
Videos Mentioning Dynamic Programming

Stanford AA274A Principles of Robotic Autonomy | Autumn 2019 | Trajectory Tracking
Stanford Online
A method for solving stochastic optimal control problems, often studied in graduate computer science and reinforcement learning courses.

Stanford AA274A Principles of Robotic Autonomy | Autumn 2019 | Trajectory Optimization
Stanford Online
A method for solving complex problems by breaking them down into simpler subproblems, developed by Richard Bellman.

AStanford AA203 Optimal and Learning-Based Control | Spring 2026 | Lecture 8: Nonlinearity
Stanford Online
A fundamental algorithm used to compute closed-loop optimal policies, derived here for discrete time and extended to continuous time.

Stanford AA203 Optimal and Learning-Based Control | Spring 2026 | Lecture 17: RL Value-Based Methods
Stanford Online
A method used to solve Markov Decision Processes by relying on the principle of optimality, requiring knowledge of system dynamics.