Markov Decision Processes
A mathematical framework for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision-maker. It assumes the current state contains all necessary information about the future.
Save the 3 videos on Markov Decision Processes to your own pod.
Sign up free to keep building your knowledge base on Markov Decision Processes as more episodes are added.
Videos Mentioning Markov Decision Processes

Leslie Kaelbling: Reinforcement Learning, Planning, and Robotics | Lex Fridman Podcast #15
Lex Fridman
A mathematical framework for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision-maker. It assumes the current state contains all necessary information about the future.

Stanford AA203 Optimal and Learning-Based Control | Spring 2026 | Lecture 1: Course Overview
Stanford Online
A formulation of problems in a stochastic setting, related to discrete-time optimal control.

Stanford AA203 Optimal and Learning-Based Control | Spring 2026 | Lecture 9: Stochastic Dyn. Program
Stanford Online
A mathematical framework used for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision maker. It's central to the lecture's discussion on optimal control with uncertainty.