Markov decision process
mathematical model for sequential decision making under uncertainty
Build a research pod on Markov decision process.
6 expert discussions. Save them all to your own pod, ask any question, get cited answers.
Common Themes
Videos Mentioning Markov decision process
Marcus Hutter: Universal Artificial Intelligence, AIXI, and AGI | Lex Fridman Podcast #75
Lex Fridman
A mathematical framework for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision-maker; often used in RL but has limitations.
MIT 6.S094: Deep Reinforcement Learning
Lex Fridman
A mathematical framework used to model decision-making in situations where outcomes are partly random and partly under the control of a decision-maker.
MIT 6.S094: Deep Reinforcement Learning for Motion Planning
Lex Fridman
A mathematical framework for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision-maker, commonly used in reinforcement learning.
Stanford CS229 Machine Learning | Spring 2026 | Lecture 18: GMM (EM), PCA
Stanford Online
The basic modeling framework for applying reinforcement learning, describing how decisions affect the environment and future states.
Stanford AA203 Optimal and Learning-Based Control | Spring 2026 | Lecture 18: RL Policy Optimization
Stanford Online
A formalism used in reinforcement learning to define the problem, involving states, actions, and transitions.
Stanford AA203 Optimal and Learning-Based Control | Spring 2026 | Lecture 16: Fundamentals of RL
Stanford Online
A mathematical framework used in reinforcement learning to model decision-making in situations where outcomes are partly random and partly under the control of a decision-maker.