Sarsa
Software / App
A classic algorithm related to SARSA, which is an online version of policy iteration and deals with a different Bellman equation than DQN.
Mentioned in 3 videos
Save the 3 videos on Sarsa to your own pod.
Sign up free to keep building your knowledge base on Sarsa as more episodes are added.
Videos Mentioning Sarsa
Deep Reinforcement Learning (John Schulman, OpenAI)
Lex Fridman
A classic algorithm related to SARSA, which is an online version of policy iteration and deals with a different Bellman equation than DQN.
Stanford AA203 Optimal and Learning-Based Control | Spring 2026 | Lecture 19: Model-Based RL
Stanford Online
An on-policy temporal difference learning algorithm for reinforcement learning, used as an example of value-based methods.
Stanford AA203 Optimal and Learning-Based Control | Spring 2026 | Lecture 17: RL Value-Based Methods
Stanford Online
An on-policy temporal difference learning algorithm for control, named after the quintuple of events (State, Action, Reward, Next State, Next Action).