In this course, you will learn about several algorithms that can learn near optimal policies based on trial and error interaction with the environment---learning from the agent’s own experience. Learning from actual experience is striking because it requires no prior knowledge of the environment’s dynamics, yet can still attain optimal behavior. We will cover intuitively simple but powerful Monte Carlo methods, and temporal difference learning methods including Q-learning. We will wrap up this course investigating how we can get the best of both worlds: algorithms that can combine model-based planning (similar to dynamic programming) and temporal difference updates to radically accelerate learning.
Dieser Kurs ist Teil der Spezialisierung Spezialisierung Verstärkungslernen
21.201 bereits angemeldet
von
University of Alberta
Alberta Machine Intelligence Institute
Spezialisierung VerstärkungslernenUniversity of AlbertaÜber diesen Kurs
47.498 kürzliche Aufrufe
Flexible Fristen
Setzen Sie Fristen gemäß Ihrem Zeitplan zurück.
Zertifikat zur Vorlage
Erhalten Sie nach Abschluss ein Zertifikat
100 % online
Beginnen Sie sofort und lernen Sie in Ihrem eigenen Tempo.
Kurs 2 von 4 in
Stufe „Mittel“
Probabilities & Expectations, basic linear algebra, basic calculus, Python 3.0 (at least 1 year), implementing algorithms from pseudocode
Ca. 22 Stunden zum Abschließen
Englisch
Untertitel: Arabischer Raum, Französisch, Portugiesisch (europäisch), Italienisch, Vietnamesisch, Deutsch, Russisch, Englisch, Spanisch
Kompetenzen, die Sie erwerben
- Artificial Intelligence (AI)
- Machine Learning
- Reinforcement Learning
- Function Approximation
- Intelligent Systems
Flexible Fristen
Setzen Sie Fristen gemäß Ihrem Zeitplan zurück.
Zertifikat zur Vorlage
Erhalten Sie nach Abschluss ein Zertifikat
100 % online
Beginnen Sie sofort und lernen Sie in Ihrem eigenen Tempo.
Kurs 2 von 4 in
Stufe „Mittel“
Probabilities & Expectations, basic linear algebra, basic calculus, Python 3.0 (at least 1 year), implementing algorithms from pseudocode
Ca. 22 Stunden zum Abschließen
Englisch
Untertitel: Arabischer Raum, Französisch, Portugiesisch (europäisch), Italienisch, Vietnamesisch, Deutsch, Russisch, Englisch, Spanisch
von
University of Alberta
UAlberta is considered among the world’s leading public research- and teaching-intensive universities. As one of Canada’s top universities, we’re known for excellence across the humanities, sciences, creative arts, business, engineering and health sciences.
Alberta Machine Intelligence Institute
The Alberta Machine Intelligence Institute (Amii) is home to some of the world’s top talent in machine intelligence. We’re an Alberta-based
Lehrplan - Was Sie in diesem Kurs lernen werden
1 Stunde zum Abschließen
Welcome to the Course!
Welcome to the second course in the Reinforcement Learning Specialization: Sample-Based Learning Methods, brought to you by the University of Alberta, Onlea, and Coursera. In this pre-course module, you'll be introduced to your instructors, and get a flavour of what the course has in store for you. Make sure to introduce yourself to your classmates in the "Meet and Greet" section!
1 Stunde zum Abschließen
2 Videos (Gesamt 10 min), 2 Lektüren
3 Stunden zum Abschließen
Monte Carlo Methods for Prediction & Control
This week you will learn how to estimate value functions and optimal policies, using only sampled experience from the environment. This module represents our first step toward incremental learning methods that learn from the agent’s own interaction with the world, rather than a model of the world. You will learn about on-policy and off-policy methods for prediction and control, using Monte Carlo methods---methods that use sampled returns. You will also be reintroduced to the exploration problem, but more generally in RL, beyond bandits.
3 Stunden zum Abschließen
11 Videos (Gesamt 58 min), 3 Lektüren, 2 Quiz
5 Stunden zum Abschließen
Temporal Difference Learning Methods for Prediction
This week, you will learn about one of the most fundamental concepts in reinforcement learning: temporal difference (TD) learning. TD learning combines some of the features of both Monte Carlo and Dynamic Programming (DP) methods. TD methods are similar to Monte Carlo methods in that they can learn from the agent’s interaction with the world, and do not require knowledge of the model. TD methods are similar to DP methods in that they bootstrap, and thus can learn online---no waiting until the end of an episode. You will see how TD can learn more efficiently than Monte Carlo, due to bootstrapping. For this module, we first focus on TD for prediction, and discuss TD for control in the next module. This week, you will implement TD to estimate the value function for a fixed policy, in a simulated domain.
5 Stunden zum Abschließen
6 Videos (Gesamt 37 min), 2 Lektüren, 2 Quiz
6 Stunden zum Abschließen
Temporal Difference Learning Methods for Control
This week, you will learn about using temporal difference learning for control, as a generalized policy iteration strategy. You will see three different algorithms based on bootstrapping and Bellman equations for control: Sarsa, Q-learning and Expected Sarsa. You will see some of the differences between the methods for on-policy and off-policy control, and that Expected Sarsa is a unified algorithm for both. You will implement Expected Sarsa and Q-learning, on Cliff World.
6 Stunden zum Abschließen
9 Videos (Gesamt 30 min), 3 Lektüren, 2 Quiz
7 Stunden zum Abschließen
Planning, Learning & Acting
Up until now, you might think that learning with and without a model are two distinct, and in some ways, competing strategies: planning with Dynamic Programming verses sample-based learning via TD methods. This week we unify these two strategies with the Dyna architecture. You will learn how to estimate the model from data and then use this model to generate hypothetical experience (a bit like dreaming) to dramatically improve sample efficiency compared to sample-based methods like Q-learning. In addition, you will learn how to design learning systems that are robust to inaccurate models.
7 Stunden zum Abschließen
11 Videos (Gesamt 47 min), 4 Lektüren, 2 Quiz
Bewertungen
Top-Bewertungen von SAMPLE-BASED LEARNING METHODS
von DP14. Feb. 2021
Excellent course that naturally extends the first specialization course. The application examples in programming are very good and I loved how RL gets closer and closer to how a living being thinks.
von NG25. Juni 2020
It's an important course in understanding the working of reinforcement learning. Although some important and complex topics are not explored in this course which are mentioned in the textbook.
von AA11. Aug. 2020
Great course, giving it 5 stars though it deserves both because the assignments have some serious issues that shouldn't actually be a matter. All the other parts are amazing though. Good job
von MC29. Juni 2020
This course excellent, my only complaint is that there is a 5 attempts limits and a 4 months wait to retry. It seems excesive to me and adds extra pressure when taking on assignments.
Über den Spezialisierung Verstärkungslernen
The Reinforcement Learning Specialization consists of 4 courses exploring the power of adaptive learning systems and artificial intelligence (AI).
Häufig gestellte Fragen
Wann erhalte ich Zugang zu den Vorträgen und Aufgaben?
Was bekomme ich, wenn ich diese Spezialisierung abonniere?
Ist finanzielle Unterstützung möglich?
Haben Sie weitere Fragen? Besuchen Sie das Learner Help Center.
