University of Colorado Boulder

Foundations of Reinforcement Learning Specialization

Ends soon! Keep adding new skills with 10,000+ programs for $239 (usually $399). Save now.

University of Colorado Boulder

Foundations of Reinforcement Learning Specialization

Master Reinforcement Learning.

Build foundations in classical RL, deep RL, and reward design.

Ashutosh Trivedi

Instructor: Ashutosh Trivedi

Included with Coursera Plus

Get in-depth knowledge of a subject
Intermediate level

Recommended experience

4 weeks to complete
at 10 hours a week
Flexible schedule
Learn at your own pace
Get in-depth knowledge of a subject
Intermediate level

Recommended experience

4 weeks to complete
at 10 hours a week
Flexible schedule
Learn at your own pace

What you'll learn

  • Explain the mathematical foundations of reinforcement learning.

  • Analyze and compare tabular, approximate, and deep reinforcement learning algorithms .

  • Explain how function approximation and neural networks extend reinforcement learning beyond finite tabular settings

  • Design, infer, and assess reward structures and specification-based objectives that align learned behavior with intended task goals.

Details to know

Shareable certificate

Add to your LinkedIn profile

Taught in English
Recently updated!

July 2026

See how employees at top companies are mastering in-demand skills

 logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Advance your subject-matter expertise

  • Learn in-demand skills from university and industry experts
  • Master a subject or tool with hands-on projects
  • Develop a deep understanding of key concepts
  • Earn a career certificate from University of Colorado Boulder

Specialization - 3 course series

Mastering Classic Reinforcement Learning Algorithms

Mastering Classic Reinforcement Learning Algorithms

Course 1, 14 hours

What you'll learn

  • Formulate sequential decision-making problems as deterministic decision processes, Markov chains, and finite Markov decision processes.

  • Explain and apply core reinforcement-learning concepts, including discounting, value functions, policies, Bellman equations, and optimality.

  • Implement planning algorithms for finite Markov decision processes, including value iteration, policy iteration, and linear programming formulations.

  • Compare tabular reinforcement-learning algorithms, including bandits, Monte Carlo methods, temporal-difference learning, SARSA, and Q-learning.

Skills you'll gain

Category: Machine Learning Algorithms
Category: Machine Learning
Category: Applied Mathematics
Category: Reinforcement Learning
Category: Sampling (Statistics)
Category: Artificial Intelligence and Machine Learning (AI/ML)
Category: Machine Learning Methods
Category: Operations Research
Category: Theoretical Computer Science
Category: Markov Model
Category: Statistical Methods
Category: Mathematical Modeling
Category: Algorithms
Deep Reinforcement Learning: From Theory to Practice

Deep Reinforcement Learning: From Theory to Practice

Course 2, 14 hours

What you'll learn

  • Explain how neural-network-based function approximation extends reinforcement learning beyond finite tabular settings.

  • Implement and evaluate value-based deep reinforcement learning algorithms, including Deep Q-Networks and stabilizing techniques.

  • Derive and implement policy-gradient methods, including REINFORCE, baselines, and advantage-based updates.

  • Explain and analyze actor–critic methods that combine policy optimization with value estimation.

Skills you'll gain

Category: Algorithms
Category: Artificial Intelligence and Machine Learning (AI/ML)
Category: Model Optimization
Category: Applied Machine Learning
Category: Machine Learning Methods
Category: Reinforcement Learning
Category: Deep Learning
Category: Machine Learning Algorithms

What you'll learn

  • Identify limitations of standard scalar reward formulations, including reward hacking, specification gaming, and brittle proxies.

  • Express structured learning objectives using formal tools such as temporal logic, automata, and reward machines.

  • Construct and analyze reward mechanisms based on temporal logic, automata, product MDPs, reward machines, and reward shaping.

  • Model reward-programming problems under hidden state, memory, hierarchy, multiagent interaction, and continuous-time dynamics

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructor

Ashutosh Trivedi
University of Colorado Boulder
2 Courses47 learners

Offered by

Why people choose Coursera for their career

Felipe M.

Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Frequently asked questions