SP17: REINFORCEMENT LEARNING FOR AI: 16961

Home

CS B659: Reinforcement Learning

News:

 

Basic info:

  • Class meets Tuesday & Thursday 2:30pm - 3:45 pm, Ballantine Hall Room 330
  • Instructor: Adam White
  • AI: Matthew Schlegel
    • office: Lindley Hall 406
    • office hours: (Tentative) *: 4-6, Wed: 4-6  (* - The day homework is due)
    • email: mkschleg@umail.iu.edu
  • AI: Su Zhang
    • office: Lindley Hall 004
    • office hours: (Tentative) *: 4-6, Mon: 4-6  (* - The day homework is due)
    • email: zhangsu@indiana.edu 

 

Class schedule

This schedule is tentative and may change throughout the semester.

Readings and assignment questions are from the main course text: Sutton and Barto Links to an external site.

Supplementary material can be found in Szepesvari's book Links to an external site..

These slides will be released progressively.

Week Date Lecture Readings and Deadlines
1 Jan 10 Download Chapter 1: Introduction

 

Read Chapter 1 of Sutton and Barto

Assignment #1 Released

Jan 12 Download Chapter 2: Evaluative feedback

Read Chapter 2 of Sutton & Barto

2 Jan 17 Download Chapter 2: Evaluative feedback continued 

Two thought questions due monday night.

Jan 19 Download Chapter 3: The reinforcement learning problem

Read Chapter 3

 

3 Jan 24

Download Chapter 3 continued

One thought question due monday night.
Jan 26

Chapter 3 completed. Download Start of Chapter 4 Dynamic programming 

Assignment #1 Due

4 Jan 31 Download Finish Chapter 4: Dynamic programming

Read Chapter 4

Thought question on Ch4 due Monday 1 min to Midnight

Assignment #2 released

Feb 2 Download Chapter 5: Monte Carlo methods

 

5 Feb 7

 No class: work on assignments and projects 

 

 

Feb 9

 Guest lecture: David Crandall 

 

Feb 14

Monte Carlo methods

 

6 Feb 16 Download Monte Carlo methods
Feb 21

Download Chapter 6: Temporal difference learning


Download Project info

Assignment #2 due

 

7 Feb 23 Download Chapter 6:TD learning

Download Assignment #3 released

Feb 28

Download Chapter 7: n-step TD methods

 

 

8 Mar 2

Download Quiz Review


Download Chapter 8: Planning and learning

Mar 7

Download Thoughts on Research

Chapter 8: Planning and learning

 

9 Mar 9 Chapter 9: Function approximation

 

Mar 14 No classes: Spring break

 

 

10 Mar 16 No classes: Spring break

Assignment #3 Due

Assignment #4 Released

Mar 21 Download Chapter 9:Function approximation

 

 

11 Mar 23 Download Policy evaluation with function approximation

 30 minute in class quiz (5% of total grade)

Mar 28 Policy evaluation with function approximation

 

12 Mar 30 Download Control with function approximation  
April 4

Download lambda-returns and Eligibility traces

 

13 Apr 6

Advanced topics ( Download LSTD

and Off-policy gradient TD)

Assignment #4 Due

Assignment #5 released

Apr 11

Lecture Cancelled 

 

14 Apr 13

Lecture by Martha White

Advanced topics ( Download gradient TD

and Policy gradient methods)

 

Apr 18 Finish gradient TD and Download Policy gradient methods

 

15 Apr 20 Download RL and Psychology
Apr 25 Download Review Lecture Thought question Ch14 due
16 Apr 27 Download Practice Problems

Assignment #5 due 

May 2

Final Exam

 2:45- 4:45 p.m., Tues., May 2

17 May 4

Exam Period

Research projects due