Home page

CS B659: Reinforcement Learning

News:

• Notes on converting between expectations and matrix forms: matrixBellman.pdf Download matrixBellman.pdf
• A great reference to brush up on statistics is the book All of Statistics Links to an external site.
• Research Project page is now available. It describes what is expected for your projects, and list several possible project. It will be updated over the term so check it every once and a while.
• Here are two projects from last year that were well done: here Download here
  and here Download here
• The lecture slides are available below in the Class schedule
• Notes on MDPs and Value functions: markovMath.pdf Download markovMath.pdf

Basic info:

• Class meets Tuesday & Thursday 4:00pm - 5:15 pm, Swain West 103
• Instructor: Adam White
• office: 301h Lindley Hall
• office hours: Friday 1-3pm
• email: adamw@indiana.edu
• web: adamwhite.ca Links to an external site.

• AI: Mrinmoy Maity
• office: Lindley Hall 406
• office hours: Tuesday 11am - 1pm
• email: mmaity@umail.iu.edu

Class schedule

This schedule is tentative and may change throughout the semester.

Readings and assignment questions are from the main course text: Sutton and Barto Links to an external site.

Supplementary material can be found in Szepesvari's book Links to an external site..

These slides will be released progressively; look at the date on the first page to see how recently they have been updated.