Courses

Online Courses

On Campus Courses

Fall 2021, Learning and Sequential Decision Making.

Summer 2021, Introduction to Discrete Structures & Probability

Fall 2019, Learning and Sequential Decision Making.

Fall 2018, CS15 (staff).

Spring 2020, Introduction to Discrete Structures & Probability

Spring 2018, Machine learning (ML parody videos).

Fall 2017, Learning and Sequential Decision Making.

Fall 2017, CS15 (staff).

Spring 2017, A First Byte of Computer Science.

Fall 2015, Learning and Sequential Decision Making.

Fall 2015, Designing Humanity Centered Robots (with Ian Gonsher).

Spring 2015, A First Byte of Computer Science.

Fall 2014, Designing Humanity Centered Robots (with Ian Gonsher).

Spring 2014, A First Byte of Computer Science.

Fall 2013, Learning and Sequential Decision Making.

Spring 2013, Introduction to Artificial Intelligence.

Fall 2012, Learning and Sequential Decision Making.

Spring 2010, Programming for the Masses (Rutgers).

Spring 2009, Sequential decision making (Rutgers).

Fall 2008, Great Insights in Computer Science (Rutgers).

Fall 2008, Bayesian Reinforcement Learning (Rutgers).

Fall 2007, Great Insights in Computer Science (Rutgers).

Fall 2007, Planning in Learned Environments (Rutgers).

Spring 2007, Great Insights in Computer Science (Rutgers).

Spring 2007, Multiagent reinforcement learning (Rutgers).

Fall 2006, Great Insights in Computer Science (Rutgers).

Fall 2006, Light seminar on reinforcement-learning theory (Rutgers).

Spring 2006, Great Insights in Computer Science (Rutgers).

Fall 2005, Learning and Sequential Decision Making (Rutgers).

Spring 2005, Discrete Math (Rutgers).

Spring 2005, Social Reinforcement Learning (Rutgers, with Matthew Stone).

Fall 2004, Discrete Math (Rutgers).

Fall 2004, Machine Learning (Rutgers).

Spring 2004, Learning and Sequential Decision Making (Rutgers).

Fall 2003, Machine Learning (Rutgers).

Fall 2003, Learned Representations in AI (Rutgers).

Spring 2003, Learning Robots Reading Group (Rutgers).

Fall 2001, Introduction to Artificial Intelligence (Princeton).

Students

Here is a list of the PhD dissertations (theses) I have advised.

My Rutgers students were members of The Rutgers Laboratory for Real-Life Reinforcement Learning (or RL3).

Notes for students

  • Due to my new position at the NSF, I am not accepting PhD students at this time.

  • Please check my requests before asking for recommendation letters.

  • There are editorial comments I make very frequently.

  • I prefer some names more than others.

Personal links