Reinforcement Learning:
An Introduction
Second edition, in progress
November 5, 2017
Richard S. Sutton and Andrew G. Barto
The text is now complete, except possibly for one more case study to be added to Chapter 16. The
references still need to be thoroughly checked, and an index still needs to be added. Please send any
errors to rich@richsutton.com and barto@cs.umass.edu. We are also very interested in correcting any
important omissions in the \Bibliographical and Historical Remarks" at the end of each chapter. If
you think of something that really should have been cited, please let us know and we can try to get it
corrected before the nal version is printed.
The MIT Press
Cambridge, Massachusetts
London, England