书好效果也很好,
1 Introduction and Preview 1
1.1 Preview of the Book 5
2 Entropy, Relative Entropy, and Mutual Information
2.1 Entropy 13
2.2 Joint Entropy and Conditional Entropy 16
2.3 Relative Entropy and Mutual Information 19
2.4 Relationship Between Entropy and Mutual
Information 20
2.5 Chain Rules for Entropy, Relative Entropy,
and Mutual Information 22
2.6 Jensen’s Inequality and Its Consequences 25
2.7 Log Sum Inequality and Its Applications 30
2.8 Data-Processing Inequality 34
2.9 Sufficient Statistics 35
2.10 Fano’s Inequality 37
Summary 41
Problems 43
Historical Notes 54
1