Book:Robert B. Ash/Information Theory

Contents

 * Preface


 * A Measure of Information
 * 1.1 Introduction
 * 1.2 Axioms for the Uncertainty Measure
 * 1.3 Three Interpretations of the Uncertainty Function
 * 1.4 Properties of the Uncertainty Function; Joint and Conditional Uncertainty
 * 1.5 The Measure of Information
 * 1.6 Notes and Remarks


 * Noiseless Coding
 * 2.1 Introduction
 * 2.2 The Problem of Unique Decipherability
 * 2.3 Necessary and Sufficient Conditions for the Existence of Instantaneous Codes
 * 2.4 Extension of the Condition $\displaystyle \sum_{i \mathop = 1}^M D^{-n_i} \le 1$ to Uniquely Decipherable Codes
 * 2.5 The Noiseless Coding Theorem
 * 2.6 Construction of Optimal Codes


 * The Discrete Memoryless Channel


 * Error Correcting Codes


 * Further Theory of Error Correcting Codes


 * Information Sources


 * Channels with Memory


 * Continuous Channels


 * Appendix


 * Tables of Values of $-\log_2 p$ and $-p \log_2 p$


 * Solutions to Problems


 * References


 * Index