Why our approach is so powerful

• All other information-theoretic approaches stop with the notion of entropy, and do not approach the notion of a channel

• All they provide access to is Shannon’s first (source coding) theorem

• “entropy is the minimum number of bits required, on average, to represent a random variable”

• Communication channels provide access to other work on both information theory and coding

• Clearly just a beginning

Notes: