1.Previous
3.Next

system composed of three elements: a source of data, a communication channel, and a receiver. The "fundamental problem of communication" - as expressed by Shannon - is for the receiver to be able to identify what data was generated by the source, based on the signal it receives through the channel. Shannon considered various ways to encode, compress, and transmit messages from a data source, and proved in his source coding theorem that the entropy represents

1.Previous
3.Next