in the interval . Specifically:

* An event with probability (a certain event) has an information content of . Its occurrence is perfectly unsurprising and reveals no new information.
* An event with probability (an impossible event) has an information content of , which is undefined but is taken to be by convention. This reflects that observing an event believed to be impossible would be infinitely surprising.

This monotonic relationship is fundamental to the use of information

1.Previous
3.Next