Entropy · Probability

Shape a distribution

Among all distributions over n outcomes the uniform one has the highest entropy, log₂ n bits; piling probability onto one outcome drives it to 0, and a 50/50 split on two outcomes is exactly 1 bit however many empty outcomes sit alongside.

Builds on Biased coin entropy. Taught in Bits & Surprise.

Drag eight bars into any shape and read the entropy and a meter showing it as a fraction of the maximum. Presets give the uniform, a single spike and a fair coin on two outcomes.

The claim above is what this widget demonstrates. Disagree with it?

Where next