One word, several questions
What Entropy Measures
Separate visual variety from average uncertainty, worst-case guessability, and uncertainty that remains after an observer’s clues.
5 instruments
One claim, three lenses.
Change depth inside any card. “Another example” adapts the lens to the situations you chose during onboarding.
One idea · three lenses
A result does not carry its recipe
The number 5831 might come from four fair dice, a secure machine, or someone’s birthday written backward. The digits are identical; what a guesser should expect is completely different.
One idea · three lenses
How surprising is the average reveal?
A fair coin keeps you wondering one yes-or-no answer per flip. A coin that almost always lands heads teaches you less when revealed, because you usually expected the answer already.
One idea · three lenses
How good is the very best guess?
Imagine a spinner with ten labels where one label covers half the circle. The ten labels look varied, but a guesser who always picks the giant slice wins half the time. Min-entropy focuses on that danger.
One idea · three lenses
What remains after the clues?
A hidden hand of cards may surprise someone outside the room but not the camera above the table. The source did not change; the observer’s information did.
One idea · three lenses
A perfect-looking trick can be rehearsed
A magician can produce a sequence that looks wonderfully mixed because every move was planned. A lopsided old die may look less tidy yet still surprise the magician. Looks and unpredictability are different tests.
Bench notes
Keep these three.
- 01
Ask how data was generated and what the observer knows before assigning entropy.
- 02
Shannon entropy describes average uncertainty; min-entropy highlights the best single guess.
- 03
Statistical tests can expose failure, but passing them is not proof of unpredictability.
Local field-note progress
Finished What Entropy Measures?
This optional mark lives only in this browser. It does not score the lesson or lock what comes next.
Touch the model
Make the variables move.
The lab runs locally in your browser and is designed to expose the assumptions behind this lesson.