Entropy
Entropy (S) is a thermodynamic state function, introduced by Rudolf Clausius in 1865, whose change in a reversible process is dS = δQrev/T. Ludwig Boltzmann gave it a statistical meaning: S = kB ln W, where W is the number of microscopic states compatible with the macroscopic state. By the second law, the total entropy of an isolated system never decreases.
Curious
Shuffle a sorted deck of cards and it almost certainly ends up unsorted, not because sorted is forbidden but because there are vastly more unsorted orders. Entropy applies the same counting to atoms and energy. A gas spreading through a room, ice melting in a warm drink, and heat flowing from hot to cold all move the system towards states with overwhelmingly more microscopic arrangements.
The idea came from engines. In 1865 Rudolf Clausius coined the word, from a Greek root meaning “transformation”, to quantify the part of heat that cannot be turned into work. Boltzmann later showed what it means at the level of atoms. It is the quantity behind the second law.
Exploring
| Definition | Formula | Origin |
|---|---|---|
| Thermodynamic (Clausius) | dS = δQrev/T | Clausius, 1865 |
| Statistical (Boltzmann) | S = kB ln W | Boltzmann, 1877; form by Planck, 1900 |
| Gibbs | S = −kB Σ pi ln pi | Gibbs, 1902 |
| Quantum (von Neumann) | S = −kB Tr(ρ ln ρ) | von Neumann, 1927 |
Deep Dive
Equivalence of definitions. In equilibrium statistical mechanics, maximising S = kB ln W for an isolated system with fixed energy leads to 1/T = ∂S/∂U, reproducing the thermodynamic temperature, and the Gibbs form for a system in contact with a heat bath gives the canonical distribution. The Boltzmann constant kB = 1.380649×10−23 J/K converts the dimensionless log-count into thermodynamic units; the equation was carved on Boltzmann's tombstone in Vienna, although the constant in that notation was introduced by Max Planck (see Max Planck).
Extensions. Entropy appears far beyond engines: black holes carry an entropy proportional to their horizon area (Bekenstein–Hawking, S = kBc³A/(4Gℏ)), the entropy of entanglement quantifies quantum correlations (see Quantum Entanglement), and information theory uses Shannon's formally identical expression. These connections are well established mathematically; their deeper interpretation, especially for black holes, is still researched.
Subtleties. Entropy is defined for equilibrium states; extending it to systems far from equilibrium is an active field. The Gibbs paradox (mixing identical gases) is resolved by treating identical particles as indistinguishable, a point clarified by quantum mechanics. Whether thermodynamic entropy is objective or partly reflects an observer's knowledge is debated in the philosophy of physics.
Concept Relationship Map
Requires: second law, heat, temperature
Enables: third law, free energies, statistical mechanics
Commonly confused with: visual disorder; Shannon information entropy
Sources
- Clausius, R. (1865). Annalen der Physik, 125, 353–400.
- Boltzmann, L. (1877). “Über die Beziehung zwischen dem zweiten Hauptsatze der mechanischen Wärmetheorie und der Wahrscheinlichkeitsrechnung.” Wiener Berichte, 76, 373–435.
- Schroeder, D.V. (2000). An Introduction to Thermal Physics. Addison-Wesley.