Quantifying Order Out of Equilibrium

Entropy is a central concept in the statistical mechanics and thermodynamics of equilibrium systems. I will discuss how lossless data compression can be used to estimate the Shannon entropy, which reduces to the thermodynamic entropy in equilibrium, and show that it gives useful information for a variety of different far-from-equilbrium systems.