Thermodynamic entropy provides a measure of certain aspects of energy in relation to absolute temperature. It is an integral part of the second law of thermodynamics, which can be stated as saying that temperature differences between thermodynamic systems in contact with each other tend to even out and that work can be obtained from these non-equilibrium differences, but that loss of heat occurs, in the form of entropy, when work is done. In this form it provides a measure of the extent to which a heat engine can never completely recycle unused heat into work as a perpetual motion machine might, but will always convert some of the heat into internal energy due to intermolecular interactions, which is not available to do work. Entropy also relates to all kinds of energy and to other fields of science such as chemistry, where the entropy of materials measures the energy required to raise the material to its state at a given temperature from absolute zero. Thermodynamics (from the Greek thermos meaning heat and dynamics meaning power) is a branch of physics that studies the effects of changes in temperature, pressure, and volume on physical systems at the macroscopic scale by analyzing the collective motion of their particles using statistics. ... Absolute zero is the lowest temperature that can be obtained in any macroscopic system. ... The second law of thermodynamics is a theorem in physics regarding the directional flow of heat in relation to work and which accounts for the phenomenon of irreversibility in thermodynamic systems. ... Thermodynamics (Greek: thermos = heat and dynamic = change) is the physics of energy, heat, work, entropy and the spontaneity of processes. ... In thermodynamics, thermodynamic work is a generalisation of the concept of mechanical work in mechanics. ... Ice melting - classic example of entropy increasing[1] described in 1862 by Rudolf Clausius as an increase in the disgregation of the molecules of the body of ice. ... In engineering and thermodynamics, a heat engine performs the conversion of heat energy to mechanical work by exploiting the temperature gradient between a hot source and a cold sink. Heat is transferred from the source, through the working body of the engine, to the sink, and in this process some... In thermodynamics, the internal energy of a thermodynamic system, or a body with well-defined boundaries, denoted by U, or sometimes E, is the total of the kinetic energy due to the motion of molecules (translational, rotational, vibrational) and the potential energy associated with the vibrational and electric energy of...

In calculations, entropy is symbolised by S and is a measure at a particular instant, a state function. Thus entropy as energy Q in relation to absolute temperature T is expressed as S = Q/T. Often change in entropy, symbolised by ΔS, is referred to in relation to change in energy, δQ.

Statistical mechanics introduces calculation of entropy using probability theory to find the number of possible microstates at an instant, any one of which will contain all the energy of the system at that instant. The calculation shows the probability, which is enabled by the energy: in terms of heat, by the motional energy of molecules Statistical mechanics is the application of probability theory, which includes mathematical tools for dealing with large populations, to the field of mechanics, which is concerned with the motion of particles or objects when subjected to a force. ... Probability theory is the mathematical study of phenomena characterized by randomness or uncertainty. ... Wikipedia does not yet have an article with this exact name. ...

Statistical mechanical entropy is mathematically similar to Shannon entropy which is part of information theory, where energy is not involved. This similarity means that some probabilistic aspects of thermodynamics are replicated in information theory. Entropy of a Bernoulli trial as a function of success probability. ... A bundle of optical fiber. ...

Ice melting provides an example of entropy increasing

Image File history File links Download high resolution version (768x1024, 98 KB) Ice water. ... Image File history File links Download high resolution version (768x1024, 98 KB) Ice water. ...

Example of entropy increasing

Ice melting provides a classic example in which entropy increases in a small 'universe', a thermodynamic system consisting of the 'surroundings' (the warm room) and the 'system' of glass, ice, cold water which has been allowed to reach thermodynamic equilibrium at the melting temperature of ice. In this universe, some heat energy δQ from the warmer room surrroundings at 298 K (77⁰F, 25⁰C) will spread out to the cooler system of ice and water at its constant temperature T of 273 K (32⁰F, 0⁰C), the melting temperature of ice. Thus, the entropy of the system, which is δQ/T, increases by δQ/273 K. (The heat δQ for this process is the energy required to change water from the solid state to the liquid state, and is called the enthalpy of fusion, i.e. the ΔH for ice fusion.) Thermodynamics (Greek: thermos = heat and dynamic = change) is the physics of energy, heat, work, entropy and the spontaneity of processes. ... In thermodynamics, a thermodynamic system is in thermodynamic equilibrium when it is in thermal equilibrium, mechanical equilibrium, and chemical equilibrium. ... In physics, heat, symbolized by Q, is defined as energy in transit. ... Heat of fusion is the amount of heat energy which must be absorbed or lost for 1 gram of a substance to change states from a solid to a liquid or vice versa. ...

It is important to realise that the entropy of the surrounding room decreases less than the entropy of the ice and water increases: the room temperature of 298 K is larger than 273 K and therefore the ratio, (entropy change), of δQ/298 K for the surroundings is smaller than the ratio (entropy change), of δQ/273 K for the ice+water system. This is always true in spontaneous events in a thermodynamic system and it shows the predictive importance of entropy': the final net entropy after such an event is always greater than was the initial entropy. Thermodynamics (Greek: thermos = heat and dynamic = change) is the physics of energy, heat, work, entropy and the spontaneity of processes. ...

As the temperature of the cool water rises to that of the room and the room further cools imperceptibly, the sum of the δQ/T over the continuous range, “at many increments”, in the initially cool to finally warm water can be found by calculus. The entire miniature ‘universe’, i.e. this thermodynamic system, has increased in entropy. Energy has spontaneously become more dispersed and spread out in that ‘universe’ than when the glass of ice + water was introduced and became a 'system' within it.

Overview

The concept of thermodynamic entropy is central to the second law of thermodynamics, which deals with physical processes and whether they occur spontaneously. In a general sense the second law says that temperature differences between systems in contact with each other tend to even out and that work can be obtained from these non-equilibrium differences, but that loss of heat occurs, in the form of entropy, when work is done. The concept of energy is central to the first law of thermodynamics, which deals with the conservation of energy and under which the loss in heat will result in an increase in the internal energy of the thermodynamic system. Thermodynamic entropy provides a comparative measure of the amount of this increase in internal energy at a given temperature. A simple and more concrete visualisation of the second law is that energy of all types changes from being localized to becoming dispersed or spread out, if it is not hindered from doing so. Entropy change is the quantitative measure of that kind of a spontaneous process: how much energy has flowed or how widely it has become spread out at a specific temperature. Thermodynamics (from the Greek thermos meaning heat and dynamics meaning power) is a branch of physics that studies the effects of changes in temperature, pressure, and volume on physical systems at the macroscopic scale by analyzing the collective motion of their particles using statistics. ... The second law of thermodynamics is a theorem in physics regarding the directional flow of heat in relation to work and which accounts for the phenomenon of irreversibility in thermodynamic systems. ... Ice melting - classic example of entropy increasing[1] described in 1862 by Rudolf Clausius as an increase in the disgregation of the molecules of the body of ice. ... The first law of thermodynamics, a generalized expression of the law of the conservation of energy, states: // Description Essentially, the First Law of Thermodynamics declares that energy is conserved for a closed system, with heat and work being the forms of energy transfer. ... Conservation of energy states that the total amount of energy (often expressed as the sum of kinetic energy and potential energy) in an isolated system remains constant. ... In thermodynamics, the internal energy of a thermodynamic system, or a body with well-defined boundaries, denoted by U, or sometimes E, is the total of the kinetic energy due to the motion of molecules (translational, rotational, vibrational) and the potential energy associated with the vibrational and electric energy of... Thermodynamics (Greek: thermos = heat and dynamic = change) is the physics of energy, heat, work, entropy and the spontaneity of processes. ...

In thermodynamics, entropy is one of the three basic thermodynamic potentials U (internal energy), S (entropy) and F (Helmholtz free energy). In thermodynamics, the internal energy of a thermodynamic system, or a body with well-defined boundaries, denoted by U, or sometimes E, is the total of the kinetic energy due to the motion of molecules (translational, rotational, vibrational) and the potential energy associated with the vibrational and electric energy of... Ice melting - classic example of entropy increasing[1] described in 1862 by Rudolf Clausius as an increase in the disgregation of the molecules of the body of ice. ... The Helmholtz energy is a thermodynamic potential which measures the useful work obtainable from constant temperature, constant volume thermodynamic systems. ...

Entropy has been developed to describe any of several phenomena, depending on the field and the context in which it is being used. Information entropy takes the mathematical concepts of statistical thermodynamics into areas of probability theory unconnected with heat and energy. Entropy of a Bernoulli trial as a function of success probability, often called the binary entropy function Entropy is a concept in thermodynamics (see thermodynamic entropy), statistical mechanics and information theory. ... Statistical mechanics is the application of statistics, which includes mathematical tools for dealing with large populations, to the field of mechanics, which is concerned with the motion of particles or objects when subjected to a force. ... Probability theory is the mathematical study of phenomena characterized by randomness or uncertainty. ...

Origins and uses

Originally, entropy was named to describe the "waste heat", or more accurately energy losses, from heat engines and other mechanical devices which could never run with 100% efficiency in converting energy into work. Later, the term came to acquire several additional descriptions as more came to be understood about the behavior of molecules on the microscopic level. In the late 19th century the word "disorder" was used by Ludwig Boltzmann in developing statistical views of entropy using probability theory to describe the increased molecular movement on the microscopic level. That was before quantum behavior came to be better understood by Werner Heisenberg and those who followed. Descriptions of thermodynamic (heat) entropy on the microscopic level are found in statistical thermodynamics and statistical mechanics. Ludwig Eduard Boltzmann (Vienna, Austrian Empire, February 20, 1844 – Duino near Trieste, September 5, 1906) was an Austrian physicist famous for his founding contributions in the fields of statistical mechanics and statistical thermodynamics. ... In this section we discuss the statistical nature of entropy. ... Probability theory is the mathematical study of phenomena characterized by randomness or uncertainty. ... Werner Karl Heisenberg (December 5, 1901 – February 1, 1976) was a celebrated German physicist and Nobel laureate, one of the founders of quantum mechanics, and acknowledged to be one of the most important physicists of the twentieth century. ... Statistical mechanics is the application of statistics, which includes mathematical tools for dealing with large populations, to the field of mechanics, which is concerned with the motion of particles or objects when subjected to a force. ... Statistical mechanics is the application of probability theory, which includes mathematical tools for dealing with large populations, to the field of mechanics, which is concerned with the motion of particles or objects when subjected to a force. ...

For most of the 20th century textbooks tended to describe entropy as "disorder", following Boltzmann's early conceptualisation of the motional energy of molecules. More recently there has been a trend in chemistry and physics textbooks to describe entropy in terms of "dispersal of energy". Entropy can also involve the dispersal of particles, which are themselves energetic. Thus there are instances where both particles and energy disperse at different rates when substances are mixed together.

The mathematics developed in statistical thermodynamics were found to be applicable in other disciplines. In particular, information sciences developed the concept of information entropy where a constant replaces the Temperature which is inherent in thermodynamic entropy. Statistical mechanics is the application of statistics, which includes mathematical tools for dealing with large populations, to the field of mechanics, which is concerned with the motion of particles or objects when subjected to a force. ... Entropy of a Bernoulli trial as a function of success probability, often called the binary entropy function Entropy is a concept in thermodynamics (see thermodynamic entropy), statistical mechanics and information theory. ...

Heat and entropy

At a microscopic level motional energy of molecules is responsible for the temperature of a substance or a system. “Heat” is the motional energy of molecules being transferred: when motional energy is transferred from hotter surroundings to a cooler system, faster moving molecules in the surroundings collide with the walls of the system and some of their energy gets to the molecules of the system and makes them move faster.

• (molecules in a gas like nitrogen at room temperature at any instant are moving at an average speed of nearly a thousand miles an hour, constantly colliding and therefore exchanging energy so that their individual speeds are always changing, even being motionless for an instant if two molecules with exactly the same speed collide head-on, before another molecule hits them and they race off, as fast as 2500 miles an hour. At higher temperatures average speeds increase and motional energy becomes considerably greater.)
  • Thus motional molecular energy (‘heat energy’) from hotter surroundings like faster moving molecules in a flame or violently vibrating iron atoms in a hot plate will melt or to boil a substance (the system) at the temperature of its melting or boiling point. That amount of motional energy from the surroundings that is required for melting or boiling is called the phase change energy, specifically the enthalpy of fusion or of vaporization, respectively. This phase change energy breaks bonds between the molecules in the system (not chemical bonds inside the molecules that hold the atoms together) rather than contributing to the motional energy and making the molecules move any faster – so it doesn’t raise the temperature, but instead enables the molecules to break free to move as a liquid or as a vapor.
  • In terms of energy, when a solid becomes a liquid or a liquid a vapor, motional energy coming from the surroundings is changed to ‘ potential energy ‘ in the substance (phase change energy, which is released back to the surroundings when the surroundings become cooler than the substance's boiling or melting temperature, respectively). Phase change energy increases the entropy of a substance or system because it is energy that must be spread out in the system from the surroundings so that the substance can exist as a liquid or vapor at a temperature above its melting or boiling point. When this process occurs in a ‘universe’ that consists of the surroundings plus the system, the total energy of the universe becomes more dispersed or spread out as part of the greater energy that was only in the hotter surroundings transfers so that some is in the cooler system. This energy dispersal increases the entropy of the 'universe'.

The important overall principle is that ”Energy of all types changes from being localized to becoming dispersed or spread out, if it is not hindered from doing so. Entropy (or better, entropy change) is the quantitative measure of that kind of a spontaneous process: how much energy has been transferred/T or how widely it has become spread out at a specific temperature.

Classical calculation of entropy

When entropy was first defined and used in 1865 the very existence of atoms was still controversial and there was no concept that temperature was due to the motional energy of molecules or that “heat” was actually the transferring of that motional molecular energy from one place to another. Entropy change, ΔS, was described in macro terms that could be measured, such as volume or temperature or pressure. The 1865 equation, which is still completely valid, is that ΔS = q (rev)/T. This can be expanded, part by part, in modern terms of how molecules are responsible for what is happening. Here is that equation expanded:

• ΔS = the entropy of a system (i.e., of a substance or a group of substances), after some motional energy (“heat”) has been transferred to it by fast moving molecules, minus the entropy of that system before any such energy was transferred to it. So, ΔS = S (final) – S (initial).

• Then, ΔS = S (final) – S (initial) = q, the motional energy (“heat”) that is transferred "reversibly" (rev) to the system from the surroundings (or from another system of in in contact with the first system) divided by T, the absolute temperature at which the transfer occurs = q (rev) / T.
  • “Reversible” or “reversibly” (rev) simply means that T, the temperature of the system, has to stay (almost) exactly the same while any energy is being transferred to or from it. That’s easy in the case of phase changes, where the system absolutely must stay in the solid or liquid form until enough energy is given to it to break bonds between the molecules before it can change to a liquid or a gas. For example in the melting of ice at 273.0 K, no matter what temperature the surroundings are – from 273.1 K to 500 K or even higher, the temperature of the ice will stay at 273.0 K until the last molecules in the ice are changed to liquid water, i.e., until all the hydrogen bonds between the water molecules in ice are broken and new, less-exactly fixed hydrogen bonds between liquid water molecules are formed. This amount of energy necessary for ice melting per mole has been found to be 6008 joules at 273 K. Therefore, the entropy change per mole of q(rev)/T = 6008 J/273 K or 22 J/K.
  • When the temperature isn't at the melting or boiling point of a substance no intermolecular bond-breaking is possible, and so any motional molecular energy (“heat”) from the surroundings transferred to a system raises its temperature, making its molecules move faster and faster. As the temperature is constantly rising, there is no longer a particular value of “T” at which energy is transferred. However, a "reversible" energy transfer can be measured at a very small temperature increase, and a cumulative total can be found by adding each of many many small temperature intervals or increments. For example, to find the entropy change (q(rev)/T) from 300 K to 310 K, measure the amount of energy transferred at dozens or hundreds of temperature increments, say from 300.00 K to 300.01 K and then 300.01 to 300.02 and so on, dividing the q by each T, and finally adding them all.
  • Calculus can be used to make this calculation easier if the effect of energy input to the system is linearly dependent on the temperature change, as in simple heating of a system at moderate to relatively high temperatures. Thus, the energy being transferred “per incremental change in temperature” (the heat capacity, Cp), multiplied by the integral of dT/T from T(initial) to T(final), is directly given by ΔS = Cp ln (T(final)/T(initial)).

Introductory descriptions of entropy

Traditionally, 20th century textbooks have introduced entropy as order and disorder so that it provides "a measurement of the disorder or randomness of a system". Ambiguities in the terms used (such as "disorder" and "chaos") contribute to widespread confusion and can hinder comprehension of entropy for most students. A more recent formulation describing Entropy as energy dispersal describes entropy as measuring "the spontaneous dispersal of energy — at a specific temperature." Boltzmanns molecules (1896) shown at a rest position in a solid In thermodynamics, entropy, historically, has often been associated with the amount of order, disorder, and or chaos in a thermodynamic system. ... The thermodynamic concept of entropy can be described qualitatively as a measure of energy dispersal at a specific temperature. ...

Notes and references