The partition function provides a link between the microscopic properties of atoms and molecules (e.g. size, shape and characteristic energy levels) and the bulk thermodynamic properties of matter. In order to understand the partition function, how it can be derived, and why it works, it is important to recognize that these bulk thermodynamic properties reflect the average behavior of the atoms and molecules. For example, the pressure of a gas is really just the average force per unit area exerted by its particles as they collide with the container walls. It doesn't matter which particular particles strike the wall at any given time or even the force with which a given particle strikes the wall. In addition it is not necessary to consider the fluctuations in pressure as different numbers of particles hit the walls, since the magnitude of these fluctuations is likely to be extremely small. Only the average force produced by all the particles over time is important in determining the pressure. Similarly for other properties, it is the average behavior that is important. The partition function provides a way to determine the most likely average behavior of atoms and molecules given information about the microscopic properties of the material. In statistical mechanics, the partition function Z is an important quantity that encodes the statistical properties of a system in thermodynamic equilibrium. ... Thermodynamics (Greek: thermos = heat and dynamic = change) is the physics of energy, heat, work, entropy and the spontaneity of processes. ... Thermodynamics (Greek: thermos = heat and dynamic = change) is the physics of energy, heat, work, entropy and the spontaneity of processes. ...

In order to derive the partition function, consider a system composed of N molecules. Although the system has a constant total energy of E, the energy may be distributed among the molecules in any number of ways. As molecules interact, the energy is continually redistributed. Not only is energy exchanged between molecules, but between the various modes of motion (e.g. rotation, vibration, etc...). Instead of attempting to determine the energy of each individual molecule at every instant in time, we instead focus on the population of each energetic state. In other words, we would like to determine on average how many molecules, n_i, are in a particular energetic state, E_i. Over time the population of each state remains almost constant, although the individual molecules in each state may change at every collision.

In order to proceed we assume the ergodic hypothesis. This means that we assume that all states corresponding to a given energy are equally probable. (If there are other conserved quantities like particle number, this assumption becomes all states corresponding to a given energy and particle number/charge, and a similar derivation would lead to chemical potentials, electric potentials and the like) For example, vibrational states of a given energy are just as likely to be populated as rotational or electronic states of the same energy. We also assume that the molecules are independent in the sense that the total energy of the system is equal to the sum of the energies of each individual particle. In physics and thermodynamics, the ergodic hypothesis says that, over long periods of time, the time spent in some region of the phase space of microstates with the same energy is proportional to the volume of this region, i. ... The principle of indifference is a rule for assigning epistemic probabilities. ... The chemical potential of a thermodynamic system is the change in the energy of the sytem when an additional constituent particle is introduced, with the entropy and volume held fixed. ... Electric potential is the potential energy per unit charge associated with a static (time-invariant) electric field, also called the electrostatic potential, typically measured in volts. ...

At any instant there will be n₀ molecules in the state with energy E₀, n₁ with E₁, and so on. The complete specification of populations n₀, n₁,... for each energy state gives the instantaneous configuration of the system. For convenience we may write a particular configuration as {n₀, n₁,...}. We'll also take E₀ to correspond to the lowest energy level or the ground state.

A large number of configurations are possible. For instance one possible configuration is {N,0,0,...} with all of the molecules in the ground state, E₀. Another possible configuration could be {N-1,1,0,...}, where one of the molecules is in the excited state, E₁. Of these two configurations, the second is much more likely, since any of the N molecules could be in the excited state resulting in a total of N possible arrangements of molecules. On the other hand there is only one possible way to get the first configuration, since all of the molecules must be in the ground state. If the system were free to fluctuate between these two states, we would expect to find it most frequently in the second state, especially for large values of N. Since the system would most often be found in the second state, we would also expect the characteristics of the system to be dominated by the characteristics of that state.

The number of arrangements, W, corresponding to a given configuration {n₀, n₁,...} is given by:

This expression comes from combinatorics (and is applied in probability theory) and corresponds to the number of distinguishable ways N objects can be sorted into bins with n_i objects in bin i. Combinatorics is a branch of mathematics that studies finite collections of objects that satisfy specified criteria. ... Probability theory is the mathematical study of probability. ...

When working with large numbers it is often convenient to work with ln(W) instead of W itself. For this case:

Applying Stirling's approximation, In mathematics, Stirlings approximation (or Stirlings formula) is an approximation for large factorials. ...

and the fact that

gives

We showed previously that the configuration {N-1,1,0...} dominates {N,0,0,...} because there are more ways to obtain it. We would expect there to be other configurations that dominate both of these. In fact we would expect the configuration with the largest value of W to dominate all other configurations. We can find this dominant configuration by finding the maximum of the function W with respect to n_i. We know that when W is a maximum then ln(W) is also a maximum, so for convenience we will instead try to find the maximum of ln(W).

One way to find the maximum of ln(W) is to solve the equation:

However, Equation (4) applies to the situation in which any arbitrary configuration {n₀, n₁,...} is possible. In reality there are a few constraints on the system that must be accounted for. First, since the total number of molecules is fixed at N, not all values of n_i can be arbitrary. Instead only configurations in which:

are possible. Also, the total energy of the system is fixed at E. Therefore, since the total energy is the sum of the energies of all the individual molecules:

We can find the maximum of ln(W) subject to the constraints on N and E expressed in equations (5) and (6) using the method of Lagrange multipliers as follows. First, we must rearrange the constraint equations as: In mathematical optimization problems, Lagrange multipliers are a method for dealing with constraints. ...

Next, we create a new function by multiplying the constraints by the arbitrary constants -α' and β, and adding them to the original function, ln(W), to get:

Taking the derivative of Equation (8) and setting the result to zero gives:

We define a new parameter α = α' - 1, giving:

Solving this for n_i gives the most probable population of state E_i:

Finally, we must evaluate the constants α and β. Substituting Equation (10) back into Equation (5) and solving for exp(α) gives:

Changing the subscript to j and substituting this result back into Equation (10) gives the Maxwell-Boltzmann distribution: The Maxwell-Boltzmann distribution is a probability distribution with applications in physics and chemistry. ...

The Boltzmann distribution gives the most probable energy distribution of molecules in a system. It can further be shown that β = 1/kT, where k is Boltzmann's constant and T is the absolute temperature (given in kelvins). The term in the denominator is called the partition function and is defined as follows: The kelvin (symbol: K) is the SI unit of temperature, and is one of the seven SI base units. ...

The partition function provides a measure of the total number of energetic states that are accessible at a particular temperature and can be related to many different thermodynamic properties (see Statistical mechanics). Statistical mechanics is the application of statistics, which includes mathematical tools for dealing with large populations, to the field of mechanics, which is concerned with the motion of particles or objects when subjected to a force. ...

Canonical ensemble derivation

The previous derivation is too restricted. Because of its assumption of the independence of the molecules, it only really applies to ideal gases. In the following derivation, we assume the system is immersed in a "heat bath" environment with no transfer of matter across the boundary. The environment is assumed to be so much larger than the system that a huge influx of heat (energy) across the boundary in either direction would affect the system a lot but create very little of a change in its environment. Let's call the system S and the environment V, the energy of the system E_S and the energy of the environment E_V. The conservation of energy tells us E=E_S+E_V is conserved. Suppose the states of the system have energies E_i for the i^th state. The corresponding case for a continuum of states is similar in argument. Because the environment is so huge, even if its energy spectrum is discrete, the spacing between its energy levels is so small that for all intents and purposes, we can treat it as a continuum. So, let W(E_V) give the number of environmental states with energies between E_V and E_V+dE divided by dE. It's a general statistical observation that at least for tiny changes in energy (and because the environment is so huge, even what is considered an extremely, extremely huge energy transfer for the system, is still tiny for the environment) tends to vary exponentially with E. So, since the environment is so huge, A canonical ensemble in statistical mechanics is an ensemble of dynamically similar systems, each of which can share its energy with a large heat reservoir, or heat bath. ... An ideal gas or perfect gas is a hypothetical gas consisting of identical particles of negligible volume, undergoing perfectly elastic collisions, with no intermolecular forces and no intramolecular storage of energy. ...

as E_S varies over the entire range of energies the system can take without having astronomically tiny probabilities.

So, essentially, assuming ergodicity, the probability of the system being in state i is proportional to In mathematics, a measure-preserving transformation T on a probability space is said to be ergodic if the only measurable sets invariant under T have measure 0 or 1. ...

W(E − E_i)

which in turn is proportional to

.

Let's call β. Note that this is purely a property of the environment. Then,

Grand canonical ensemble derivation

Let's now assume both energy and matter can be exchanged with the once again very huge environment. Then, using the same arguments, In statistical mechanics, the grand canonical ensemble is a statistical ensemble, that means a set of identically prepared systems, each of which is in equilibrium with an external bath with respect to particle and energy exchange. ...

assuming particle number is conserved (otherwise, we would have ergodicity with respect to particle number). Particle numbers are always integral, but it still turns out this approximation is always valid for cases of interest.

As before, call β and -βμ_a (the chemical potential) and note these are solely the property of the environment. The chemical potential of a thermodynamic system is the change in the energy of the sytem when an additional constituent particle is introduced, with the entropy and volume held fixed. ...

.

Let's get back to the probability distribution of a molecule. As long as it doesn't interact too strongly with the other molecules (i.e. it's in a gas) we can assume the particle is a system and the rest of the gas is the reservoir. This leaves us with the same Boltzmann distribution. However, even for a nonideal gas, the energy is not simply the sum of the energy of the particle with the energy of the rest of the system because there are interaction terms, rendering the Boltzman distribution incorrect for the particle, even though it still continues to hold for the system as a whole. The Maxwell-Boltzmann distribution is a probability distribution with applications in physics and chemistry. ...

Actually, the assumption of a very huge reservoir is often overkill as long as the number of molecules in the system is astronomical. It turns out for these systems, the number of states of the system at a given energy varies exponentially with energy and the number of particles. So, the range of values over which P_i has appreciable value is often much smaller than E_S and N_S by many orders of magnitude. So, oftentimes, a reservoir much smaller than the system can work.