# Decomposition of Probability Measures

## Theorem

Let $\left({\Omega, \Sigma, P}\right)$ be a probability space.

Suppose that for every $\omega \in \Omega$, it holds that:

$\left\{{\omega}\right\} \in \Sigma$

i.e., that $\Sigma$ contains all singletons.

Then there exist a unique diffuse measure $\mu$ and a unique discrete measure $\nu$ such that:

$P = \mu + \nu$

## Proof

### Existence

For each $n \in \N$, define $\Omega_n$ by:

$\Omega_n := \left\{{\omega \in \Omega: P \left({\left\{{\omega}\right\}}\right) \ge \dfrac 1 n}\right\}$

Suppose that $\Omega_n$ has more than $n$ elements, and define $\Omega'_n$ to be a finite subset of $\Omega_n$ with $n + 1$ elements.

From Measure is Monotone and Measure is Finitely Additive Function, it follows that:

$\displaystyle 1 = P \left({\Omega}\right) \ge P \left({\Omega'_n}\right) = \sum_{\omega \mathop \in \Omega'_n} P \left({\left\{{\omega}\right\}}\right) \ge \frac {\left\vert{\Omega'_n}\right\vert} {n} = \frac {n + 1} {n}$

This is an obvious contradiction, whence $\Omega_n$ has at most $n$ elements, and in particular, $\Omega_n$ is finite.

It follows from Power of Reciprocal: Corollary that:

$\forall p > 0: \exists n \in \N: \dfrac 1 n < p$

Therefore, defining $\Omega_\infty$ by:

$\Omega_\infty := \left\{{\omega \in \Omega: P \left({\left\{{\omega}\right\}}\right) > 0}\right\}$

we have:

$\displaystyle \Omega_\infty = \bigcup_{n \mathop \in \N} \Omega_n$

whence by Countable Union of Countable Sets is Countable, $\Omega_\infty$ is countable.

Also, being the countable union of elements in $\Sigma$, $\Omega_\infty \in \Sigma$.

Thus, let $\left({\omega_n}\right)_{n \in \N}$ be an enumeration of $\Omega_\infty$.

Now define the discrete measure $\nu$ by:

$\displaystyle \nu := \sum_{n \mathop \in \N} P \left({\omega_n}\right) \delta_{\omega_n}$

Next, we define $\mu$ in the only possible way:

$\mu: \Sigma \to \overline{\R}: \mu \left({E}\right) := P \left({E}\right) - \nu \left({E}\right)$

It remains to verify that $\mu$ is a measure, and diffuse.

So let $E \in \Sigma$, and write, by Set Difference and Intersection form Partition:

$E = \left({E \cap \Omega_\infty}\right) \sqcup \left({E \setminus \Omega_\infty}\right)$

where $\sqcup$ signifies disjoint union.

Then we also have, trivially, the decomposition:

$\displaystyle E \cap \Omega_\infty = \bigsqcup_{\omega_n \mathop \in E} \left\{{\omega_n}\right\}$

Now, we can compute:

 $\displaystyle \nu \left({E}\right)$ $=$ $\displaystyle \sum_{n \mathop \in \N} P \left({\left\{ {\omega_n}\right\} }\right) \delta_{\omega_n} \left({E}\right)$ $\quad$ Definition of $\nu$ $\quad$ $\displaystyle$ $=$ $\displaystyle \sum_{\omega_n \mathop \in E} P \left({\left\{ {\omega_n}\right\} }\right)$ $\quad$ Definition of Dirac measure $\quad$ $\displaystyle$ $=$ $\displaystyle P \left({E \cap \Omega_\infty}\right)$ $\quad$ $P$ is a measure $\quad$ $\displaystyle \implies \ \$ $\displaystyle P \left({E}\right) - \nu \left({E}\right)$ $=$ $\displaystyle P \left({E \cap \Omega_\infty}\right) + P \left({E \setminus \Omega_\infty}\right) - P \left({E \cap \Omega_\infty}\right)$ $\quad$ Measure is Finitely Additive Function $\quad$ $\displaystyle$ $=$ $\displaystyle P \left({E \setminus \Omega_\infty}\right)$ $\quad$ $\quad$

From Set Difference as Intersection with Complement, we may write:

$E \setminus \Omega_\infty = E \cap \left({\Omega \setminus \Omega_\infty}\right)$

So for every $E \in \Sigma$, we have:

$\mu \left({E}\right) = P \left({E \cap \left({\Omega \setminus \Omega_\infty}\right)}\right)$

whence by $\mu$ is an intersection measure, and by Intersection Measure is Measure, a measure.

To show that $\mu$ is diffuse, let $\omega \in \Omega$; then:

$\mu \left({\left\{{\omega}\right\}}\right) = P \left({\left\{{\omega}\right\} \cap \left({\Omega \setminus \Omega_\infty}\right)}\right)$

Now, by definition of $\Omega_\infty$, we have:

$\left\{{\omega}\right\} \setminus \Omega_\infty = \begin{cases}\left\{{\omega}\right\} & \text{if$P \left({\left\{{\omega}\right\}}\right) = 0$}\\ \varnothing & \text{otherwise} \end{cases}$

and so in either case, it follows that:

$P \left({\left\{{\omega}\right\} \cap \left({\Omega \setminus \Omega_\infty}\right)}\right) = 0$

that is to say, $\mu$ is diffuse.

$\Box$

### Uniqueness

Let $P = \mu_1 + \nu_1 = \mu_2 + \nu_2$ be two decompositions.

Since $\mu_1$ and $\mu_2$ are diffuse, it follows that, for any $\omega \in \Omega$:

$P \left({\left\{{\omega}\right\}}\right) = \nu_1 \left({\left\{{\omega}\right\}}\right) = \nu_2 \left({\left\{{\omega}\right\}}\right)$

Suppose that we have the discrete measures $\nu_1$ and $\nu_2$ defined as:

$\displaystyle \nu_1 = \sum_{n \mathop \in \N} \kappa_n \delta_{x_n}$
$\displaystyle \nu_2 = \sum_{m \mathop \in \N} \lambda_m \delta_{y_m}$

where we take $\left({x_n}\right)_{n \in \N}$ and $\left({y_n}\right)_{n \in \N}$ to be sequences of distinct terms.

Then the equality derived for arbitrary $\omega$ above yields, taking $\omega = x_n$:

$\displaystyle \kappa_n = \sum_{m \mathop \in \N} \lambda_m \delta_{y_m} \left({\left\{{x_n}\right\}}\right)$

which by definition of Dirac measure implies the existence of a unique $m \in \N$ such that:

$x_n = y_m, \, \kappa_n = \lambda_m$

and reversing the argument, also an $n \in \N$ with this equality for every $y_m$.

That is, it must be that $\nu_1 = \nu_2$.

Whence $\mu_1 = P - \nu_1 = P - \nu_2 = \mu_2$, and uniqueness follows.

$\blacksquare$

## Axiom of Countable Choice

This theorem depends on the Axiom of Countable Choice, by way of Countable Union of Countable Sets is Countable.

Although not as strong as the Axiom of Choice, the Axiom of Countable Choice is similarly independent of the Zermelo-Fraenkel axioms.

As such, mathematicians are generally convinced of its truth and believe that it should be generally accepted.