An Operadic View of the Law of Total Probability1. The Operad of Probability Simplices2. What Does the Composition Mean?3. Measurable Partitions as a Colored Operad 4. Probability as an Operad Morphism5. The Simplex Operad Acts on
An Operadic View of the Law of Total Probability
The standard simplex
may be identified with the space of probability measures on an
This simple observation leads to an operadic interpretation of the law of total probability.
The basic notions of symmetric colored operads, their morphisms, algebras, and algebra morphisms are recalled in the appendix. We use the terms symmetric colored operad and symmetric multicategory interchangeably; see Leinster [Lei04].
1. The Operad of Probability Simplices
For
Thus an element
is an
We may regard
The operadic structure is most transparent in terms of partial composition.
Let
and
For
Thus the
Since
we indeed obtain an element of
The unit is
and the symmetric group acts by permuting coordinates.
2. What Does the Composition Mean?
Consider
Interpret this as a random choice among three alternatives
with probabilities
Suppose that we now refine only the second alternative. Conditional on being in
with conditional distribution
Then
hence
The four final branches have probabilities
Thus the meaning of
3. Measurable Partitions as a Colored Operad
Now fix a probability space
For the moment, we restrict to measurable events
and to partitions whose pieces also have positive probability. This avoids the ambiguity of conditioning on null events.
Define a colored operad
Its colors are the positive-probability measurable events
There is an operation
precisely when
Thus an operation is a finite ordered measurable partition of
The colored structure records exactly which event is being refined. If
and
then the second decomposition may be inserted only into the
Their partial composition is the refined partition
The output color remains
Thus
Associativity says that successive refinements may be grouped in any order without changing the final partition.
4. Probability as an Operad Morphism
The probability measure now gives a natural map from the partition colored operad to the simplex operad.
Since
For an operation
define
We claim that
is a morphism of colored operads.
The essential point is compatibility with partial composition.
Suppose
and the
Write
and
The partial composite in the simplex operad is
whose new coordinates in the
Since
Hence
So the elementary identity
is exactly the condition that probability preserve operadic composition.
This gives a structural interpretation of conditional probability:
5. The Simplex Operad Acts on
The interval
determines an
given by
These operations are compatible with operadic composition. Indeed,
which is precisely the operation corresponding to
Thus
Equivalently, in
is an operad morphism.
Combining this with
Consequently, every measurable partition
acts on
6. The Law of Total Probability
Fix an event
For each positive-probability event
Now let
The operation associated to this partition is
Substituting
gives
The law of total probability states that this is exactly
Hence
Equivalently,
Thus the law of total probability says that the family
is compatible with the operations of the partition colored operad.
When
7. The Law of Total Probability as a Morphism of Algebras
The preceding interpretation can be sharpened further.
Recall that the composite
defines a
to every color
For each measurable partition
the corresponding algebra operation is
given explicitly by
Thus the colored operad
through conditional-probability-weighted barycentric combinations.
The law of total probability can now be expressed as a morphism into this algebra.
7.1 The Terminal Algebra
For every color
be the one-point set.
These one-point sets form a
Indeed, for every operation
there is exactly one possible map
Explicitly,
All operadic compatibility conditions are automatic, since every relevant map between singleton sets is unique.
Moreover,
7.2 A Fixed Event Determines a Family of Elements
Now fix an event
For every positive-probability event
Equivalently, an element of
defined by
Thus a fixed event
At this point, however,
The question is:
When is this family a morphism of
-algebras?
The answer is precisely: when the law of total probability holds.
7.3 The Algebra-Morphism Condition
By definition,
the diagram
commutes.
Since the upper row is the unique map between singleton sets, there is only one input to check:
Going first across the top and then down the right gives
Going first down the left and then across the bottom gives
and then
Therefore the diagram commutes if and only if
But this is exactly the conditional form of the law of total probability.
Hence:
if and only if
for every admissible measurable partition
Thus the law of total probability can be reformulated as the statement
Equivalently, this compatible point is the algebra morphism
7.4 What Does This Reformulation Add?
At first sight, this may appear to be only a categorical rewriting of the familiar identity
However, the algebra-morphism formulation packages a stronger structural statement.
The law of total probability is not attached to a single partition. For fixed
Thus the family
is compatible with the entire system of measurable refinements.
In particular, if
and each
then the algebra-morphism condition may be applied first to each
Because
and therefore
Hence the compatibility encoded by
We may therefore separate the structure into three levels:
For a fixed event
then says that the conditional probabilities
respect this entire compositional structure.
This gives a concise operadic interpretation of the law of total probability:
Or, in purely operadic language,
8. Further Refinement
Suppose
Applying the law of total probability first inside each
Applying it again at the outer level gives
Using
we obtain
This familiar refinement invariance is the combined effect of:
associativity in the partition colored operad;
the fact that
preserves operadic composition;the compatibility of the simplex-operad action on
.
In other words, a probability tree may be evaluated level by level or flattened first. The result is the same.
9. The Basic Diagram
The whole construction may be summarized by
The three terms have distinct meanings:
and
Thus
From this point of view, the law of total probability is not an isolated summation identity. It expresses the compatibility between these three compositional structures.
Appendix A. Colored Operads
We recall only the conventions used above. For a systematic treatment in the language of multicategories, see Leinster [Lei04].
Let
A symmetric
for colors
An element
is thought of as an operation
If
and
then the partial composite
is obtained by inserting
The associativity axioms express the independence of iterated substitution from the order in which a rooted operation tree is composed.
An ordinary operad is precisely a one-colored colored operad.
A category may be regarded as a colored operad in which all non-unary operation sets are empty.
Appendix B. Morphisms of Colored Operads
Let
A morphism
consists of a map of colors
and maps
compatible with units, permutations, and operadic composition.
In particular,
The source and target operads need not have the same set of colors.
Appendix C. Algebras and Algebra Morphisms
Let
An
No closedness assumption on
If
and a morphism
A morphism
such that every operadic operation is preserved:
References
[Lei04] Tom Leinster, Higher Operads, Higher Categories, London Mathematical Society Lecture Note Series 298, Cambridge University Press, 2004.
Collaboration Report
This note grew out of a sequence of discussions between Marco and ChatGPT concerning operadic structures in probability theory.
Marco's contribution. Marco initiated the main conceptual direction of the note. In particular, he observed that the standard simplex
ChatGPT's contribution. ChatGPT assisted in formalizing and checking these ideas. This included making the colored-operad structure on measurable partitions precise, formulating the morphism
verifying that its compatibility with partial composition is exactly the identity
and identifying the natural action of the simplex operad on
is a morphism of
The resulting note is therefore based on Marco's mathematical questions and structural insights, with ChatGPT serving primarily as a tool for formalization, verification, and exposition.