โ† back to probability

Combinatorics

Grinstead & Snell ยท GFDL ยท PDF

Probability on finite sets reduces to counting. Permutations count ordered arrangements, combinations count unordered selections, and the binomial coefficient C(n, k) = n! / (k!(n-k)!) ties them together. Pascal's triangle is the lookup table.

Permutations โ€” order matters

A permutation of n objects is an arrangement in a specific order. There are n! = n × (n-1) × ... × 1 permutations. If you only arrange k objects out of n, there are n!/(n-k)! ways (the "falling factorial" P(n,k)).

Scheme

Combinations โ€” order does not matter

A combination selects k items from n without caring about order. C(n, k) = n! / (k!(n-k)!). This is the binomial coefficient, often written "n choose k." It counts the number of k-element subsets of an n-element set.

Scheme

Pascal's triangle

Each entry in Pascal's triangle is C(n, k). The entry equals the sum of the two entries above it: C(n, k) = C(n-1, k-1) + C(n-1, k). The n-th row gives the coefficients of (a + b)^n.

1 n=0 1 1 n=1 1 2 1 n=2 1 3 3 1 n=3 1 4 6 4 1 n=4 C(n,k) = C(n-1, k-1) + C(n-1, k)
Scheme

The binomial theorem

(a + b)^n = ∑ C(n, k) a^k b^(n-k) for k from 0 to n. This connects algebra to counting. Setting a = b = 1 gives 2^n = ∑ C(n, k), the total number of subsets of an n-element set.

Scheme

Counting for probability

With uniform distributions, P(E) = |E|/|Ω|. Combinatorics gives you |E| and |Ω|. The probability of exactly k heads in n fair coin flips is C(n, k) / 2^n.

Scheme

Notation reference

Textbook Scheme Meaning
n!(factorial n)Factorial
P(n, k)(permutations n k)Ordered arrangements
C(n, k) = (n k)(choose n k)Binomial coefficient
(a+b)^n(binomial-expand a b n)Binomial theorem
C(n,k)/2^n(coin-prob n k)Probability of k heads in n flips
Neighbors

Adjacent chapters

Paper pages

Foundations (Wikipedia)

Ready for the real thing? Read Ch 3 of Grinstead & Snell.