Tutorial on Discrete Probability Distributions

Tutorial on discrete probability distributions with examples and detailed solutions.

Discrete Probability Distribution

Let \(X\) be a discrete random variable that takes the numerical values \(X_1, X_2, \ldots, X_n\) with probabilities \(p(X_1), p(X_2), \ldots, p(X_n)\) respectively. A discrete probability distribution consists of the values of the random variable \(X\) and their corresponding probabilities \(P(X)\).

The probabilities \(P(X)\) are such that:

\[\sum P(X) = 1\]

Example 1

Let the random variable \(X\) represents the number of boys in a family.

a) Construct the probability distribution for a family of two children.

b) Find the mean and standard deviation of \(X\).

Solution to Example 1

a) We first construct a tree diagram to represent all possible distributions of boys and girls in the family.

tree diagram for boys and girls distribution

Assuming that all the above possibilities are equally likely, the probabilities are:

\(P(X=2) = P(BB) = \frac{1}{4}\)

\(P(X=1) = P(BG) + P(GB) = \frac{1}{4} + \frac{1}{4} = \frac{1}{2}\)

\(P(X=0) = P(GG) = \frac{1}{4}\)

The discrete probability distribution of \(X\) is given by:

\(X\)\(P(X)\)
0\(\frac{1}{4}\)
1\(\frac{1}{2}\)
2\(\frac{1}{4}\)

Note that: \[\sum P(X) = 1\]

b) The mean \(\mu\) of the random variable \(X\) is defined by:

\[\mu = \sum X P(X)\]

\[= 0 \times \frac{1}{4} + 1 \times \frac{1}{2} + 2 \times \frac{1}{4} = 1\]

The standard deviation \(\sigma\) of the random variable \(X\) is defined by:

\[\sigma = \sqrt{\sum (X - \mu)^2 P(X)}\]

\[= \sqrt{(0 - 1)^2 \times \frac{1}{4} + (1 - 1)^2 \times \frac{1}{2} + (2 - 1)^2 \times \frac{1}{4}}\]

\[= \frac{1}{\sqrt{2}}\]

Example 2

Two balanced dice are rolled. Let \(X\) be the sum of the two dice.

a) Obtain the probability distribution of \(X\).

b) Find the mean and standard deviation of \(X\).

Solution to Example 2

a) When the two balanced dice are rolled, there are 36 equally likely possible outcomes as shown below.

possible outcomes when two dice are rolled

The possible values of \(X\) are: 2, 3, 4, 5, 6, 7, 8, 9, 10, 11 and 12.

The possible outcomes are equally likely hence the probabilities \(P(X)\) are given by:

\(P(2) = P(1,1) = \frac{1}{36}\)

\(P(3) = P(1,2) + P(2,1) = \frac{2}{36} = \frac{1}{18}\)

\(P(4) = P(1,3) + P(2,2) + P(3,1) = \frac{3}{36} = \frac{1}{12}\)

\(P(5) = P(1,4) + P(2,3) + P(3,2) + P(4,1) = \frac{4}{36} = \frac{1}{9}\)

\(P(6) = P(1,5) + P(2,4) + P(3,3) + P(4,2) + P(5,1) = \frac{5}{36}\)

\(P(7) = P(1,6) + P(2,5) + P(3,4) + P(4,3) + P(5,2) + P(6,1) = \frac{6}{36} = \frac{1}{6}\)

\(P(8) = P(2,6) + P(3,5) + P(4,4) + P(5,3) + P(6,2) = \frac{5}{36}\)

\(P(9) = P(3,6) + P(4,5) + P(5,4) + P(6,3) = \frac{4}{36} = \frac{1}{9}\)

\(P(10) = P(4,6) + P(5,5) + P(6,4) = \frac{3}{36} = \frac{1}{12}\)

\(P(11) = P(5,6) + P(6,5) = \frac{2}{36} = \frac{1}{18}\)

\(P(12) = P(6,6) = \frac{1}{36}\)

The discrete probability distribution of \(X\) is given by:

\(X\)\(P(X)\)
2\(\frac{1}{36}\)
3\(\frac{1}{18}\)
4\(\frac{1}{12}\)
5\(\frac{1}{9}\)
6\(\frac{5}{36}\)
7\(\frac{1}{6}\)
8\(\frac{5}{36}\)
9\(\frac{1}{9}\)
10\(\frac{1}{12}\)
11\(\frac{1}{18}\)
12\(\frac{1}{36}\)

The graph of the probability of the sum of two dice is shown below.

sum of two dice probability distribution

As an exercise, check that: \[\sum P(X) = 1\]

b) The mean of \(X\) is given by:

\[\mu = \sum X P(X)\]

\[= 2 \times \frac{1}{36} + 3 \times \frac{1}{18} + 4 \times \frac{1}{12} + 5 \times \frac{1}{9} + 6 \times \frac{5}{36} + 7 \times \frac{1}{6} + 8 \times \frac{5}{36} + 9 \times \frac{1}{9} + 10 \times \frac{1}{12} + 11 \times \frac{1}{18} + 12 \times \frac{1}{36}\]

\[= 7\]

The standard deviation is given by:

\[\sigma = \sqrt{\sum (X - \mu)^2 P(X)}\]

\[= \sqrt{(2-7)^2 \times \frac{1}{36} + (3-7)^2 \times \frac{1}{18} + (4-7)^2 \times \frac{1}{12} + (5-7)^2 \times \frac{1}{9} + (6-7)^2 \times \frac{5}{36} + (7-7)^2 \times \frac{1}{6} + (8-7)^2 \times \frac{5}{36} + (9-7)^2 \times \frac{1}{9} + (10-7)^2 \times \frac{1}{12} + (11-7)^2 \times \frac{1}{18} + (12-7)^2 \times \frac{1}{36}}\]

\[= 2.41\]

Example 3

Three coins are tossed. Let \(X\) be the number of heads obtained. Construct a probability distribution for \(X\) and find its mean and standard deviation.

Solution to Example 3

The tree diagram representing all possible outcomes when three coins are tossed is shown below.

tree diagram for all possible outcomes when three coins are tossed.

Assuming that all three coins are identical and all possible outcomes are equally likely, the probabilities are:

\(P(X=0) = P(TTT) = \frac{1}{8}\)

\(P(X=1) = P(HTT) + P(THT) + P(TTH) = \frac{1}{8} + \frac{1}{8} + \frac{1}{8} = \frac{3}{8}\)

\(P(X=2) = P(HHT) + P(HTH) + P(THH) = \frac{1}{8} + \frac{1}{8} + \frac{1}{8} = \frac{3}{8}\)

\(P(X=3) = P(HHH) = \frac{1}{8}\)

The discrete probability distribution of \(X\) is given by:

\(X\)\(P(X)\)
0\(\frac{1}{8}\)
1\(\frac{3}{8}\)
2\(\frac{3}{8}\)
3\(\frac{1}{8}\)

Note that: \[\sum P(X) = 1\]

We now compute the mean \(\mu\) of the random variable \(X\) as follows:

\[\mu = \sum X P(X)\]

\[= 0 \times \frac{1}{8} + 1 \times \frac{3}{8} + 2 \times \frac{3}{8} + 3 \times \frac{1}{8} = 1.5\]

We now compute the standard deviation \(\sigma\) of the random variable \(X\) as follows:

\[\sigma = \sqrt{\sum (X - \mu)^2 P(X)}\]

\[= \sqrt{(0 - 1.5)^2 \times \frac{1}{8} + (1 - 1.5)^2 \times \frac{3}{8} + (2 - 1.5)^2 \times \frac{3}{8} + (3 - 1.5)^2 \times \frac{1}{8}}\]

\[= 0.87 \text{ (rounded to 2 decimal places)}\]

More References and links

elementary statistics and probabilities