Note that the probability P(E), sometimes known as the absolute probability of E, is different from the conditional probability P(E|F). If the conditional probability P(E|F) is the same as the absolute probability P(E), that is, P(E|F) = P(E), then the two events E and F are said to be independent. In this example, the events E and F are not independent.
Definition 3.5.1 Let S be a sample space, and let E and F be any two events in S. The events E and F are called independent if and only if any one of the following is true:
(3.5.3)
(3.5.4)
(3.5.5)
The conditions in equations (3.5.3)–(3.5.5) are equivalent in the sense that if one is true, then the other two are true. We now have the following theorem, which gives rise to the so‐called multiplication rule.
Theorem 3.5.1 (Rule of multiplication of probabilities) If E and F are events in a sample space S such that
(3.5.6)
Equation (3.5.6) provides a two‐step rule for determining the probability of the occurrence of
Example 3.5.2 (Applying probability in testing quality) Two of the light bulbs in a box of six have broken filaments. If the bulbs are tested at random, one at a time, what is the probability that the second defective bulb is found when the third bulb is tested?
Solution: Let E be the event of getting one good and one defective bulb in the first two bulbs tested, and let F be the event of getting a defective bulb on drawing the third bulb. Then,
The sample space S in which E lies consists of all possible selections of two bulbs out of six, the number of elements in S being
For the case of three events,
(3.5.7)
provided that
(3.5.8)
Example 3.5.3 (Rolling a die n times) If a true die is thrown n times, what is the probability of never getting an ace (one‐spot)?
Solution: Let
3.6 Bayes's Theorem
An interesting version of the conditional probability formula (3.5.1) comes from the work of the Reverend Thomas Bayes. Bayes's result was published posthumously in 1763.
Suppose that E and F are two events in a sample space S and such that
(3.6.1)
Using