Master conditional probability, multiplication theorem, independent events, total probability, and Bayes' theorem — with visual diagrams, step-marked solutions, MCQs, A-R, and PYQs.
Understanding conditional probability and beyond
In earlier classes, we studied probability as a measure of uncertainty of events in a random experiment. We discussed the axiomatic approach formulated by Russian Mathematician A.N. Kolmogorov.
In this chapter, we discuss conditional probability of an event given that another event has occurred — which leads to Bayes' theorem, multiplication rule, and independence of events.
If E and F are two events associated with the same sample space, the conditional probability of E given that F has occurred is:
$$P(E|F) = \frac{P(E \cap F)}{P(F)}, \text{ provided } P(F) \neq 0$$
Example: Three fair coins are tossed. E = "at least two heads", F = "first coin shows tail". Then $P(E|F) = 1/4$.
$P(S|F) = P(F|F) = 1$
$P((A \cup B)|F) = P(A|F) + P(B|F) - P((A \cap B)|F)$
If A and B are disjoint: $P((A \cup B)|F) = P(A|F) + P(B|F)$
$P(E'|F) = 1 - P(E|F)$
See probability concepts in action
Probability of E given F has occurred
If E and F are events with $P(F) \neq 0$, then:
$$P(E|F) = \frac{P(E \cap F)}{P(F)}$$
Intuition: When F is known to have occurred, the sample space reduces from S to F. The conditional probability is the fraction of F in which E also occurs.
Experiment: Toss three fair coins.
S = {HHH, HHT, HTH, THH, HTT, THT, TTH, TTT}
E = "at least two heads" = {HHH, HHT, HTH, THH}
F = "first coin shows tail" = {THH, THT, TTH, TTT}
$E \cap F = \{THH\}$
$P(E) = 1/2$, $P(F) = 1/2$, $P(E \cap F) = 1/8$
$$P(E|F) = \frac{1/8}{1/2} = \frac{1}{4}$$
$P(S|F) = P(F|F) = 1$
$P((A \cup B)|F) = P(A|F) + P(B|F) - P((A \cap B)|F)$
For disjoint events: $P((A \cup B)|F) = P(A|F) + P(B|F)$
$P(E'|F) = 1 - P(E|F)$
Probability of simultaneous occurrence
$$P(E \cap F) = P(E) \cdot P(F|E) = P(F) \cdot P(E|F)$$
provided $P(E) \neq 0$ and $P(F) \neq 0$.
$$P(E \cap F \cap G) = P(E) \cdot P(F|E) \cdot P(G|E \cap F)$$
Extension: The rule extends to four or more events naturally.
An urn contains 10 black and 5 white balls. Two balls are drawn without replacement.
P(both black) = $P(E) \cdot P(F|E) = \frac{10}{15} \times \frac{9}{14} = \frac{3}{7}$
Three cards drawn without replacement. P(King, King, Ace):
$P(K) = 4/52$, $P(K|K) = 3/51$, $P(A|KK) = 4/50$
$P(KKA) = \frac{4}{52} \times \frac{3}{51} \times \frac{4}{50} = \frac{2}{5525}$
Events that don't affect each other
Two events E and F are said to be independent if:
$$P(E \cap F) = P(E) \cdot P(F)$$
Equivalently: $P(E|F) = P(E)$ and $P(F|E) = P(F)$ (when the conditionals exist).
Three events A, B, C are mutually independent if:
$P(A \cap B) = P(A)P(B)$
$P(A \cap C) = P(A)P(C)$
$P(B \cap C) = P(B)P(C)$
$P(A \cap B \cap C) = P(A)P(B)P(C)$
All four conditions must hold.
Independent ≠ Mutually Exclusive
Weighted sum over a partition
Events $E_1, E_2, \ldots, E_n$ form a partition of S if:
Where $\{E_1, \ldots, E_n\}$ is a partition of S and A is any event.
P(strike) = 0.65, P(completed | no strike) = 0.80, P(completed | strike) = 0.32
$P(A) = 0.65 \times 0.32 + 0.35 \times 0.80 = 0.208 + 0.28 = 0.488$
Reverse conditional probability
If $E_1, E_2, \ldots, E_n$ are pairwise disjoint and exhaustive events (a partition of S), and A is any event with $P(A) \neq 0$, then for any $i$:
$$P(E_i|A) = \frac{P(E_i) \cdot P(A|E_i)}{\sum_{j=1}^{n} P(E_j) \cdot P(A|E_j)}$$
Bag I: 3R, 4B ; Bag II: 5R, 6B. One ball drawn from randomly selected bag and is red.
$P(\text{Bag II} | R) = \frac{(1/2)(5/11)}{(1/2)(3/7) + (1/2)(5/11)} = \frac{35}{68}$
Machines A, B, C produce 25%, 35%, 40% with defect rates 5%, 4%, 2%.
P(defective from B) = $\frac{0.35 \times 0.04}{0.25 \times 0.05 + 0.35 \times 0.04 + 0.40 \times 0.02} = \frac{28}{69}$
Memorize these for board exams
Where $\{E_1, \ldots, E_n\}$ is a partition of S.
Speed techniques for probability problems
Ask: What is given? What is asked?
For "and" problems with sequential draws:
Compute P(E)·P(F) and compare with P(E∩F)
Use the complement trick!
Identify partition first!
Draw a tree!
Don't confuse them!
Count directly when the sample space is small
Use symmetry to simplify
Always verify:
Click "Show Answer" to reveal step-by-step solutions with marks
Q1. If $P(A) = 7/13$, $P(B) = 9/13$, and $P(A \cap B) = 4/13$, evaluate $P(A|B)$.
$P(A|B) = \frac{P(A \cap B)}{P(B)}$
$= \frac{4/13}{9/13} = \frac{4}{9}$
$P(A|B) = 4/9$
Q2. A family has two children. What is the probability that both are boys given that at least one is a boy?
S = {(b,b), (g,b), (b,g), (g,g)}
E = "both boys" = {(b,b)}
F = "at least one boy" = {(b,b), (g,b), (b,g)}
$P(F) = 3/4$, $P(E \cap F) = 1/4$
$P(E|F) = \frac{1/4}{3/4} = \frac{1}{3}$
Q3. A die is thrown twice and the sum is 6. Find the conditional probability that 4 appears at least once.
E = "4 appears at least once" ; F = "sum is 6"
F = {(1,5), (2,4), (3,3), (4,2), (5,1)} → 5 outcomes
E ∩ F = {(2,4), (4,2)} → 2 outcomes
$P(F) = 5/36$, $P(E \cap F) = 2/36$
$P(E|F) = \frac{2/36}{5/36} = \frac{2}{5}$
Q4. An urn contains 10 black and 5 white balls. Two balls are drawn without replacement. Find P(both black).
E = "first ball is black" ; F = "second ball is black"
$P(E) = \frac{10}{15} = \frac{2}{3}$
After one black ball is drawn: 9 black, 5 white, total 14
$P(F|E) = \frac{9}{14}$
$P(E \cap F) = \frac{10}{15} \times \frac{9}{14} = \frac{3}{7}$
Q5. Bag I: 3R, 4B ; Bag II: 5R, 6B. One bag chosen at random, a red ball is drawn. Find P(from Bag II).
$E_1$ = Bag I chosen, $E_2$ = Bag II chosen, A = red drawn
$P(E_1) = P(E_2) = 1/2$
$P(A|E_1) = 3/7$, $P(A|E_2) = 5/11$
$P(E_2|A) = \frac{(1/2)(5/11)}{(1/2)(3/7) + (1/2)(5/11)}$
$= \frac{5/22}{3/14 + 5/22} = \frac{5/22}{68/154} = \frac{35}{68}$
Q6. Machines A, B, C produce 25%, 35%, 40% of items with defect rates 5%, 4%, 2%. A defective item is found. Find P(from B).
$P(B_1) = 0.25$, $P(B_2) = 0.35$, $P(B_3) = 0.40$
$P(E|B_1) = 0.05$, $P(E|B_2) = 0.04$, $P(E|B_3) = 0.02$
$P(B_2|E) = \frac{0.35 \times 0.04}{0.25 \times 0.05 + 0.35 \times 0.04 + 0.40 \times 0.02}$
$= \frac{0.0140}{0.0345} = \frac{28}{69}$
Q7. A man speaks truth 3 out of 4 times. He reports a six. Find P(it's actually a six).
$S_1$ = six occurs, $S_2$ = six does not occur
$P(S_1) = 1/6$, $P(S_2) = 5/6$
E = "reports six"
$P(E|S_1) = 3/4$, $P(E|S_2) = 1/4$
$P(S_1|E) = \frac{(1/6)(3/4)}{(1/6)(3/4) + (5/6)(1/4)}$
$= \frac{3/24}{3/24 + 5/24} = \frac{3}{8}$
Q8. If A and B are independent with P(A) = 3/5 and P(B) = 1/5, find P(A∩B) and P(A∪B).
$P(A \cap B) = P(A) \cdot P(B)$
$P(A \cap B) = \frac{3}{5} \times \frac{1}{5} = \frac{3}{25}$
$P(A \cup B) = P(A) + P(B) - P(A \cap B)$
$= \frac{3}{5} + \frac{1}{5} - \frac{3}{25} = \frac{15+5-3}{25} = \frac{17}{25}$
$P(A \cap B) = 3/25$, $P(A \cup B) = 17/25$
Select your answer and click "Check Answers"
Each question has an Assertion (A) and a Reason (R). Choose the correct option.
(A) Both A and R are true, and R is the correct explanation of A.
(B) Both A and R are true, but R is NOT the correct explanation of A.
(C) A is true, but R is false.
(D) A is false, but R is true.
Frequently asked questions in board exams
Q. If $P(A) = 7/13$, $P(B) = 9/13$, $P(A \cap B) = 4/13$, evaluate $P(A|B)$.
$P(A|B) = \frac{P(A \cap B)}{P(B)}$
$= \frac{4/13}{9/13} = 4/9$
$4/9$
Q. A family has two children. Find P(both are boys) given at least one is a boy.
S = {BB, BG, GB, GG}
E = {BB} ; F = {BB, BG, GB}
$P(F) = 3/4$, $P(E \cap F) = 1/4$
$P(E|F) = \frac{1/4}{3/4} = 1/3$
Q. Bag I: 3R, 4B ; Bag II: 5R, 6B. One bag chosen at random, red ball drawn. Find P(from Bag II).
$P(E_1) = P(E_2) = 1/2$ ; $P(A|E_1) = 3/7$, $P(A|E_2) = 5/11$
$P(E_2|A) = \frac{(1/2)(5/11)}{(1/2)(3/7)+(1/2)(5/11)} = \frac{35}{68}$
$35/68$
Q. A die is thrown twice, sum is 6. Find P(4 appears at least once | sum = 6).
E = "4 appears at least once" ; F = "sum is 6"
F = {(1,5),(2,4),(3,3),(4,2),(5,1)} → 5 outcomes
E∩F = {(2,4),(4,2)} → 2 outcomes
$P(E|F) = \frac{2/36}{5/36} = 2/5$
Q. Machines A, B, C produce 25%, 35%, 40% with defect rates 5%, 4%, 2%. Defective found. Find P(from B).
$P(B_1)=0.25$, $P(B_2)=0.35$, $P(B_3)=0.40$
$P(E|B_1)=0.05$, $P(E|B_2)=0.04$, $P(E|B_3)=0.02$
$P(B_2|E) = \frac{0.0140}{0.0345} = \frac{28}{69}$
$28/69$
Q. A man speaks truth 3/4 times. Reports a six. Find P(it's actually a six).
$P(S_1)=1/6$, $P(S_2)=5/6$
$P(E|S_1)=3/4$, $P(E|S_2)=1/4$
$P(S_1|E) = \frac{3/24}{3/24+5/24} = \frac{3}{8}$
$3/8$
Q. If A and B are independent with P(A) = 3/5, P(B) = 1/5, find P(A∩B) and P(A∪B).
$P(A \cap B) = \frac{3}{5} \times \frac{1}{5} = \frac{3}{25}$
$P(A \cup B) = \frac{3}{5} + \frac{1}{5} - \frac{3}{25} = \frac{17}{25}$
$3/25$ and $17/25$
Q. An urn contains 10 black and 5 white balls. Two drawn without replacement. Find P(both black).
$P(E) = \frac{10}{15}$
$P(F|E) = \frac{9}{14}$
$\frac{10}{15} \times \frac{9}{14} = \frac{3}{7}$
$3/7$