Probability: Basic Concepts

Introduction to Probability: Basic Concepts

Probability is the branch of mathematics that studies the likelihood (chance) of different events or outcomes occurring. It provides a way to measure uncertainty numerically, allowing us to make informed predictions and decisions in situations where the outcome is not certain in advance. Probability concepts are used in everyday life, from weather forecasting and games of chance, to insurance, medicine, and scientific research.

Basic Probability Terms

An experiment (or trial) is an action or process that leads to a result, such as tossing a coin or rolling a die. An outcome is a possible result of an experiment, such as getting "heads" when tossing a coin. The sample space is the set of all possible outcomes of an experiment; for example, the sample space for tossing a coin is {Heads, Tails}, and for rolling a standard six-sided die is {1, 2, 3, 4, 5, 6}. An event is a specific outcome or a set of outcomes that we are interested in, such as rolling an even number on a die.

The Probability Scale

Probability is always expressed as a number between 0 and 1 (inclusive), or equivalently as a percentage between 0% and 100%. A probability of 0 means an event is impossible and can never happen (such as rolling a 7 on a standard six-sided die). A probability of 1 means an event is certain and will always happen (such as the sun rising tomorrow). Probabilities between 0 and 1 indicate varying degrees of likelihood, with values closer to 1 representing more likely events, and values closer to 0 representing less likely events.

Calculating Theoretical Probability

The theoretical probability of an event is calculated using the formula: P(Event) = (Number of favourable outcomes) ÷ (Total number of possible outcomes), assuming all outcomes are equally likely. For example, the probability of rolling a 4 on a standard six-sided die is P(4) = 1/6, since there is only one favourable outcome (rolling a 4) out of six equally likely possible outcomes.

Calculating Probability of Compound Events

Sometimes we are interested in the probability of more than one specific outcome. For example, the probability of rolling an even number (2, 4, or 6) on a six-sided die is P(even) = 3/6 = 1/2, since there are three favourable outcomes (2, 4, and 6) out of six total possible outcomes.

Probability with a Standard Deck of Cards

Probability problems often use a standard deck of 52 playing cards, which contains 4 suits (hearts, diamonds, clubs, and spades), each with 13 cards. For example, the probability of drawing a heart from a well-shuffled deck is P(heart) = 13/52 = 1/4, since there are 13 hearts out of 52 total cards.

Experimental (Empirical) Probability

Experimental probability is based on actually carrying out an experiment or observing real data, rather than theoretical reasoning about equally likely outcomes. It is calculated as: Experimental Probability = (Number of times the event occurred) ÷ (Total number of trials). For example, if a coin is tossed 50 times and lands on heads 28 times, the experimental probability of heads is 28/50 = 0.56, which may differ slightly from the theoretical probability of 0.5 due to natural random variation, especially with a smaller number of trials.

The Law of Large Numbers

The law of large numbers states that as the number of trials in an experiment increases, the experimental probability tends to get closer and closer to the theoretical probability. This is why, for example, tossing a fair coin only a few times might produce an uneven result, but tossing it thousands of times will produce a proportion of heads very close to the theoretical probability of 0.5 (50%).

Complementary Events

The complement of an event A, written A' (or "not A"), consists of all the outcomes in the sample space that are not part of event A. The probability of an event and its complement always add up to 1, expressed as: P(A) + P(A') = 1, or equivalently P(A') = 1 − P(A). For example, if the probability of rain tomorrow is 0.3, the probability of no rain tomorrow is 1 − 0.3 = 0.7.

Mutually Exclusive Events

Two events are mutually exclusive if they cannot both occur at the same time, meaning they share no common outcomes. For example, when rolling a single die, the events "rolling a 2" and "rolling a 5" are mutually exclusive, since a single roll cannot produce both outcomes simultaneously. For mutually exclusive events, the probability of either event occurring is found using the addition rule: P(A or B) = P(A) + P(B).

Independent Events

Two events are independent if the occurrence of one event does not affect the probability of the other event occurring. For example, tossing a coin and rolling a die are independent events, since the result of the coin toss has no effect on the result of the die roll. For independent events, the probability of both events occurring together is found using the multiplication rule: P(A and B) = P(A) × P(B). For example, the probability of tossing heads and rolling a 6 is P(heads) × P(6) = (1/2) × (1/6) = 1/12.

Using Probability Trees

A probability tree diagram is a visual tool used to show all possible outcomes of a sequence of events, along with their probabilities, making it easier to calculate the probability of combined events, especially involving two or more stages, such as tossing a coin twice or drawing two cards from a deck without replacement.

Real-Life Applications of Probability

Probability concepts are used extensively in real life: weather forecasters use probability to predict the chance of rain or other weather events; insurance companies use probability to calculate premiums based on the likelihood of accidents, illness, or other claims; games of chance, such as lotteries and board games, rely entirely on probability; medical researchers use probability to evaluate the effectiveness and risks of treatments; and businesses use probability in quality control and risk assessment.

Common Mistakes in Probability

Common errors in probability include assuming all outcomes are equally likely when they are not (such as assuming a biased coin behaves the same as a fair one), confusing "or" situations (requiring addition) with "and" situations (requiring multiplication), forgetting that probabilities must always fall between 0 and 1, and incorrectly calculating probabilities for events that are not actually independent or not actually mutually exclusive.

Summary

Probability measures the likelihood of an event occurring, expressed as a value between 0 (impossible) and 1 (certain). Theoretical probability is calculated using the ratio of favourable outcomes to total possible outcomes, while experimental probability is based on the results of actual trials, converging towards theoretical probability as the number of trials increases, according to the law of large numbers. Key concepts such as complementary events, mutually exclusive events, and independent events provide important tools for calculating the probability of more complex situations, with wide-ranging applications across science, business, and everyday decision-making.

Practising Probability Problems

Probability becomes much more intuitive with regular practice using familiar objects such as coins, dice, and playing cards, since these examples make it easy to check whether a calculated probability makes intuitive sense. Students should practise identifying whether a given problem involves "and" (requiring multiplication for independent events) or "or" (requiring addition for mutually exclusive events), and should practise using probability tree diagrams to break more complex, multi-stage problems into simpler, manageable steps.

Worked Examples

Example 1: Find the probability of rolling a 3 on a fair six-sided die. P(3) = 1/6 = 1/6.

Example 2: Find the probability of drawing a king from a standard deck of 52 cards. There are 4 kings, so P(king) = 4/52 = 1/13.

Example 3: The probability of rain tomorrow is 0.4. Find the probability of no rain tomorrow. P(no rain) = 1 − 0.4 = 0.6.

Example 4: Find the probability of rolling a 2 or a 5 on a single die roll (mutually exclusive events). P(2 or 5) = P(2) + P(5) = 1/6 + 1/6 = 2/6 = 1/3.

Example 5: Find the probability of tossing a coin and getting heads, and rolling a die and getting a 4 (independent events). P(heads and 4) = P(heads) × P(4) = (1/2) × (1/6) = 1/12.

Student Exercise

Solve the following problems, showing all your working:

1. Find the probability of rolling a number greater than 4 on a fair six-sided die.
2. Find the probability of drawing a spade from a standard deck of 52 cards.
3. If the probability of passing an exam is 0.85, find the probability of not passing.
4. A bag contains 5 red balls, 3 blue balls, and 2 green balls. Find the probability of picking a blue ball at random.
5. Find the probability of rolling a 2 or a 6 on a single die roll.
6. Find the probability of tossing a coin and getting heads, and rolling a die and getting a 5.
7. A coin is tossed 40 times and lands on heads 18 times. Find the experimental probability of heads.
8. Find the probability of drawing a card that is either a heart or a diamond from a standard deck.
9. Two dice are rolled together. Find the probability that both show a 6.
10. A box contains 10 identical balls numbered 1 to 10. Find the probability of picking a number that is a multiple of 3.