Part 3: Probability
Probability is the engine that powers inference.
If that sentence doesn't mean much to you yet, that's fine — it will soon. But here's the short version: everything you'll do in the second half of this book (confidence intervals, hypothesis tests, regression) depends on probability. Probability is how we move from "here's what I see in my sample" to "here's what I can say about the world." Without it, statistics would just be a fancy way of making tables and graphs. With it, statistics becomes a tool for making decisions under uncertainty.
And let's be honest — probability can feel abstract at first. Coins and dice and cards. It can seem like a detour from the real-world data analysis you signed up for. But I promise it's not. Every time a weather app says there's a 30% chance of rain, that's probability. Every time a medical test gives a false positive, that's probability. Every time an AI recommends a song or flags a credit card transaction as fraudulent, probability is running under the hood.
The goal of these three chapters isn't to turn you into a mathematician. It's to give you the probabilistic intuition you need to understand why inference works.
Chapter 8 lays the foundation. You'll learn what probability actually means (there's more debate about this than you'd expect), and you'll master the basic rules — addition, multiplication, complementary probability. You'll work with contingency tables and get comfortable thinking about events, outcomes, and sample spaces. The key threshold concept here is probability as long-run frequency: the shift from thinking "will this happen?" to thinking "how often does this happen in the long run?"
Chapter 9 takes you deeper with conditional probability and Bayes' theorem. This is where things get genuinely interesting — and genuinely tricky. You'll learn why the probability of having a disease given a positive test is not the same as the probability of a positive test given a disease (a confusion that has real consequences in medicine and criminal justice). Bayes' theorem is also the mathematical backbone of modern AI, so understanding it gives you a window into how algorithms actually think.
Chapter 10 introduces probability distributions — mathematical models that describe how data is expected to behave. You'll meet the binomial distribution and the star of introductory statistics: the normal distribution, the famous bell curve. You'll learn to use z-scores to calculate probabilities, and just as importantly, you'll learn that the normal distribution is a model, not a law of nature. Real data only approximately follows it, and knowing when the approximation is good enough is a skill you'll use for the rest of the course.
When you finish this part, you'll have the machinery to understand the most important theorem in all of statistics — the Central Limit Theorem — which is waiting for you in Part 4.