Statistics 🎯 Sampling & the CLT

Populations vs Samples

The whole group you care about, the slice you actually measure, and why the gap between them is the heart of statistics.

Intro StatisticsAP Statistics levelCollege Stats 101
💡
The big idea: Almost every interesting question is about a huge group you can never fully measure — every voter, every customer, every light bulb off the line. So you measure a small slice instead and reason back to the whole. A number describing the whole group is a parameter; the matching number from your slice is a statistic. Statistics works only when that slice is chosen well: a random sample mirrors the group, while a convenient one quietly tilts your answer.
🎯 By the end, you'll be able to
  • Distinguish a population from a sample, and say why we usually study samples
  • Tell a parameter (mu, sigma) apart from a statistic (x-bar, s), and match the symbols
  • Explain sampling bias and why convenience samples mislead
  • Describe how random sampling makes a sample representative and sets up sampling distributions
📎 You should already know
  • Mean and standard deviation

You can rarely measure everyone

Suppose you want the average commute time of every worker in a city. There are millions of them, they change jobs, and nobody has time to ask them all. Measuring the entire group is almost never possible — too expensive, too slow, sometimes physically impossible (you cannot test every light bulb by burning it out).

So statistics does something clever: it measures a small slice, then reasons carefully back to the whole. Getting that reasoning right starts with naming the two groups precisely.

🔑 Population vs sample
The population is the entire group you actually care about — every worker, every customer, every bulb. A sample is the subset you actually collect data from. You study the sample because you cannot study the whole population, but the population is always the thing you really want to know about.

Two words for a number: parameter vs statistic

Once you have a population and a sample, you will compute the same kinds of numbers — an average, a spread — for each. They get different names and different symbols so nobody confuses the true value with the estimate.

  • A number that describes the population is a parameter. It is usually unknown and fixed. The population mean is \( \mu \) ("mu") and the population standard deviation is \( \sigma \) ("sigma").
  • A number computed from your sample is a statistic. You can actually calculate it, and it changes from sample to sample. The sample mean is \( \bar{x} \) ("x-bar") and the sample standard deviation is \( s \).

A handy memory hook: parameter goes with population; statistic goes with sample. Greek letters describe the unknown truth; ordinary letters describe what you measured.

\[ \underbrace{\mu,\ \sigma}_{\text{parameters (population)}} \qquad \longleftrightarrow \qquad \underbrace{\bar{x},\ s}_{\text{statistics (sample)}} \]
The population parameters mu and sigma are what you want to know; the sample statistics x-bar and s are what you can actually compute. We use the second to estimate the first.

Watch a sample stand in for a population

The simulation below draws samples from a population whose true shape is fixed. The top strip is the whole population. Each time you draw, a handful of values is pulled out and its average recorded in the bottom panel.

For this lesson, focus on one idea: a single sample's average lands near the population mean but rarely exactly on it, and different samples give slightly different averages. That wobble — the fact that a statistic like \( \bar{x} \) changes from sample to sample — is exactly what the next lessons on sampling distributions are about.

🎮 Interactive: samples drawn from a population LIVE
Top: the whole population. Bottom: the average of each sample you draw. Notice that each sample average (a statistic) lands close to, but not exactly on, the population center (a parameter) — and that the averages vary from draw to draw.
✨ A good sample is a small mirror
The goal of sampling is a sample that looks like the population in miniature — same mix of fast and slow commuters, young and old customers. When it does, the sample statistic is a trustworthy estimate of the population parameter. When it does not, no amount of clever math can rescue the answer: a biased sample gives a confidently wrong number.

The trap: sampling bias

A sample fails when it is systematically unlike the population — that is sampling bias. Bias is not the same as bad luck; it is a lean in one direction that repeats no matter how much data you collect.

The most common culprit is a convenience sample — grabbing whoever is easy to reach. Ask about commute times only in the office parking lot at 9am and you miss everyone who works from home, takes the train, or starts at noon. Poll about a product only among people who already follow your brand and you hear mostly fans. The sample is easy to get and quietly skewed.

⚠️ More data does not fix bias
It is tempting to think a bigger sample cures a tilted one. It does not. If your method leans one way, collecting ten times as much of the same lean just gives you a more precise wrong answer. Bias is a problem of how you sample, not how much.

The fix: random sampling

The cure is to remove your choices from the selection. In a simple random sample, every member of the population has an equal chance of being picked, and picks do not depend on who you find convenient. Randomness has no agenda, so on average the sample mirrors the population — fast and slow commuters show up in roughly their true proportions.

Random selection does more than remove bias. Because the picks are random, the sample statistic behaves in a predictable, mathematical way from sample to sample. That predictable behavior — the sampling distribution — is what lets statistics attach honest margins of error to an estimate, and it is exactly where the next lessons go.

📝 Worked example: A campus cafe wants the average daily spend of all its customers (the population). A manager records the spend of the first 40 people through the door at 8am on a Monday and reports their average as the estimate. Identify the population, the sample, the statistic it estimates, and one reason the estimate may be biased.
  1. Population: all customers of the cafe — the group the manager actually cares about.
  2. Sample: the 40 early-Monday customers whose spend was recorded.
  3. The sample average is the statistic \( \bar{x} \); it is being used to estimate the population parameter \( \mu \), the true average spend of all customers.
  4. This is a convenience sample taken at one time of day. Early-morning customers may buy mostly coffee, while lunch and afternoon customers spend more on food — so the sample systematically leans low.
  5. The fix is not simply more early-morning customers; it is a random sample spread across times and days so every customer type has a fair chance to appear.
✓ Population = all cafe customers; sample = the 40 early-Monday customers; the sample mean x-bar estimates the population mean mu. Because the sample was grabbed at one convenient time, it likely underestimates spend — a sampling bias that a larger early-morning sample would not fix, but a random sample across times would reduce.

Check your understanding

1. A researcher wants to know the average height of all adults in a country but measures only 500 of them. In this study, the 500 measured adults are the…
The population is all adults in the country; the 500 actually measured are the sample — the subset you collect data from.
2. The symbol \( \mu \) (mu) refers to…
mu is the population mean, a parameter. The mean you compute from a sample is the statistic x-bar. Greek letters describe the population.
3. An online store emails a satisfaction survey but only long-time newsletter subscribers respond. Why is the result likely biased?
This is a convenience/self-selected sample: loyal subscribers are not representative of every customer, so the sample systematically leans favorable — a sampling bias.
4. Your sampling method tends to over-represent one group. To reduce that bias you should…
Bias is about how you sample, not how much. Enlarging a tilted method keeps the tilt; random selection is what removes the systematic lean.
✅ Key takeaways
  • A population is the entire group you care about; a sample is the smaller subset you actually measure because studying everyone is usually impossible.
  • A parameter describes the population (mean mu, standard deviation sigma) and is usually unknown; a statistic describes the sample (mean x-bar, standard deviation s) and is what you compute.
  • We use sample statistics to estimate population parameters, so the sample must resemble the population in miniature.
  • Sampling bias is a systematic lean toward one kind of member; convenience samples (whoever is easy to reach) are a classic cause, and a bigger sample does not fix it.
  • Random sampling, where every member has an equal chance of selection, removes that lean and makes the statistic behave predictably — setting up sampling distributions.