Distributions: The Shape of Data
The shape of data explained — and why a bell curve is rarer than you think.
You already know the centre (mean, median) and the spread (variance, standard deviation) of your data. But imagine two datasets with the same mean of 50 and the same standard deviation of 10 — one looks like a bell, the other has a long tail to the right. The shape changes everything.
The shape of a distribution determines which summaries you can trust, which models will work, and whether rare events are truly rare — or just hidden in the tail. This article introduces three distribution shapes that cover most of what you will encounter in data science.
The Normal Distribution — The Bell Curve
Definition
Normal Distribution
Analogy
Definition
The dart-board analogy breaks at three points: first, a dart board is two-dimensional while a normal distribution is typically one-dimensional. Second, real players have systematic bias (they don’t perfectly centre). Third — and most importantly: not all data follows a bell curve.
Note
The 68-95-99.7 Rule
- 1. ±1σ = 68%About 68% of all values lie within one standard deviation of the mean.
- 2. ±2σ = 95%About 95% of all values lie within two standard deviations.
- 3. ±3σ = 99.7%Nearly all values (99.7%) lie within three standard deviations.
This rule works only for normally distributed data. Applied to skewed distributions, it massively underestimates extreme events.
Example: Men in Germany average around 180 cm tall with σ ≈ 7 cm. 68% are between 173 and 187 cm. 95% are between 166 and 194 cm. A 210 cm man is over 4σ above the mean — extremely rare. If σ were 2 cm instead of 7, 95% would be between 176 and 184 cm — a much narrower range with the same mean.
Why does the bell curve appear everywhere? The central limit theorem provides the answer: when you add up many small, independent random quantities, the sum approaches a normal distribution — almost regardless of how the individual values are distributed. Roll one die: the outcomes are uniformly distributed (1–6, each equally likely). Roll 30 dice and add the results. Repeat 1,000 times. The sums form a nearly perfect bell curve. Height and measurement errors (with many independent contributing factors) approximately follow normal distributions for exactly this reason.
Caution
Common Misconception
"All data follows a normal distribution." Wrong. Many real-world datasets — incomes, web traffic, stock returns — are clearly not normal. The 68-95-99.7 rule is invalid for these. Applying it to skewed data massively underestimates extreme events.
The bell curve is symmetric — equally distributed on both sides. But what happens when the bell hangs crooked?
Skewness & Long-Tail — When the Average Lies
Definition
Skewness
Analogy
Definition
In our thought experiment there are only two extremes (40,000 and 10 million). In the real world, the long tail is continuous — there are also people earning 100,000, 500,000, and 2 million euros. The curve tails off slowly to the right rather than jumping abruptly.
Mean = Median. Values are evenly distributed around the centre. If the distribution is also bell-shaped, the 68-95-99.7 rule works.
Mean > Median. The long tail to the right pulls the mean upward. The 68-95-99.7 rule does not work here.
Mean: 50,000 € | Median: 50,000 € — Both values agree. Salaries are evenly distributed.
Mean: 50,000 € | Median: 35,000 € — Most earn 25–40k, a few executives at 500k+ pull the mean up.
Both companies have a mean salary of 50,000 euros. But reporting "average salary 50,000" for Company B is technically correct yet deeply misleading. The median of 35,000 euros describes the typical salary far more honestly. Long-tail distributions are common in finance ("Black Swan" events), social networks (a few superstar accounts, many with few followers), and machine learning (rare but critical edge cases that live in the tail).
Caution
Common Misconception
"The 68-95-99.7 rule works for any distribution." Wrong — it works only for normal (symmetric, bell-shaped) data. For right-skewed income data, noticeably more values often lie beyond 2 standard deviations on the right than the 2.5% the bell curve expects there – and almost none on the left.
Interactive: Centre, Width and Skewness
Try it yourself. The box starts with the example from the introduction: a bell with mean 50 and standard deviation 10. With μ you move the centre, with σ you make the bell wider or narrower; the arrows show ±1σ, and below you find the ranges of the 68-95-99.7 rule. Then pull the skewness slider: the curve grows a long tail to the right. The median stays at μ while the mean wanders into the tail – just like the CEO in the thought experiment. The skewed curve is a drawn example, not measured data.
So far we have measured continuous data — salaries, heights, temperatures. But what if we are counting events?
Discrete vs. Continuous — Counting vs. Measuring
Definition
Discrete vs. Continuous
Analogy
Definition
The analogy breaks at two points: first, real phone calls are not perfectly independent — a call can trigger follow-up calls, violating Poisson assumptions. Second, temperature is measured with finite precision (one decimal place), technically making it discrete in practice — but the continuous model is the better abstraction.
Distributions are everywhere in AI. Neural network weights are often initialised from a normal distribution N(0, σ²) — too large and training explodes; too small and gradients vanish. The softmax function converts a vector of raw values into a discrete probability distribution over tokens or classes. And in anomaly detection: a data point more than 3σ from the mean gets flagged as an outlier — but that is only reliable if the data is actually normally distributed.
Caution
Common Misconception
"All distributions are bell-shaped." Wrong. The bell curve is just one shape. Poisson distributions are right-skewed, uniform distributions are flat, and many real-world distributions have heavy tails or multiple peaks. Always visualise your data (histogram) before assuming a shape.
Interactive: The Central Limit Theorem
We just saw that far from all data is bell-shaped — skewed and multi-peaked distributions are everywhere. And yet the bell curve keeps reappearing. The reason is one of the most surprising theorems in statistics: almost no matter how crooked the source distribution, the distribution of its means turns approximately normal. Pick any source shape below, draw many samples, and watch the histogram of their means form a bell — and grow ever narrower as the sample size n increases.
Takeaways
Note
Three Key Insights
- The normal distribution is symmetric and fully defined by μ and σ. The 68-95-99.7 rule gives you an instant sense of where most values lie — but only when the data is actually bell-shaped.
- Skewed distributions pull the mean away from the median. When these two values diverge significantly, the distribution has a long tail — and the median tells the truer story.
- Discrete distributions count events (0, 1, 2, ...), continuous distributions measure values (any real number in a range). Choosing the right distribution type is the first modelling decision in any data analysis.
Check
Quiz: Distributions
What does the 68-95-99.7 rule describe?
Select one answer
1. What does the 68-95-99.7 rule describe?
2. A dataset has mean = 80 and median = 45. What does this tell you about the distribution?
3. A helpdesk receives an average of 12 tickets per hour. Which distribution models the number of tickets per hour?
4. Why is the mean misleading for right-skewed salary data?
Checkpoint
Check
Learning Goals
Can you explain this in your own words? Tick what you've got.
0 of 3 done