Normal Distribution — The Bell Curve and Its Properties
Foundations of Statistics
The Universal Language of Randomness
The normal distribution is the cornerstone of statistical theory and practice, appearing everywhere from natural phenomena to financial markets. Its mathematical elegance makes complex probability calculations tractable and enables powerful inferential techniques.
- Quality Control — Manufacturing processes use normal distributions to set tolerance limits and detect defects
- Finance — Asset returns and risk models rely on normal distribution assumptions for portfolio optimization
- Social Sciences — Test scores, heights, and measurement errors follow approximately normal distributions
Understanding the bell curve unlocks the door to nearly all of classical statistics.
Why the Normal Distribution is Central
The normal (Gaussian) distribution is the most important probability distribution in all of statistics and the natural sciences. Three fundamental reasons account for its centrality:
- The Central Limit Theorem guarantees that sums and averages of many independent random variables converge to a normal distribution, regardless of the underlying distribution.
- Maximum entropy among all distributions with fixed mean and variance — it is the "least informative" assumption.
- Mathematical tractability — closed-form expressions exist for its moments, moment-generating function, and convolutions.
Definition and Probability Density Function
Fundamental Properties
The Standard Normal Distribution
Interactive Visualization
Cumulative Distribution Function
The CDF of the standard normal has no closed-form expression:
Key values from the standard normal table:
| Interpretation | ||
|---|---|---|
| 0 | 0.5000 | 50% of area is below the mean |
| 1 | 0.8413 | 84.13% below |
| 1.645 | 0.9500 | 95% below (one-sided) |
| 1.960 | 0.9750 | 97.50% below |
| 2 | 0.9772 | 97.72% below |
| 2.576 | 0.9950 | 99.50% below |
| 3 | 0.9987 | 99.87% below |
The Empirical Rule (68-95-99.7)
This is the foundation of the rule: for normally distributed data, 99.7% of observations lie within 3 standard deviations of the mean. Observations beyond this range are potential outliers.
Comparing Normal Distributions
Moment-Generating Function
Reproductive Property
This property is why the normal distribution is so pervasive — sums of normal random variables are always normal, making it closed under linear combinations.
Normal Approximation to the Binomial
The approximation improves as increases. A standard rule of thumb: apply when and . A continuity correction () improves accuracy for finite .