Confidence Intervals
Overview
A confidence interval is a range computed from sample data such that, before observing data, . After observing data, we compute specific bounds and say we are confident the interval contains . The general structure is point estimate Β± critical value Γ standard error. For means with known , use the z-interval. When is unknown (almost always), use the t-interval which has heavier tails reflecting the additional uncertainty from estimating . For proportions, the Wilson score interval is preferred over the basic Wald interval, especially when is near 0 or 1. Bootstrap CIs make no distributional assumptions and work for any statistic.
Key Concepts
Common Critical Values
| Confidence Level | |||
|---|---|---|---|
| 90% | 0.10 | 1.645 | 1.697 |
| 95% | 0.05 | 1.960 | 2.042 |
| 99% | 0.01 | 2.576 | 2.750 |
Factors Affecting CI Width
| Factor | Effect on Width | Reason |
|---|---|---|
| Higher confidence level | Wider | Must cover more of the sampling distribution |
| Larger sample size | Narrower | Standard error decreases as |
| Larger variability | Wider | More uncertainty about the parameter |
Quick Example
Key Takeaways
Deep Dive
For detailed explanations, worked examples, and Python implementations, explore the dedicated statistics lessons:
Confidence Intervals for Means
- Confidence Intervals for the Mean β Z-interval and t-interval with full derivations, examples, and Python code
Confidence Intervals for Proportions
- Confidence Intervals for Proportions β Wilson score interval, Agresti-Coull, and when each is appropriate
Margin of Error
- Margin of Error β Factors affecting ME, the rate, and practical guidelines for study planning
Sample Size Determination
- Sample Size Determination β Formulas for means and proportions, power considerations, and conservative estimates
Bootstrap Methods
- Bootstrap Confidence Intervals β Percentile, BCa, and pivotal methods for distribution-free inference
Related Topics
- Central Limit Theorem β Foundation for why CIs work: the sampling distribution of the mean is approximately Normal
- Point Estimation β MLE and the point estimates that CIs are built around
- Hypothesis Testing β CIs and hypothesis tests are duals: same information, different format
- t-Distribution β The heavier-tailed distribution used when Ο is unknown