Correlation vs Causation
Causal inference is the process of determining whether one variable truly causes a change in another, as opposed to merely being correlated.
Three conditions for causation:
- Temporal precedence: Cause precedes effect
- Covariation: Cause and effect are related
- No confounders: The relationship is not explained by a third variable
Potential Outcomes Framework
Rubin Causal Model
For individual i, define:
- Y_i(1) = outcome if treated (potential outcome under treatment)
- Y_i(0) = outcome if not treated (potential outcome under control)
Fundamental Problem of Causal Inference
Average Treatment Effect (ATE)
Conditional Average Treatment Effect (CATE)
SUTVA (Stable Unit Treatment Value Assumption)
- No interference: One unit's treatment does not affect another's outcome
- Consistency: Only one version of each treatment level
Propensity Score Matching
Key Property
Matching Methods
| Method | Description | Example |
|---|---|---|
| Nearest Neighbor | Find closest control by propensity score | T1→C3, T2→C1 |
| Caliper | Reject matches beyond threshold | T1 (d=0.02) ✓, T2 (d=0.08) ≤ |
| Kernel | Weighted average of all controls | T1 ← weighted sum of C1-C5 |
| Stratification | Divide by propensity score strata | Stratum 1: [0.0-0.2] → ATE_1 |
Implementation
Difference-in-Differences (DiD)
Two-Period Model
Parallel Trends Assumption
Implementation
Instrumental Variables (IV)
When to Use IV
When treatment is correlated with unobserved confounders (endogeneity):
Instrument Requirements
- Relevance: Z is correlated with X
- Exclusion: Z affects Y only through X
- Exogeneity: Z is uncorrelated with confounders
Two-Stage Least Squares (2SLS)
Architecture Diagram
Confounding:
U (unobserved)
/ \
v v
X Y Endogeneity: Cov(X, ε) ≈ 0
Instrumental Variable:
U (unobserved)
/ \
v v
X Y IV Z satisfies: Z ⊥ U, Z -> X
^
|
Z (instrument)
Regression Discontinuity Design (RDD)
Sharp RDD
Directed Acyclic Graphs (DAGs)
Pearl's Causal Hierarchy
- Association: P(Y | X) — Seeing
- Intervention: P(Y | do(X)) — Doing
- Counterfactual: P(Y_x | X', Y') — Imagining
do-Calculus
Backdoor Criterion
A set Z satisfies the backdoor criterion relative to (X, Y) if:
- No node in Z is a descendant of X
- Z blocks every path between X and Y that contains an arrow into X
Key Takeaways
Practice Exercises
- Propensity Score Matching: Perform PSM on job training data and check covariate balance before/after matching
- DiD Analysis: Replicate the minimum wage study and test the parallel trends assumption
- IV Estimation: Implement IV using quarter of birth as an instrument for education. Check instrument strength
- RDD Design: Apply RDD to a dataset with a known cutoff. Estimate the effect at different bandwidths
- Discussion: When would you prefer DiD over propensity score matching? How do you validate the exclusion restriction?