Correlated Random Effects
Can we estimate the coefficient of gender while controlling for individual fixed effects? This sounds impossible as an individual’s gender typically does not vary and hence would be absorbed by individual fixed effects. However, Correlated Random Effects (CRE) may actually help.
At last year’s FMA Annual Meeting, I learned this CRE estimation technique when discussing a paper titled “Gender Gap in Returns to Publications” by Piotr Spiewanowski, Ivan Stetsyuk and Oleksandr Talavera. Let me recollect my memory and summarize the technique in this post.
Table of Contents
- Random Intercept (Effect) Model
- Fixed Effect Model
- Hybrid Model
- Correlated Random Effect Model
- Further Readings
Random Intercept (Effect) Model
Consider a random intercept model for a firm-year regression, e.g., to examine the relationship between firm performance, R&D expense, and whether the firm is VC-backed,
- is firm-year level outcome variable, e.g., firm ROA
- is firm-year level independent variable, e.g., firm R&D expense
- is an time-invariant firm-level variable, e.g., if the firm is VC-backed
- is firm-level error and random intercept to capture the unobserved, time-invariant factors
- is firm-year level error, assumed to be white noise and ignored in this post
We can estimate , , and . Assuming that we’ve properly controlled for observable firm characteristics, tells the relationship between R&D expenditure and firm performance. tells the difference in firm performance between VC-backed and non-VC-backed firms.
However, we cannot rely on to assert whether VC-back firms have better or worse performance. The drawback here is that we are unable to exhaustively control for all other time-invariant firm attributes that correlate with both firm performance and VC investment, thereby leading to biased estimate due to omitted variables.
Similarly, our estimate of may also be biased if some omitted firm-specific and time-invariant attributes correlate with both R&D expenditure and firm performance.
Fixed Effect Model
If we subtract the “between” model
from Equation (1), we have the fixed effect model in the demeaned form:
The fixed effect model above removes the firm-level error so that the within effect (or fixed effect) estimate of is unbiased even if . This helps a lot and is why most of the time we control for firm fixed effects when estimating firm-year regressions.
However, the firm-level variable is also removed. It is now impossible to estimate as in the random intercept model. In fact, we can no longer estimate the effect of any firm-level time-invariant attributes after controlling for firm fixed effects.
So, how to estimate both when firm fixed effects are controlled for?
The same question, if paraphrased differently, is how to estimate the within effect in a random intercept model.
Interestingly, we can decompose the firm-year level variable into two components, a between component and a cluster component , so that
It is apparent that the estimate gives the within effect as in the fixed effect model, identical to in Equation (3).
Moreover, the firm-level variable is kept in the model and we can estimate . The inclusion of cluster mean corrects the estimate of for between-cluster differences in . Note that, however, for estimate to be unbiased, we still require and .
Correlated Random Effect Model
A related model is correlated random effect model (Wooldridge 2010) that relaxes the assumption of zero correlation between the firm-level error and firm-year variable . Specifically, it assumes that , so Equation (1) becomes
By including the cluster mean , we can account for the correlation between the random effects and the independent variable and obtain consistent estimates of the coefficients. The inclusion of in the random intercept (effect) model makes the estimate for the same within effect (fixed-effect) estimate as in Equation (4).
Of course, as the time-invariant firm-specific attribute remains in the model, we can estimate as in the hybrid model.
Note that there are many caveats for estimating CRE.
To be discussed.
This post is based on Within and between Estimates in Random-Effects Models: Advantages and Drawbacks of Correlated Random Effects and Hybrid Models.
Some other suggested readings include:
- Correlated random effects models with unbalanced panels.
- Fitting and Interpreting Correlated Random-coefficient Models Using Stata.
- A correlated random effects approach to the estimation of models with multiple fixed effects.